I agree 100% with Roseberry. It totally depends on the rabbit. I had a rabbit that I used to travel between my home and my parents home regularly (they were 150 miles apart) and he was fine and we were really close, but I've got some other bunnies that I wouldn't consider doing that too, because it would be cruel to them, and equally others, nowadays, who would be fine and would thrive as long as they are with me.
Get him stable somewhere first and then work out what you think would be best for him, as opposed to what you think would be best for you.