We wouldn't with ours as they hate car journeys and get very stressed but I do know of a French lady who takes her bunny to France when she goes back to visit family - got his own passport even.
Maybe you could take him out for a few more car journeys before hand to get him more used to it...even though he sounds quite okay anyway?