It depends how much space the rabbits are used to and how long they'd be staying.
I have 3 buns, and one is a large breed, so I personally would want something a little larger. If I had a normal sized pair I'd be fine leaving them in a 4x4 playhouse for a few days.