I think if keeping rabbits is a long term thing than having more than two is good if possible, because no bun will ever be left on it's own.
I have a trio and I think it works really well for my particular rabbits, I'd love to have a larger group but it's not really affordable.