I dont believe so. I have adopted rabbits from rescues that are breed specific, Mojo the english lop, Willow the rex, Oose the giant, Riley the french x english lop.
I believe if i went to a pet shop or breeder it would be for a breed of my choice, i choose rescue every time, but then i believe if a breed that interests me comes in, it is not selfish to pick that rabbit. Of course in an ideal world i would be entirely selfless and pick a long term rescue bunny, but even if i choose a breed from a rescue, its still helping a rescue rabbit and not supporting the petshop and breeding trade, so i feel no guilt for having favourite breeds. Everyones idea of an "ideal" rabbit are different
This said, i also pick bunnies if they have health issues, im a sucker for a disabled bunny too.
And finally, you will find a rescue bun will pick you, not the other way. So you may find, your ideals go out the window when you see all the lovely buns needing new homes, they are all irresistable.
ETA i also have cross breed bunnies here, i do not always go breed specific especially when i am looking for partners for my rabbits, i believe a rabbit will pick its own rabbit friend regardless of what I want.