There is some room for caution regarding transmission from us to rabbits actually. It seems in this modern world it is thought that more viruses and bacteria are able to transmit from human to rabbit.... MRSA and other respiratory infections, or herpes simplex (cold sore virus) for example. It is very unlikely the other way around.
I would make very sure you follow strict hygiene at the moment with washing your hands before handling your bunnies and their food and keep your nose and mouth away from them, using tissues etc.