I have a similar situation with the pony we loan for my daughter. I was advised not to get her insured as vet's bills generally are low. So I didn't; I opened a savings account instead.
I pay in £30 per month and have done for the last 10 months as I now have £300 in the account.
She was poorly last week. The vet had to come out and I'm expecting a bill of about £200+. She had a chest infection and needed antibiotics and a "breathe-easy" powder (the latter alone is £68 a tub :shock
.
So it's taken me almost a year to save it and only one vet bill to spend it. Good job she only had a cough ...
My friend's horse has also needed the vet as he got kicked in the face and suffered a very bad eye injury. Her vet bill will be closer to £500 I reckon (that's more than I've got saved), if not more.
Personally I'd get insurance for your rabbit. I'm so glad I have my girls insured as I'd be stone flat broke by now.
Who did you get your quote from as £10+ per month for a baby bunny is a lot; I only paid £8 each for my 2 when they were that age, they're with Pet Plan. Get quotes online too as you may be given a discount purely for buying online.
(oh, and I'm seriously considering getting the pony insured too, though as she's a "veteran" at 18 years old it will be for "injury only" and not illness, so her chest infection wouldn't have been covered. However, she's in a different field with different horses and has a fresh cut every day. If she gets her face kicked in like Tommy above, I wouldn't be able to afford the vet bill.)