Yeah, patience is the way forward. If he'll take food from your hand that's a really good first step even if he does run away with it. Cutting things up into tiny pieces so you can feed them individually will help.
Every single time he gets even a tiny piece of food from you, that's a positive association he's making, as long as the food is tasty enough to be "worth it".
I think that's the balance you have to find. Whatever you want to do with him (stroke him, pick him up, etc.) has to be rewarded enough that it's "worth it" to him. Right now he's probably scared enough of being touched that there isn't a reward in the world that is good enough, so you'll have to work on something easier and move on as he gets more comfortable.
What I'd aim to do is to find a level he's only slightly uncomfortable with and work with him until he's happy with that level of interaction, before moving on a little, getting him used to more and more very slowly until he eventually tolerates whatever handling you need to do with him.
Perhaps a progression a bit like this (although it would need modifying according to how he's responding - everything's on his time and not yours):
* Food in tiny pieces in your open hand. Let him approach, don't worry if he grabs a bit and runs. Speak to him softly but don't move or try to touch him. When he's relaxed enough to eat next to you, move on.
* Give him a single piece of food when he approaches, by moving your hand towards him with the food in it. Little movements at first. Remember you want him to be just a bit uncomfortable, so if he's spooked you're going too fast. When he's confident with you giving him food, move on.
* Ask him to sniff your (empty) hand before you give the treat with the other. He should be used to you moving your hand towards his face by now, so if you move your hand towards him he'll naturally sniff it. Give him food right away when he sniffs or touches you with his nose. Soon he'll nudge you for treats (but probably only when he knows you have food)!
* Next is a big step - you touching him, rather than the other way around. Give him a treat as usual and gently touch his head or nose (literally the briefest and lightest of touches) while he's eating it. Bigger pieces of food that take longer to eat can be helpful for this as long as he stays near you to eat them. It's really important not to go too fast here, you don't want him to be scared enough to move away. Make sure he can see your hand so he isn't surprised when you touch him (rabbits have a "blind spot" directly in front of their face) and move slowly, and stop moving if he flinches back, let him approach you again.
* When he's happy to be touched you can start to gradually build up to little nose strokes, or touching on different parts of the body. Again, if he's too uncomfortable, you're going too fast and should back up to something he finds easier. From here you can slowly move to putting your hands under his belly, then exerting upward pressure but not actually lifting him, then lifting very slightly off the floor and putting him down again, up to picking him up properly. Getting another pair of hands is really helpful for training this because then one of you can do the handling while the other stuffs food in bunny's face.
Although my two boys are pretty confident little Nethies who were handled every day by their breeders, neither liked being handed and only tolerated head strokes. Now I can touch all over their bodies and pick them up without any fuss, they love strokes and now allow me (short) snuggle sessions and cuddles.
