That sounds plausible - it may well be that your door knocking got other people to notice and the rumour mill started working. I remember about 20 years ago when there was a massive storm while I was out (back when I used to free range unsupervised) and my bunnies escaped the garden through the blown-down fence, they never went far, they just went on a little adventure to explore the neighbour's garden but kept coming back. It sounds as if similar is happening here - they know where 'home' is so just hung around the area until they were rumbled!