My experience living in a town full of highly visible, big bucks surrounded by public land with not so visible, smaller bucks, is that these bucks just don't seem to leave town.
Yeah, living in a town with a lot of big bucks that is also immediately surrounded by public land, the delineation between private land and public land is dramatic. Private land is flat with yards, shrubs and edges. Public land is steep with scrub oak. Private land has a great concentration of sign everywhere. Public land has sporadic and random sign. Given the amount of does that live in town, there's no real reason for a buck to leave unless he was in direct pursuit over a longer distance and the land that he would cross, while BLM land that you could technically hunt, would be, what most people would consider impractical to actually hunt due to the size of the parcels, the immediate proximity to houses and/or the amount of recreational traffic.
Not saying it couldn't happen, because it certainly could, but I, too, would raise an eyebrow with suspicion at recognizing a buck I've seen daily/weekly for 3-4 years in the same 5 block radius year around.