I have a seriously beat up body. When I was young, I was jogging 3 jogs a day for over 18 miles total, and a bunch of other stuff. I not long ago (a few years), underwent 5 surgeries within 1 year and 1 week. I simply didn't have time between surgeries to fully recoup. My physical abilities were seriously reduced for a couple years. At this point, I am likely in as good of shape as I will be able to get in; nothing close to previously before surgeries. But good enough to get hunts done.
But, to your question, instead of hunting my honey holes (way to far for me, at the time), after the surgeries, I simply camped just off dirt roads in areas that I know hold animals, and are travel routes. However, I had plenty of company, ad these spots are no secret. I simply used my knowledge of these areas, and travel routes, along with other hunters presence to my advantage. I very successfully hunted these areas, filling my tags. I didn't go further than 150 yards from either camp or my truck
With that said, it was definitely not the type of hunting I prefer, I prefer to get away from people, and have a spot to myself, if possible. If not possible, I want to hunt places with few people. So, the hunting I did during that time, was not my preferred hunting, but it did slightly scratch the itch, so to speak. I'm still trying to improve the distance I can cover, and my stamina, however, I am unsure if further improvement is possible, for me. But, if I can keep going as I currently can, I can live with that.
In short, you may way to push yourself, but you need to not push to much. The above sentence I know much to well, ad I pushed to hard numerous times, only to be useless for a few days in a row. He'll, not so long ago, I pushed it pig hunting and I knew it. I was packed in, and knew I needed a couple days to recuperate, before packing out. I would also need a couple days at home after the hunt. Well low and behold, the pigs came out to play, and I simply didn't pull the trigger, despite ample opportunities; because I knew I wasn't capable of getting all the meat out. As Harry Callahan said, "a man's got to know his limitations".
The short of it, hunt within your limitations. There is nothing wrong with pushing limitations mildly, to improve, but overdoing it can literally break you down.