I hunt in the Adirondack forest which sounds like similar country to what you're hunting. Lots of lever guns here, but more bolt actions. I hunt with a bolt, and mostly always have, but have used levers and understand their nostalgic appeal. I owned a pretty nice 30-06 Model 760 carbine for a few months but never warmed up to it and sold it. I am a licensed hunting guide in NY and Maine, and many of my closest hunting buddies are also Adirondack guides. Nearly all these guys primarily use bolt actions as well. A couple use pumps or a lever occasionally just to change things up, but for the most part they use bolts. If you hunt by yourself, which I do the majority of the time, your one opportunity for the season may last less than 5 seconds. A reliable and accurate rifle that you're confident in and practiced with will likely be the difference between success and failure. Of the other serious Adirondack whitetail hunters I know, about the only ones using semis are guys who hunt deer drives in parties. They love them and do well with them. The majority of the rest use bolts. That said, the best younger tracker that I know is a pump guy at heart but still hunts with a bolt quite a bit and a lever some. A lot of the Maine guys use pumps as well, especially the guys who track deer. The pumps and autos are handy for running deer, no doubt about it. If I remember the OP correctly, you sit or still hunt the majority of time and don't shoot at running deer. To me, given those conditions, a bolt is no handicap. Accuracy that you're confident in is extremely important for those times when you only have a 6-8" path (or less) to the vitals and when the shots are the rare long ones (80 or even 100 yards!).
I am not a fan of small objective scopes if you sit through the last minute of legal shooting light, which in many states is 30 or more minutes after sunset. In the green timber (evergreen stands) this can be pretty dang dark. I have a 3-9x33 Compact on one rifle and a 3-9x40 Vari-x IIC on another, both Leupolds. The 40mm objective is noticeably better during the first or last minutes of the day which are often the most productive of the day. Both are 1" scopes and dialing is of no value to me or any of the guys that I know who hunt this area. Light and reliable, set and forget scopes are key for rifles that will be carried miles and miles, never dialed and shot infrequently, IMHO.
I've shot about 6 deer with a .223 (a few with the 77TMK, very effective, thanks Form and others) and quite a few more with a 6x45, a .243, a 7-08, a .250 Savage, a 7x57, a 7mm Rem. Mag. and a few other cartridges, (my first buck was a pretty good blacktail in CA with a .222 when I was in the Navy) but none with a 30 caliber or larger cartridge. I've taken deer with muzzleloaders using round balls (hate them) and modern saboted bullets. Bullets, other than muzzle loader. have been from 50 to 140gr, most cup and core, some Barne's Xs. I never felt handicapped by any of the cartridges or bullets I used and also don't believe in the brush busting thing. It's been pretty well disproven in a number of studies and in the experiences of experienced hunters I know. That said, I did carry a .308 Montana quite a lot this season, but shot my buck with a 7-08 at under 25 yards. Two of the most successful Adirondack hunters I know also use smaller calibers. One uses a Model 88 Winchester in .243 that he stocked with a piece of local bird's eye maple that he sawed on his own mill many years ago. It's a beautiful rifle with the pistol grip cap made from the crown of an impressive whitetail shed. Last thing I knew his preferred handload was with an 85gr HPBT Sierra. The other hunter has killed a pretty amazing amount of deer with a beautiful old Model 317 H&R (worth Googling) in 223 long before it was thought of as a capable deer cartridge. It's only one of a number of bolts he hunts with. Many of those deer with the .223 were shot with U.S. Military surplus 5.56 ball ammo. He said he was surprised at how effective it was on deer. He served on the ground in Vietnam so I'm guessing he had some experience with it.
With that all said, like most people, I'd recommend what I use, an accurate, reliable and lighter weight bolt action rifle with a 3-9x40 set and forget scope that's reasonable light weight. I don't believe that 3x will ever hinder you on close shots, and 9x is nice if you have to look one over at a distance to see or evaluate horns. In country where a deer can get out of sight in two jumps, I like an exit wound from a bullet that still does plenty of internal damage. Many cup and core bullets (in medium or heavier weight for caliber) do this in larger calibers. Smaller calibers are obviously more difficult to achieve this with. I'm working on a load with the 75gr Gold Dot to use in my .223 Montana (1 in 9 twist) to try and achieve his.
A last recommendation I'd make would be that instead of obsessing on the rifle, which I also have a tendency to do, obsess on becoming an expert on the area where you hunt and the deer that live there. Getting out before season to look for deer will get you in better physical and mental shape and help you acclimate to seeing things in the woods more quickly. It also helps you move more quietly in the woods when he season starts and you'll be more prepared on day 1 of the season and all other days that follow. The mast crop in my area varies greatly from year to year and knowing what food is available helps you make a plan on where to locate or intercept deer as the season progresses. There's no logging in our state forest so mast crop can be key in any given year, especially if it's limited. It is of much greater importance to hunting success than the rifle I'm carrying. I don't do enough of this myself, but next year.......
Thanks for taking the time to read this and I hope that I don't come across as thinking I know it all, or that my way is THE way. I've been at this for over a half century and I try to learn something new every time I go out. So far that goal hasn't been difficult to achieve.
Good luck to you.
Frank