One of the better analogies I have heard on antler growth is that deer (or particularly elk) cannot eat enough calcium in a summer to growth the amount of bone they have on their head - they have to "mine" it from their own bodies. So, essentially early in life (and through falls and winters) they have to build that mine with nutrition.
Specific to summer conditions. I know folks in the southwest often talk about bulls "starting strong" or "finishing strong" , so no doubt current conditions make some difference too. I feel like
@robby denning probably had someone on the show a while back (Brock or Randy Larsen) that talked about how much antler growth is a year effect and how much is a year-of-birth effect. I want to say it was around 10% for each. Which means that your 180" buck would have been a meager 164" buck in a dry year. My math is close, my recollection could be waaay off.
I'm thinking this is THE year for antler growth across much of the West. Moist year in 2023 filled the tanks well, a mild winter didn't tax it much, and so far (fingers crossed) we'll get some monsoonal rains to help "close them out". ahh the perils of an optimist!