I started @ 10 years old with a 10# rifle, 60 years later I still pack a 10# rifle. @10 years old I also had a crappy pack and when we carried elk out we tied 1/4" nylon rope around the quarter and put it over our shoulders and packed it out. The last elk I packed out went on my pack and I hardly knew it was there.
As others have stated, 1) good boots, 2) good pack 3) and leave the kitchen sink at home 4) find a good rifle sling for your pack 5) and when you get home make a list of the good things you had on the hunt and a list of the stuff you did not use or that did not work, and then spend the winter and spring replacing the stuff that did not work with something better.
And a word of advice. Look through the classified ads for your upgrades, no use spending a lot of money on new when you can pickup barely used stuff that has a lot of life left in it. At least until you nail your good stuff list.
Good Luck in your hunt and remember, "A shity day in the woods is still better than any day at work"