I don't do some of the massive backpacking trips that a lot of you North Americans do, but I lug my fair share of heavy stuff around and as has been said, I just accept that if I want the good pictures, I need to carry the gear.
My camera is an Olympus OMD EM1 MkII.
If I pack in a very long way, I have a few lenses to choose from. 17mm, 12-40mm, or 14-150mm. The last lens covers more bases but isn't as fast as the 12-40mm which can stay at a constant f2.8. The 14-150 goes from f4.0 to f5.6 - still not too bad.
I have a 50-200 for the 4/3 format Olympus DSLR's and use an adapter for my camera. It's too big to want to lug around a lot but it's a great lens and the new autofocus in the OMD EM1 MkII works well.
I have some places I pack into but don't even spend the night, but I may as well. I'll spend the night a few times this year, just to save the massive walk in and out. Depending on whether I'm mainly fishing or hunting, will depend on which lenses I take. If I'm after lots of video of the game, I have to take the 50-200, and then most likely another one for trophy shots, but if I don't think I'll be filming much, the 12-40mm lens is the best one I have.