Drop leg holster while backpacking/hunting

[taskswap]

I've had setups where I feel like a drop-leg would be better than a chest or hip-belt mount for my sidearm, a G20. But I've tried two products and just can't deal with the "flopping around" when I walk. If I tighten a typical holster's straps too much my thigh gets crunched when I climb. Too loose and it's flop-town.

I'm started to think my issue is more the attachment of the holster itself (a Blackhawk Serpa Lev3) than the drop-leg portion. I feel like the circular attachment pad/panel is just too small so it makes the pistol want to pivot around it. I wonder if maybe a different holster with a more wide/rectangular rear panel would distribute the load better and make it flop less? Or any other tricks?