I have a swfa 5-20 for that exact usage case. I think it’s a decent match. Optically it’s not as good as the razor hd g2 3-18 I used to have for the same purpose; but it’s about a pound lighter and mechanically more sound.
I’m sure a trijicon tenmile 3-18 would be in the same ballpark, as would the bushy lrhs 4.5-18. They’re all going to be solid enough in all categories to work for long range target and hunting. They all should retain zero with normal use. Optically they will all allow you to see and hit targets out to 1k very easily. I think going from one to another is a lateral move; although you would save a few oz with the tenmile, if that’s important to you.
I imagine a Nightforce ATACR 4-16 or 4-20 would be a decent step up for an “in between” the swfa hd and the zp5, but I’ve never looked through the zp5 to compare.
The 4-32 doesn’t really do anything for me, personally. That’s more x’s than I’d ever use. I have a buddy who uses the 2.5-20, but I don’t see much improvement between that and the SWFA 5-20, other than field of view and zero stop.