My wife has a '20 Gx460 that we put on a full Dobinson's IMS kit with about 2.5" in the front and 1.5" in the back. Paired with some 33" Falken Wildpeak AT3s, this thing goes anywhere around here effortlessly. With the center seats laid down it has a ton of space. If it was mine, adding a roof rack and hitch carrier would provide more than enough room for a couple guys on a week long western hunt. The v8 has plenty of torque and hp for reasonably sized boats, and there are outfits that offer aftermarket tuning. We owned 2 4Runners prior to this truck and loved them as well.
I have a '09 Duramax crew cab and I love it. It is 100% deleted, and actually gets better mileage than the Lexus (15 vs 20 on the highway. It has all the power and then some that I will ever need and with a 4" lift it can go some places.
The key advantages to the 460 include nimble handling, excellent power and reliability, and more than anything else, absolutely reliable traction. The full time 4wd system in the Gx460 and 4Runner Limiteds is a game changer for me. We live on gravel in Iowa and in the mud and snow the 4Runners and 460s run circles around every half ton pickup around.
The advantages to my Duramax are the size, absolute power, ruggedness, and cargo/towing capacity. Howevever, even with factory rear "locking differential", it still requires 4wd just to get out of the driveway when its a little snowy or muddy.
If I was going to buy another half ton pickup, it would either come with or I'd have a e-locker installed at least in the rear. I think you can get the Tacoma with factory lockers front and rear, but you'd need to do some research.