I have been slowly building my hunting gear collection. But there have been some times when I loved the gear so much I wanted to have multiple purposes so I purchased some solids. Sitka Timberline pants are a great example. It's like indestructible pajamas you can wear to more places than just Walmart.
I have had this conversation with my buddy. His thoughts are he wants to buy once, cry once, and have all his hunting gear in camo to have all the odds in his favor. I do agree with him to an extent, however, some pieces of gear are just too nice not to want to wear to other places. I also don't want to be wearing a camo jacket when going somewhere nicer where if it was in a solid color I would be fine. I spend a lot of time backpacking as well and unfortunately some folks on the trail you stick out like a sore thumb and it can create some awkward times and conversations.
My game plan right now is most of my hunting gear for archery will be in camo since that's closer to your target, minus the pants since usually I am waist-deep in brush. For rifle, I think I will be more lax and wear more solids since the distance is greater.
Now I am also a newer hunter so you may destroy me for my decisions.