Here's what I use; it's all based on function, and is camo pattern agnostic.
My pants, across all seasons, are the cheap Wrangler outdoor pants (the 96% nylon/4% spandex blend). I like the fit well enough, the fabric is great performance-wise, and I don't mind destroying them. I'm past trying different pants trying to find something will hold up. When I snag these in briars or on a barbwire fence, it hurts lot less than putting a hole in a $150 pair of pants. I buy these in browns and grays, they obviously don't come in camo.
For warm weather hunting, I love the Kuiu merino 120 hoodie. You can get it in camo if that's your thing (the Valo pattern looks pretty good).
My heaviest base layers are the Stone Glacier Chinook, which are a 170 weight. I want my base layers to wick moisture and dry relatively quickly, and heavier merino doesn't do that as well (as far as drying). I'm not a big fan of synthetics, but there's a strong argument for them.
For mid layers, I have a few that I really like. The Sitka heavyweight hoodie is great for a fairly basic grid fleece layer, but the Sitka Ambient hoody (I have the original version) is a step above for me. It's my pick when temps are mild, or I'm planning on moving a lot. By far, my favorite mid - probably my favorite piece of clothing ever - is the Duckworth Powder hoody. I can wear this thing down to about freezing before it reaches its performance limit (with a good base under). I used to hate merino as a mid layer, but this hoody is amazing. It's too warm to be walking around in a ton, but very well suited to typical whitetail hunting.
If you can come up with a First Lite Sawtooth jacket, it's also a very versatile layer that I love. It's hard to imagine fitting it into a "system" until you start using it, then it seems to fit almost everywhere.
For insulation, I have and use an Outdoor Vitals puffy (the now discontinued Loftek), a Sitka Ambient 200, and a Kuiu Kenai. The Ambient and the Kenai are quiet and well suited for whitetail hunting, but they aren't the warmest jackets in the world. I think this is where whitetail layers start to deviate from a typical layering system.
You need something that can cut wind and keep you warm for long periods in really cold weather, while being quiet enough for those still days, or that period of time at dusk when the wind drops off and deer are really on their feet. I use an old Cabela's wool jacket and pants (Standhunter, maybe?), but Sitka and Kuiu both have options that work here as well. These aren't generally very packable layers, but they do the job described above.
I also keep a Sitka Dewpoint in my pack pretty much all the time for high wind and warmer temps, or for rain. I use wool gloves from Hunt Monkey, with a full finger glove on my left hand and a fingerless on my right hand, then usually the Hunt Monkey wool beanie. I keep either a merino wool neck gaiter or a cotton shemagh in my pack as well, and a pair of lined leather gloves.
This is what works for me. It's all brown, green, or gray but you can get most of it in camo. I'd really encourage you to focus on performance of the garments rather than pattern or color.