There's an angle in here that I haven't seen brought up yet, and it relates to the nature and spirit of "fair chase" - at a couple of levels.
Why are archery hunts the earliest of the year? Because it gives archers an easier hunt for what is a very difficult challenge - esp with mule deer, they're a lot easier to find and hunt when they're in velvet, often bachelored up in a group still, and often out in the open. Nobody has been hunting them yet, either, so archery guys get first crack at their animals, when they're easiest to hunt for several reasons, and able to get within archery ranges.
It's also why you don't have rifle seasons when deer are in velvet - it's a bit of an unfair advantage at that point. Same with why most Western states have little to no season opportunities for rut hunts with rifles - unfair advantage, less "fair chase".
Why were MZ hunts first set up to be immediately after Archery - and not at the same time, or before? Same reasons, related to fair chase in some ways, for both the animals and hunters using a different class of weapons. MZ is hard enough, but significantly less difficult than Archery. But if you allow MZ hunting during Archery season, it would molest the experience and the hunts of a lot of archers - and give unfair advantage to the MZ hunters.
And both of these types of hunts just get ruined in most states if you throw in rifle hunters. It's the same reason why almost nobody is out hunting with a bow or a muzzleloader during the rifle/any-legal-weapon seasons. Because rifle hunters (of which I am one) make an entirely unequal playing field for guys out with bows or muzzleloaders.
Personally, I use a traditional muzzleloader, but genuinely don't give two $h*ts what kind of muzzleloaders other guys use. There does seem to be a fair-chase tipping point in there somewhere, however, for both the game animals at a particular time of year, and for other MZ hunters, when your modern muzzleloaders just become a different class of weapon - where a 600yd-capable, sub-MOA, optic-equipped smokeless muzzleloader just completely exceeds the fair-chase experience of other hunters in the field at that time, and the animal behavior that MZ seasons were originally selected for. I don't think it's right to ban them, but it also doesn't seem any more right for them to be used during MZ season than it would be to use muzzleloaders in Archery season.