Muzzy season is usually earlier, which means you are typically not dealing with snow and bitter cold. In some cases, you can hunt muzzy during the rut. I think the biggest positive is the fact that in most cases you'll get better draw odds from a muzzy hunt compared to a rifle hunt.
Negatives would be, if the muzzy season is early, then you're hiking higher in elevation. Personally, I prefer this over hiking in cold/snow. Also, the harvest success rates are lower, just because you don't have the reach and efficacy that a modern rifle provides.
If you're comfortable with a muzzy, then I'd take that over a general rifle tag. It will provide you access that could be years of point building away.