All great points. I guess I don't expect an intruder to be standing still, providing a frontal shot at 5 yds so those shots can be placed perfectly center mass. Given that the average homeowner isn't trained nor well-practiced, the chances of him missing are quite high (adrenaline, fear, panic, lack of practice, etc). And those rounds are almost certainly going to exit the house when using a rifle. I imagine my neighbor defending his home with an AR and he misses, sending rounds through my house. I'm really not cool with that.
No doubt, everyone here is a certified badass who will never miss, but the average guy is going to miss more often than he hits. Why not mitigate collateral damage by choosing a better option?