Growing up, rifles weren't commonly sold with breaks. I bought a SAKO Finnlight in 30.06 and shot that thing for the better part of 10-15 years before I would first buy a rifle with a muzzle break on it. Having a muzzle break wasn't the reason I bought it, as practicing at long range distance was. Fast forward to a couple of years ago. I had just done a thorough cleaning of all of commonly used rifles and wanted to go foul in the barrels so they would be ready for next season.
Sako Finnlight 30.06 no break
28 Nosler with a break
300 Norma AI with a break
I started with the Norma, then the Nosler and lastly the .06. The first two were a pleasure to shoot as they have always been. No issues. When I got to the Sako, I figured it would be no different than the prior 15 years of hunting with it. Always an accurate and precise rifle. Never new it to be anything different. After that first shot it felt like Mike Tyson just punched me in the shoulder. A very violent rapid recoil. Significantly worse than the 2 other guns with breaks. Sure, it's weight is quite a bit less than the others, but man it was a punisher to shoot. Odd how all the years prior I didn't know any different and never questioned it nor distance myself from taking it hunting.
But I will tell you this, it rarely ever gets taken out of the safe now. I don't enjoy shooting it like I do my other rifles that have breaks on them. Just a simple fact. I have a 375H&H that isn't breaked as well, and I hate shooting it. It's the only gun that has scoped me. Recoil definitely makes a difference for me regarding the experience; however, it doesn't impact my ability to accurately shoot. I just know it will be less enjoyable. Not saying I won't shoot a rifle without a break, but the experience is definitely different.
As for the noise, that is not an issue. I don't care how loud it is as it isn't something that affects my shooting. Nor do I care about the poor soul in line with my muzzle blast. They should be smart enough to not stand in it or move away from me at the range.