What is your goal?
I think it doesn’t matter whether you include weighted or exclude the few flyers.
Different ways to argue it, but I think about it in terms of mean radius and then use a circle with the mean radius to capture the most shots and call that the center.
Whether you weighted or whether you excluded the few outside shots, the center wouldn’t move much up or down in the first group. Some high cancel out some low. The center might move a tiny fraction to the left by the weight of the 4 shots that were outside the furthest left limits of the group.
If you shot 100, would you get “flyers” only in the same area as the others? Possibly. But, if they are a few, they have limited weight.
In the groups you showed, the difference it between weighted or excluded would be less than a tenth. Your gut call is your pattern detecting mechanism in your brain. Over thinking is that part of the brain that lives in FOMO.