I'm assuming the velocity climbed as shot numbers went up? If not, temp sensitivity probably isn't your problem.
IMO you'd be better off shooting the 10 rounds at near your max hunting range to see how it groups than burning 10 more just for chrono readings. If it has a ton of vertical, then worry about your velocity spread. Otherwise it seems like you're going to chase your tail and still have no idea what the real impact on hit % at distance would be.
Unless you have smaller case capacity than most with your brass, your charge weight is quite mild.