It depends on the cartridge. As you move up in velocity, you move up in bullet size and toughness because a 6UM will have similar velocity at 300 yards as a 6mm ARC has at the muzzle.
To do it right you need to figure out what bullet you want to use and what maximum range you will shoot. Back calculate to find your minimum muzzle velocity to get your bullet to perform at or beyond your maximum range. Use a ballistic calculator to find those numbers. Then find your cartridge that gives you your required velocity with the bullet you want to use. Always use the heaviest bullets you might want to use to do this calculation so that of you end up using a lighter bullet, you will be over velocity rather than being under velocity because you started with a light bullet.
Example...
You hunt in 2 different places normally. Where you live at 1900' and where you go for your yearly trip and that is 7600'. You know that the largest bullet you will ever use is the 108 ELDM although you would also try the 108 and 105 Berger and 103 Hornady bullets. Your maximum distance is 650 yards so we want that 1800 fps threshold at 700 yards to make sure we stay above it. We run the numbers and find that to get 1800 fps in our typical hunting weather atmospheric conditions at 700 yards we need a 2900 fps MV. What cartridge will give that?
We do research on real world velocity readings with the 108 ELDM and find that 243 will give you 2900 fps with common powders, the 6mm Creedmoor will give you 2960 fps with common powders, the 6ARC will give you 2680 fps, and the 6UM will give you 3210 fps. The 243 will work, the 6CM will work, the 6ARC doesn't get you there, and the 6UM is way too much for your needs.
Say you didn't have the skills or the the place to shoot past 500 yards and you didn't plan on using anything but the 103 ELDX to hunt with. Run the numbers and find that at 550 yards you get to the 1800 fps threshold when you launch at 2690 fps. Do the research and find that the 243 spits that bullet at 2980 fps, the 6CM is 3050 fps, the 6ARC is at 2710 fps, and the 6UM is 3300 fps. The little 6ARC gets you where you need to be without issue. The others will work but you will have more velocity and recoil than needed and increase your chance to have over expansion at short range when shots take place at closer than expected distances.
This is an easy way for you to find the proper bullet launching speed and cartridge to get you there.
Jay