Becca,
the great thing with calories, you don't have to be exact, and for that matter, can't expect to be exact. However, unless you know what you require, what you burn, and what you eat in calories, you will struggle.
I think you've made the meat thing way too hard. Have you noticed that most game meats run about 35-45 calories per ounce (they do). So if you just take an average of 40 calories per ounce for wildgame, you can easily estimate all kinds of meat from mountain goat to deer to wild hogs.
Fish will run about the same as an average, but Salmon/trout, because of the higher fat content (healthy Omega 3 fats by the way) will run about 60 calories per ounce.
Average red meat (non game) averages 70-80 calories per ounce with some much higher (prime rib= 120 calories per ounce). Big difference!
Here is an example from my tracking today.
Frosted 100% whole grain Mini Wheats (ahhhhh sugar, but only 11 grams per cup) 2 cups = 400 calories, 10 gms fiber
Milk 1% 1 cup 100 calories
Banana large 4 grams fiber 140 calories
Grapes/blackberries 1 cup 4 grams fiber 100 calories
whole wheat pasta 3 cups w/ 1/2 cup tomato sauce 12 grams fiber 620 calories
apple 5 grams fiber 80 calories
Homemade chowmein (no noodles) 2.5 cups 5 grams fiber, 150 calories per cup = 375 calories
Whole wheat roll 1.5 ounces 4 grams fiber 150 calories (secret, most bread are 100 calories per ounce)
Wheat thins whole grain crackers with 1/2 cup salsa 6 grams fiber 150 calories
And the kicker....
1 Krispy Creme donut for desert 280 calories, zero, yes zero fiber
Total calories 2400; 50 grams fiber and I'm full!
I require 2200 at rest and burn about 400 per day, so 2600 is about right for me and with highs on the weekend, I will average that (I weigh 184, 5'9" and 15% body fat).
I only spent about 5 minutes to track all this because I only had to look up/measure the chow mein. Everything else I ate in bowls/cups I've used enough to know the serving size. Notice all my calories are rounded to the nearest 10- why? Because I've done it long enough (takes a few months) that I can estimate pretty close with only having to look up a few things.
The only other option is to do a diet that limits you to a few foods, and eat just those. You'll notice those food lists rarely include carbs so by design, calories consumed drop considerably and people lose weight UNTIL they tire of eating that way which a high percentage do.
I'd much rather do what the good data says and learn how to eat from a wide variety of foods so I can stay with it (and budget in a Krispy Creme here and there- about 1 per week for me). Much more sanity for me.
summary: you will never get your calories exact, but the good news is they don't have to be exact for healthy eating and weight management- just close.