Whatever you do, get a decent scale that is accurate. Last thing you want to do is blow up a gun or worse because of a faulty load (too light or too heavy). Stay within load specs from a reliable source until you know a lot about reloading or under the direction and supervision of a very responsible experienced reloader. Be careful about subsituting components (primers and powders are different and respect the difference). Get a good reloading manual and read it twice. Understand the warnings in the manual--- they are there for a reason.
I load all my centerfire calibers for several reasons: costs, control of accuracy and speed and for fun. It can be a lot of work to really dial in a gun, but the satisfaction of a job well done is worth everything.
Unless you have someone locally that you want to buy components (good idea for powder and primers due to haz mat), I would look at some of the bigger names for gear and materials. I personally use Midway, MidSouth, Natchez and Precision Reloading. Periodically, I will pick up some supplies at Cabelas, Sportsman's Wharehouse or Scheels if I need something and I'm at the store. There are several others out there and you will find differences in prices and availability from company to company. There may be some sponsors on this site who may be a resource to use also.