Portsmouth is in NH, worth the stop for an afternoon.
Portland is ME, I personally don't know the city as well. Bissell Brothers Brewery is worth the stop though!
Freeport if you want to check out LL Bean and do the tourist thing.
All of Casco Bay is full of stripers, blues when they're running. Kennebec river too - There are beaches at small point and Reid State Park that can offer good surf casting. Careful with tides near the Kennebec if you take the Kayak out - no joke up there. I've almost sunk a 20' center console there...
Dolphin Marina in South Harpswell has a restaurant with some Of the best views on the east coast, and you can also eat lobster on the pier.
Could drive out Orrs and Bailey Islands from Brunswick, see I think the only standing Cribstone Bridge (between Orr's and Bailey Islands) and head out to the end where there's a gift shop, and parking lot, small beach if you want to kayak there. You can catch stripers in the wash on all the rocks up and down the coast - put your lure / fly / bait right in the whitewater.
5 Islands Lobster Company is another great stop north of the Kennebec for lobster on another pier. Prototypical Maine harbor. (Pass Bath Iron Works on Route 1, hang a right, drive 20-30 minutes). Reid State Park is out here too.
A couple hours north up the coast and you get to Acadia which is awesome as well.
What type of camping - Campgrounds or "Real" camping?
Shoot me a message if you want, my family has a house in Harpswell and I'll be there early July.