You're not crazy, it's a proven tactic for BT's, you just have to be persistent. Look for areas with a lot of rubs, keep the wind in your face and be ready to shoot quickly, many times the buck will just slip up on you. Some good books have been written about hunting BT's, Boyd Iverson's are probably the best. Good luck!
Blackttial Rattling 101:
have your bow ready at all times
mind the wind,
use estrus whiz if need be
wear gloves when rattling. (YOU WILL bang your knuckles around!)
mind the wind
then can come in very fast huffing and grunting
they can come in slow as molassis in dec.
A doe decoy works good to keep their attention and draw then in.
tree stands on trial intersections on ridges or in a draw will be good spots for cruising bucks.
rainy days do NOT effect bucks, they love rain.
they are constantly on the move and shots will be fast if at all.
FIND THE DOES,, you'll find the bros!
Oh,, and mind the wind!