Sounds like your neighbor has a sensor pointed your way. Could be one of those cheap Harbor Freight driveway alarms. Be nice to build a wood fence to block his line of sight.
I paint mine and block out the red light, using mostly for catching predators… Which turned out to be two poachers one night.