Id quit hunting and start corning the heck out of it. Set the trail cam on it. Check it maybe every two or three weeks. If you pull him back over to you, the trail cam will let you know what time and how often. Other than that your best chance is rut. Whatever you do, dont booger it up by shooting anything else or walking around looking for his sign. Nothing really is gauranteed to pull him to you but this is what i would do. After ole neighbor pressures him out he ought to be right in your lap.