Come up with some reasonable times for him to gain access to his property that doesn't restrict your enjoyment of your property.
Before daylight, between 10-2, and after dark should not hurt your hunting whatsoever.
May I ask, who are you leasing from? Is this off Roundhill Road by chance?