I had this situation for 15 years with property I leased, only I was the guy driving through the middle of the other property.
I treated that property and those neighbors just as I would expect them to treat me. I never hunted on that land, I never pulled a trigger on that land. I only used it to access my lease. It was never an issue. My neighbors learned to trust me and my family members and I even helped them with planting their fields because they lived 4 hours away.
You cannot assume this other person will poach or trespass. You can talk to him, get along with him and trust him unless he gives you reasons not to.
I'm pretty sure this would go a long way with Mr. Sammy.
