If you kill this tree and it falls from your property onto your neighbor’s home, are you legally liable for repairing the damage? I don’t know the answer to this but I would dang sure find out if I were you.
Yes. If you create a hazardous condition like this your homeowners insurance may decline to cover the damage.
Call the man and have it removed.