You did the right thing. I feel if his intentions weren't bad he would have never spoke to you