I don't think it is uncommon for immature deer to get down wind of people and not do anything. With that being said, I have never seen a mature buck or doe stick around long when they got down wind of me.