I tend to agree. I've noticed based off of my pictures, unless I wanted to come in to the stand around 3am, I was likely going to run anything off anyways getting there.
This is what I'm struggling with now. I greatly prefer to hunt mornings because I hate dragging a deer out at night, but I know for a fact at one spot I hunt I have run the "big boy" of the area off by being a bit too loud making it to my stand in the early morning hours (confirmed via cameras).
I can't remember ever spooking a deer when hunting in the afternoon hours, but it can happen quite a bit in the still mornings. It can be very, very hard, almost impossible even, to be super quiet walking through the woods with a bow, climber, and backpack.
I'll probably try to incorporate more afternoon hunts because of the reasons listed above.