You are probably close to his bedding area and he is getting up and hitting the feeder for a mid-morning snack after running around all night. They will get up and move around in a localized area during the day and in my experience its to and from the closest food source. IMO that's what is going on here it's not rutting behavior this time of year.

The next rain will likely have a cold snap with it.... he will be there maybe just before the rain but I would almost guarantee he will be there the morning after.

Outside of weather some sort of change in any particular day could make it happen and it could be as simple as the neighbors riding 4-wheelers one afternoon or morning.