We use to plant it in our food plots years ago. We never had the problems with it that y'all have. I don't know what we were doing that keep it from coming back every year.
I've never had it come back in a plot either, but it will dang sure come back in a hay field. I don't know if the deer keep the seed eaten off in a small plot or what it has been. When the seeds are in the milk stage, those suckers are sky high in protein. That goes for all cereal grains.
I know that 2Dogs knows what he's talking about when he said he's had it come back from seed, and I know he's got a pretty high deer density where he's at so I don't know what the deal is.