Looks a lot like an old chimney base. When we hunted in Barbour county there were a LOT of piles of rocks similar to that from farmers cleaning out their fields and piling them out of the way.
The photo with the rifle in it could be an old storm pit or even a root cellar for storing food.