Why limit yourself to being inside a shooting house if your target is 500 yards away? (assuming you can dope the wind correctly and you know how your rifle and cartridge will perform at that distance)
A deer won't even notice you outside of the house at that range.