Are you on a foundation or do you have a crawl space? Check into spray foam insulation. I think they can spray down into existing walls now. That stuff is amazing. Put more insulation in the attic. Old windows can let a lot of air out as well.

It be's that way sometimes.

www.sunpoolcompany.com