Went to the cabin on our lease today. Probably several hundred bees are back in the wall where they been the last 3 years. A bunch of them swarming outside. I’m at a loss of what to do. It’s on the 2nd floor too.

Do a search for Bee Keepers in your area (Not ads for bee removal services). Call several of them and tell them you have a colony you'd like removed. Might find one that would come get them to start another hive... and would do it for free. Can't hurt to try.
Whoops, sorry I posted this before reading all the replies. Contacting a bee keeper was already mentioned.