Bow hunting puts a lot more pressure on them than rifle hunting . You have to get closer. When you get closer you get busted more.
Let’s say you have a ladder stand sitting back 100 yards off a field. You can come and leave with rifle and the deer never know you are there. That same stand is worthless to hunt from with a bow. To bow hunt same place you have to put a stand right on top of the expected trail. Much higher probability of getting busted. After that happens a few times they will quit coming by there.
Yes there are a lot more deer killed during rifle season. There are also a lot more hunters. If rifle season is as shortened. There would be a lot more people take up bow hunting.