They replace the ecological niche of the peccaries which were hunted to extinction, disturbing the soil and uprooting large quantities of plants is a vital function that the white tailed deer cannot fulfill. I think hunting should be restricted to allow their population levels to explode, they would also make a suitable prey item for the large predators that are missing from these parts like wolves and cougars.
Great idea. Bring back the wolves and mountain lions.