So I planted sunflowers already this year. Our deer population is not too crazy. There has been deer in them as they are coming up, is this when they typically hammer them or is it more of a problem once they start to flower/seed out?