I try to avoid the UV brighteners, but I question how much of an impact it really has. These brighteners have been in almost all detergents and factory treatments for 50+ years. If you truly glowed like a lamp to deer in an otherwise muted forest, there is simply no way any of us would be seeing deer, especially mature bucks or matriarch does, at close ranges sitting in a treestand against a bare trunk. It’s simply not logical.
I can see it being a slight factor that could cause your movement to be more noticeable in very low light conditions, but I am not buying that you glow like a horror movie alien.