If both barrels are shooting high POI vs POA, I’d lean toward your eye not being low enough behind the gun. POI vs POA should be a touch high, but not more than 60/40 on the pattern. Fit vs POI for true wingshooting is a different animal. A clamp on rifle style rear sight, adjusted all the way down might show you something. Just guessing, from here.