If you believe that the noise you hear is from the contactor buzzing, replace it. They are inexpensive.
You'll need to know if you need a 1 pole or a 2 pole contactor. They are simple to change out, just kill the breaker at the outdoor unit and the breaker for the air handler. Replace the part 1 wire at a time or label them.