OK, the sponge filter itself, inside the tank, should not be making noise aside from the stream of bubbles. I can hear mine, more in the smaller tanks than the larger that have sponge filters. Adjusting the air flow can increase/decrease this sound. You want to have a decent stream of bubbles though. or the filter will be less effective, so don't lower it too much.
If the air pump itself is producing noise, that is another thing entirely. Some pumps are more noisy than some other brands. Sometimes adjusting the flow (if this is available on the air pump) can reduce or increase motor noise. The substance on which the pump sits can sometimes "amplify" the motor reverberation/noise.
Byron.