Most air pumps have a small screw in the side that holds the air chamber in the pump. If you loosen the screw a small amount, it will reduce the amount of air going into the tank.
Alternatively, get a plastic T-piece and tap from a pet shop and fit it into the airline just after it comes off the pump. Then put a length of airline (about 12 inches long) on the spare outlet. This short length of airline helps to muffle the noise of the air as it gets pumped into the room.