This is normal, given your GH and KH. You have very soft water, so its capacity to "buffer" the pH is minimal. Provided you keep only soft water fish species, this is not a problem, quite the opposite, as most soft water fish prefer an acidic ph. Now to simply explain the chemistry.
The GH and KH test of three drops each means the GH is 3 dGH (= 53 ppm) and the KH is 3 dKH (53 ppm). This is very soft water. Only keep soft water fish species, they will thrive.
In an aquarium with fish, organics are continually being produced. As these are broken down by many species of bacteria primarily in the substrate (not the same species of bacteria responsible for nitrification here), carbon dioxide is produced, and CO2 causes carbonic acid in the water. This lowers the pH. In water with a higher GH and KH the increased minerals and carbonates work to "buffer" the pH, keeping it stable. This is more important in tanks of fish requiring moderately hard or harder water with a correspondingly higher (basic, above 7) pH. In tanks with soft watyer fish species, the GH needs to be lower, and this usually means the KH will also be minimal. The pH thus becomes more acidic over time.
Provided you only have soft water fish species, and provided you do absolutely nothing to adjust GH, KH or pH, and provided you perform regular (once a week) significant (50-70% of the tank volume) water changes, and keep the filter well cleaned--you are fine.
My GH and KH is basically zero (actually 7 ppm) out of the tap, so the pH lowers in the tanks to a point that I cannot even test it. It is below 5 in some tanks. Not a problem for soft water fish.