What size tank and what kinds of fish are in it? Can you give parameters for ammonia, nitrite, and nitrate?
To me it sounds like old tank syndrome:
The first sign of "old tank syndrome" is rising nitrate levels. The nitrification process, which oxidizes ammonia to nitrite and nitrite to nitrate, is continuous. The same process also produces hydrogen ions. Hydrogen ions directly influence the pH level. PH, in simple words, is the bonding of carbonate ions (buffer) with hydrogen ions. The more bonding, the higher the pH. Accumulating hydrogen ions will use up all available buffers. If none are left hydrogen ions will acidify the water, resulting in a steady but continuous decline of pH.
If left unchecked, the pH will eventually drop below 6. At this point, the beneficial bacteria will be in serious danger and cease to convert ammonia into less toxic compounds (nitrite, nitrate). The consequence is a build up in ammonia.
Even at this point, there are no visible signs of something going badly wrong, except if the basic water parameters are checked on regularly.
The increase in ammonia at this stage will not have a big impact but harbors a potential and deadly threat. Ammonia consists of either ammonium (NH4 - not very toxic) or ammonia (NH3 - very toxic). At a pH below 6 ammonia is in the less toxic form of NH4 which in effect protects the remaining fish.
Adding new buffers by replacing evaporated water, the old tank syndrome shifts slightly over to more acceptable pH readings and acceptable ammonia, but will be high in nitrates and water hardness. (Carbonate hardness = buffers).
To remedy the old tank syndrome, water changes are essential. A few Gallons per day will eventually raise the pH to the point where the beneficial bacteria are "re-activated" again, solving the ammonia problem. This has to be done slowly to prevent any disaster by drastic changes in the environment. Ammonia has to be monitored and the water changes should be paused if pH is rising but ammonia not declining. The bacteria need to catch up first. Remember ammonia gets toxic with rising pH.
Prevention of course is the best remedy. Regular maintenance of the tank will prevent the old tank syndrome. Maintenance is essential.