All fish are slowly weakened by nitrates. Ammonia and nitrite harm them (even kill them) rapidly, but nitrate takes longer but it is still toxic to all species. It can vary depending upon the level, the exposure time, and the species. But 20 ppm nitrate is as high as you ever should allow it, and if you can keep it well below this the fish will be healthier.
My tanks over 12 years have always been in the 0-5 ppm range. This is the API test so it might be 0 or 1 or 4 or 5, but no more. Planted tanks (low-tech or natural like mine) often have zero nitrates permanently.
It is easy enough to keep nitrates very low/zero if they only occur within the tank. Nitrates in the source water is a very different issue. If this is only around 5 ppm I would tend not to worry, but keeping the tank very low is more important.