Yup, most bacteria that process nutrients are killed by chlorine. A few drops of non-dechlorinated tapwater wont hurt anything, but 5-10% changes might. And larger changes 20-50% surely would have a big impact on your biological filter
No problem . Its a shame too cause the chlorine in tapwater (perchlorate) is great at oxidizing dissolved organic compounds thus helping your skimmer work better... but I'd rather have living nitrogen cycle bacteria