Do you mean you washed or rinsed the filter media (sponge/floss) under the tap?
If so, should be fine, the bacteria are pretty resilient and the amount of chlorine/chloramine will not have had enough time to have any effect on the bacteria (remember, bacs are protectted by a biofilm).
You MAY get a slight spike but I would imagine you still not see any real effect of this.
However, if you cleaned the entire filter, media, casing, impeller, hose etc then you are more likely to see a spike but the bacteria inside the tank, over the substrate, wood, plants and decor etc will help recolonise the bacteria again, may take a few days to get back to strength.
In either case, its worth watching closely your stocking over the next few days to see if any effects start to occur, i.e gasping, lethargy, erractic swimming, red gills and that sort of thing.