Eating fish can cause an allergic reaction. So I suppose touching them could also cause a (weaker) reaction.
I could imagine that just like with cats, you can get allergic reactions when coming close to them, you can get reactions when touching the water where the fish are in.
Although, I must admit. An allergic reaction to your face is a very unexpected place.