Well, if you are using the word "gender" interchangably with sex, don't, because they do not mean the same thing. I don't know that fish can have genders. Humans are the only animal that I know for sure can have genders.
As for their sex, I have heard that before too but I am really not sure if that's accurate or not. It sounds a bit far-fetched but at the same time maybe not. I don't know how fish are sexed.
Amberleaf: I am pretty sure whichever sex they are at the moment IS their "true" sex at the time, regardless of whether it changes or not... it's not like everything can only be male or female on a permanent basis you know. In our society we are very used to the idea that sex is immutable and permanent but it just ain't so!