Do you know about tank cycling?
Unfortunately with having done a complete water change and washing your gravel over and over, all the good bacteria were destroyed.
Did you dechlorinate before putting the fish in?
Someone more knowledgable about tank cycling will be along to give you advice on how to proceed, but my guess is that the fish are in bad shape because of the shock of the new water.