Well, as long as the dirt wasn't radioactive or contained chemicals you should be ok.
You can buy some water clarifier that's simply poured into the tank. It bonds to the tiny particles so that they can be filtered out by the sponge in your filter.
After the treatment you will need to clean out the sponge though cause it will get clogged up (depending on how my dirt we're talking about).
Cheers.