Nothing really cleans brown algae off short of bleaching. Obviously if you use bleach, you need to rinse the objects very well afterwards. Possibly you could use a safer alternative like hydrogen peroxide (which converts to water and oyxgen very soon after it's out of the bottle).
To be honest, I'd let the algae grow. Once there's a decent thickness of the stuff, it'll look quite attractive. This is what you see in public aquaria, for example.
What's your salinity? If it is relatively low, you could grow more plants to surpress algae. If the SG is under 1.010, then Malayan livebearing snails could be used as algae eaters. If you have a high salinity system, things are more tricky. Violet gobies and mollies are the two prime algae eaters, though scats eat hair algae.
Cheers,
Neale