What kind of algae eater do you have? How large is it? You're not in danger of the fish eating your fry right out as they don't do that, but they will get grumpy and harass fish, which could possibly kill your fry. You are most likely okay though with nothing to worry about.