These fish have a hirachy, so it will take a while before the other fish accept them. Presumably the others chase them off fairly soon after they try to join? They will eventualy be accepted, but being the smallest they will be at the bottom of the pecking order, and will likely be last to food, thus may be slow to grow on. Just observations of my own and speculation though...
Rabbut