before adding any gravel to any setup, it's worth washing it very very thoroughly till the water runs clear. That should get rid of most of the tiny bits. As for the other tiny bits, loads of people use gravel with no abnormal results right? So I should think it'd be ok.
