yes its a good idea to boil it first then leave it in water outside for couple days before putting in the aquarium. This is what i have done, as i have made one for myself few weeks back and it turns out that my fishes enjoys hiding away in the coconut cave.

Have you turned it upside down in the water to release an air bubbles trapped inside, it should then stay down.