It's actually the bulb like part of the roots of the plant. Here is a diagram that shows it. The rhizome must remain above the soil for the plant to grow. The best way is to attache it with sewing thread to a rock or piece of driftwood.
I use normal white sewing cotton to attach plants to wood, you could also use fishing line but the cotton rots away over time where the fishing line may still be visible.