I would clean it just for asthetics myself, I don't think it would raise nitrate though. High nitrate will feed the algae. Water changes will reduce the nitrate.
It's probably a mix of algae, bacterial floc, and detritus and it's very common. As mentioned just clean it off regularly and perhaps increase the frequency or size of water changes to reduce the nutrients feeding it.
I don't know for sure what it's composed of. My theory has always been that it's bacterial floc that creates a sort of sticky mat into which detritus and algae get trapped.