personally I feel that beneficial bacteria will colonize realistically any surface in the aquarium... however larger colony's can be supported in areas with more waterflow... for example, if you have a plastic fern, in front of a powerhead or wave maker type pump, you may end up with as much beneficial bacteria, on the fern, as in the filter media...
if you have a sponge filter that you are just trickling air bubbles through it, it may not have enough water movement to support bacteria in areas of the sponge with the most resistance to flow... the thicker parts, or any of the sponge, that there is not enough draw of water to support the bacteria...
it's also in the bio film on most all surfaces, including the glass, but at minimal amounts, if there is not sufficient water movement, to effectively feed the bacteria...
I'd like to add to Gary's very good comment, that you reduce beneficial bacteria, any time you remove any filter media, or hard or soft structure from the aquarium... yes, there will also be beneficial bacteria on your live plants...
scraping your glass, only "moves" the bio film ( and beneficial bacteria ) from the glass to another surface, like the gravel or other structures in the tank, unless you are changing water at the time, & remove suspended bio film... vacuuming gravel, not only removes fish waste, it also removes some beneficial bacteria from your substrate