The "brown stuff" is probably not causing any problems in itself, but the photo does look like really bad fungus, bad enough that it needs to be treated. Fungus and fin-rot (both can occur at the same time) are usually caused by bad water quality, so I would consider increasing water changes and decreasing feeding because of that.