then do try to siphon it out like you've been doing. i know it can be tedious, but eventually it should go away. or grow inside the substrate up against the glass.
as long as its on top of the substrate, it is able to spread onto plants and probably starve them for light and other things. siphon is the best method. the shrimp should agitate it enough too. just keep at it. you'll win.