I think I'll pick up a tiny filter for it.
as far as cover goes, I plan on doing TONS of anubias (or similar depending on availability). I pretty much want the ground covered with nice hiding places.
Moss is good for cover. It also gives something for the shrimp to graze on. You can check out the SnS/Power sellers forums and see what's availabe.
Btw, what kind of betta is it?