Crypt willisii is my favorite long draping background plant. You might be able to find it locally, I did.
Look into getting an Azoo Palm filter or something similar. It hangs on the back of the tank, it's tiny, and the flow can be turned down to almost nothing so it won't bother your betta. You can also put a tiny amount of bio-media in there to help grow beneficial bacteria.