Are you going to be running filtration? I'd assume the breakdown of the potting soil would release dangerous amounts of ammonia unless the tank was heavily planted from the start.
Also IME, bettas will eat shrimp. If they can't eat them whole, they will harrass and nip at them until they die from stress or jump out. I think decent plant cover might mitigate this though.
RAOK Club #77|The Fraternity of Dirt #112