Inanna, shrimp, given happy conditions, will not climb out of tanks.
You sound like a first timer for shrimp, and I'd really encourage you to hold off on fish, test your parameters (assuring yourself you have no nitrates, stable temp, decent TDS and stable PH) then buy some pure fire red neos. I love speedie's supreme reds.
With no natural predators, nobody to eat the fry, they'll be VERY happy, show their true colors, swim and reproduce happily.
In my opinion, they're more fun than any other invert and way more interesting than fish.
On the ghost shrimp note-- I recommend against ghost shrimp. They're so often mislabeled, they can be extremely mean, harm fish and harm other tankmates.
Neos will breed, (ghosts will not) they're 100% peaceful and they are beautiful to look at.
If you love the look of ghost shrimp, allow me to recommend Snowball neos. They're translucent, have a beautiful white coloration to their eggs, and act the same as every other neo.
MABJ's iDevice used for this message :p