We picked up one of the 10 gallon kits from walmart for a shrimp tank about a year and a half ago for 27 dollars. An inch of Miracle Grow Organic Potting Soil, topped with inert gravel and a sponge filter and we were good to go. A few bulbs for the hood will run you 8 or 10 bucks. A sponge filter can be had for about 7 dollars on aquabid, and used air pump can be had for pretty cheap. I bought one today for 6 bucks from my LFS. All in all, you could probably get the entire setup for ~50 dollars. Maybe 60 if you went for a nice heater.
With that said, personally, I think Ebi's, Evolves, and Floras are more visually pleasing then a standard 10 gallon.