Albany is a little far if you mainly want to stay in the city.
The only place worth making the trip if you are looking for a good variety is Ocean Aquarium. Its a small place but you will not be disappointed in the selection. Report back and tell us how you like it!
120 Cedar St
San Francisco, CA 94109