If your water only contains chlorine and not chloramines, just leave it out overnight. The chlorine will offgas. But this won't work for chloramines. The dehumidifier thing should work, except for trying to get it filtered clean again. If you can come up with a way of filtering it well enough, it should work ok. Try coffee filters or paper towels as filters.