Depending on your stocking, it may be easy to remove your fish and put them in a temporary bucket with some tank water and your filter media. I've done that once before, and it certainly removed the stress of worrying about hurting them.
That would be another story, but many won't do that, too much work! Still better IMO to address the cause. Most of these issues happen from an improper startup.