Yes, it would be too much. If you have a HOB filter you can increase the offgasing by lowering the water level a bit, increasing surface agitation and lowering the CO2 of the water. If you include a bubble counter, you could then increase the water level as the bubble production slowed. You would want to keep good records of pH all through this until you got a feel for it. You could also just use a smaller container, or less sugar and yeast.
In any case, be sure to monitor CO2 in the tank and know what you target pH is and what the pH limit is so you can take action before fish are damaged.