Yes, to stop the fighting separate them! They can and will kill each other. Some puffers can live pretty peacefully with others, others well, are super territorial. Figure out which one starts the fights, then put him in his own tank.
Sent from my phone, in the land of magical unicorns and rainbows!