dwarf gourimi swimming sideways

I have a 20 gallon high tank that has 6 zebra danios, 5 corys, and a new male dwarf gourami..Had a neon blue dwarf gourami for months and it died a week ago. Got another blue one to replace it and it died after week, yesterday morning. Just got a dwarf male gourami yesterday. It was swimming...