It could just be a bully of a male, your orange one. If you got a few more, it would perhaps lessen.
Also, corydoras need a school. They aren't really suitable for your tank. The glofish, too, need schools. If you rehome those guys, then you could have a nice guppy shoal.