Maybe he's just a dominant male.
I have given mine to a friend so she can take care of him in his own tank, he looks happy now and wont bother his new larger friends.
I am going to keep a few fry from the grow out tank to see how they do with other smaller fish. If I feel he won't bother them, I'll put them in my show tank.