When breeding bettas there is a high mortality rate with the fry when some one is just beginnig the breeding process. By that I mean someone new to breeding them. Yes, you probably did take the male out too soon. (don't put him back in as this could get the rest killed.) Like I have said before breeding bettas isn't a exact science. It takes time and patience to get it right. Rose 8)