No - don't feel bad - it's the same in the wild - survival of the fittest. It leads to only the strongest fry surviving. I've always let the fry in my tank fend for themselves and, as a result, the fish that manage to survive have turned into the strongest of their kind.
Do you have anywhere in the tank for the fry to hide - placts, decorations etc?