I would never say it was impossible for isolated fish to behave in such a manner, indeed, I have seen several times, radically different species try to "court" totally inappropriate mates. It is most unlikely that an courtship would be successful, and remote that any spawning would result in viable offspring.
I had some Iriatherina wernerii, (a small rainbow fish), in a tank with some tetras, the male wernerii would enter their courtship ritual, (involves flicking their flag like anterior dorsal fin up and down whilst dancing around the "mate"), it was hysterical to watch. You could almost feel the puzzlement the tetras must have been experiencing.