Very broadly, saltwater bacteria will adapt down to quite low salinities, but freshwater bacteria won't tolerate even moderate salinities. So while freshwater filter bacteria can be taken to about SG 1.003, perhaps a little higher, from 1.005 upwards you're cultivating saltwater bacteria. On the other hand, saltwater bacteria can be acclimated down to SG 1.005 without problems. In other words, you could mature a brackish water aquarium quickly using substrate from a marine aquarium, but substrate from a freshwater aquarium would likely do little good.
Cheers, Neale