there's 3 main types of media
mechanical
chemical
biological
the biological is most important, this is sponges, filter floss, noodles, ceramic tubes, bio balls etc. these are all media's designed to have a very large surface area for the bacteria to live on.
chemical is things like carbon or rowaphos, only use them if you have a specific problem. they just deal with removing one of the chemicals from your water
mechanical, to an extent all the biological media will do this, but in a large filter the first layer is generally a corse sponge or somethng similar to collect most of the muck and waste, this is the mechanical filtration
is there just carbon in your filter now? so long as there's something else in there too then it's fine to just take the carbon out and replace it. very little of the bacteria will be living on the carbon as it's chemical filtration not biological