You should change your carbon filter (the cartridge) every month. Carbon removes any odors from the water, the yellowness, and any medicine or chemicals that may get into the water.
It won't harm your fish if you don't change the carbon. I'm guessing, though, that your carbon is in a filter...