Don't remove the gravel.
You can replace the filter pad but I would NOT recommend you do anymore then that.
If you replace everything you've stated, you're going to throw your tank into another mini-cycle which will stress your fish out more then what they already are.
Nematodes are caused by...