Um, I don't know how you would even feel like it. But whatever. It wouldnt be a good idea for a couple of reasons. When you have a fever, you can have an accelerated pulse rate. This isnt good for the heart to put more strain on it by having sex. If you have a cold, wouldnt you be spreading your germs to your partner? If none of this matters to you than go for it.