First, you have no parental rights in this case. It's your husband's child not yours. If you are sharing his opinion like this, it sounds like he doesn't want to support the child HE created because someone else might benefit. So he doesn't give a crap about his son and just wants to say the hell with it. I sure hope you don't plan to have children with this man. But given that you share that attitude, you shouldn't have kids either.
Child support does tend to help the family but the better the lifestyle for the family, the better for the son. Deal with it.
Others have suggested he ask for custody, but given how cheap you both are, I can't help but think you would be lousy parents.
The court will wonder if you are doing it solely to get out of paying child support. It's one thing to do it because there is a new father in the picture (and that doesn't sound like it), but an entirely different thing if you want to screw over his child to spite the others. They can deny giving up parental rights if it means the state (we, the taxpayers) have to pay for the son HE chose to create. (Accident or not, he could have chosen to not have sex.)
Shame on both of you.
And to correct what someone else said, the only time that someone has to pay child support for a kid not theirs is if the child was conceived during a marriage.