Your man is an idiot. You are who you are and at least you want sex, right? So, quiet is fine. Actually I do not like noisy, it is irritating to me and stupid so I think you are o.k.
I would though, with that said, talk to him about what you want while you are in a sexual situation as that is good to know your body and say what you like and dont like.
Dont be a sexual doormat for him, if he complains now I probably would just leave. He is not the man for you, really.
Good Luck,
I remain,
Your assistant