For me, when I am sexually active, I am very aware of my motive. For me, it's more about boosting my self esteem than the desire for sex or even intimacy. And though there are times my body might become aroused, it doesn't necessarily coincide with what my mind wants.
You are not a weirdo...