It's not ridiculous what-so-ever. give yourself a break.
Most people are scared to have sex for the first time and not having it with the right person can lead to other worries.
My opinion would be to wait till you find a nice guy, i know how you feel, i was there. but i waited and found a...