No, it's not weird. People's bodies give off pheromones, which make up their natural smell. That's how other people know who their genes will mix well with, when someone smells attractive to them. When women ovulate they let off a particularly enticing smell that attracts all sorts of men.
So, your liking they way women smell is actually very, very normal.