23 and 37 seems kind of strange at first. I'm not saying that you two should split just because of the age difference, though. I'm just saying be prepared for some raised eyebrows.
As you get older, age won't be as big of an issue (a 65 year old and a 79 year old together doesn't seem quite as strange...to me at least).