I told My Boyfriend he Comes too fast Did this lower his confidence in sex?

[Menage]

We have been together 4 months. His mom was going through getting evicted so I let him stay with me. I like him alot but his sex doesn't last that long. I told him this and I have noticed we have been having sex less. he says sex isn't everything and that I am wonderful but it's not everything to him. He even comes fast when I do oral. Did I make him nervous by letting him know he needs to improve and he doesn't like to do it rough he's more slow