should i stop my fling?

[Ruby]

i work with this guy and we seriously flirt a lot and at the chrsitmas party he kissed me i had a bf atthe time so nothing happened. i saw him at a club a little while ago and we had both just broken up with our ex's and i told him that i thought he was really good looking and would do anything to sleep with him...i was drunk ! anyway at work after this he kissed me a couple times, i messed him about a bit because i was still confused about my ex and never met up with him. we decided to stop texting and kissing because it was leading to more and i dint know where my head was with everything a couple days later after feeling really crap about the whole situation i went to his and we had really good sex. A lot. it was good because it was fun and we both don't want a relationship. this happened alot and i stayed round last week this week when we had the same shift he wouldnt talk to me and was complaining because he was hungover so i just left it. i text him about doing it again but he was working. the problem is i like him a lot but i dont want a relationship so i dont know what to do? and now hes being a bit off and its getting more complicated than i ever wanted it to be.