I would suggest that if you see this guy again, in a group setting, just ignore him. Honestly, this guy probably feeds off of all the fakers and copycats, and by you not giving in, it pisses him off. Especially if you get more people to do it.
And with the work thing, don't quit. It's your...