Well, younger brothers usually blab out a lot! So I probably say no he was not joking. First he told the two brothers, and wouldn't tell you! Then he said he would tell later. I've had this happen before, just wait and watch. See if he flirts with you, and try hanging out more.