Personally, I'd be upset after about a week, but still happy if he called. Before two weeks could come and go, I'd probably already be at the point of "you suck.". xD
However, who *knows* how guys' minds work sometimes. He may have a good reason. Give him a chance, and then, if too much time passes, don't.
Good luck! ^_^