That is what ALL dealers do. The first time he goes to check with the "manager" tell him "look, I have x amount of money, if you can't give it to me for that price I'm going to go buy at the Toyota dealer." If they can't give a price you like, go elsewhere. You can't fire a dealer for negotiating.