Download PHP....how do you "download" a language ?

[ilikepizza]

you have to download PHP to develop web pages with it...but what exactly are you downloading ? is it the syntax, so that the server knows what each piece of code should output ?
please explain

thank you