Black and white aren't colors, they are contrasts. If you have no color at all you'll get white and if you put al the colors together, you'll get black. You can call them colors if you like, because they still have an important influence on paintings and in other arts. I wouldn't even say that it is really wrong to call them colors, but on the scientific view black and white are no real colors!
hope, this helped ya! =)