The manual should detail what the fuses under the hood are, although I'm pretty sure the window fuse is inside the car.
It could also be a problem with the switch or the window motors themselves. A relay could also be to blame. Check that the window lock switch isn't activated.