I've always wandered. What exactly is 2x4 mean?

[SHAGGY]

Does it mean 2 in. long and 4 in. wide? Or the other way around?