Why didn't the U.S. consider Italians, Irish and the Polish White back then?

[Stefan Ama Europa]

They are clearly White so why did the U.S. not consider them? I think that is dumb of them.