4 weeks is too young, they can barely walk.
mom will teach them, but it takes a few weeks.
they all eat and play in it and even sleep in it. soon, they learn it is a toilet.
also, make sure the box is low enough so they can get in. no kitten is going to scale a wall to go potty. you might have to put litter on newspaper next to the box until they are older.