After opening iTunes, follow these steps:
1) Click File > Add Folder to Library and choose your My Music folder.
2) If you have files in WMA format, you will be prompted to convert those WMA files to AAC. This is a necessary step if you want those tracks available to play on your iPod Shuffle.
Then your done!