I did the same thing the same way and had the 'same' results. I corrected that problem by connecting the speakers directly to the tv/ monitor. That ways, whatever came out of the tv also comes through the speakers.
P.S. I could never figure out what it would not work the other way.
my2cents