It happened to me a lot.
It seemed that the modem got bottlenecked at certain times of the day.
In the morning, I'd be getting like 400kbs down regular. Which is spunkable for me. But in the evening, I'd be getting 20kbs which sucks testicles.
You BT modem gets zapped to fuck at high usage...