Once again, I repeat, do not just jump from 4 to 20 connections. Add one at a time and use the MINIMUM number of connections to max your speed. If you are still having issues, try with/without SSL and then, as topicaltapioca said, contact Astraweb, they may be able to change your routing to increase your speed.