How to make anonymous HTTP request in PHP?

M

mahen

New member
I am using CURL+ Anno Proxy and making anno Http request by my spiders so that the reqesting server can not be identified, but I found that this approach is not giving scalaility, and oaften failed, somtimes unexpected results are comming.
I am using free anno. proxies for this purpose.
Is there some better solution for this problem
Thanks in advance
 
What you need is multithreaded download. Make around 20-30 connections at the same time (anything more than that is unlikely to get any faster unless you have a really speedy internet connection), and start downloading in parallel.

Since you used an external program to download (cURL), it might be possible that you won't need to use multithreading. Just do a non-blocking read or check whether download has finished before reading. I don't know PHP and cURL well enough to suggest you what specific functions to use.
 
Back
Top