I am looking for a starting point in how to make a forum crawler, similar to:
• http://blue.mmo-champion.com/ or
• http://diablofans.com/blizz-tracker/
I've searched the internet for about 3 days now for any source code (preferably PHP), but had no luck. I am trying to make one for a much smaller game to implement on my website for it.
I've found out so far that Perl seems to be the preferred language for a crawler, but I don't know much Perl but could learn it if needed.
I am looking to write a forum crawler, that goes to a forum, searches all the topics for certain poster's names, and saves their posts with the originating URL in one of my databases.
Thanks for your help.
Cheers
• http://blue.mmo-champion.com/ or
• http://diablofans.com/blizz-tracker/
I've searched the internet for about 3 days now for any source code (preferably PHP), but had no luck. I am trying to make one for a much smaller game to implement on my website for it.
I've found out so far that Perl seems to be the preferred language for a crawler, but I don't know much Perl but could learn it if needed.
I am looking to write a forum crawler, that goes to a forum, searches all the topics for certain poster's names, and saves their posts with the originating URL in one of my databases.
Thanks for your help.
Cheers