bytewolf
/
proxy_scraper
1
0
Fork 0
Code Issues Pull Requests Releases Wiki Activity
1 Commit 1 Branch 0 Tags 0 B
Perl 83.7%
Shell 16.3%
Go to file
Hui Wang ba5157c21c init proxy_scraper 2014-08-23 19:40:40 +08:00
data init proxy_scraper 2014-08-23 19:40:40 +08:00
tmp init proxy_scraper 2014-08-23 19:40:40 +08:00
README init proxy_scraper 2014-08-23 19:40:40 +08:00
check_proxy.pl init proxy_scraper 2014-08-23 19:40:40 +08:00
run.sh init proxy_scraper 2014-08-23 19:40:40 +08:00
scrap_proxy.pl init proxy_scraper 2014-08-23 19:40:40 +08:00

README 

Following modules are required:

Furl
AnyEvent::HTTP
Web::Scraper

You can use cpanm (http://cpanmin.us) to install above modules easily.

    cpanm Furl AnyEvent::HTTP Web::Scraper

Run ./run.sh to generate available proxies and you can find the output file ",proxylist" in "data" directory.