Tag Archives: screen scraping
Screen Scraping with Perl to get the top 25 Websites and the Web Servers they use
This was a really fun little script I wrote that I thought I would share with everyone. I basically wrote a Perl script using the popular LWP Perl module to screen scrape and obtain the top 25 sites and the … Continue reading
Posted in Data Mining, Hacks, Perl, Programming Languages, Technology
Tagged alexa, alexa.com, bot, bots, download webpage, hack, hacking, HTTP, HTTP header, HTTP request, HTTP response, Library for WWW in Perl, libwww-perl, LWP, LWP::Simple, LWP::UserAgent, perl, screen scraping, script, scripts, server, Simple, top 25 websites, UserAgent, web server. web servers. automate
3 Comments