Return Styles: Pseud0ch, Terminal, Valhalla, NES, Geocities, Blue Moon. Entire thread

Writing a Scraper

Name: Anonymous 2011-07-04 1:07

1) Use Perl with LWP
2) Use FIOC with beautiful soup
3) Other [please specify]

Name: Anonymous 2011-07-04 3:29

Really depends on how big the project is. Half of my scrapers are so simple that I just use curl with sed and cut (yes, I get paid for that).

Newer Posts