Return Styles: Pseud0ch, Terminal, Valhalla, NES, Geocities, Blue Moon.

Pages: 1-

HTML Scraping methods?

Name: Anonymous 2013-11-23 17:24

I'm sick of manually browsing the 5+ local craigslists, and all the aggregator sites are shit, I want to write my own personal craigslist crawler.

What method would you use for this?

I don't know much PHP, but I'm pretty good with Javascript.

Name: Anonymous 2013-11-23 18:23

I would write this in a real language like C#.

Something like:
1. Fold through each craigslist city and apply search term.
2. Return links.

Name: posting niggers in captcha 2013-11-24 0:56

>>1
use perl

Name: Anonymous 2013-11-24 3:58

>>1
I've done a lot of scraping with Python + the requests library + beautiful soup.  Alternately there's Ruby + Nokogiri.
And if it turns out that craigslist is a bitch to scrap, there's Python or Ruby + Selenium (headless browser)

Don't change these.
Name: Email:
Entire Thread Thread List