Return Styles: Pseud0ch, Terminal, Valhalla, NES, Geocities, Blue Moon.

Pages: 1-

automating importing data from html tables

Name: Anonymous 2010-07-28 21:46

This is seeming /prog/ressively more hopeless, so I'm turning to you guys.

This website has two dropboxes: one for state, one for city.  With those two selections made, clicking a button brings me to a new page with a table.  The URL reflects the options selected for city and state.  How can I automate the importing of these tables (for each city / state combination) into a CSV file, or just something excel will acknowledge?

The only thing I can really offer in return is telling you guys how awesome the Scott Pilgrim movie is, but I'll pay upfront: really awesome

Name: Anonymous 2010-07-28 21:55

Brian Lee O'Malley: “I love `retro' video games, honest I do! Look, look! I can prove it by referencing Mario as a substitute for actual humour! Does this make me cool?”

Name: Anonymous 2010-07-28 21:56

curl + HTML parsing
NO EXCEPTIONS

Name: Anonymous 2010-07-28 22:08

what >>3 said, just make sure to use a real html parser instead of regexen

Name: Anonymous 2010-07-28 22:54

Is this something HTML 5 has improved upon?

Name: Anonymous 2010-07-28 23:02

>>1
LWP + HTML::Parser + Class::CSV or Snail::CSV.
All you have to write is a little bit of glue to stick those pieces together.

Name: Anonymous 2010-07-28 23:34

>>5
This is something that was made obsolete by JSON a long time ago.

Name: Anonymous 2010-12-06 9:50

Back to /b/, ``GNAA Faggot''

Don't change these.
Name: Email:
Entire Thread Thread List