A Ruby gift for you, /prog/

gem install hpricot
ruby fukkensaved.rb

-------------------
# fukkensaved.rb
# scrape an entire thread's worth of pictures from /b/

require 'rubygems'
require 'open-uri'
require 'hpricot'

USER_AGENT = 'Mozilla/5.0 (Windows; U; Windows NT 6.0; en-US; rv:1.9.1b4) Gecko/20090423 Firefox/3.5b4 GTB5 (.NET CLR 3.5.30729)'

def fetch_thread(thread_id)
  Hpricot(open("http://boards.4chan.org/b/res/#{thread_id}", 'User-Agent' => USER_AGENT))
end

def save_image(thread_no, url)
  if !File.exists?("#{thread_no}/#{File.basename(url)}")
    f = File.open("#{thread_no}/#{File.basename(url)}", 'wb')
 
    open(url, 'User-Agent' => USER_AGENT) do |i|
      f.write(i.read)
    end
 
    f.close 
  end
end

print "Thread number? "
thread_id = gets.chomp

puts "Loading thread #{thread_id}..."

imgs = fetch_thread(thread_id).search("img[@md5]")

# Make a directory based on the thread number
Dir.mkdir(thread_id) unless File.directory? thread_id

# Download each image to this new directory
imgs.each do |img|
  puts "Downloading file #{img.parent.attributes['href']}..."
  save_image(thread_id, img.parent.attributes['href'])
end

Windows NT 6.0
Firefox/3.5b4 GTB5 (.NET CLR 3.5.30729)
what.

Just a phony useragent so it doesn't show up as open-uri or whatever in the logs. I suppose it should be randomized between five or ten different ones.

Personally my useragent is Mozilla/5.0 (Macintosh; U; Intel Mac OS X 10_6_3; en-us) AppleWebKit/531.22.7 (KHTML, like Gecko) Version/4.0.5 Safari/531.22.7 :)

and the reason anyone would use this slow as fuck shitfest instead of one line with wget is...?

Because Ruby is the shit.

ruby can hax my anus any day of the week

scrape an entire thread's worth of pictures from /b/
gee, thanks. It's what I've always wanted *sigh*

require 'hpricot'

Don't. Since his suicide, his code was frozen for posterity, without concern for security issues.

HPRICOT MY ANUS

why my lucky anus

Too bad the thread will be gone by the time the script finishes.

wget http://boards.4chan.org/b/$1 | egrep -O- 'http://images.4chan.org/b/src/[0-9];+\.(jpg|gif|png)' | sort -u | wget -i-

The generalization for any imageboard is left to the user.

wget http://boards.4chan.org/$2/$1 | egrep -O- 'http://images.4chan.org/$2/src/[0-9];;+\.(jpg|gif|png)' | sort -u | wget -i-

>>12-13
wget -A.gif,.jpg,.png -erobots=off -I/$1/src -nd -rH http://boards.4chan.org/$1/res/$2

wget -qO - http://sprunge.us/PfMN

I wish I were the only one outside Japlandia to know of Ruby so I wouldn't be so ashamed of using such a nice language.

>>16
code your ruby with pride

Ruby is a better Perl, or a worse Python.

Ruby is a worse Perl, or an equal Python.

Ruby is more enjoyable to use than its main competitors once you learn to pretend the community doesn't exist.

>>19
Still deep in denial, I see. It's unhealthy, you know? Face up to the fact that you made a mistake and move on.

>>21
I am more inclined to agree with >>19 than >>18

>>20
Funny, that applies to Python too.

>>22
I hope you don't mind being wrong as well, then.

>>23
And Haskell.
Really, all programming communities are shit.

>>24
Wrong on a matter of opinion? It's like I'm really on the internet. I'll concede: you can be king retard.

>>26
No, no, I insist, take the crown - you should be the leader!

>>26
The fact that Perl is a terrible language isn't a matter of opinion any more than the fact that Java or PHP are terrible languages is.

>>28
The only way one person could be against both PHP and Perl is if she's too stupid to understand Perl.

>>29
understand Perl

>>30
UNDERSTAND MY ANUS

>>29
she
IHBT

<-- check em dubz

35 Name: Gruff 2011-03-06 19:55

Its true, almos tall languages ive learnt ive had t oshut myself away from the community, for being such unhelpful bastards