gelbooru scraper

I MADE YOU A PRESENT, /PROG/! I HOPE YOU LIKE IT

(actually I made it for me, then spent two minutes tacking on python2 support so I could publish)

Does what it says on the tin.

https://gist.github.com/3885201

PLEASE TELL ME THIS WORKS WITH DANBOORU FAGGOT

Gelbooru is ad-ridden low quality crap.

Make a Danbooru version, ``please''.

Screw that, where's the pixiv scraper?

>>4
pixiv is worse than Gelbooru in quality terms, you dirty weeaboo.

Still, OP, thank you for making this.

ugh I will make danbooru version. Check back soon.

Gelbooru is ad-ridden...
lol this doesn't scrape the ads.

>>6
of course it doesn't

that doesn't make gelbooru any better though

Updated to support danbooru. You need an account there, and their API is hilariously insecure for users, but that's not my problem.

https://gist.github.com/3885201

shit uh
forgot to change the number of images per request back to 20 (instead of 2).

Use this one.
https://gist.github.com/3885201

this is unpythonic

>>8
how is it unsecure? i'm downloading pics of naked touhous, how can that get me hacked?

Downloading a bunch of shitty pictures automatically instead of selecting the good ones manually?

Where's your autism?

>>10
sanitize looks pythonic as fuck

>>10
fuck you, 'Now is better than never.' is pythonic.

>>11
It authenticates you using a hash of your password, which completely defeats the purpose of hashing passwords in the first place. Anyone evesdropping your connection can authenticate as you. Not like it really matters, of course.

As I recall, Windows (at least pre-Vista) did something similar for LAN filesharing authentication, which meant you didn't even need to decrypt the password hash to authenticate. Of course, these days reversing NTLM hashes is trivial to the point of being laughable, but it's still a stupid design decision.

>>12
Easier to sort them after they're downloaded. Also, your autism allows you not to archive everything regardless of quality? That must be nice for you.

Awesomeee! I'm going to go scrape the toddlercon guro tag right now!

>>14
I thought autists were picky as hell.

>>1
Someone is bad with wget, cURL, and fetch under regular expression and AWK.

>>1,8,9
# can we all move on from python2, please?
Fully agreed.

>>14
It authenticates you using a hash of your password, which completely defeats the purpose of hashing passwords in the first place.
It doesn't. The purpose is to protect users reusing the same password for different applications, over an insecure connection that may include passive eavesdroppers. If the eavesdropper intercepts the hash, he can use it to log in to Danbooru, but it's useless for anything else.
It's nowhere near as good as using TLS, but if that's not an option, it's better than nothing. If you have active men in the middle, of course, it's completely meaningless.

The reason everyone insists that passwords need to be hashed for storage isn't primarily because accounts of the application using the database could be compromised if the database becomes public information; if that happens, they almost certainly already are.

the wheel already exists: wget. but if this is just to practice then okay.

someone download all the jewkari pictures for me

dubs scraper

>>22 nice dubs