Yet another lame image dumper

And here's yet another lame script for dumping images off 4chan.. Since we probably don't have enough of them already.

Made it over the weekend.. Why?
Well, first of all, I was bored.
Second, all other I could find kinda sucked
Third.. I love python, and if its not made in python, its useless :D

URL : http://bayfiles.com/file/Y6J/uBEivF/dump_4chan.zip (24kb)
URL2: http://cf4a7g.1fichier.com/ - no wait, but in cheese language

Command line script, tested on linux and windows.

Feedback wanted. Good feedback especially wanted.

Go back to the imageboards, please. Your shit is of no use here.

My shit, eh? Awfully defensive today, don't you think?

>>1
1fichier.com
Baise en congé, ``pédé-tempête'' !!

Looks like an insult.. Let me guess, if it was .ru site, you'd be convinced I was russian, eh? Because, no one can use a site in an unknown language? Stop insulting your own intellect, mate

>>4
Pitoyable.

The dots (.) in your regular expressions are special characters, and will match any character, but it looks like you only want them to match dots.

Great point :) Somehow I always forget to escape them. Usually I'll notice right away, but not this time.

Thanks for the comment!

Does it post images or download them? If it's the latter then it's a scraper, not a dumper. A dumper would be something which posts images.

Well, it depends on how you look at it :p For me, "get an url, store all images from there in that folder" is a dumper.

It's the old upload/download discussion. But yeah, "scraper" might be a bit less ambiguous in this context.

>>10
The technical term is reacher-grabber.

>>10
A dumper is something that sends images, a scraper retrieves them.

I've been playing with a dumper for a few days that will hopefully be able to break CAPTCHA. I just need to get tesseract (an OCR engine) set up and then add that into my code.

>>12
A dumper is a large ass, and so are you.

>>12
Good luck, buddy. Don't come crying here when you fail though!

Considering the reCAPTCHA project is based on parts of old books where industry-strength OCR fails hard, and "crowdsource" the digitalization of those books...

Yeah, using some random open source OCR program will work well for this. Can't imagine what the problem could be. Your plan is full of win!

import threading

Finally grabber written someone who is not a complete moron.
You earn one upboat.

self.L.debug("Image already exist! Skipping")

I would asked Content-Length from server here and checked size with saved image. If sizes are different, then image should be saved.

True, the fetcher is still rather stupid. It could f.x check if the last image displayed in a thread on the index already exist on the disk before requesting a full thread dump,

and it doesn't handle other than the main page of index (not page 1, 2, 3 and so on). The last part is just laziness by me, tho.

And the Content-Length part is a very good idea, thanks :) Does 4chan server give HEAD? Will look into that when I get home.

Stil adding some small features here and there (added a "minimum images" limit option for when threads should be downloaded - this could also be done way smarter), and refactoring / restructuring code to make it easier to read and work with.

Hmm.. Your content-length idea could be combined with "only if image is less than or bigger than X size" options.

Any more ideas for simple functions and features to put in? Or better ways to structure the code?

>>17
How about this: Stop typing like a retard and learn to form coherent paragraphs. The pretense of ``intelligence'' you like to flaunt around would look more realistic that way.

>>18

I am sorry, my good sir. I am just writing as I think. Any pretense, or lack of, is entirely inside your own judgemental head.

>>17
Does 4chan server give HEAD?
too lewd; didn't read

Does 4chan server give HEAD?

Sure it does.

There are many brands of <a href="http://www.barbourjackets-uk.org/"><strong>barbour fusilier</strong></a> in the market today. Each of the brand promises to bring out something new to the customers.

>>15
You know, one of the words is from a book and the other is generated. You only have to write the generated one correctly, it doesn't matter if you type in ``nigger'' for the one from a book.

You will find that <a href="http://www.cheaptomsshoessaleusa.com/">toms shoes</a> are comfortable to wear While you can get <a href="http://www.cheaptomsshoessaleusa.com/">cheap toms</a> at low price online. Maybe <a href="http://www.cheaptomsshoessaleusa.com/last-chance-c-3.html">toms last chance shoes</a> will be your favorite.