Return Styles: Pseud0ch, Terminal, Valhalla, NES, Geocities, Blue Moon.

Pages: 1-

Best Site Ripper

Name: Anonymous 2005-09-18 18:50

I'm looking for something that can let you rip multiple sites at once and download video, picture and zip files. Something like Picaloader.

Name: Anonymous 2005-09-18 20:29

curl

Name: Anonymous 2005-09-18 22:47

wget

Name: Anonymous 2005-09-19 0:27

Something with A GUI!!!!!!!!!!!!

Name: Anonymous 2005-09-19 0:49

>>4
close your eyes and pretend

Name: Anonymous 2005-09-19 2:38

>>4
Learn how to use a command line, for God's sake. You know, we didn't always have these fancy-dancy GUIs with eye candy and wizards to wipe your ass for you.

<code>wget -r http://www.4chan.org</code>;
Not that fucking hard.

Name: Anonymous 2005-09-19 7:35

>>1
Webmasters don't like that. Don't do that.

>>4
Lol slow. You have to do all sorts of clicks and fly through menus and stuff. It takes me a few seconds to type leech <url> <depth>.

>>6
You really need many more parameters if you want wget to behave properly, identify properly (including user agent, language, etc.), don't hit servers too hard, and do not download ads. That's why I like it, casual users will take time using it to leech. I wrote a simple command line frontend for it.

Name: Anonymous 2005-09-19 8:52

Please, for all that's holy, don't rip image boards. They're suffering enough already.

Name: Anonymous 2005-09-19 9:31

Exactly. BTW, I said I leech, but I never leech this site. Besides, I think they ban you if they catch you.

Name: Anonymous 2005-09-19 10:08

Doesn't 0chan regularly archive 4chan?

Name: CCFreak2K !mgsA1X/tJA 2005-09-19 11:38

I can't believe wget wasn't the FIRST to be suggested.

Name: Anonymous 2005-09-19 14:34

NIGGERS

Name: Anonymous 2005-09-19 19:10

>>7
I take it your 'leech' is just a wrapper script for wget with some preset arguments.  Care to share it?

Name: Anonymous 2005-09-19 19:37

>>13
Exactly. Sure:

#Opciones de esta versión
$ODESC = 'English version 1.0 [en]'; #Para la ayuda
$OOPTS = '-t 2 -nc -nH -w 1 --random-wait -r -k -p -R ad.*.*,ads.*.*'; #Opciones de WGET para leechear
$OLANG = '--header="Accept-Language: en,es;q=0.5"'; #Accept-Language
$OCHAR = '--header="Accept-Charset: ISO-8859-1,utf-8;q=0.7,*;q=0.3"'; #Accept-Charset
$OUSER = '-U "Mozilla/5.0 (Windows; U; Windows NT 5.1; en-US; rv:1.7) Gecko/20040616"'; #User-Agent
$OBAKA = ''; #Para ejecutar en la ayuda, uso interno


#Verificar argumentos y mostrar ayuda
if ($#ARGV < 1 || int(@ARGV[1]) < 1) {
    eval $OBAKA;
    print 'LEECH v1.0 - Download a website using WGET
¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯¯
Usage: LEECH URL depth [<option> [<option> [...]]]

    URL       Address to start leeching
    depth     Depth (minimum = 1)

<option>: (also lowercase)

    /V=x      Limits speed to x (bytes, uses KB if it ends in k, MB if in m)
    /P=x      Prefix x for all directories that will need to be created
    /N        Does not recurse upper directories (parents)
    /H        Also jumps to other hosts
    /R=x      Sets HTTP referrer to x
    /C        Disables server-side cache (Pragma: No-cache)
    <WGET>    Any WGET option (see wget --help)

', $ODESC, "\n";
    exit (1);
}

#Extraer partes
$url = shift(@ARGV);
$prof = shift(@ARGV);
$args = join(" ", @ARGV);

#Procesar argumentos
if ($args) {
    study $args;
    $args =~ s|\B/[Vv]=([0-9]+[km]?)\b|--limit-rate=$1|;
    $args =~ s|\B/[Pp]=([^*?:\\\/<>\|\s]+)|-P $1 |;
    $args =~ s|\B/[Nn]\b|-np|;
    $args =~ s|\B/[Hh]\b|-H|;
    $args =~ s|\B/[Rr]=(\S+)|--referer=$1|;
    $args =~ s|\B/[Cc]\b|-C off|;
}

$a = "wget $OOPTS -l $prof $args $OLANG $OCHAR $OUSER $url";

print 'Invoking: ', $a;

system ($a);

This is Perl BTW. Name it leech.pl under Windows (and add .PL to PATHEXT and Perl's bin directory to PATH); add #!/usr/bin/perl and name it leech under *nix.

Name: Anonymous 2005-09-20 1:41

>>14
"leechear"? Damn Mexicans, stealing our verbs. We don't want yours, since they all end in [a|e|i]r.

Name: Anonymous 2005-09-20 7:25

>>15
I'm Mexican but Spanish, and it's the other way though, 80% of English words - the less common 80%, but 80% nonetheless - have Latin roots :P

To leech can be translated to chupar, but it also means to suck...

Name: Anonymous 2005-09-20 7:26

>>16
Er, I'm NOT Mexican but Spanish

Name: Anonymous 2005-09-21 19:32

>>16

So if I told a Spanish babe to "chupa" me, would she?

Name: Anonymous 2005-09-22 6:17

Is that where Chupa Chups comes from?

Name: Anonymous 2005-09-22 17:30

>>18
Well, she'd most definitely understand what you meant, but I doubt she'd oblige :) . The most correct form would be "chúpamela" ("chupa", "me", and "la" ("it")).

>>19
Yup, although not from sucking cocks, but lollipop.

Name: Anonymous 2005-09-27 20:32

For the love of god. I remember using a command line. I started downloading porn by using DOS to dial up BBS's using a 2400 baud modem and using DOS telnet clients connect to telnet to hundreds of BBS that I can no longer remember.

But the internet has gotten much bigger, my eyesight is getting 
worse and I want something that's fucking easy. Plus I don't want to leech 4chan, just a lot of paid sites with free samples and myfreepaysite.com. AND I HATE WGET!!!!!!

Name: Anonymous 2005-09-27 20:36

For the love of god. I remember using a command line. I started downloading porn by using DOS to dial up BBS's using a 2400 baud modem and using DOS telnet clients connect to telnet to hundreds of BBS that I can no longer remember.

But the internet has gotten much bigger, my eyesight is getting 
worse and I want something that's fucking easy. Plus I don't want to leech 4chan, just a lot of paid sites with free samples and myfreepaysite.com. AND I HATE WGET!!!!!!

Name: Anonymous 2005-09-28 6:41

Non-interactive operations, like leeching, are done from the command line 10 times faster than you click this and that as if you were playing Virtua Cop. It may be automatized into scripts, customized and wrapped into other applications, and used in ways GUIs can't dream of, like pipes. I strongly recommend you to learn to use the Windows command line and get a good set of utilities (GNU's textutils, Perl, PHP, Python, FAR Manager, Windows utils, etc.). You'll save months of time, learn how stuff works, and be able to do things you can't even think of if you're used to GUIs.

Don't change these.
Name: Email:
Entire Thread Thread List