Re: Please Help W/Wget.

From: Crikey Schmikey (hate_at_spam.com)
Date: 11/26/03


Date: Wed, 26 Nov 2003 08:08:04 GMT

On Sat, 22 Nov 2003 23:42:29 +0100, "Baard Ove Kopperud"
<bokoppeNOSpamHere@frisurf.no> wrote:

>"Bozo Schmozo" <hate@spam.com> wrote in message
>news:m9jvrvcd4br5tcp9etq3l118ki264gsn8o@4ax.com...
>> Baard, thanks for your excellent and informative reply. I really
>> appreciate it. I particularly liked the idea of feeding an init file
>> to wget for files that have patterns in their names and using sed for
>> others. I'll give it a try. Thanks!!
>
>Great I could help...
>
>Me and wget are *old* friends...
>
>I learned much the hard way, like the -np -option...
>I wanted to download an area on geocities, and started a download
>with infinite recursive for the area (e.g. www.geocities.com/site).
>Unfortunately, I encountered a link-page...

LOL!...sorry, but it just struck as it being funny, especially since I
had experienced a similar episode when I first used wget.

>Wget *didn't* start to download sites on other domains than
>geocities (although, you can specify that it should span sites
>in that manner), but for every link to sites below geocities,
>it started downloading. When I return the next morning, it
>hadn't finished downloading the site I wanted... but had
>instead downloaded parts of 20+ sites I *didn't* want.
>Which forced me to read the documentation, and find
>the -np (no parent) option, to keep wget in "this-directory-or-below".

Yeah, I learned my lesson the hard way as well. I RTFM from then on
:-)

>If you like, I can give you a few more tips. Although, I may remember
>a few options incorrectly, so you may want to look at the info-pages
>(or man-pages) of wget.

[snipped a wealth of knowledge I never would've figured out on my own]

>Good luck with your downloading.

Koppe, I sincerely thank you for your time and courtesy. I have your
post saved in my wget dir so I can refer to it like a manual. Thanks
again.



Relevant Pages

  • Re: Free Metalworking Plans
    ... NRA LOH & Endowment Member, Golden Eagle, Patriot"s Medal. ... | I Dl'd the lathe plans, ... Use something like Wget ... or some other worthy download manager to retrieve it. ...
    (rec.crafts.metalworking)
  • Wget usage : request for comments
    ... I am going to start a small project to analyze ... 8 websites with hyperlinks, images, js, etc.. ... I will use wget as a crawler (I like command ... seems I can't download the results in text format. ...
    (comp.os.linux.misc)
  • I/O or CPU bandwidth issue or wget issue or perhaps isp???
    ... negligible when I start wget. ... a while chokes as above. ... The download speeds fluctuate as low as a few hundred ...
    (Fedora)
  • Re: I/O or CPU bandwidth issue or wget issue or perhaps isp???
    ... negligible when I start wget. ... a while chokes as above. ... The download speeds fluctuate as low as a few ...
    (Fedora)
  • Re: JScript question
    ... GNU Wget is a free utility for non-interactive download of files from the Web. ... It supports HTTP, HTTPS, and FTP protocols, as well as retrieval through HTTP proxies. ... Thus Wget can see if the remote file has changed since last retrieval, and automatically retrieve the new version if it has. ... it will instruct the server to continue the download from where it left off. ...
    (microsoft.public.scripting.jscript)