Re: [SLE] wget confusion...

From: Randall R Schulz (rschulz_at_sonic.net)
Date: 10/30/05

  • Next message: mike: "Re: [SLE] Parsing of undecoded UTF-8 will give garbage..." 
    To: suse-linux-e@suse.com
Date: Sun, 30 Oct 2005 07:26:08 -0700

    Anders,

    On Saturday 29 October 2005 23:19, Anders Norrbring wrote:
    > I'm a bit confused by the behavior of wget... I've issued the command
    >
    > wget -m -k -K -np http://host.domain.tld/directory/
    >
    > on a box to backup a site completely, but after what I can see, wget
    > loops this indefinately, am I right?

    Is it possible that the modification time returned is not that of the
    underlying files, but rather the current time? I think this will
    subvert wget's cycle-breaking logic, 'cause when it comes around to
    download a given file a second time and it appears to have changed
    (later mod time than the previous download), it will retrieve that file
    again and the files it refers to again. The result: An infinite loop.

    > My intention was that it should do one round, and then exit, but it
    > seems like it just goes on...

    Normally it works, as long as the graph formed by the hyperlinks is
    bounded, either intrinsically or because you gave options that cut off,
    say, links that go off-site or outside the hierarchy at which you
    initiated the retrieval.

    > --
    >
    > Anders Norrbring

    Randall Schulz 

    -- 
Check the headers for your unsubscription address
For additional commands send e-mail to suse-linux-e-help@suse.com
Also check the archives at http://lists.suse.com
Please read the FAQs: suse-linux-e-faq@suse.com
  • Next message: mike: "Re: [SLE] Parsing of undecoded UTF-8 will give garbage..."

    Relevant Pages

    • Re: [SLE] wget confusion...
      ... >>I'm a bit confused by the behavior of wget... ... I've issued the command ... >, it will retrieve that file ... Anders ...
      (SuSE)
    • Re: how to use the wget command to copy whole website to local
      ... so that I use wget -r to try to download it. ... maybe it would help if you tell us the command line you used. ... Allman Professional Consulting, Inc., www.allmanpc.com ...
      (Fedora)
    • Re: JScript question
      ... GNU Wget is a free utility for non-interactive download of files from the Web. ... It supports HTTP, HTTPS, and FTP protocols, as well as retrieval through HTTP proxies. ... Thus Wget can see if the remote file has changed since last retrieval, and automatically retrieve the new version if it has. ... it will instruct the server to continue the download from where it left off. ...
      (microsoft.public.scripting.jscript)
    • Re: FTP Commands
      ... mdelete * command, The problem with this is that there is the ... download and deletion commands, meaning that files can be missed. ... How about using a different tool than Microsoft's FTP, like WGET. ... could invoke WGET twice, the second time with the "-N," or ...
      (microsoft.public.windowsxp.general)
    • Re: wget (how to use)?
      ... used this method so I am just using the command he used, ... Looks to be a 15 hour ETA download, ... sleep, then resume the wget download tomorrow. ... Continue getting a partially-downloaded file. ...
      (alt.os.linux)