Wget hangs: process never terminates



Hello all.

I use wget in a a shell script to do some offsite backup stuff, so the
script is kicked off using cron. However, ever time - wget hangs in the
middle of downloading a file! The result is, I get a partially
downloaded file and the cron job NEVER terminates.
I ran just the wget command from a shell with degug output to see what
I could see, but nothing of interest is shown! It shows the dl
progress, then sometime in the middle (arbitrary) - wget just hangs...
the estimated time goes to infinity and file never completes and wget
does not terminate!! After I Ctrl-C, then re-run wget with the -c
option, the dl picks up from where it left off and the file is
eventually downloaded.

Specifics: File is 800MB in size coming over a 1.5Mb connection using
http.

Can someone please offer advice as how to fix this?? I would have
thought that wget would be more robust and I would try curl, but I've
seen curl do this same thing before too (with urpmi). My other thought
was to have ANOTHER cron job run that finds the hung wget job,
terminates it, then re-runs wget with the -c option... but thats kinda
messy.
Can anyone suggest anything??

TIA, any help would be GREATLY appreciated!!

-Mike

.



Relevant Pages

  • Re: Wget hangs: process never terminates
    ... I use wget in a a shell script to do some offsite backup stuff, ... downloaded file and the cron job NEVER terminates. ... Can you try ftp or some protocol other than http? ...
    (comp.os.linux.misc)
  • Re: WGET Problem
    ... > Can I just use WGET not cron schedule a download task every hour for ... # end of hourly wget script. ... I would use cron though... ...
    (comp.unix.admin)
  • Re: Daily download query
    ... What is the simplest way to do this? ... What about a cron job calling wget? ...
    (alt.os.linux.suse)
  • Re: Wget hangs: process never terminates
    ... I use wget in a a shell script to do some offsite backup stuff, ... file and the cron job NEVER terminates. ... ANOTHER cron job run that finds the hung wget job, terminates it, then ...
    (comp.os.linux.networking)
  • Wget hangs: process never terminates
    ... I use wget in a a shell script to do some offsite backup stuff, ... downloaded file and the cron job NEVER terminates. ... terminates it, then re-runs wget with the -c option... ...
    (comp.os.linux.misc)