wget mirror question
- From: knorr.orange@xxxxxxxxx
- Date: 7 Apr 2007 00:00:40 -0700
I am working at a school with recently acquired Internet access but
with very poor bandwidth. We have a network with many computers but
if we allowed all computers to access the Internet concurrently it
would be worthless.
I would like to create an internal mirror (updated nightly) of several
news sites that are commonly accessed though. I have tried using
wget, and it works well except that I am having problems with URL's.
In my local mirror copy of a page, the URL's do not match up. Can
someone help me with the proper arguments for wget (or curl I suppose)
to get this working?
My ideal end product is a directory structure something like this:
/mirror
/mirror/cnn
/mirror/bbc
/mirror/chicagotribune
With each news site being dumped into its respective directory
(recursing one level deep). I can get that all working fine and
loaded up in apache but when I click a link from one of the mirrored
pages, the relative URL is wrong since my directory structure will
always be different.
Would appreciate any help on this or alternative solutions. Thanks.
.
- Follow-Ups:
- Re: wget mirror question
- From: Baho Utot
- Re: wget mirror question
- Prev by Date: bg a foreground process, pipe output?
- Next by Date: Re: Downgrade from 2.6 to 2.4?
- Previous by thread: bg a foreground process, pipe output?
- Next by thread: Re: wget mirror question
- Index(es):
Relevant Pages
|