Re: Please Help W/Wget.

From: Alan Connor (zzzzzz_at_xxx.yyy)
Date: 11/26/03 

Date: Wed, 26 Nov 2003 08:58:55 GMT

On Sat, 22 Nov 2003 19:40:18 +0100, Baard Ove Kopperud <bokoppeNOSpamHere@frisurf.no> wrote:

<snip>

Great stuff, Baard. I've saved both of your posts.

-----------------------------------------------------------------

The OP may be interested in this, which I just learned today. It brings
down the first 100 hits for a google search:

wget -U msie 'http://www.google.com/search?q=whatever&num=100'

(replace "whatever" with your search string, in quotes if any spaces)

-----------------------

What I can't figure out is how to get wget to bring down the next 1 or
more pages of hits. It's driving me bananas!

I thought --follow-tags=list would work, because the links for the next
pages are unique, but no luck. Apparently they aren't in its internal
list of tags.

(Google apparently has a limit of 100 on the number of hits it will return
in a single document: num=200 still only returns a 100 hits.)

Do YOU know?

AC

Relevant Pages

  • Scaling JPG files
    ... I have done a Google search on this, and the hits seem to indicate ... reading in the whole JPG file (and then reading it again when it's ...
    (microsoft.public.dotnet.framework.aspnet)
  • Re: Can anyone enlighten me on daylight lamps
    ... I did google search and saw a bunch of sites ... > one stresses on the health of the eyes. ... Adding the required word: sale ... slims the hits to 7,760. ...
    (sci.chem)
  • Re: Please Help A Newbie - Running Totals
    ... I had never thought of using the link from the whole Google search ... Opened up my SnipURL shortcut and got a shortcut to the site with all ... If I wanted to direct OP to just one of those hits, ... and then snipped and posted the single hit URL. ...
    (microsoft.public.excel.misc)
  • Re: Kerry Screws the Dems
    ... Ann Coulter - Intervention Magazine, ... I did a Google search and found very little - just a few blogs ... Magazine and don't get hits on the text you posted. ...
    (rec.sport.golf)
  • Re: Google
    ... Everyone Click-On the # 3 Link in this Google Search ... It counts hits from unique IP addresses. ... If you search "Michael A. Terrell" in quotes, ...
    (rec.radio.shortwave)