Re: A script for scanning the internet for one particular index.html?
- From: markhobley@xxxxxxxxxxxxxxxxxxxxxxxx (Mark Hobley)
- Date: Sun, 23 Sep 2007 11:08:22 GMT
Tee Jay <support@xxxxxxxxxx> wrote:
I want to know how I make a script for scanning the entire internet
(127.0.0.1 - 255.255.255.255)
That is not the entire internet, as already mentioned.
An alternative approach might be to find some sort of fingerprint (unique
segment) in the index file, and utilize a search engine (such as google) to try
and match the fingerprint. (The search engine may provide an API that can be
utilized.)
The search will of course be limited to pages indexed by the search engine,
but you will need a lot of computing power and sufficient bandwidth if you
want to outperform google. (There are billions of pages to process.)
Regards,
Mark.
--
Mark Hobley
393 Quinton Road West
QUINTON
Birmingham
B32 1QE
Email: markhobley at hotpop dot donottypethisbit com
http://markhobley.yi.org/
.
- References:
- Prev by Date: Re: Kermit - How do I escape to a local kermit from a telnet session?
- Next by Date: Re: Kermit - How do I escape to a local kermit from a telnet session?
- Previous by thread: Re: A script for scanning the internet for one particular index.html?
- Next by thread: easy way to limit the network bandwidth among users
- Index(es):
Relevant Pages
|
