Re: updatedb for very large filesystems



On 2008-10-01 13:15 +0200, Mag Gam wrote:

I was wondering if its possible to run updatedb on a very large
filesystem (6 TB). Has anyone done this before?

I don't have such luxurious filesystems, but it should certainly be
possible. It's just a matter of time (the number of files is what
really counts, not the size of the filesystem).

I plan on running this
on a weekly basis, but I was wondering if updatedb was faster than a
simple 'find'. Are there any optimizations in 'updatedb' ?

The implementation of updatedb mlocate package has an important
optimization, it reuses old entries for directories whose mtime didn't
change since the last run. So the second and subsequent runs should be
considerably faster than the first. Note, however, that mlocate is not
available in Etch.

The findutils version may be too slow to be run on a weekly basis on
systems with many millions of files.

Sven


--
To UNSUBSCRIBE, email to debian-user-REQUEST@xxxxxxxxxxxxxxxx
with a subject of "unsubscribe". Trouble? Contact listmaster@xxxxxxxxxxxxxxxx



Relevant Pages

  • Re: updatedb for very large filesystems
    ... not the size of the filesystem). ... Are there any optimizations in 'updatedb'? ... The implementation of updatedb mlocate package has an important ... To UNSUBSCRIBE, email to debian-user-REQUEST@xxxxxxxxxxxxxxxx ...
    (Debian-User)
  • Re: updatedb for very large filesystems
    ... Are there any optimizations in 'updatedb'? ... canned list of files from a part of the filesystem that never changes. ... -- Thomas Jefferson ... To UNSUBSCRIBE, email to debian-user-REQUEST@xxxxxxxxxxxxxxxx with a subject of "unsubscribe". ...
    (Debian-User)
  • Re: updatedb for very large filesystems
    ... I am more interesting is searching a large Networked filesystem. ... I was wondering if its possible to run updatedb on a very large ... To UNSUBSCRIBE, email to debian-user-REQUEST@xxxxxxxxxxxxxxxx with a subject ...
    (Debian-User)
  • Re: -mm merge plans for 2.6.23
    ... > I'd just like updatedb to amortize its work better. ... > accurate index on the filesystem. ... http://sourceforge.net/projects/rlocate/ - Source Forge Project Summary ...
    (Linux-Kernel)
  • Re: [ck] Re: -mm merge plans for 2.6.23
    ... > I'd just like updatedb to amortize its work better. ... > accurate index on the filesystem. ... That's not fun with inotify, and that's just my home directory. ...
    (Linux-Kernel)