Re: too many files....



Unruh <unruh-spam@xxxxxxxxxxxxxx> wrote:
I simply do not believe that directory lookup is a significant time on any
filesystem, even if he has 100,000 files ( which I do not believe. At 100K
for size, that would be over 10GB. )

I can believe it. I noticed a slowdown of a FAT filesystem with
only 2000-odd entries in one directory. Admittedly, that was FAT on a
crappy old 5400 RPM drive...not what I would recommend for high
performance!


Sounds much more likely-- that he is doing something non-optimally.

I agree. Most software is just not written for maximal performance,
IME. The question is when it's worthwhile to try and wring more
performance out of the same hardware, and when it's more worthwhile just
to go buy faster hardware. Then again, there may be a simple fix - if
the software is doing an unnecessary stat() on every file or whatever,
there you go.

--
Oh to have a lodge in some vast wilderness. Where rumors of oppression
and deceit, of unsuccessful and successful wars may never reach me
anymore.
-- William Cowper
.



Relevant Pages

  • Re: too many files....
    ... Jeremiah DeWitt Weiner wrote: ... filesystem, even if he has 100,000 files (which I do not believe. ... to go buy faster hardware. ... is LINUX tuneable in The number of directory entries and simultaneous file handles it caches/can handle? ...
    (comp.os.linux.misc)
  • Re: [opensuse] cant mount USB dribe /dev/sdb1
    ... Verify that it is in fact a FAT filesystem. ... that might only tell you that it is a block device. ... The blkid program is the command-line interface to working with the ...
    (SuSE)
  • Re: NTFS For Mac OSX
    ... I use it only for transport of temporary copies. ... years since I first started working with the FAT filesystem I've had ... The 4gig stick in my mobile phone uses FAT, ... filesystem. ...
    (uk.comp.sys.mac)
  • Re: Mount problems
    ... the directory listing shows ... Force uppercase characters in filenames to lowercase ... when reading them from the filesystem. ... I don't know how to specify this for a FAT filesystem ...
    (comp.unix.bsd.openbsd.misc)
  • Re: FreeCP/M
    ... Support for hierarchical filesystem (Z80 FAT16 implementation already ... The CP/M-86 4.1 api seems to support directories though only on FAT ... free implementation of the FAT filesystem. ...
    (comp.os.cpm)