Re: ext3 File System Performance Issue

Hi,

<ellis@xxxxxxx> wrote in message news:1174637029.926183@xxxxxxxxxx
In article <eu002s$kts$1@xxxxxxxxxxxxxxxxx>,
LaBird <wlcheung1975@xxxxxxxxx> wrote:

I am writing a program which generates lots of temp files,
and need to remove the unneeded ones (to save disk space)
during execution. Currently I put them into the /tmp directory,
but I found the performance very slow, especially during the
file remove phase when the number of files generated is large.
(Each file size is small, at a maximum of 16KB, though.)

Have you consider that your design just might be the real
problem here?

Yes, I am trying to make some optimizations here. For example,
by merging a few files as one, and more importantly, put files
into different directories. But for the latter approach, I'd like to
know how many files should be put in one directory for optimal
performance. That's why I have the question in the 2nd paragraph
of my first thread.

But I cannot prevent writing files or removing them during
execution, because my application generates much data and the
problem size is large.

Best Regards,
LaBird (Benny).
[Remove all numbers for the actual email address].



.

Relevant Pages

  • Re: ext3 File System Performance Issue
    ... LaBird wrote in part: ... and need to remove the unneeded ones (to save disk ... space) during execution. ... Does mounting the FS with `noatime` improve things?" ...
    (comp.os.linux.development.system)
  • Re: ext3 File System Performance Issue
    ... LaBird wrote: ... a better design. ... man 2 truncate ...
    (comp.os.linux.development.system)
  • Re: ext3 File System Performance Issue
    ... I am writing a program which generates lots of temp files, ... and need to remove the unneeded ones (to save disk space) ... during execution. ...
    (comp.os.linux.development.system)