Large number of files in single directory

From: Chris (redhat-list_at_dotcomdesigners.com)
Date: 05/25/05

  • Next message: Anthony Leung: "RE: streaming audio/video on linux"
    To: <redhat-list@redhat.com>
    Date: Wed, 25 May 2005 10:18:47 -0700
    
    

    There seems to be a filesystem limitation on most flavors of Linux I've
    worked on, in terms of a max number of files in a single directory - before
    tools like tar, gzip, rm, mv, cp and others stop working properly. For
    example, I have some users that have 2000+ files in a single directory (some
    as many as 10,000 files) and trying to tar these directories is always
    coming up with "argument list too long."

    Is there a way for tar and these other tools to "see" all these files and
    process them as normal? I recall once I had to resort to something like
    "find . -print | xargs rm -fr" to remove thousands of files from a single
    directory. Is doing something similar but replacing "rm" with "tar" the
    only way to make this work, or does tar have some sort of command line
    switch (I couldn't find one) to work with extremely long argument lists?

    Chris

    -- 
    redhat-list mailing list
    unsubscribe mailto:redhat-list-request@redhat.com?subject=unsubscribe
    https://www.redhat.com/mailman/listinfo/redhat-list
    

  • Next message: Anthony Leung: "RE: streaming audio/video on linux"

    Relevant Pages

    • Re: Large number of files in single directory
      ... Tom - forget the "by character" method... ... Chris ... Large number of files in single directory ... > tools like tar, gzip, rm, mv, cp and others stop working properly. ...
      (RedHat)
    • RE: Large number of files in single directory
      ... in terms of a max number of files in a single directory - ... > tools like tar, gzip, rm, mv, cp and others stop working properly. ... Do You Yahoo!? ... Mail has the best spam protection around ...
      (RedHat)
    • Re: Large number of files in single directory
      ... > There seems to be a filesystem limitation on most flavors of Linux I've ... in terms of a max number of files in a single directory - before ... > tools like tar, gzip, rm, mv, cp and others stop working properly. ... This is beacue of the limit of the length of the command line. ...
      (RedHat)
    • RE: Large number of files in single directory
      ... Large number of files in single directory ... tools like tar, gzip, rm, mv, cp and others stop working properly. ... switch to work with extremely long argument lists? ... unsubscribe mailto:redhat-list-request@redhat.com?subject=unsubscribe ...
      (RedHat)
    • SOLVED Disk-Performace issue?
      ... The copying from all 523000 files has used over 7MB ... >> by copying the files from one disk to another or an direktory on the ... > Directories are kept as lists. ... > single directory. ...
      (freebsd-stable)