Re: Re: Can't Defrag Ext3 File System-No Problem!

From: Leonard Chatagnier (lenc_at_ruralcomm.com)
Date: 05/23/05

  • Next message: Clive Menzies: "Re: poor font rendering in white-over-black (eg Mutt)"
    Date: Mon, 23 May 2005 09:08:56 +0000
    To: debian-user@lists.debian.org
    
    

    Thanks to everyone who patiently helped me to remove all my scepticism
    about defragging a linux system. I am
    convinced and Carlos Rodrigues' explanation of how a linux/unix fs works
    went a long way in doing this. I'm going to remove/purge e2defrag from
    my HD and just forget about defragging although I might look into
    dump/restore just in case my system falls into one of those exceptional
    cases as I'm alittle tight of space.
    I don't consider my post any waste of time as it should help convince
    other former mswindows users who just
    know as I did once that at some point in time all hard drives had to be
    defragged. Again, thanks to all of
    you for adding a little more knowledge and understanding of how linux
    works. I've long known about the shortcommings of Dos/Windows just
    didn't know any details about the advantages of other operating systems.

    Leonard Chatagnier

    Leonard Chatagnier wrote:

        Thanks for the reply as I would like to get to the bottom of this.
        ...snipped

    It is a trivial amount. On ext3 filesystems with some fairly regular use
    you should see fragmentation always around 5%. This is normal, and has
    no impact in performance.

    On DOS filesystems, the defrag program puts everything on the start of
    the drive. You may think that this is good for performance, but consider
    this:

    - When a file has to be extended (after the fs having been defragged),
    the next block will be put after all the other files. This will is much
    worse than having a small amount of fragmented files on an ext3 fs,
    which will have all their blocks somewhat near.

    This means that 5% fragmentation on an ext3 fs means basically nothing,
    whereas it may mean some performance degradation on a DOS fs.

        Can you elaborate on why extension 3 file systems wont become
        fragmented over time.

    *nix filesystems in general distribute files and their blocks in the fs,
    in ways that let them grow over time and reduce fragmentation. This
    could mean that some blocks are left free after some files are created,
    or that writes are deferred slightly in order to better know where to
    allocate new blocks and know if the file has potential to grow a lot or not.

    Every fs has its own way to do it, but they don't suffer from
    performance degradation from fragmentation. Period.

    Actually, there is one situation where this may actually happen: on very
    active filesystems, with almost no free space.
    In this case, fragmentation becomes an issue, but this mostly _never_
    happens in real life, and when it does... dump/restore (move everything
    somewhere else, and then move it back).

        Do I have to revert to ext 2 fs in order to defrag a hard drive
        safely? Debian appears to put out the message that ext3 file system
        is the greatest yet I don't seem to be able to use any utilities to
        maintain it.

    You can't use e2defrag, which hardly qualifies as "any utilities".

    Let me state this one more time: e2defrag is merely a proof-of-concept,
    nobody actually uses it (which is why it doesn't support the latest
    additions to ext3).

    I know it is difficult to accept this, coming from a Windows background,
    but this is how things work in the unix world (or everywhere besides
    MS-land, for that matter).

        Or if asking for comments on this is more than you care to do,
        perhaps you can offer some references(normal human readable types)
        that explains my concerns.

    The references on this are mostly highly technical, and you can find a
    bunch of those by googling. But sometimes the best way to is just to try
    and forget the habits learned on MS-land and adopt a wait-and-see approach.

    Just let your filesystems be, and in time you will realise that they
    works very well without the rituals you are used to perform on your
    Windows systems.

    I know what I'm talking about, because I already asked the same
    questions you are asking now and it took me quite some time to finally
    believe it to be true.

    And after 8 years using Linux all the time, I came to find the MS-land
    rituals somewhat exotic (if unix filesystems take care of themselves,
    why can't the so called New Technology File System?).

        Why does Debian put out programs that will trash the system without
        at least giving some warning?

    If it didn't give any warning, you would have a trashed fs by now.
    Refusing to work is enough warning, if you ask me.

    Just to finish, I understand you wanting to know more before believing
    what we are saying, but understand that this is something that most unix
    folks know as fact, proven by everyday experience.

    Most people don't actually know the specifics on why this is so, but
    know that their many-years-old filesystems don't turn slow just from
    using them.

    Carlos Rodrigues

    -- 
    To UNSUBSCRIBE, email to debian-user-REQUEST@lists.debian.org 
    with a subject of "unsubscribe". Trouble? Contact listmaster@lists.debian.org
    

  • Next message: Clive Menzies: "Re: poor font rendering in white-over-black (eg Mutt)"

    Relevant Pages

    • Re: Cant Defrag Ext3 File System
      ... On ext3 filesystems with some fairly regular use ... This means that 5% fragmentation on an ext3 fs means basically nothing, ... whereas it may mean some performance degradation on a DOS fs. ...
      (Debian-User)
    • Re: Follow up to defrag validity discussion: please read
      ... lots of people out there giving false info if what you say is correct, ... major problem in the DOS/Windows world (*nix and other systems all ... handle fragmentation far better, and always have done). ... Therefore defragging makes a difference"). ...
      (comp.sys.ibm.pc.hardware.storage)
    • Re: Question about fragmentation and moving folders . . .
      ... My question is: Will this cause fragmentation? ... use a stopwatch to notice any difference in speed, ... (I'm now bracing myself for the backlash from the defragging ... It does not care in the least where on the disk it finds the ...
      (microsoft.public.win2000.file_system)
    • Re: Follow up to defrag validity discussion: please read
      ... false information on many subjects in IT - fragmentation is only one ... only /you/ can say if defragging makes a difference for ... proper documented tests that someone else does and those that wont ... likely wont be convinced by their own tests anyway or even be capable ...
      (comp.sys.ibm.pc.hardware.storage)
    • Re: How do you defrag a PVR?
      ... My Thomson DHD4000 has a format option buried away in the engineering menu. ... In the normal run of events, deleting files will naturally tend to eliminate any fragmentation that accumulates. ... PVR filesystems differ from PC filesystems in that they hold only a fairly small number of very large files, and these typically get watched and then deleted. ...
      (uk.tech.tv.video.pvr)