Re: Elastic Quota File System (EQFS)

From: Olaf Dabrunz (od_at_suse.de)
Date: 06/24/04

  • Next message: Andries Brouwer: "Re: [ANNOUNCE] linux-libc-headers 2.6.7.0"
    Date:	Thu, 24 Jun 2004 15:51:23 +0200
    To: Sam Elstob <samelstob@fastmail.fm>
    
    

    On 24-Jun-04, Sam Elstob wrote:
    > Amit
    >
    > I agree that the situation with 10000+ users is where such a filesystem
    > becomse useful. It is the difference between actual disk usage and sum
    > of all disk quota that provides the elastisicty.
    >
    > Imagine an ISP providing free mail with an advertised quota of 1GB per
    > user. With 100,000 users, 100TB of storage would be needed. However,
    > it is likely that most users would not use their full quota meaning a
    > lot of wasted storage capacity, at the expense of the mail provider.
    > What if the EFS could allow the sum of all advertised quotas to total
    > more than the actual online disk capacity. Assuming average quota usage
    > settles down and doesn't suddenly change on mass the actual online
    > storage capacity of the system could be much lower (and thus cheaper)
    > than the case where every user is at full quota. When the actual disk
    > usage reaches, say 70%, of the attached capacity the administrator could
    > be notified and action taken e.g. attach more disks and extend the
    > volume, or backup and delete dead accounts.

    This case is easily solved without any new mechanism. Simply assign a
    quota of 1GB to each user while providing physical disk space only for
    the expected filling + free space margin. Handle additional space
    requirements as you described above.

    What Amid tries to solve is obviously a different "scenario": how to put
    more files on the disks than fit in the physically available space.

    He tries to do that by
       - squeezing in more data by compressing other data
       - deleting files
       - backing up files

    And he provides a mechanism how a user can buy more space by marking
    other files as "shrink/delete/back up at filesystems discretion". So in
    effect he says: buy more space by marking files as "not needed, may be
    removed (deleted or moved to some unreachable place) at any time". Then
    I would rather opt to "clean up" my files myself whenever I need more
    space within my quota.

    (The compression case is actually not working out, since it will only
    get back as much space as the compression achieves. So the elastic quota
    may only be expanded by the space saved when the file is compressed. To
    find out this ratio, you have to compress the file. But then you can as
    well have your filesystem transparently compress the file.)

    > I'm talking about the case where large (10000>) numbers of users are
    > involved with a habit of using less than some advertised quota.
    > Obviously the adverised quota is still available to those who want it,
    > but overall the necessary disk space is less than the sum of all
    > advertised disk quotas.
    >
    > Sam Elstob

    -- 
    Olaf Dabrunz (od/odabrunz), SUSE Linux AG, Nürnberg
    -
    To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
    the body of a message to majordomo@vger.kernel.org
    More majordomo info at  http://vger.kernel.org/majordomo-info.html
    Please read the FAQ at  http://www.tux.org/lkml/
    

  • Next message: Andries Brouwer: "Re: [ANNOUNCE] linux-libc-headers 2.6.7.0"

    Relevant Pages

    • Re: Quota and who is using my drive?
      ... I am afraid of that we can not set a specific folder's quota. ... quota feature is designed to limit disk usage of users. ... Microsoft CSS Online Newsgroup Support ... >permissions to the folder. ...
      (microsoft.public.windows.server.sbs)
    • RE: mapped drive size
      ... Is "Disk Quota" enabled on the drive on which the share folder is stored? ... Log event when a user exceeds their quota limit is checked. ... If a volume has multiple folders, the quotas assigned to that volume apply ...
      (microsoft.public.windows.server.sbs)
    • Re: Not enough free space, disk full
      ... Im not sure here but I also think that this quota limit not only applies ... It applies on that whole disk that has quota enabled. ... Shared Folder by default while it applies the 1GB limit to these folders, ... network shared folder created in the Users Shared Folder? ...
      (microsoft.public.windows.server.sbs)
    • RE: Quota Entries
      ... disk quotas track and control the amount of disk ... you may also want to deny additional disk space ... To Enable Disk Quota Management ... Microsoft CSS Online Newsgroup Support ...
      (microsoft.public.windows.server.sbs)
    • Re: [opensuse] Re: compress? uncompress? Why are they gone? - With a twist towards the future
      ... that way unless the file is re-requested from disk ... Novell Netware introduced compression - turned on by ... organisations is still storing data files on local PC ... user would go over quota and all sorts of grief ensued. ...
      (SuSE)