Re: Active Memory Defragmentation: Our implementation & problems

From: Timothy Miller (miller_at_techsource.com)
Date: 02/04/04

  • Next message: Juergen E. Fischer: "Re: Problem with module-init-tools-3.0-pre3"
    Date:	Wed, 04 Feb 2004 14:37:53 -0500
    To: root@chaos.analogic.com
    
    

    Richard B. Johnson wrote:

    > If this is an Intel x86 machine, it is impossible for pages
    > to get fragmented in the first place. The hardware allows any
    > page, from anywhere in memory, to be concatenated into linear
    > virtual address space. Even the kernel address space is virtual.
    > The only time you need physically-adjacent pages is if you
    > are doing DMA that is more than a page-length at a time. The
    > kernel keeps a bunch of those pages around for just that
    > purpose.
    >
    > So, if you are making a "memory defragmenter", it is a CPU time-sink.
    > That's all.

    Would memory fragmentation have any appreciable impact on L2 cache line
    collisions?

    Would defragmenting it help?

    In the case of the Opteron, there is a 1M cache that is (I forget) N-way
    set associative, and it's physically indexed. If a bunch of pages were
    located such that there were a disproportionately large number of lines
    which hit the same tag, you could be thrashing the cache.

    There are two ways to deal with this: (1) intelligently locates pages
    in physical memory; (2) hope that natural entropy keeps things random
    enough that it doesn't matter.

    -
    To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
    the body of a message to majordomo@vger.kernel.org
    More majordomo info at http://vger.kernel.org/majordomo-info.html
    Please read the FAQ at http://www.tux.org/lkml/


  • Next message: Juergen E. Fischer: "Re: Problem with module-init-tools-3.0-pre3"

    Relevant Pages

    • Re: Cached memory never gets released
      ... Stock linux 2.4.26 kernel. ... Due to flash bug 3M of memory gets lost due to font memory getting lost ... The output of "free" cache number steadily grows. ... longer to exhaust all of system memory with the cache. ...
      (Linux-Kernel)
    • Re: Explorer unresponsive
      ... Jeff Stanton wrote: ... boxes before Peak Memory Usage and Virtual Memory size. ... Volume fragmentation ... Event Viewer: Event Type: Error ...
      (microsoft.public.windowsxp.basics)
    • Re: Explorer unresponsive
      ... Jeff Stanton wrote: ... boxes before Peak Memory Usage and Virtual Memory size. ... Volume fragmentation ... Event Viewer: Event Type: Error ...
      (microsoft.public.windowsxp.basics)
    • Re: Watching Virtual Memory
      ... where the undo feature will hold large amounts of information in memory ... files are often not easily defragmented by Disk Defragmenter. ... Is System Restore monitoring your D and E drives. ... Volume fragmentation ...
      (microsoft.public.windowsxp.general)
    • Re: Explorer unresponsive
      ... before Peak Memory Usage and Virtual Memory size. ... The Commit Charges figures from Task Manager are less than your RAM. ... Volume fragmentation ... the System and Application logs in Event Viewer for the last boot. ...
      (microsoft.public.windowsxp.basics)