Re: experiences beyond 4 GB RAM with 2.4.22

From: Rogier Wolff (R.E.Wolff_at_BitWizard.nl)
Date: 09/17/03

  • Next message: Meelis Roos: "Re: df hangs on nfs automounter in 2.6.0-current"
    Date:	Wed, 17 Sep 2003 12:42:30 +0200
    To: Jens Axboe <axboe@suse.de>
    
    

    On Wed, Sep 17, 2003 at 12:26:29PM +0200, Jens Axboe wrote:
    > On Wed, Sep 17 2003, Rogier Wolff wrote:
    > > On Tue, Sep 16, 2003 at 03:36:14PM +0100, Alan Cox wrote:
    > > > I/O is a real pain. Also in some cases it might be interesting to try
    > > > using the extra RAM above the 4G boundary as a giant ram disk and using
    > > > it as first swap device.
    > >
    > > 4G? Above 4G? The limit should be configurable a lot earlier.
    > >
    > > I'd want to configure that on the machines I'm installing tomorrow.
    > > 4G RAM, but I'd rather not use the highmem stuff. I think the workload
    > > that this machine is likely to get will work very well with this setup.
    > >
    > > Why does this have the opportunity to work better than just using the
    > > 2 or 4G of RAM? Because after you've used the bottom 1G, that might
    > > just remain there, requiring lots of IO to go through bounce buffers
    > > and memory remappings. By considering the top part of RAM as swap,
            ^^^^^^^^^^^^^^^^^
    > > you'll force the important stuff into the more easily accessable
    > > RAM (Compare to fastram as it was called on the Amiga!).
    >
    > You are misunderstanding the problem. You don't use bounce buffers just
    > because the page happens to reside in high memory, it is only used if
    > the hardware cannot DMA to it. And that is exactly the problem here with
    > the 3ware adapter, it cannot dma to > 4GB. So in a 6GB setup (with
    > potentially 5G of highmem), only the last 2G requires bouncing.

    As I understand things (But this is from following discussions on
    linux-kernel from afar, not from personal poking at the code!) there
    is also a performance penalty for the kernel not having direct
    physically mapped access to RAM. We map up to 3G of virtual memory of
    userspace, and up to 1Gb of physical RAM into the kernel memory map
    for performance reasons. So if I have 2G RAM and want to keep 3G
    userspace, I have to use some "highmem" stuff right?

    This will not directly require the use of bounce buffers, but it will
    require the kernel to remap regions when it needs to access them.

    If this doesn't have a performance impact, why do I have the option of
    directly mapping 1G, 2G, or 3G?

                            Roger.

    -- 
    ** R.E.Wolff@BitWizard.nl ** http://www.BitWizard.nl/ ** +31-15-2600998 **
    *-- BitWizard writes Linux device drivers for any device you may have! --*
    **** "Linux is like a wigwam -  no windows, no gates, apache inside!" ****
    -
    To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
    the body of a message to majordomo@vger.kernel.org
    More majordomo info at  http://vger.kernel.org/majordomo-info.html
    Please read the FAQ at  http://www.tux.org/lkml/
    

  • Next message: Meelis Roos: "Re: df hangs on nfs automounter in 2.6.0-current"

    Relevant Pages

    • [PATCH 2.6.24] mm: BadRAM support for broken memory
      ... This is the latest version of the BadRAM patch, ... run Linux on broken memory. ... a new kernel appeared, ... the BadRAM subsystem dealing with statically challanged RAM modules. ...
      (Linux-Kernel)
    • Re: Patch 4/6 randomize the stack pointer
      ... > it," so perhaps this would be a good compromise. ... less than 512M of memory to keep track of. ... what about the case where you have gobs of RAM and need a highmem ... Kernel data structures, no. ...
      (Linux-Kernel)
    • Re: Allocating kernel memory
      ... > I never complained about the real memory that was used but pointed out ... > that a large portion of the kernel virtual address space is used up. ... RAM you should avoid PAE, ... But it was limited to 1GB of physical RAM. ...
      (comp.os.linux.development.system)
    • Re: Newbie Setting up xserver
      ... Could be, but now that I know that low memory is causing the problem, I will ... The kernel gobbles up the rest of the physical memory huh. ... Actually my RAM is split into two ... >it could be that some of the processes related to setting the timezone ...
      (comp.os.linux.setup)
    • Re: OS-question
      ... MacOS X supports>4GB of RAM on IA32 and so does FreeBSD but I don't know ... Linux can use up to 64 Gigabytes of physical memory on x86 systems. ... If you are compiling a kernel which will never run on a machine with ...
      (comp.arch)