Re: Over used cache memory?

jlnance_at_unity.ncsu.edu
Date: 11/06/03

  • Next message: Prakash K. Cheemplavam: "Re: 2.9test9-mm1 and DAO ATAPI cd-burning corrupt" 
    Date:	Thu, 6 Nov 2003 08:40:31 -0500
To: linux-kernel@vger.kernel.org

    On Thu, Nov 06, 2003 at 10:11:50AM +0100, Helge Hafting wrote:
    >
    > Yes - _use_ the memory for something else.
    > 1. All unused memory will be put to good use as cache.
    > 2. Memory is taken from the cache whenever you need it for
    > something else, so (1) is not a problem at all.

    This is the way it is susposed to work, but I am working on a problem
    where this does not seem to be happening. We have a machine with 6G
    of ram. It reads some huge files (~5G) and cache fills up. Then
    it starts to process the data and goes into a swap storm because it
    can not get any memory for the process because it all is in the cache.
    If you run top, you see kswapd stuck at the top.

    If anyone has any ideas about this, I would love to hear them.

    Thanks,

    Jim
    -
    To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
    the body of a message to majordomo@vger.kernel.org
    More majordomo info at http://vger.kernel.org/majordomo-info.html
    Please read the FAQ at http://www.tux.org/lkml/

  • Next message: Prakash K. Cheemplavam: "Re: 2.9test9-mm1 and DAO ATAPI cd-burning corrupt"

    Relevant Pages

    • Re: Cached memory never gets released
      ... Stock linux 2.4.26 kernel. ... Due to flash bug 3M of memory gets lost due to font memory getting lost ... The output of "free" cache number steadily grows. ... longer to exhaust all of system memory with the cache. ...
      (Linux-Kernel)
    • Re: Problem: Creating a raw binary string
      ... > While its true that a 64-bit cpu will move twice the data per instruction it ... > Memory bus width plays an important role here and unless it too is widened / ... You are forgetting the two levels of cache in the processor. ... The memory chips are addressed in Row col fashion. ...
      (alt.comp.lang.borland-delphi)
    • Re: Is Greenspun enough?
      ... Most OSes memory map executables directly from the file system so code doesn't pollute the file cache or swap space. ...
      (comp.lang.lisp)
    • Re: High-bandwidth computing interest group
      ... sequential access patterns, brute force - neither of us consider that interesting ... Perhaps we should lose the cache line orientation - transferring data bytes that aren't needed. ... Particularly if it has scatter/gather vector instructions like Larrabee, or if it is a CIMT coherent threaded architecture like the GPUs. ... As I have discussed in this newsgroup before, this allows us to have writeback caches where multiple processors can write to the same memory location simultaneously. ...
      (comp.arch)
    • Re: Superstitious learning in Computer Architecture
      ... Without a LOT of logic or some other better approach, re-executing the instructions requires re-decoding and it ties up the cache memory bus transferring more data as instructions than the instructions are working on. ... The concept of cache is fundamentally flawed in that it STILL restricts access to one word per clock cycle, when a single modern ALU can easily use 5 plus whatever is eaten up with instruction accesses. ... The size of an optimizing compiler is proportional to the SQUARE of the size of the language times the SQUARE of the complexity of the machine - because all interactions must be considered. ...
      (comp.arch.arithmetic)