'out of memory' errors



i am trying to us a perl application that handles large files (.5GB) in scalar
variables. when i try to 'slurp' one of these files into a variable
(e.g., '$_ = `cat filename`) i get an out of memory error. (same for '@var =
<FH>') initially, i ran the script without any memory limits. that was fine
except the process would freeze the rest of the system. i dealt with this
problem by setting limits for myself in /etc/security/limits.conf as follows;


kloro hard rss 256000
kloro hard memlock 256000
kloro hard as 768000

now, tho' i get 'out of memory' errors.

is there not some way to get linux to use swap space when physical memory is
exceeded?

thanks,

tom arnall
north spit, ca



--
To UNSUBSCRIBE, email to debian-user-REQUEST@xxxxxxxxxxxxxxxx
with a subject of "unsubscribe". Trouble? Contact listmaster@xxxxxxxxxxxxxxxx



Relevant Pages

  • Re: Int 32 processing speed: Is it a bug
    ... Let me try to answer your question as to why scalar int performance is sometimes slower than double scalar performance. ... The MMX registers used to perform int operations are either 64 or 128 bits depending on what your particular CPU supports. ... loading or storing an MMX register to memory is special optimized instruction on the Intel architecture. ...
    (comp.soft-sys.matlab)
  • RE: ten thousand small processes
    ... >If your going to get this serious about your memory management, ... Where is all that DRAM going? ... >I don't care much about the 3-page text segment. ... >To unsubscribe, send any mail to ...
    (freebsd-performance)
  • We keep getting these from you
    ... Subject: 1GB RAM is missing. ... that on a 32bit install you are limited to 2gb maximum of memory that can ... To UNSUBSCRIBE, email to debian-user-REQUEST@xxxxxxxxxxxxxxxx ... Trouble? ...
    (Debian-User)
  • Re: Problem with mod_fcgid inside a jail.
    ... memory for size %zu byte ... I'm running FreeBSD 6.2-RELEASE, ... To unsubscribe, send any mail to ...
    (freebsd-questions)
  • Re: Tie::StdScalar - perl tells me it cant find it
    ... untie %f; ... I wanted to put a very large file into a scalar in a way that has the ... system keeping most of the data on disk and putting in physical memory only ... north spit, ca ...
    (perl.beginners)