Re: Network performance degradation from 2.6.11.12 to 2.6.16.20

On Fri, 16 Jun 2006 09:01:23 -0700
Harry Edmon <harry@xxxxxxxxxxxxxxxxxxxx> wrote:

I have a system with a strange network performance degradation from
2.6.11.12 to most recent kernels including 2.6.16.20 and 2.6.17-rc6.
The system is has Dual single core Xeons with hyperthreading on. The
application is the LDM system from UCAR/Unidata
(http://www.unidata.ucar.edu/software/ldm). This system requests
weather data from a variety of systems using RPC calls over a reserved
TCP port (388), puts them into a memory mapped queue file, and then
sends the data out to a variety of downstream requesting systems, again
using RPC calls. When the load is heavy, the 2.6.16.20 kernel falls way
behind with the data ingestion. The 2.6.11.12 kernel does not. I have
tried an experiment with a 2.6.17-rc6 system where it just does the
ingestion, and not the downstream distribution, and it is able to keep
up. I would really appreciate any pointers as to where the problem may
be and how to diagnose it. I have attached the config files from both
kernels and the sysctl.conf file I am using. I have also included the
output from "netstat -s" on the 2.6.16.20 system during a time when it
was having problems.


(added netdev)

A quick grep indicates that it isn't using TCP_NODELAY - we've had problems
with that in the past.

Perhaps a tcpdump of the net traffic will help to determine what's going on.
-
To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
the body of a message to majordomo@xxxxxxxxxxxxxxx
More majordomo info at http://vger.kernel.org/majordomo-info.html
Please read the FAQ at http://www.tux.org/lkml/

Relevant Pages

  • Re: Kernel Space -> User Space IPC
    ... I am writing a network mini-redirector and I want to know how I can asynchronously send 'messages' from the kernel space to the user space and receive ACK or something similar. ... we use RPC binding both a SOCKET channel and a LOCAL RPC channel which if I recall Windows use named pipes beneath the hood. ... If all you want is a broadcast, you can register a message and broadcast it for your client to receive. ...
    (microsoft.public.win32.programmer.kernel)
  • Re: OT: Re: Jobst Brandt vs. Tire Glue
    ... Now that MS has largely caught up on kernel performance and reliability, it's a contender in even "narrow" systems. ... restrictive interfaces of stdin, stdout and argv. ... hand goes in for remote procedure calls (RPC) and object-oriented ... if the world stopped every time the ankle grippers were getting it, they'd soon associate the pain with lack of production and modify behavior accordingly. ...
    (rec.bicycles.tech)
  • Re: OT: Re: Jobst Brandt vs. Tire Glue
    ... It solved the easy (kernel) ... The "integration of applications" is certainly different if you compare ... restrictive interfaces of stdin, stdout and argv. ... hand goes in for remote procedure calls (RPC) and object-oriented ...
    (rec.bicycles.tech)
  • Re: NFS proc entry
    ... >>client like showmount does with RPC? ... I agree with you that it's kind of messy to put this in the kernel. ... send the line "unsubscribe linux-kernel" in ...
    (Linux-Kernel)