Re: LMbench as gcc performance regression test?

From: Dan Kegel (dank_at_kegel.com)
Date: 08/31/03

  • Next message: Jörn Engel: "Re: bandwidth for bkbits.net (good news)"
    Date:	Sun, 31 Aug 2003 08:59:10 -0700
    To: Daniel Jacobowitz <dan@debian.org>
    
    

    Daniel Jacobowitz wrote:
    > On Sun, Aug 31, 2003 at 12:21:37AM -0700, Dan Kegel wrote:
    >
    >>http://cs.nmu.edu/~benchmark/ has an interesting little graph
    >>of LMBench results vs. Linux kernel version, all done with the
    >>same compiler.
    >>
    >>Has anyone seen a similar graph showing LMBench results vs. gcc version,
    >>all done with the same Linux kernel?
    >>And does everyone agree that's a meaningful way to compare the
    >>performance of code generated by different compilers?
    >
    > It's been a while since I looked at lmbench but: why do you think this
    > would be useful? It's a system and kernel benchmark; I doubt
    > optimization makes much difference at all.

    I need to make sure that moving to a newer compiler for our kernel
    will cause no performance regressions. Before bothering to bring up a
    real-world networking application and measuring its performance
    under the new compiler, it seems sensible to use a couple microbenchmarks
    to verify that identifiable parts of the system have
    not degraded in performance.

    I myself am quite convinced I need to move to a newer compiler,
    since I keep running into problems building various things with
    old compilers, but my users are very conservative and skeptical;
    I have to build a solid case for updating. Hence the insane amount
    of time I spent figuring out and documenting how to build and test
    the various versions of gcc and glibc (http://kegel.com/crosstool),
    and then understanding the regression test failures.
    - Dan

    -- 
    Dan Kegel
    http://www.kegel.com
    http://counter.li.org/cgi-bin/runscript/display-person.cgi?user=78045
    -
    To unsubscribe from this list: send the line "unsubscribe linux-kernel" in
    the body of a message to majordomo@vger.kernel.org
    More majordomo info at  http://vger.kernel.org/majordomo-info.html
    Please read the FAQ at  http://www.tux.org/lkml/
    

  • Next message: Jörn Engel: "Re: bandwidth for bkbits.net (good news)"

    Relevant Pages

    • LMbench as gcc performance regression test?
      ... of LMBench results vs. Linux kernel version, ... same compiler. ... Has anyone seen a similar graph showing LMBench results vs. gcc version, ...
      (Linux-Kernel)
    • Re: kfree(0) - ok?
      ... compiler anybody makes nowadays has a NULL pointer value with all bits clear. ... we rely on the uninitialized data to have all bits clear and we depend on that producing NULL pointers; if a NULL pointer was not bitwise ... So yes the Linux kernel "breaks the standard" in a bunch of places, but on the other hand we're not your average software and we don't have to worry about building on an LLP64 compiler or other strangeness. ...
      (Linux-Kernel)
    • Re: Linux Kernel Source--Unquestionably Undefined Behavior
      ... The Linux Kernel Source is NOT part of the implementation, ... The linux kernel is not compiled using a compiler configured for ... adherence to any ANSI or ISO C standard. ... The Linux Kernel Source, as a result, commits undefined behavior. ...
      (comp.lang.c)
    • [newbie] compiling linux
      ... I am an experienced C/C++ engineer, who has done Java for the last couple of ... Linux kernel and the Delorie DJGPP ... what compiler are the makefiles written ...
      (comp.os.linux)
    • Re: what is this code exactly meaning?
      ... I saw the following code in linux kernel 2.6's code (arch/sparc/lib/ ... consult the gcc compiler documentation ... based interface to post a proper signature delimiter. ... have an appropriate newsgroups line in your header for your mail to be seen, ...
      (comp.lang.c.moderated)