Groups | Search | Server Info | Login | Register

Groups > comp.lang.c > #125749

Re: A new benchmark

Show all headers | View raw

On 1/25/2018 7:50 AM, Philipp Klaus Krause wrote:
> For benchmarking C implementations, the there are a few benchmarks, but
> they all have their problems. Many benchmarks have memory requirements
> that are far too high or need functionality not necessarily available.
> Some are quite one-sided in what they measure (e.g. Whetstone,
> Dhrystone, Coremark).
> 
> To address these issues, I want to write a new benchmark.
> 
> I have started work on stdcbench (the name was chosen since it is meant
> to only use standard C and the name was not yet in use yesterday).
> 
> Goals for stdcbench:
> 
> * Works with most C implementations.
> 	- Does not depend on non-standard features.
> 	- Does not depend on features not required for freestanding
> implementations of C90.
> 	- Does not depend on standard features missing on many implementations
> (e.g. double).
> 	- Does not require more than 4 KB of data memory on small systems.
> 	- Does not require more than 32 KB of code memory on small systems.
> * Takes optional standard features into account.
> 	- Can benchmark C99 and C11 features.
> 	- Can benchmark features of the C library that are useful, but not
> mandatory for freestanding implementations.
> * Gives a balanced reflection of performance.
> 	- No single functionality should dominate the results.
> * Gives a single number as final score.
> * Verifies correctness of results.
> * Benchmarks code from or similar to real-world applications.
> 
> To achieve these goals, stdcbench is modularized. The total score is the
> sum of the scores in the individual modules. For now, there is only  a
> first version of one module: c90base.
> 
> I am looking forward to comments from you on this work.
> 
> http://stdcbench.org/

How does it work?  How do you benchmark an application written in C?
I can write a GUI library written in C which has lots of user input
and OS system calls.  It might seem to go slowly, but it's only be-
cause the user had to get up and go to a meeting, then come back and
continue on with the program.

-- 
Thank you!      |  Indianapolis, Indiana  |  God is love -- 1 John 4:7-9
Rick C. Hodgin  |  http://www.libsf.org/  |  http://tinyurl.com/yaogvqhj
-------------------------------------------------------------------------
Software:  LSA, LSC, Debi, RDC/CAlive, ES/1, ES/2, VJr, VFrP, Logician
Hardware:  Arxoda Desktop CPU, Arxita Embedded CPU, Arlina Compute FPGA

Back to comp.lang.c | Previous | Next — Previous in thread | Next in thread | Find similar

Thread

A new benchmark Philipp Klaus Krause <pkk@spth.de> - 2018-01-25 13:50 +0100
  Re: A new benchmark "Rick C. Hodgin" <rick.c.hodgin@gmail.com> - 2018-01-25 08:25 -0500
    Re: A new benchmark Philipp Klaus Krause <pkk@spth.de> - 2018-01-25 14:45 +0100
      Re: A new benchmark fir <profesor.fir@gmail.com> - 2018-01-25 06:41 -0800
        Re: A new benchmark Philipp Klaus Krause <pkk@spth.de> - 2018-01-25 15:52 +0100
          Re: A new benchmark fir <profesor.fir@gmail.com> - 2018-01-25 07:02 -0800
            Re: A new benchmark Philipp Klaus Krause <pkk@spth.de> - 2018-01-26 15:22 +0100
  Re: A new benchmark bartc <bc@freeuk.com> - 2018-01-25 16:09 +0000
  Re: A new benchmark Robert Wessel <robertwessel2@yahoo.com> - 2018-01-25 13:00 -0600
    Re: A new benchmark Philipp Klaus Krause <pkk@spth.de> - 2018-01-26 10:14 +0100
      Re: A new benchmark Robert Wessel <robertwessel2@yahoo.com> - 2018-01-26 10:56 -0600
        Re: A new benchmark supercat@casperkitty.com - 2018-01-26 13:07 -0800
          Re: A new benchmark Robert Wessel <robertwessel2@yahoo.com> - 2018-01-27 13:13 -0600
  Re: A new benchmark supercat@casperkitty.com - 2018-01-25 13:42 -0800
    Re: A new benchmark Philipp Klaus Krause <pkk@spth.de> - 2018-01-26 11:19 +0100
      Re: A new benchmark supercat@casperkitty.com - 2018-01-26 08:17 -0800

csiph-web