Groups | Search | Server Info | Login | Register

Groups > comp.lang.c > #125744

A new benchmark

Show all headers | View raw

For benchmarking C implementations, the there are a few benchmarks, but
they all have their problems. Many benchmarks have memory requirements
that are far too high or need functionality not necessarily available.
Some are quite one-sided in what they measure (e.g. Whetstone,
Dhrystone, Coremark).

To address these issues, I want to write a new benchmark.

I have started work on stdcbench (the name was chosen since it is meant
to only use standard C and the name was not yet in use yesterday).

Goals for stdcbench:

* Works with most C implementations.
	- Does not depend on non-standard features.
	- Does not depend on features not required for freestanding
implementations of C90.
	- Does not depend on standard features missing on many implementations
(e.g. double).
	- Does not require more than 4 KB of data memory on small systems.
	- Does not require more than 32 KB of code memory on small systems.
* Takes optional standard features into account.
	- Can benchmark C99 and C11 features.
	- Can benchmark features of the C library that are useful, but not
mandatory for freestanding implementations.
* Gives a balanced reflection of performance.
	- No single functionality should dominate the results.
* Gives a single number as final score.
* Verifies correctness of results.
* Benchmarks code from or similar to real-world applications.

To achieve these goals, stdcbench is modularized. The total score is the
sum of the scores in the individual modules. For now, there is only  a
first version of one module: c90base.

I am looking forward to comments from you on this work.

http://stdcbench.org/

Philipp

Back to comp.lang.c | Previous | Next — Next in thread | Find similar

Thread

A new benchmark Philipp Klaus Krause <pkk@spth.de> - 2018-01-25 13:50 +0100
  Re: A new benchmark "Rick C. Hodgin" <rick.c.hodgin@gmail.com> - 2018-01-25 08:25 -0500
    Re: A new benchmark Philipp Klaus Krause <pkk@spth.de> - 2018-01-25 14:45 +0100
      Re: A new benchmark fir <profesor.fir@gmail.com> - 2018-01-25 06:41 -0800
        Re: A new benchmark Philipp Klaus Krause <pkk@spth.de> - 2018-01-25 15:52 +0100
          Re: A new benchmark fir <profesor.fir@gmail.com> - 2018-01-25 07:02 -0800
            Re: A new benchmark Philipp Klaus Krause <pkk@spth.de> - 2018-01-26 15:22 +0100
  Re: A new benchmark bartc <bc@freeuk.com> - 2018-01-25 16:09 +0000
  Re: A new benchmark Robert Wessel <robertwessel2@yahoo.com> - 2018-01-25 13:00 -0600
    Re: A new benchmark Philipp Klaus Krause <pkk@spth.de> - 2018-01-26 10:14 +0100
      Re: A new benchmark Robert Wessel <robertwessel2@yahoo.com> - 2018-01-26 10:56 -0600
        Re: A new benchmark supercat@casperkitty.com - 2018-01-26 13:07 -0800
          Re: A new benchmark Robert Wessel <robertwessel2@yahoo.com> - 2018-01-27 13:13 -0600
  Re: A new benchmark supercat@casperkitty.com - 2018-01-25 13:42 -0800
    Re: A new benchmark Philipp Klaus Krause <pkk@spth.de> - 2018-01-26 11:19 +0100
      Re: A new benchmark supercat@casperkitty.com - 2018-01-26 08:17 -0800

csiph-web