Groups | Search | Server Info | Login | Register

Groups > comp.lang.c > #125744

A new benchmark

Path csiph.com!news.mixmin.net!weretis.net!feeder4.news.weretis.net!feeder5.news.weretis.net!news.solani.org!.POSTED!not-for-mail
From Philipp Klaus Krause <pkk@spth.de>
Newsgroups comp.lang.c
Subject A new benchmark
Date Thu, 25 Jan 2018 13:50:01 +0100
Organization solani.org
Lines 40
Message-ID <p4cjpp$g2c$1@solani.org> (permalink)
Mime-Version 1.0
Content-Type text/plain; charset=utf-8
Content-Transfer-Encoding 8bit
X-Trace solani.org 1516884601 16460 eJwFwYERADAEBLCVUP8YR13tP0ITHConnKBjsXVXXAEdT5nQ6lepfRoNmonkBAddiut89gEG7RA4 (25 Jan 2018 12:50:01 GMT)
X-Complaints-To abuse@news.solani.org
NNTP-Posting-Date Thu, 25 Jan 2018 12:50:01 +0000 (UTC)
User-Agent Mozilla/5.0 (X11; Linux x86_64; rv:52.0) Gecko/20100101 Thunderbird/52.2.1
Cancel-Lock sha1:lEtnjwSq6Xg5i9vaLfYbetP8g5E=
X-NNTP-Posting-Host eJwFwQEBwCAMAzBLO7QdlTN28C+BhFOfOiEKvLxIR3WssaYsdbWIMnb8uw4AOyM46upEuh8H8hB6
X-User-ID eJwNysERwDAIA7CVKNjmMk7J4f1HaPUWS49uQxRo+hRYBiprsLWW2+reo3k3fWP8B0YEcjc+FFMRBQ==
Content-Language en-US
X-Mozilla-News-Host snews://news.solani.org:563
Xref csiph.com comp.lang.c:125744

Show key headers only | View raw

For benchmarking C implementations, the there are a few benchmarks, but
they all have their problems. Many benchmarks have memory requirements
that are far too high or need functionality not necessarily available.
Some are quite one-sided in what they measure (e.g. Whetstone,
Dhrystone, Coremark).

To address these issues, I want to write a new benchmark.

I have started work on stdcbench (the name was chosen since it is meant
to only use standard C and the name was not yet in use yesterday).

Goals for stdcbench:

* Works with most C implementations.
	- Does not depend on non-standard features.
	- Does not depend on features not required for freestanding
implementations of C90.
	- Does not depend on standard features missing on many implementations
(e.g. double).
	- Does not require more than 4 KB of data memory on small systems.
	- Does not require more than 32 KB of code memory on small systems.
* Takes optional standard features into account.
	- Can benchmark C99 and C11 features.
	- Can benchmark features of the C library that are useful, but not
mandatory for freestanding implementations.
* Gives a balanced reflection of performance.
	- No single functionality should dominate the results.
* Gives a single number as final score.
* Verifies correctness of results.
* Benchmarks code from or similar to real-world applications.

To achieve these goals, stdcbench is modularized. The total score is the
sum of the scores in the individual modules. For now, there is only  a
first version of one module: c90base.

I am looking forward to comments from you on this work.

http://stdcbench.org/

Philipp

Back to comp.lang.c | Previous | Next — Next in thread | Find similar

Thread

A new benchmark Philipp Klaus Krause <pkk@spth.de> - 2018-01-25 13:50 +0100
  Re: A new benchmark "Rick C. Hodgin" <rick.c.hodgin@gmail.com> - 2018-01-25 08:25 -0500
    Re: A new benchmark Philipp Klaus Krause <pkk@spth.de> - 2018-01-25 14:45 +0100
      Re: A new benchmark fir <profesor.fir@gmail.com> - 2018-01-25 06:41 -0800
        Re: A new benchmark Philipp Klaus Krause <pkk@spth.de> - 2018-01-25 15:52 +0100
          Re: A new benchmark fir <profesor.fir@gmail.com> - 2018-01-25 07:02 -0800
            Re: A new benchmark Philipp Klaus Krause <pkk@spth.de> - 2018-01-26 15:22 +0100
  Re: A new benchmark bartc <bc@freeuk.com> - 2018-01-25 16:09 +0000
  Re: A new benchmark Robert Wessel <robertwessel2@yahoo.com> - 2018-01-25 13:00 -0600
    Re: A new benchmark Philipp Klaus Krause <pkk@spth.de> - 2018-01-26 10:14 +0100
      Re: A new benchmark Robert Wessel <robertwessel2@yahoo.com> - 2018-01-26 10:56 -0600
        Re: A new benchmark supercat@casperkitty.com - 2018-01-26 13:07 -0800
          Re: A new benchmark Robert Wessel <robertwessel2@yahoo.com> - 2018-01-27 13:13 -0600
  Re: A new benchmark supercat@casperkitty.com - 2018-01-25 13:42 -0800
    Re: A new benchmark Philipp Klaus Krause <pkk@spth.de> - 2018-01-26 11:19 +0100
      Re: A new benchmark supercat@casperkitty.com - 2018-01-26 08:17 -0800

csiph-web