Groups | Search | Server Info | Login | Register


Groups > comp.compilers > #3704

Paper: Multi-Language Benchmark Generation via L-Systems

Path csiph.com!weretis.net!feeder9.news.weretis.net!news.misty.com!news.iecc.com!.POSTED.news.iecc.com!nerds-end
From John R Levine <johnl@taugh.com>
Newsgroups comp.compilers
Subject Paper: Multi-Language Benchmark Generation via L-Systems
Date Mon, 22 Dec 2025 22:56:52 -0500
Organization Compilers Central
Sender johnl%iecc.com
Approved comp.compilers@iecc.com
Message-ID <25-12-002@comp.compilers> (permalink)
MIME-Version 1.0
Content-Type text/plain; charset="UTF-8"
Injection-Info gal.iecc.com; posting-host="news.iecc.com:2001:470:1f07:1126:0:676f:7373:6970"; logging-data="88809"; mail-complaints-to="abuse@iecc.com"
Keywords benchmarks, testing, paper
Posted-Date 22 Dec 2025 22:57:35 EST
X-submission-address compilers@iecc.com
X-moderator-address compilers-request@iecc.com
X-FAQ-and-archives http://compilers.iecc.com
Xref csiph.com comp.compilers:3704

Show key headers only | View raw


The authors built a system that uses a production grammar to create
largish benchmark programs which they then used to evaluate compiler
performance and (occasionally) look for bugs.

Abstract
L-systems are a mathematical formalism proposed by biologist Aristid
Lindenmayer with the aim of simulating organic structures such as trees,
snowflakes, flowers, and other branching phenomena. They are implemented
as a formal language that defines how patterns can be iteratively
rewritten. This paper describes how such a formalism can be used to create
artificial programs written in programming languages such as C, C++, Julia
and Go. These programs, being large and complex, can be used to test the
performance of compilers, operating systems, and computer architectures.
This paper demonstrates the usefulness of these benchmarks through
multiple case studies. These case studies include a comparison between
clang and gcc; a comparison between C, C++, Julia and Go; a study of the
historical evolution of gcc in terms of code quality; a look into the
effects of profile guided optimizations in gcc; an analysis of the
asymptotic behavior of the different phases of clang's compilation
pipeline; and a comparison between the many data structures available in
the Gnome Library (GLib). These case studies demonstrate the benefits of
the L-System approach to create benchmarks, when compared with fuzzers
such as CSmith, which were designed to uncover bugs in compilers, rather
than evaluating their performance.

https://arxiv.org/abs/2512.17616

Regards,
John Levine, johnl@taugh.com, Taughannock Networks, Trumansburg NY
Please consider the environment before reading this e-mail. https://jl.ly

Back to comp.compilers | Previous | NextNext in thread | Find similar


Thread

Paper: Multi-Language Benchmark Generation via L-Systems John R Levine <johnl@taugh.com> - 2025-12-22 22:56 -0500
  Re: Paper: Multi-Language Benchmark Generation via L-Systems Fernando Magno Quintao Pereira <pronesto@gmail.com> - 2025-12-23 13:12 -0300

csiph-web