Re: Figuring out grammars from examples

From	Derek <derek@shape-of-code.com>
Newsgroups	comp.compilers
Subject	Re: Figuring out grammars from examples
Date	2024-04-15 02:17 +0100
Organization	Compilers Central
Message-ID	<24-04-004@comp.compilers> (permalink)
References	<24-04-001@comp.compilers> <24-04-002@comp.compilers>

Show all headers | View raw

John,

> [I would like to see some actual data. In my experience, LLMs are
> impressive, confident, and frequently wrong. -John]

LLM's performance on fact recall is poor.

It seems to be much better than other tools when dealing with
grammars. I could not find the example I was looking for, but here are
two others: https://arxiv.org/abs/2305.19234
https://szopa.medium.com/teaching-chatgpt-to-speak-my-sons-invented-language-9d109c0a0f05

My own experience using local (i.e., very small)
models
https://shape-of-code.com/2024/02/25/extracting-named-entities-from-a-change-log-using-an-llm/

Back to comp.compilers | Previous | Next — Previous in thread | Find similar

Thread

Figuring out grammars from examples John R Levine <johnl@taugh.com> - 2024-04-12 18:39 -0400
  Re: Figuring out grammars from examples Derek <derek@shape-of-code.com> - 2024-04-13 12:06 +0100
    Re: Figuring out grammars from examples Derek <derek@shape-of-code.com> - 2024-04-15 02:17 +0100

csiph-web