Groups > linux.debian.maint.python > #15546

Bug#1065572: ITP: llm -- Access large language models from the command-line

Path	csiph.com!fu-berlin.de!bofh.it!news.nic.it!robomod
From	Antoine Beaupre <anarcat@debian.org>
Newsgroups	linux.debian.bugs.dist, linux.debian.devel, linux.debian.maint.python
Subject	Bug#1065572: ITP: llm -- Access large language models from the command-line
Date	Wed, 06 Mar 2024 21:30:01 +0100
Message-ID	<If63L-eSh8-1@gated-at.bofh.it> (permalink)
X-Original-To	Debian Bug Tracking System <submit@bugs.debian.org>
X-Mailbox-Line	From debian-bugs-dist-request@lists.debian.org Wed Mar 6 20:24:10 2024
Old-Return-Path	<debbugs@buxtehude.debian.org>
X-Spam-Flag	NO
X-Spam-Score	0.19
Reply-To	Antoine Beaupre <anarcat@debian.org>, 1065572@bugs.debian.org
Resent-To	debian-bugs-dist@lists.debian.org
Resent-Cc	debian-devel@lists.debian.org, debian-python@lists.debian.org, debian-ai@lists.debian.org, wnpp@debian.org
X-Debian-Pr-Message	report 1065572
X-Debian-Pr-Package	wnpp
Content-Type	text/plain; charset="us-ascii"
MIME-Version	1.0
Content-Transfer-Encoding	7bit
X-Mailer	reportbug 12.0.0
X-Debian-Message	from BTS
X-Mailing-List	<debian-bugs-dist@lists.debian.org> archive/latest/1826181
List-ID	<debian-bugs-dist.lists.debian.org>
List-URL	<https://lists.debian.org/debian-bugs-dist/>
Approved	robomod@news.nic.it
Lines	39
Organization	linux.* mail to news gateway
Sender	robomod@news.nic.it
X-Original-Date	Wed, 06 Mar 2024 15:20:18 -0500
X-Original-Message-ID	<170975641880.1971877.16540516054284737256.reportbug@angela.anarc.at>
Xref	csiph.com linux.debian.bugs.dist:1189296 linux.debian.devel:110816 linux.debian.maint.python:15546

Cross-posted to 3 groups.

Show key headers only | View raw

Package: wnpp
Severity: wishlist
Owner: Antoine Beaupre <anarcat@debian.org>
X-Debbugs-Cc: debian-devel@lists.debian.org, debian-python@lists.debian.org, debian-ai@lists.debian.org

* Package name    : llm
  Version         : 0.13.1
  Upstream Contact: Simon Willison <swillison@gmail.com>
* URL             : https://llm.datasette.io/
* License         : Apache-2.0
  Programming Lang: Python
  Description     : CLI utility and Python library for interacting
  with Large Language Models

A CLI utility and Python library for interacting with Large Language
Models, both via remote APIs and models that can be installed and run
on your own machine.

Run prompts from the command-line, store the results in SQLite,
generate embeddings and more.

----

So there has been some discussions about packaging LLM things in
Debian, and this is my stab at opening a discussion about *what*
exactly, we *can* package, right now.

LLM is a (possibly poorly named) package that allows users to interact
with various language models. Its primary target is obviously the
OpenAI API (it's the example in the "Quick Start"), but it also
supports local models like Llama 2, Ollama, and MLC, and other online
models like Claude, GEmini and Mistral.

I *think* this belongs in contrib, because it *mostly* relies on
non-free software (and services) to do its thing, but I'd be happy to
move that around.

I need this because I was using GPT plus for a while and now I'm
switching to the API to cut down on costs.

Back to linux.debian.maint.python | Previous | Next | Find similar | Unroll thread

Thread

Bug#1065572: ITP: llm -- Access large language models from the command-line Antoine Beaupre <anarcat@debian.org> - 2024-03-06 21:30 +0100

csiph-web