Path: csiph.com!fu-berlin.de!bofh.it!news.nic.it!robomod From: Antoine Beaupre Newsgroups: linux.debian.bugs.dist,linux.debian.devel,linux.debian.maint.python Subject: Bug#1065572: ITP: llm -- Access large language models from the command-line Date: Wed, 06 Mar 2024 21:30:01 +0100 Message-ID: X-Original-To: Debian Bug Tracking System X-Mailbox-Line: From debian-bugs-dist-request@lists.debian.org Wed Mar 6 20:24:10 2024 Old-Return-Path: X-Spam-Flag: NO X-Spam-Score: 0.19 Reply-To: Antoine Beaupre , 1065572@bugs.debian.org Resent-To: debian-bugs-dist@lists.debian.org Resent-Cc: debian-devel@lists.debian.org, debian-python@lists.debian.org, debian-ai@lists.debian.org, wnpp@debian.org X-Debian-Pr-Message: report 1065572 X-Debian-Pr-Package: wnpp Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit X-Mailer: reportbug 12.0.0 X-Debian-Message: from BTS X-Mailing-List: archive/latest/1826181 List-ID: List-URL: Approved: robomod@news.nic.it Lines: 39 Organization: linux.* mail to news gateway Sender: robomod@news.nic.it X-Original-Date: Wed, 06 Mar 2024 15:20:18 -0500 X-Original-Message-ID: <170975641880.1971877.16540516054284737256.reportbug@angela.anarc.at> Xref: csiph.com linux.debian.bugs.dist:1189296 linux.debian.devel:110816 linux.debian.maint.python:15546 Package: wnpp Severity: wishlist Owner: Antoine Beaupre X-Debbugs-Cc: debian-devel@lists.debian.org, debian-python@lists.debian.org, debian-ai@lists.debian.org * Package name : llm Version : 0.13.1 Upstream Contact: Simon Willison * URL : https://llm.datasette.io/ * License : Apache-2.0 Programming Lang: Python Description : CLI utility and Python library for interacting with Large Language Models A CLI utility and Python library for interacting with Large Language Models, both via remote APIs and models that can be installed and run on your own machine. Run prompts from the command-line, store the results in SQLite, generate embeddings and more. ---- So there has been some discussions about packaging LLM things in Debian, and this is my stab at opening a discussion about *what* exactly, we *can* package, right now. LLM is a (possibly poorly named) package that allows users to interact with various language models. Its primary target is obviously the OpenAI API (it's the example in the "Quick Start"), but it also supports local models like Llama 2, Ollama, and MLC, and other online models like Claude, GEmini and Mistral. I *think* this belongs in contrib, because it *mostly* relies on non-free software (and services) to do its thing, but I'd be happy to move that around. I need this because I was using GPT plus for a while and now I'm switching to the API to cut down on costs.