Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]


Groups > linux.debian.bugs.dist > #1231943

Bug#1063673: ITP: llama.cpp -- Inference of Meta's LLaMA model (and others) in pure C/C++

From Petter Reinholdtsen <pere@hungry.com>
Newsgroups linux.debian.bugs.dist
Subject Bug#1063673: ITP: llama.cpp -- Inference of Meta's LLaMA model (and others) in pure C/C++
Date 2025-02-06 01:40 +0100
Message-ID <KcY5X-eHYo-3@gated-at.bofh.it> (permalink)
References (15 earlier) <KcUF3-eFLJ-5@gated-at.bofh.it> <KcUF3-eFLJ-1@gated-at.bofh.it> <KcY5X-eHYo-5@gated-at.bofh.it> <I6Vyx-9PtM-15@gated-at.bofh.it> <KcY5X-eHYo-5@gated-at.bofh.it>
Organization linux.* mail to news gateway

Show all headers | View raw


[Christian Kastner]
> Repo is here [1].

Very good.  Built just fine here.  I checked in a few minor fixes.

I noticed llama.cpp depend on llama.cpp-backend with no concrete
dependency first.  This lead to unpredictable behaviour, and I suggest
depending on for example 'llama.cpp-cpu | llama.cpp-backend' to make
sure 'apt install llama.cpp' behave predictably.

I was sad to discover the server example is missing, as it is the
llama.cpp progam I use the most.  Without it, I will have to continue
using my own build.

> I thought it best to upload now and fix the remaining issues above while
> the package sits in NEW.

Very good.

I hope to get whisper.cpp to the same state, so it can have a fighting
chance to get into testing before the freeze.

-- 
Happy hacking
Petter Reinholdtsen

Back to linux.debian.bugs.dist | Previous | Next — Previous in thread | Next in thread | Find similar | Unroll thread


Thread

Bug#1063673: ITP: llama.cpp -- Inference of Meta's LLaMA model (and others) in pure C/C++ Petter Reinholdtsen <pere@hungry.com> - 2025-02-05 22:00 +0100
  Bug#1063673: ITP: llama.cpp -- Inference of Meta's LLaMA model (and others) in pure C/C++ Petter Reinholdtsen <pere@hungry.com> - 2025-02-06 01:40 +0100
    Bug#1063673: ITP: llama.cpp -- Inference of Meta's LLaMA model (and others) in pure C/C++ "M. Zhou" <lumin@debian.org> - 2025-02-06 02:50 +0100
      Bug#1063673: ITP: llama.cpp -- Inference of Meta's LLaMA model (and others) in pure C/C++ Petter Reinholdtsen <pere@hungry.com> - 2025-02-06 09:00 +0100
      Bug#1063673: ITP: llama.cpp -- Inference of Meta's LLaMA model (and others) in pure C/C++ "M. Zhou" <lumin@debian.org> - 2025-02-06 15:20 +0100
    Bug#1063673: ITP: llama.cpp -- Inference of Meta's LLaMA model (and others) in pure C/C++ Petter Reinholdtsen <pere@hungry.com> - 2025-02-06 09:30 +0100

csiph-web