Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]


Groups > linux.debian.bugs.dist > #1231961

Bug#1063673: ITP: llama.cpp -- Inference of Meta's LLaMA model (and others) in pure C/C++

From Petter Reinholdtsen <pere@hungry.com>
Newsgroups linux.debian.bugs.dist
Subject Bug#1063673: ITP: llama.cpp -- Inference of Meta's LLaMA model (and others) in pure C/C++
Date 2025-02-06 09:00 +0100
Message-ID <Kd4XL-eM7v-9@gated-at.bofh.it> (permalink)
References (18 earlier) <KcY5X-eHYo-3@gated-at.bofh.it> <Kd4XL-eM7v-11@gated-at.bofh.it> <dKoem-164-11@gated-at.bofh.it> <I6Vyx-9PtM-15@gated-at.bofh.it> <KcZbI-eIzF-3@gated-at.bofh.it>
Organization linux.* mail to news gateway

Show all headers | View raw


[M. Zhou]
> I second this. llama-server is also the service endpoint for DebGPT.

So, what exactly need to happen for llama-server to be included in the
package?

I found this in d/copyright:

 DFSG compliance
 ---------------
 The server example contains a number of minified and generated files in the
 frontend. These seem to be essential to the example, so the server example
 has been removed entirely, for now.

I guess some build mechanics need to be included to build the minified
and generated files, but do not know which one are the problem.
According to examples/server/README.md the "Web UI" is buitl using 'npm
run build', so I guess some nodejs dependencies are needed.  Sadly, I do
not know how to convince npm to not download random stuff from the
Internet.

-- 
Happy hacking
Petter Reinholdtsen

Back to linux.debian.bugs.dist | Previous | Next — Previous in thread | Next in thread | Find similar | Unroll thread


Thread

Bug#1063673: ITP: llama.cpp -- Inference of Meta's LLaMA model (and others) in pure C/C++ Petter Reinholdtsen <pere@hungry.com> - 2025-02-05 22:00 +0100
  Bug#1063673: ITP: llama.cpp -- Inference of Meta's LLaMA model (and others) in pure C/C++ Petter Reinholdtsen <pere@hungry.com> - 2025-02-06 01:40 +0100
    Bug#1063673: ITP: llama.cpp -- Inference of Meta's LLaMA model (and others) in pure C/C++ "M. Zhou" <lumin@debian.org> - 2025-02-06 02:50 +0100
      Bug#1063673: ITP: llama.cpp -- Inference of Meta's LLaMA model (and others) in pure C/C++ Petter Reinholdtsen <pere@hungry.com> - 2025-02-06 09:00 +0100
      Bug#1063673: ITP: llama.cpp -- Inference of Meta's LLaMA model (and others) in pure C/C++ "M. Zhou" <lumin@debian.org> - 2025-02-06 15:20 +0100
    Bug#1063673: ITP: llama.cpp -- Inference of Meta's LLaMA model (and others) in pure C/C++ Petter Reinholdtsen <pere@hungry.com> - 2025-02-06 09:30 +0100

csiph-web