Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]

Groups > linux.debian.bugs.dist > #1275246

Bug#1123651: llama-server: Crash with SIGABRT on assertion (`system_regions_fine_.size() > 0')

Show all headers | View raw

Petter Reinholdtsen <pere@hungry.com> writes:

> [Cordell Bloor]
>
> Once this was done, the llama-server program started as it should.

Not quite.  It started and no longer crashed, but not as it should.  I
starts with this:

load_backend: loaded BLAS backend from /usr/lib/x86_64-linux-gnu/ggml/backends0/libggml-blas.so
load_backend: loaded CPU backend from /usr/lib/x86_64-linux-gnu/ggml/backends0/libggml-cpu-icelake.so
warning: no usable GPU found, --gpu-layers option will be ignored
warning: one possible reason is that llama.cpp was compiled without GPU support
warning: consult docs/build.md for compilation instructions
build: 5882 (Debian) with cc (Debian 14.3.0-5) 14.3.0 for x86_64-linux-gnu
system info: n_threads = 16, n_threads_batch = 16, total_threads = 32


And there is no sign of any GPU being used. :(

I tried to work around this by installing libggml0-backend-hip, but
alas, it do not work:

% LC_ALL=C sudo apt install libggml0-backend-hip
Solving dependencies... Error!  
Some packages could not be installed. This may mean that you have
requested an impossible situation or if you are using the unstable
distribution that some required packages have not yet been created
or been moved out of Incoming.
The following information may help to resolve the situation:

Unsatisfied dependencies:
 libggml0-backend-hip : Depends: libggml0 (>= 0.9.4) but 0.0~git20250712.d62df60-5 is to be installed
                        Depends: libhipblas2 (>= 6.4.3) but it is not installable
                        Depends: librocblas4 (>= 5.3.3) but it is not installable
Error: Unable to satisfy dependencies. Reached two conflicting decisions:
   1. libggml0:amd64=0.9.4-4+hip~exp2 is not selected for install
   2. libggml0:amd64=0.9.4-4+hip~exp2 is selected as an upgrade because:
      1. libggml0-backend-hip:amd64=0.9.4-4+hip~exp2 is selected for install
      2. libggml0-backend-hip:amd64 Depends libggml0 (>= 0.9.4)
%

I tried disabling experimental as a source in sources.list, but then I
only got this:

Package libggml0-backend-hip is not available, but is referred to by another package.
This may mean that the package is missing, has been obsoleted, or
is only available from another source

Error: Package 'libggml0-backend-hip' has no installation candidate

-- 
Happy hacking
Petter Reinholdtsen

Back to linux.debian.bugs.dist | Previous | Next — Previous in thread | Next in thread | Find similar | Unroll thread

Thread

Bug#1123651: llama-server: Crash with SIGABRT on assertion (`system_regions_fine_.size() > 0') Petter Reinholdtsen <pere@hungry.com> - 2025-12-19 13:10 +0100
  Bug#1123651: llama-server: Crash with SIGABRT on assertion (`system_regions_fine_.size() > 0') Cordell Bloor <cgmb@slerp.xyz> - 2025-12-19 19:30 +0100
    Bug#1123651: llama-server: Crash with SIGABRT on assertion (`system_regions_fine_.size() > 0') Petter Reinholdtsen <pere@hungry.com> - 2025-12-19 21:20 +0100
      Bug#1123651: llama-server: Crash with SIGABRT on assertion (`system_regions_fine_.size() > 0') Petter Reinholdtsen <pere@hungry.com> - 2025-12-19 21:20 +0100
        Bug#1123651: llama-server: Crash with SIGABRT on assertion (`system_regions_fine_.size() > 0') Cordell Bloor <cgmb@slerp.xyz> - 2025-12-19 23:50 +0100
          Bug#1123651: llama-server: Crash with SIGABRT on assertion (`system_regions_fine_.size() > 0') Petter Reinholdtsen <pere@hungry.com> - 2025-12-20 00:50 +0100
            Bug#1123651: llama-server: Crash with SIGABRT on assertion (`system_regions_fine_.size() > 0') Petter Reinholdtsen <pere@hungry.com> - 2025-12-20 01:00 +0100
              Bug#1123651: llama-server: Crash with SIGABRT on assertion (`system_regions_fine_.size() > 0') Petter Reinholdtsen <pere@hungry.com> - 2025-12-20 01:10 +0100

csiph-web