Re: LLM Local Documents ?

From	jeremy ardley <jeremy.ardley@gmail.com>
Newsgroups	linux.debian.user
Subject	Re: LLM Local Documents ?
Date	2024-06-25 09:50 +0200
Message-ID	<IT969-5qan-3@gated-at.bofh.it> (permalink)
References	<IT5vA-5nQZ-11@gated-at.bofh.it> <IT7xo-5pn9-3@gated-at.bofh.it>
Organization	linux.* mail to news gateway

Show all headers | View raw

On 25/6/24 13:59, Jeff Peng wrote:
>
> does gtp4all have a shell only interface? my debian is remote server, 
> has no desktop. 

GPT4ALl hosts a webservice on localhost - 127.0.0.1

There are many ways to access that including using haproxy or running a 
web browser on the server using X tunneling.

But your big problem will be speed. All LLMS require a modern graphics 
card / GPU to get acceptable speed. Something like an nVidia 3060 with 
12G video RAM or better.

If your server is headless you won't have that compute available and 
results will be very ordinary.

Back to linux.debian.user | Previous | Next — Previous in thread | Find similar | Unroll thread

Thread

LLM Local Documents ? jeremy ardley <jeremy.ardley@gmail.com> - 2024-06-25 06:00 +0200
  Re: LLM Local Documents ? Jeff Peng <jeff@simplemail.co.in> - 2024-06-25 08:10 +0200
    Re: LLM Local Documents ? jeremy ardley <jeremy.ardley@gmail.com> - 2024-06-25 09:50 +0200

csiph-web