Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]

Groups > alt.comp.software.thunderbird > #21643

Re: "Don't mess with that which you don't understand" ...

Show all headers | View raw

On Sat, 8/1/2026 10:19 AM, The Real Bev wrote:
> This is so info-dense that I have saved it for later.  I have ~400GB empty on my main drive, but mental effort is problematical :-(
> 
> The idea of having my own AI is novel.  I am ashamed of having become so dependent on the AIs for information that I formerly googled, but I am unable to resist the temptation.  Being able to emulate Captain Picard (typing, not voice;  my computer has no eyes or ears) is seductive.
> 

I'm not good at this stuff, but the latest attempt
suggests the smallest models may be too weak. Since
something like three million people had downloaded
the small one (E4B), I figured there must be some evidence
that one was worthwhile. The bigger one seems braver
about how it runs its business, and does not run
away from a job quite as easily.

And then it becomes a question of how much system RAM
have you got. Gemma 31B wrote a program as an output,
whereas Gemma E4B merely sketched an outline with
"comment statements". And an even larger model found
a cheat for itself, to "save itself from writing 200 lines of code".
How heroic.

 16GB of RAM would handle the  7GB or so Gemma E4B needs (a bit weak model).
 64GB of RAM would handle the 35GB or so Gemma 31B needed.
128GB of RAM would handle the 80GB the OpenAi 120B needed.

Look at both how much RAM and how much disk space. The
OS installation with Gemma 31B on it, there is only 7GB left
on the C: drive, as it wasn't sized for this sort of thing.

And there is a model format which is more efficient and
still works. But they have only released one model that
way, and the industry knows now, how to make a smaller one.
They release FP4 and FP16 models, because video cards accelerate
that, but the smallest model is the TRIT [-1,0,1 ] which is
harder for them but easier for us. TRIT works best if trained
as a TRIT, not quantized from a larger format. Whereas other
models in the list in LMStudio, are quantized from larger
models. The offerings of Kimi could be like that (the largest
model being impossibly big, have to buy a $100K computer, good
for Bill Gates home computer).

   Paul

Back to alt.comp.software.thunderbird | Previous | Next — Previous in thread | Next in thread | Find similar | Unroll thread

Thread

"Don't mess with that which you don't understand" ... "J. P. Gilliver" <G6JPG@255soft.uk> - 2026-07-30 19:38 +0100
  Re: "Don't mess with that which you don't understand" ... T <T@invalid.invalid> - 2026-07-30 16:01 -0700
    Re: "Don't mess with that which you don't understand" ... The Real Bev <bashley101@gmail.com> - 2026-07-30 19:27 -0700
      Re: "Don't mess with that which you don't understand" ... "J. P. Gilliver" <G6JPG@255soft.uk> - 2026-07-31 09:10 +0100
        Re: "Don't mess with that which you don't understand" ... dillinger <dillinger@not.invalid> - 2026-07-31 11:45 +0200
          Re: "Don't mess with that which you don't understand" ... MikeS <MikeS@fred.com> - 2026-07-31 11:56 +0100
            Re: "Don't mess with that which you don't understand" ... T <T@invalid.invalid> - 2026-07-31 11:53 -0700
            Re: "Don't mess with that which you don't understand" ... Paul <nospam@needed.invalid> - 2026-07-31 15:29 -0400
              Re: "Don't mess with that which you don't understand" ... T <T@invalid.invalid> - 2026-08-02 02:05 -0700
          Re: "Don't mess with that which you don't understand" ... Paul <nospam@needed.invalid> - 2026-07-31 10:59 -0400
      Re: "Don't mess with that which you don't understand" ... Paul <nospam@needed.invalid> - 2026-07-31 14:48 -0400
        Re: "Don't mess with that which you don't understand" ... The Real Bev <bashley101@gmail.com> - 2026-08-01 07:19 -0700
          Re: "Don't mess with that which you don't understand" ... Paul <nospam@needed.invalid> - 2026-08-01 14:16 -0400
            Re: "Don't mess with that which you don't understand" ... The Real Bev <bashley101@gmail.com> - 2026-08-01 18:38 -0700
    Re: "Don't mess with that which you don't understand" ... "s|b" <me@privacy.invalid> - 2026-07-31 15:03 +0200
      Re: "Don't mess with that which you don't understand" ... T <T@invalid.invalid> - 2026-07-31 12:37 -0700
  Re: "Don't mess with that which you don't understand" ... T <T@invalid.invalid> - 2026-07-30 16:20 -0700
  Re: "Don't mess with that which you don't understand" ... Retirednoguilt <HapilyRetired@fakeaddress.invalid> - 2026-07-31 10:48 -0400
    Re: "Don't mess with that which you don't understand" ... "J. P. Gilliver" <G6JPG@255soft.uk> - 2026-07-31 21:45 +0100

csiph-web