Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]
Groups > alt.comp.software.thunderbird > #21646
| From | The Real Bev <bashley101@gmail.com> |
|---|---|
| Newsgroups | alt.comp.software.thunderbird |
| Subject | Re: "Don't mess with that which you don't understand" ... |
| Date | 2026-08-01 18:38 -0700 |
| Organization | None, as usual |
| Message-ID | <114m732$1ns8$1@dont-email.me> (permalink) |
| References | (1 earlier) <114gl4b$27abm$1@dont-email.me> <114h17d$2ar5p$1@dont-email.me> <114iqm2$3055k$1@dont-email.me> <114kv8p$3lc0r$1@dont-email.me> <114ld5c$3qt3e$1@dont-email.me> |
On 8/1/26 11:16, Paul wrote:
> On Sat, 8/1/2026 10:19 AM, The Real Bev wrote:
>> This is so info-dense that I have saved it for later. I have ~400GB empty on my main drive, but mental effort is problematical :-(
>>
>> The idea of having my own AI is novel. I am ashamed of having become so dependent on the AIs for information that I formerly googled, but I am unable to resist the temptation. Being able to emulate Captain Picard (typing, not voice; my computer has no eyes or ears) is seductive.
>>
>
> I'm not good at this stuff, but the latest attempt
> suggests the smallest models may be too weak. Since
> something like three million people had downloaded
> the small one (E4B), I figured there must be some evidence
> that one was worthwhile. The bigger one seems braver
> about how it runs its business, and does not run
> away from a job quite as easily.
>
> And then it becomes a question of how much system RAM
> have you got. Gemma 31B wrote a program as an output,
> whereas Gemma E4B merely sketched an outline with
> "comment statements". And an even larger model found
> a cheat for itself, to "save itself from writing 200 lines of code".
> How heroic.
>
> 16GB of RAM would handle the 7GB or so Gemma E4B needs (a bit weak model).
16GB. Oh well.
> 64GB of RAM would handle the 35GB or so Gemma 31B needed.
> 128GB of RAM would handle the 80GB the OpenAi 120B needed.
>
> Look at both how much RAM and how much disk space. The
> OS installation with Gemma 31B on it, there is only 7GB left
> on the C: drive, as it wasn't sized for this sort of thing.
>
> And there is a model format which is more efficient and
> still works. But they have only released one model that
> way, and the industry knows now, how to make a smaller one.
> They release FP4 and FP16 models, because video cards accelerate
> that, but the smallest model is the TRIT [-1,0,1 ] which is
> harder for them but easier for us. TRIT works best if trained
> as a TRIT, not quantized from a larger format. Whereas other
> models in the list in LMStudio, are quantized from larger
> models. The offerings of Kimi could be like that (the largest
> model being impossibly big, have to buy a $100K computer, good
> for Bill Gates home computer).
>
> Paul
--
Cheers, Bev
Salesmen welcome -- dog food is expensive
Back to alt.comp.software.thunderbird | Previous | Next — Previous in thread | Next in thread | Find similar | Unroll thread
"Don't mess with that which you don't understand" ... "J. P. Gilliver" <G6JPG@255soft.uk> - 2026-07-30 19:38 +0100
Re: "Don't mess with that which you don't understand" ... T <T@invalid.invalid> - 2026-07-30 16:01 -0700
Re: "Don't mess with that which you don't understand" ... The Real Bev <bashley101@gmail.com> - 2026-07-30 19:27 -0700
Re: "Don't mess with that which you don't understand" ... "J. P. Gilliver" <G6JPG@255soft.uk> - 2026-07-31 09:10 +0100
Re: "Don't mess with that which you don't understand" ... dillinger <dillinger@not.invalid> - 2026-07-31 11:45 +0200
Re: "Don't mess with that which you don't understand" ... MikeS <MikeS@fred.com> - 2026-07-31 11:56 +0100
Re: "Don't mess with that which you don't understand" ... T <T@invalid.invalid> - 2026-07-31 11:53 -0700
Re: "Don't mess with that which you don't understand" ... Paul <nospam@needed.invalid> - 2026-07-31 15:29 -0400
Re: "Don't mess with that which you don't understand" ... T <T@invalid.invalid> - 2026-08-02 02:05 -0700
Re: "Don't mess with that which you don't understand" ... Paul <nospam@needed.invalid> - 2026-07-31 10:59 -0400
Re: "Don't mess with that which you don't understand" ... Paul <nospam@needed.invalid> - 2026-07-31 14:48 -0400
Re: "Don't mess with that which you don't understand" ... The Real Bev <bashley101@gmail.com> - 2026-08-01 07:19 -0700
Re: "Don't mess with that which you don't understand" ... Paul <nospam@needed.invalid> - 2026-08-01 14:16 -0400
Re: "Don't mess with that which you don't understand" ... The Real Bev <bashley101@gmail.com> - 2026-08-01 18:38 -0700
Re: "Don't mess with that which you don't understand" ... "s|b" <me@privacy.invalid> - 2026-07-31 15:03 +0200
Re: "Don't mess with that which you don't understand" ... T <T@invalid.invalid> - 2026-07-31 12:37 -0700
Re: "Don't mess with that which you don't understand" ... T <T@invalid.invalid> - 2026-07-30 16:20 -0700
Re: "Don't mess with that which you don't understand" ... Retirednoguilt <HapilyRetired@fakeaddress.invalid> - 2026-07-31 10:48 -0400
Re: "Don't mess with that which you don't understand" ... "J. P. Gilliver" <G6JPG@255soft.uk> - 2026-07-31 21:45 +0100
csiph-web