Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]

Groups > sci.physics > #896394 > unrolled thread

The Wuhan Virus that destroyed Python [ggml Manifesto]

Back to article view | Back to sci.physics

Contents

  The Wuhan Virus that destroyed Python [ggml Manifesto] Mild Shock <janburse@fastmail.fm> - 2026-07-22 21:01 +0200
    Deadlock Exorcism: Switch from Push to Pull [A pi-calculus Specification of Prolog] (Re: The Wuhan Virus that destroyed Python [ggml Manifesto]) Mild Shock <janburse@fastmail.fm> - 2026-07-23 00:25 +0200
      Why do you even need a mpmc queue? [Thunder Kittens] (Re: Deadlock Exorcism: Switch from Push to Pull) Mild Shock <janburse@fastmail.fm> - 2026-07-23 08:45 +0200
        Trivial balancing example for (int i=0; i<global_id; i++) (Re: Why do you even need a mpmc queue? [Thunder Kittens]) Mild Shock <janburse@fastmail.fm> - 2026-07-23 08:55 +0200
          The Pixel Phone AI Experiment Song (Enqueue/dequeue need not be fast and can spinn ["fairness" questions]) Mild Shock <janburse@fastmail.fm> - 2026-07-23 09:19 +0200
            Enqueue/dequeue need not be fast and can spinn ["fairness" questions] (Re: The Pixel Phone AI Experiment Song (Enqueue/dequeue need not be fast and can spinn ["fairness" questions]) Mild Shock <janburse@fastmail.fm> - 2026-07-23 09:23 +0200
        And, where did I talk about rockets? [Hint its about xAI's Grok] (Re: Why do you even need a mpmc queue? [Thunder Kittens]) Mild Shock <janburse@fastmail.fm> - 2026-07-25 01:25 +0200
          Why forget something, that was never on my mind (Re: And, where did I talk about rockets? [Hint its about xAI's Grok]) Mild Shock <janburse@fastmail.fm> - 2026-07-25 09:49 +0200
        Example Mandel Brot rendering [Faster with MIMD] (Was: Why do you even need a mpmc queue? [Thunder Kittens]) Mild Shock <janburse@fastmail.fm> - 2026-07-25 09:56 +0200
    Potential Python Recovery: Free Threading [3.13 release] (Re: The Wuhan Virus that destroyed Python [ggml Manifesto]) Mild Shock <janburse@fastmail.fm> - 2026-07-23 10:21 +0200
    The things XILINX braught to the AMD table (Re: The Wuhan Virus that destroyed Python [ggml Manifesto]) Mild Shock <janburse@fastmail.fm> - 2026-07-23 18:48 +0200
      NVIDIA evacuated its Chinese market [Tau Scaling] (Re: The things XILINX braught to the AMD table) Mild Shock <janburse@fastmail.fm> - 2026-07-23 19:13 +0200
        Micro penis mother sung arias (Re: NVIDIA evacuated its Chinese market [Tau Scaling]) Mild Shock <janburse@fastmail.fm> - 2026-07-24 14:40 +0200
          Micro penis brain is in constant hiatus (Re: Micro penis mother sung arias) Mild Shock <janburse@fastmail.fm> - 2026-07-24 15:27 +0200
            Ignoramus or Ignorabimus: I don't care [(Re: Micro penis brain is in constant hiatus (Re: Micro penis mother sung arias) Mild Shock <janburse@fastmail.fm> - 2026-07-24 15:35 +0200
              You are a moron, brainless putin payed (Re: Ignoramus or Ignorabimus: I don't care) Mild Shock <janburse@fastmail.fm> - 2026-07-24 18:01 +0200
                Yeah keep reading my posts, uninspired fool (Re: You are a moron, brainless putin payed) Mild Shock <janburse@fastmail.fm> - 2026-07-24 19:47 +0200
              Out of the blue accusation span 15 days [Empirical USENET study] (Re: Ignoramus or Ignorabimus: I don't care) Mild Shock <janburse@fastmail.fm> - 2026-07-24 20:27 +0200
    Little Data Center on Your Palm [AI Laptops for 500 USD] (Re: The Wuhan Virus that destroyed Python [ggml Manifesto]) Mild Shock <janburse@fastmail.fm> - 2026-07-24 17:59 +0200
      2008: 4 Blades + Tesla S1070 versus 2026: 1 AI Laptop (Re: Little Data Center on Your Palm [AI Laptops for 500 USD]) Mild Shock <janburse@fastmail.fm> - 2026-07-24 18:15 +0200
    Hurry the blue bus doesnt stop indefinitely (Re: The Wuhan Virus that destroyed Python [ggml Manifesto]) Mild Shock <janburse@fastmail.fm> - 2026-07-24 20:37 +0200
      Not SIMD, a MIMD design for NVIDIA Volta (Re: Hurry the blue bus doesnt stop indefinitely) Mild Shock <janburse@fastmail.fm> - 2026-07-24 20:58 +0200
        Could take 3-4 months find machine / browser (Re: Not SIMD, a MIMD design for NVIDIA Volta) Mild Shock <janburse@fastmail.fm> - 2026-07-24 21:16 +0200

Page 2 of 2 — ← Prev page 1 [2]

#896434 — Hurry the blue bus doesnt stop indefinitely (Re: The Wuhan Virus that destroyed Python [ggml Manifesto])

Hi,

Ride the snake
He's old and his skin is cold
The west is the best
The west is the best
Get here and we'll do the rest
The blue bus is calling us
The blue bus is calling us
Driver, where you taking us?

Apocalypse Now intro: The Doors, The End {1979}
https://www.youtube.com/watch?v=CIrvSJwwJUE

Bye

 > Hi,
 >
 > Again I posted everything here:
 >
 >> 11.4 Giga Lips with a Budget Laptop
 >> https://github.com/Jean-Luc-Picard-2021/gigabudget
 >
 > The repo says, same time when I posted
 > the link first time:
 >
 >> This repository was archived by the
 >> owner on Jul 9, 2026. It is now read-only.
 >
 > Now a USENET user, who had already entitled
 > himself for a couple of irrational accusations
 >
 > towards my side, is asking this question:
 >
 > Chris M. Thomasson schrieb, Jul 24, 2026
 >> Show an outline of what you
 >> need you compute shader to do?
 >
 > Bravo, thats a delay of a wooping 15 days.
 >
 > Bye

Mild Shock schrieb:
> Hi,
> 
> Remember when first all local AI was Python
> and PyTorch APIs. And then suddently people started
> using bare metal C/C++ Code. Here is the story:
> 
> How it started:
> 
> GPT-J or GPT-J-6B is an open-source large
> language model (LLM) developed by EleutherAI
> in 2021. As the name suggests, it is a
> generative pre-trained transformer model
> designed to produce human-like text that
> continues from a prompt.
> https://www.eleuther.ai/
> 
> How it was going [Georgi Gerganov]:
> 
> So a few days later comes out the LLaMA, I do
> some calculations and I figure out “Okay, 65
> billion parameters. You probably need about
> 40 gigs of RAM, with 4-bit quantization. So
> this can run on a MacBook. Why not do it?”
> 
> Why I was able to do it so quickly - basically,
> for all that I saw it’s pretty much GPT-J architecture
> with some modifications, like some extra memorization
> layers. It’s minor changes. Basically, again, the
> existing code for the GPT-J, I just simply
> modified it there, it happened pretty quickly.
> https://changelog.com/podcast/532
> 
> Georgi Gerganov, Bulgarian, now with Hugging
> Face, ggml-cann also running on Chinese AI chips.
> ggml Manifesto https://github.com/ggml-org/ggml
> 
> Bye

[toc] | [prev] | [next] | [standalone]

#896435 — Not SIMD, a MIMD design for NVIDIA Volta (Re: Hurry the blue bus doesnt stop indefinitely)

Hi,

Its not tested on some Single Instruction/
Multiple Data (SIMD) GPU. It was only tested on
AI Laptops with Multiple instruction, Multiple

Data (GPU) architecture for the scalar registers
per logical thread. As introduced by NVIDIA Volta
in around 2017:

 > the first product was not announced until May 2017
 > https://en.wikipedia.org/wiki/Volta_%28microarchitecture%29

Although I wrote the code of Hack VM with SIMD
in mind, I never tested it on a pure SIMD GPU,
and I never ported boot.mjs or boot2.mjs to

WebGL2 / GLSL. I uploaded WebGPU / WGSL. Among the
tester I had were these AI Laptops, that could all
run WebGPU / WGSL in a browser:

 > Intel(R) Core(TM) Ultra 7 258V
 > AMD Ryzen AI 7 350 w/ Radeon 860M
 > Apple A18 Pro, Darwin Kernel Version 25.5.0
 > Snapdragon(R) X - X126100 - Qualcomm(R) Oryon(TM) CPU

Some AI Laptops had WebGPU / WGSL still behind
a browser flag, since its relatively new on ARM.
Also the above AI Laptops have all a iGPU and

not a separate GPU card.

Bye

Mild Shock schrieb:
> Hi,
> 
> Ride the snake
> He's old and his skin is cold
> The west is the best
> The west is the best
> Get here and we'll do the rest
> The blue bus is calling us
> The blue bus is calling us
> Driver, where you taking us?
> 
> Apocalypse Now intro: The Doors, The End {1979}
> https://www.youtube.com/watch?v=CIrvSJwwJUE
> 
> Bye
> 
>  > Hi,
>  >
>  > Again I posted everything here:
>  >
>  >> 11.4 Giga Lips with a Budget Laptop
>  >> https://github.com/Jean-Luc-Picard-2021/gigabudget
>  >
>  > The repo says, same time when I posted
>  > the link first time:
>  >
>  >> This repository was archived by the
>  >> owner on Jul 9, 2026. It is now read-only.
>  >
>  > Now a USENET user, who had already entitled
>  > himself for a couple of irrational accusations
>  >
>  > towards my side, is asking this question:
>  >
>  > Chris M. Thomasson schrieb, Jul 24, 2026
>  >> Show an outline of what you
>  >> need you compute shader to do?
>  >
>  > Bravo, thats a delay of a wooping 15 days.
>  >
>  > Bye
> 
> Mild Shock schrieb:
>> Hi,
>>
>> Remember when first all local AI was Python
>> and PyTorch APIs. And then suddently people started
>> using bare metal C/C++ Code. Here is the story:
>>
>> How it started:
>>
>> GPT-J or GPT-J-6B is an open-source large
>> language model (LLM) developed by EleutherAI
>> in 2021. As the name suggests, it is a
>> generative pre-trained transformer model
>> designed to produce human-like text that
>> continues from a prompt.
>> https://www.eleuther.ai/
>>
>> How it was going [Georgi Gerganov]:
>>
>> So a few days later comes out the LLaMA, I do
>> some calculations and I figure out “Okay, 65
>> billion parameters. You probably need about
>> 40 gigs of RAM, with 4-bit quantization. So
>> this can run on a MacBook. Why not do it?”
>>
>> Why I was able to do it so quickly - basically,
>> for all that I saw it’s pretty much GPT-J architecture
>> with some modifications, like some extra memorization
>> layers. It’s minor changes. Basically, again, the
>> existing code for the GPT-J, I just simply
>> modified it there, it happened pretty quickly.
>> https://changelog.com/podcast/532
>>
>> Georgi Gerganov, Bulgarian, now with Hugging
>> Face, ggml-cann also running on Chinese AI chips.
>> ggml Manifesto https://github.com/ggml-org/ggml
>>
>> Bye
> 

[toc] | [prev] | [next] | [standalone]

#896436 — Could take 3-4 months find machine / browser (Re: Not SIMD, a MIMD design for NVIDIA Volta)

Hi,

It could one take 3-4 months to find a suitable
machine and suitable browser, so that MIMD is
utilized, especially if you have:

 > A Sputnik Commodore C64 with 8088
 > from the basement of your mother

But maybe somebody figures out it also runs on
SIMD. Its not in my focus to test the SIMD
platform, I do not intend to go back in time

to 2008, and a Tesla S1070:

Tesla S1070 was an professional graphics card by NVIDIA
Its price at launch was 7999 US Dollars.
https://www.techpowerup.com/gpu-specs/tesla-s1070.c1540

Also not in 2026, a RTX 5090:

NVIDIA® RTX™ 5090 most powerful GeForce GPU ever made
With Boost Clock Speed its at 3779 USD
https://marketplace.nvidia.com/en-us/consumer/graphics-cards/?locale=en-us&page=1&limit=15&gpu=RTX+5090&has_offer=is_bestselling

The title of the experiment is really Budget Laptop.
What is a litte unspoken in the title, that the Laptop
is an AI Laptop. But you see it in the description:

 > 11.4 Giga Lips with a Budget Laptop
 > At the end of 2025 we acquired a couple of AI Laptops
 > https://github.com/Jean-Luc-Picard-2021/gigabudget

These AI Laptops are quite affordable ,
500 USD to 1000 USD.

Bye

Mild Shock schrieb:
> Hi,
> 
> Its not tested on some Single Instruction/
> Multiple Data (SIMD) GPU. It was only tested on
> AI Laptops with Multiple instruction, Multiple
> 
> Data (GPU) architecture for the scalar registers
> per logical thread. As introduced by NVIDIA Volta
> in around 2017:
> 
>  > the first product was not announced until May 2017
>  > https://en.wikipedia.org/wiki/Volta_%28microarchitecture%29
> 
> Although I wrote the code of Hack VM with SIMD
> in mind, I never tested it on a pure SIMD GPU,
> and I never ported boot.mjs or boot2.mjs to
> 
> WebGL2 / GLSL. I uploaded WebGPU / WGSL. Among the
> tester I had were these AI Laptops, that could all
> run WebGPU / WGSL in a browser:
> 
>  > Intel(R) Core(TM) Ultra 7 258V
>  > AMD Ryzen AI 7 350 w/ Radeon 860M
>  > Apple A18 Pro, Darwin Kernel Version 25.5.0
>  > Snapdragon(R) X - X126100 - Qualcomm(R) Oryon(TM) CPU
> 
> Some AI Laptops had WebGPU / WGSL still behind
> a browser flag, since its relatively new on ARM.
> Also the above AI Laptops have all a iGPU and
> 
> not a separate GPU card.
> 
> Bye
> 
> Mild Shock schrieb:
>> Hi,
>>
>> Ride the snake
>> He's old and his skin is cold
>> The west is the best
>> The west is the best
>> Get here and we'll do the rest
>> The blue bus is calling us
>> The blue bus is calling us
>> Driver, where you taking us?
>>
>> Apocalypse Now intro: The Doors, The End {1979}
>> https://www.youtube.com/watch?v=CIrvSJwwJUE
>>
>> Bye
>>
>>  > Hi,
>>  >
>>  > Again I posted everything here:
>>  >
>>  >> 11.4 Giga Lips with a Budget Laptop
>>  >> https://github.com/Jean-Luc-Picard-2021/gigabudget
>>  >
>>  > The repo says, same time when I posted
>>  > the link first time:
>>  >
>>  >> This repository was archived by the
>>  >> owner on Jul 9, 2026. It is now read-only.
>>  >
>>  > Now a USENET user, who had already entitled
>>  > himself for a couple of irrational accusations
>>  >
>>  > towards my side, is asking this question:
>>  >
>>  > Chris M. Thomasson schrieb, Jul 24, 2026
>>  >> Show an outline of what you
>>  >> need you compute shader to do?
>>  >
>>  > Bravo, thats a delay of a wooping 15 days.
>>  >
>>  > Bye
>>
>> Mild Shock schrieb:
>>> Hi,
>>>
>>> Remember when first all local AI was Python
>>> and PyTorch APIs. And then suddently people started
>>> using bare metal C/C++ Code. Here is the story:
>>>
>>> How it started:
>>>
>>> GPT-J or GPT-J-6B is an open-source large
>>> language model (LLM) developed by EleutherAI
>>> in 2021. As the name suggests, it is a
>>> generative pre-trained transformer model
>>> designed to produce human-like text that
>>> continues from a prompt.
>>> https://www.eleuther.ai/
>>>
>>> How it was going [Georgi Gerganov]:
>>>
>>> So a few days later comes out the LLaMA, I do
>>> some calculations and I figure out “Okay, 65
>>> billion parameters. You probably need about
>>> 40 gigs of RAM, with 4-bit quantization. So
>>> this can run on a MacBook. Why not do it?”
>>>
>>> Why I was able to do it so quickly - basically,
>>> for all that I saw it’s pretty much GPT-J architecture
>>> with some modifications, like some extra memorization
>>> layers. It’s minor changes. Basically, again, the
>>> existing code for the GPT-J, I just simply
>>> modified it there, it happened pretty quickly.
>>> https://changelog.com/podcast/532
>>>
>>> Georgi Gerganov, Bulgarian, now with Hugging
>>> Face, ggml-cann also running on Chinese AI chips.
>>> ggml Manifesto https://github.com/ggml-org/ggml
>>>
>>> Bye
>>
> 

[toc] | [prev] | [standalone]

Page 2 of 2 — ← Prev page 1 [2]

Back to top | Article view | sci.physics

csiph-web