Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]


Groups > sci.physics > #896394 > unrolled thread

The Wuhan Virus that destroyed Python [ggml Manifesto]

Started byMild Shock <janburse@fastmail.fm>
First post2026-07-22 21:01 +0200
Last post2026-08-09 21:19 +0200
Articles 16 on this page of 96 — 7 participants

Back to article view | Back to sci.physics


Contents

  The Wuhan Virus that destroyed Python [ggml Manifesto] Mild Shock <janburse@fastmail.fm> - 2026-07-22 21:01 +0200
    Deadlock Exorcism: Switch from Push to Pull [A pi-calculus Specification of Prolog] (Re: The Wuhan Virus that destroyed Python [ggml Manifesto]) Mild Shock <janburse@fastmail.fm> - 2026-07-23 00:25 +0200
      Why do you even need a mpmc queue? [Thunder Kittens] (Re: Deadlock Exorcism: Switch from Push to Pull) Mild Shock <janburse@fastmail.fm> - 2026-07-23 08:45 +0200
        Trivial balancing example for (int i=0; i<global_id; i++) (Re: Why do you even need a mpmc queue? [Thunder Kittens]) Mild Shock <janburse@fastmail.fm> - 2026-07-23 08:55 +0200
          The Pixel Phone AI Experiment Song (Enqueue/dequeue need not be fast and can spinn ["fairness" questions]) Mild Shock <janburse@fastmail.fm> - 2026-07-23 09:19 +0200
            Enqueue/dequeue need not be fast and can spinn ["fairness" questions] (Re: The Pixel Phone AI Experiment Song (Enqueue/dequeue need not be fast and can spinn ["fairness" questions]) Mild Shock <janburse@fastmail.fm> - 2026-07-23 09:23 +0200
        And, where did I talk about rockets? [Hint its about xAI's Grok] (Re: Why do you even need a mpmc queue? [Thunder Kittens]) Mild Shock <janburse@fastmail.fm> - 2026-07-25 01:25 +0200
          Why forget something, that was never on my mind (Re: And, where did I talk about rockets? [Hint its about xAI's Grok]) Mild Shock <janburse@fastmail.fm> - 2026-07-25 09:49 +0200
        Example Mandel Brot rendering [Faster with MIMD] (Was: Why do you even need a mpmc queue? [Thunder Kittens]) Mild Shock <janburse@fastmail.fm> - 2026-07-25 09:56 +0200
    Potential Python Recovery: Free Threading [3.13 release] (Re: The Wuhan Virus that destroyed Python [ggml Manifesto]) Mild Shock <janburse@fastmail.fm> - 2026-07-23 10:21 +0200
    The things XILINX braught to the AMD table (Re: The Wuhan Virus that destroyed Python [ggml Manifesto]) Mild Shock <janburse@fastmail.fm> - 2026-07-23 18:48 +0200
      NVIDIA evacuated its Chinese market [Tau Scaling] (Re: The things XILINX braught to the AMD table) Mild Shock <janburse@fastmail.fm> - 2026-07-23 19:13 +0200
        Micro penis mother sung arias (Re: NVIDIA evacuated its Chinese market [Tau Scaling]) Mild Shock <janburse@fastmail.fm> - 2026-07-24 14:40 +0200
          Micro penis brain is in constant hiatus (Re: Micro penis mother sung arias) Mild Shock <janburse@fastmail.fm> - 2026-07-24 15:27 +0200
            Ignoramus or Ignorabimus: I don't care [(Re: Micro penis brain is in constant hiatus (Re: Micro penis mother sung arias) Mild Shock <janburse@fastmail.fm> - 2026-07-24 15:35 +0200
              You are a moron, brainless putin payed (Re: Ignoramus or Ignorabimus: I don't care) Mild Shock <janburse@fastmail.fm> - 2026-07-24 18:01 +0200
                Yeah keep reading my posts, uninspired fool (Re: You are a moron, brainless putin payed) Mild Shock <janburse@fastmail.fm> - 2026-07-24 19:47 +0200
              Out of the blue accusation span 15 days [Empirical USENET study] (Re: Ignoramus or Ignorabimus: I don't care) Mild Shock <janburse@fastmail.fm> - 2026-07-24 20:27 +0200
              A brain desease of 20 days [Rossy Boy] (Re: Ignoramus or Ignorabimus: I don't care) Mild Shock <janburse@fastmail.fm> - 2026-07-29 18:41 +0200
                I didn't use a Ryzen Halo, whats wrong with you? (Re: A brain desease of 20 days [Rossy Boy]) Mild Shock <janburse@fastmail.fm> - 2026-07-29 23:25 +0200
                Ignoramus / Ignorabimus Barometer: Almost 1 Month (Re: A brain desease of 20 days [Rossy Boy]) Mild Shock <janburse@fastmail.fm> - 2026-08-03 00:07 +0200
        Re: NVIDIA evacuated its Chinese market [Tau Scaling] (Re: The things XILINX braught to the AMD table) Mild Shock <janburse@fastmail.fm> - 2026-07-28 14:17 +0200
        ASML stocks are plunging, bye bye dutchies (Re: NVIDIA evacuated its Chinese market [Tau Scaling]) Mild Shock <janburse@fastmail.fm> - 2026-07-28 14:18 +0200
    Little Data Center on Your Palm [AI Laptops for 500 USD] (Re: The Wuhan Virus that destroyed Python [ggml Manifesto]) Mild Shock <janburse@fastmail.fm> - 2026-07-24 17:59 +0200
      2008: 4 Blades + Tesla S1070 versus 2026: 1 AI Laptop (Re: Little Data Center on Your Palm [AI Laptops for 500 USD]) Mild Shock <janburse@fastmail.fm> - 2026-07-24 18:15 +0200
      Budget AI Laptop 2026 versus Cray T3D 1995 (Was: Little Data Center on Your Palm) Mild Shock <janburse@fastmail.fm> - 2026-08-05 14:21 +0200
        Re: Budget AI Laptop 2026 versus Cray T3D 1995 R Kym Horsell <kym@sdf.org> - 2026-08-05 21:11 +0000
          AI Alarmist with Supercomputer on Yacht [Horsy Boy] (Was: Budget AI Laptop 2026 versus Cray T3D 1995) Mild Shock <janburse@fastmail.fm> - 2026-08-06 13:21 +0200
            Re: AI Alarmist with Supercomputer on Yacht [Horsy Boy] R Kym Horsell <kym@sdf.org> - 2026-08-06 11:56 +0000
    Hurry the blue bus doesnt stop indefinitely (Re: The Wuhan Virus that destroyed Python [ggml Manifesto]) Mild Shock <janburse@fastmail.fm> - 2026-07-24 20:37 +0200
      Not SIMD, a MIMD design for NVIDIA Volta (Re: Hurry the blue bus doesnt stop indefinitely) Mild Shock <janburse@fastmail.fm> - 2026-07-24 20:58 +0200
        Could take 3-4 months find machine / browser (Re: Not SIMD, a MIMD design for NVIDIA Volta) Mild Shock <janburse@fastmail.fm> - 2026-07-24 21:16 +0200
        The Koan of pi-WAM queues [FORTRAN-S] (Re: Not SIMD, a MIMD design for NVIDIA Volta) Mild Shock <janburse@fastmail.fm> - 2026-07-26 19:54 +0200
          The turbo capping of AI Laptops (Was: The Koan of pi-WAM queues [FORTRAN-S]) Mild Shock <janburse@fastmail.fm> - 2026-07-26 20:00 +0200
          Re: The Koan of pi-WAM queues [FORTRAN-S] (Re: Not SIMD, a MIMD design for NVIDIA Volta) Mild Shock <janburse@fastmail.fm> - 2026-07-27 09:16 +0200
          Why forget Bulgarians, never on my mind (Re: The Koan of pi-WAM queues [FORTRAN-S]) Mild Shock <janburse@fastmail.fm> - 2026-07-27 09:16 +0200
            miniTriton CUDA is an alternative to torch variants (Re: Why forget Bulgarians, never on my mind) Mild Shock <janburse@fastmail.fm> - 2026-07-27 09:52 +0200
              Andrej Karpathy original gangster of Budget Laptop (Re: miniTriton CUDA is an alternative to torch variants) Mild Shock <janburse@fastmail.fm> - 2026-07-27 09:54 +0200
            The evolution of hardware and GPT-2 training (Re: Why forget Bulgarians, never on my mind) Mild Shock <janburse@fastmail.fm> - 2026-07-27 10:57 +0200
              How speed up π-WAM with vector operations (Re: The evolution of hardware and GPT-2 training) Mild Shock <janburse@fastmail.fm> - 2026-07-27 11:10 +0200
                AI accelerator extend from GPU to CPU [Zero Copying] (Re: How speed up π-WAM with vector operations) Mild Shock <janburse@fastmail.fm> - 2026-07-27 13:21 +0200
                  The invention of vector and matrix registers [NVIDIA Volta] (Re: AI accelerator extend from GPU to CPU [Zero Copying]) Mild Shock <janburse@fastmail.fm> - 2026-07-27 13:22 +0200
                    Re: The invention of vector and matrix registers [NVIDIA Volta] (Re: AI accelerator extend from GPU to CPU [Zero Copying]) Ross Finlayson <ross.a.finlayson@gmail.com> - 2026-07-27 07:34 -0700
                      Maybe they should have named it NVIDIA Einstein [Rossy Boy Toe Sucking] (Was: The invention of vector and matrix registers [NVIDIA Volta]) Mild Shock <janburse@fastmail.fm> - 2026-07-27 17:12 +0200
                      Re: The invention of vector and matrix registers [NVIDIA Volta] (Re: AI accelerator extend from GPU to CPU [Zero Copying]) R Kym Horsell <kym@sdf.com> - 2026-07-27 15:43 +0000
                        Re: The invention of vector and matrix registers [NVIDIA Volta] (Re: AI accelerator extend from GPU to CPU [Zero Copying]) R Kym Horsell <kymhorsell@gmail.com> - 2026-07-27 15:46 +0000
                        π-WAM is not adding decimals, it is removing decimals (Was: The invention of vector and matrix registers [NVIDIA Volta]) Mild Shock <janburse@fastmail.fm> - 2026-07-27 18:34 +0200
                          In Budget Laptops the TOPS come with low energy footprint (Re: π-WAM is not adding decimals, it is removing decimals) Mild Shock <janburse@fastmail.fm> - 2026-07-27 18:45 +0200
      Potato Computer owner impressed by Ukraine Tech [Rossy Boys Brother?] (Was: Hurry the blue bus doesnt stop indefinitely) Mild Shock <janburse@fastmail.fm> - 2026-07-27 16:56 +0200
        Rossy Boy is neither Einstein nor Zweistein (Was: Potato Computer owner impressed by Ukraine Tech) Mild Shock <janburse@fastmail.fm> - 2026-07-27 18:25 +0200
          You are still chewing on SIMD. LoL (Re: Rossy Boy is neither Einstein nor Zweistein) Mild Shock <janburse@fastmail.fm> - 2026-07-29 17:12 +0200
            Hurry Rossy Boy, the blue bus is waiting (Re: You are still chewing on SIMD. LoL) Mild Shock <janburse@fastmail.fm> - 2026-07-29 17:53 +0200
              Look how they advertized CUDA and logical threads (Re: Hurry Rossy Boy, the blue bus is waiting) Mild Shock <janburse@fastmail.fm> - 2026-07-29 17:55 +0200
                Forget any arithmetization of product FSA (Re: Look how they advertized CUDA and logical threads) Mild Shock <janburse@fastmail.fm> - 2026-07-29 17:58 +0200
            Rossy Boys tears could cool a data center [pi-WAM Interleaved Synchronized Emulator] (Re: You are still chewing on SIMD. LoL) Mild Shock <janburse@fastmail.fm> - 2026-07-29 20:06 +0200
              I don't use Rust, you are crazy [Jump off a bridge, idiot] (Re: Rossy Boys tears could cool a data center [pi-WAM Interleaved Synchronized Emulator]) Mild Shock <janburse@fastmail.fm> - 2026-07-29 20:25 +0200
                Hack ecosystem ignorance paired with paranoia [Nand to Tetris] (Re: I don't use Rust, you are crazy) Mild Shock <janburse@fastmail.fm> - 2026-07-29 22:52 +0200
                  A funny Q16.16 experiment with Hack (Re: Hack ecosystem ignorance paired with paranoia [Nand to Tetris]) Mild Shock <janburse@fastmail.fm> - 2026-07-29 23:11 +0200
                    Summer Challenge: libSQL = Prolog+Modes [VDBE versus π-WAM] (Was: A funny Q16.16 experiment with Hack) Mild Shock <janburse@fastmail.fm> - 2026-07-30 11:25 +0200
                  I wrote Hack VM for π-WAM from scratch [4 Months total JavaScript, Python and Java] (Re: Hack ecosystem ignorance paired with paranoia) Mild Shock <janburse@fastmail.fm> - 2026-07-30 19:37 +0200
                    For WebGPU I first had SIMD in mind (Re: I wrote Hack VM for π-WAM from scratch) Mild Shock <janburse@fastmail.fm> - 2026-07-30 19:51 +0200
                      Corr.: 4 Months --> 4 Weeks (Re: For WebGPU I first had SIMD in mind) Mild Shock <janburse@fastmail.fm> - 2026-07-30 20:05 +0200
                    MIPS is a big Huffman mess [But Hack could do it] (Re: I wrote Hack VM for π-WAM from scratch) Mild Shock <janburse@fastmail.fm> - 2026-07-30 22:32 +0200
                      Not declarative with PHI (Φ) nodes (Was: MIPS is a big Huffman mess [But Hack could do it]) Mild Shock <janburse@fastmail.fm> - 2026-07-30 22:38 +0200
                      Not declarative with PHI (Φ) nodes (Re: MIPS is a big Huffman mess [But Hack could do it]) Mild Shock <janburse@fastmail.fm> - 2026-07-30 22:39 +0200
                      Re: MIPS is a big Huffman mess [But Hack could do it] (Re: I wrote Hack VM for π-WAM from scratch) Ross Finlayson <ross.a.finlayson@gmail.com> - 2026-07-31 09:52 -0700
                        Re: MIPS is a big Huffman mess [But Hack could do it] (Re: I wrote Hack VM for π-WAM from scratch) Ross Finlayson <ross.a.finlayson@gmail.com> - 2026-07-31 10:00 -0700
                          Re: MIPS is a big Huffman mess [But Hack could do it] (Re: I wrote Hack VM for π-WAM from scratch) Ross Finlayson <ross.a.finlayson@gmail.com> - 2026-07-31 10:07 -0700
                    Quo Vadis: Extend investigations to WebNN (Was: I wrote Hack VM for π-WAM from scratch [4 Months total JavaScript, Python and Java]) Mild Shock <janburse@fastmail.fm> - 2026-07-31 20:43 +0200
                Standing on the shoulders of giants (Re: I don't use Rust, you are crazy [Jump off a bridge, idiot]) Mild Shock <janburse@fastmail.fm> - 2026-08-04 03:19 +0200
                  You Thief! Stealing Szemeredi, Aristotle, Leibniz, etc.. (Re: Standing on the shoulders of giants) Mild Shock <janburse@fastmail.fm> - 2026-08-04 15:19 +0200
                    How Rossy Boys plagiarism works [Copy Paste Slop] (Re: You Thief! Stealing Szemeredi, Aristotle, Leibniz, etc.. ) Mild Shock <janburse@fastmail.fm> - 2026-08-04 17:58 +0200
                      Statistics gave up, no salient truth [Signal Collapse] Re: How Rossy Boys plagiarism works [Copy Paste Slop] (Re: You Thief! Stealing Szemeredi, Aristotle, Leibniz, etc.. ) Mild Shock <janburse@fastmail.fm> - 2026-08-04 18:17 +0200
    Got it. Or are you too stupid? [New Usenet Mantra] (Was: The Wuhan Virus that destroyed Python [ggml Manifesto]) Mild Shock <janburse@fastmail.fm> - 2026-07-27 18:59 +0200
    Lamas in a cradle and Lamas on the edge [Red Pyjama] (Re: The Wuhan Virus that destroyed Python [ggml Manifesto]) Mild Shock <janburse@fastmail.fm> - 2026-07-29 13:03 +0200
      AI Accelerators and ISO Prolog multi-threading (Re: Lamas in a cradle and Lamas on the edge [Red Pyjama]) Mild Shock <janburse@fastmail.fm> - 2026-07-29 17:02 +0200
        Actor/Erlang is dead, no Thread and Mailbox conflation [golang channels] (Re: AI Accelerators and ISO Prolog multi-threading) (Re: Lamas in a cradle and Lamas on the edge [Red Pyjama]) Mild Shock <janburse@fastmail.fm> - 2026-07-29 17:04 +0200
          Can library(ironpaw) repurpose FFT hardware [Glimps into Ryzen AI 7 350] (Re: Actor/Erlang is dead, no Thread and Mailbox conflation ) Mild Shock <janburse@fastmail.fm> - 2026-08-01 02:32 +0200
      Tablet and phone UBS-C remote debugging (Re: Lamas in a cradle and Lamas on the edge [Red Pyjama]) Mild Shock <janburse@fastmail.fm> - 2026-08-01 12:19 +0200
        NPUs doing 2d chess comms (Manhattan Distance or L1 Norm) (Re: Tablet and phone UBS-C remote debugging) Mild Shock <janburse@fastmail.fm> - 2026-08-01 14:12 +0200
          NACK retransmission might double Manhattan Distance (Re: NPUs doing 2d chess comms) Mild Shock <janburse@fastmail.fm> - 2026-08-01 14:24 +0200
            I am using WebGPU, and not WebGL (Re: NACK retransmission might double Manhattan Distance) Mild Shock <janburse@fastmail.fm> - 2026-08-02 00:47 +0200
              Texture inside my compute shader makes no sense (Re: I am using WebGPU, and not WebGL) Mild Shock <janburse@fastmail.fm> - 2026-08-02 02:40 +0200
                Prolog inferencing and not canvasing fancy stuff (Re: Texture inside my compute shader makes no sense) Mild Shock <janburse@fastmail.fm> - 2026-08-02 02:42 +0200
        Re: Tablet and phone UBS-C remote debugging (Re: Lamas in a cradle and Lamas on the edge [Red Pyjama]) Taskfreak <taskfreak@gmail.com> - 2026-08-01 13:58 -0500
          Chris M. Thomasson can ask 100 more questions (Was: Tablet and phone UBS-C remote debugging) Mild Shock <janburse@fastmail.fm> - 2026-08-02 02:46 +0200
            npm install webgpu [Google Dawn] (Re: Chris M. Thomasson can ask 100 more questions) Mild Shock <janburse@fastmail.fm> - 2026-08-02 03:03 +0200
              GPU elasticity was already invented in 2008 with CUDA (Re: npm install webgpu [Google Dawn]) Mild Shock <janburse@fastmail.fm> - 2026-08-03 00:01 +0200
      Synthetic Multilanguage Autoformalization Dataset [Informath project] (Was: Lamas in a cradle and Lamas on the edge [Red Pyjama]) Mild Shock <janburse@fastmail.fm> - 2026-08-08 09:17 +0200
        Re: Synthetic Multilanguage Autoformalization Dataset [Informath project] (Was: Lamas in a cradle and Lamas on the edge [Red Pyjama]) x3 <x@x.net> - 2026-08-08 11:45 -0700
          Nice try Rossy Boy --> **plonk** (Was: Synthetic Multilanguage Autoformalization Dataset [Informath project]) Mild Shock <janburse@fastmail.fm> - 2026-08-08 23:02 +0200
            Ethernal September Idiots Gone (Was: Nice try Rossy Boy --> **plonk**) Mild Shock <janburse@fastmail.fm> - 2026-08-08 23:15 +0200
    Even send_color and recv_color can block [Cerebras Waver] (Re: The Wuhan Virus that destroyed Python [ggml Manifesto]) Mild Shock <janburse@fastmail.fm> - 2026-08-02 23:39 +0200
    GPU Elasticity: Collective Communications Libraries (Re: The Wuhan Virus that destroyed Python [ggml Manifesto]) Mild Shock <janburse@fastmail.fm> - 2026-08-07 14:35 +0200
      What are Flits and Phits? [Network on a Chip] (Was: GPU Elasticity: Collective Communications Libraries) Mild Shock <janburse@fastmail.fm> - 2026-08-07 18:05 +0200
    Cristallina: Thank you for the Beam (Was: The Wuhan Virus that destroyed Python [ggml Manifesto]) Mild Shock <janburse@fastmail.fm> - 2026-08-09 21:19 +0200

Page 5 of 5 — ← Prev page 1 2 3 4 [5]


#896546 — NACK retransmission might double Manhattan Distance (Re: NPUs doing 2d chess comms)

FromMild Shock <janburse@fastmail.fm>
Date2026-08-01 14:24 +0200
SubjectNACK retransmission might double Manhattan Distance (Re: NPUs doing 2d chess comms)
Message-ID<114kohb$pkdq$3@solani.org>
In reply to#896545
Hi,

As easy as queues and FIFO objects might
sound. They don't like congestion. NACK for
retransmission might double the Manhattan Distance:

You have not only start
S to end E communication:

+----E
|
|
S

You might also have ACK or NACK
from E or midpoints back to S:

    S'
   +
  +
E'

Ok, I made that up, I have no idea what a flit is,
when the author wrote this here:

"Packet flits are held in the FIFO which can
be used to determine back pressure. Dropping flits
in a NoC may not be possible since these
architectures may not provide an end-to-end
protocol for retransmission."

Routing Algorithms for 2D NoC Architectures
http://cva.stanford.edu/classes/ee382c/research/2DRouting.pdf

Bye

Mild Shock schrieb:
> Hi,
> 
> Looking at the floor plan of a NPU:
> 
> Getting peak TOPS on a Ryzen AI 7 350 NPU
> https://destevez.net/2026/05/getting-peak-tops-on-a-ryzen-ai-7-350-npu/
> 
> It seems to me comms between tiles takes
> at least Manhattan Distance or L1 Norm time,
> if there is no comms congestion
> 
> But how does a packet travel? This way:
> 
> +----E
> |
> |
> S
> 
> Or this way, from start S to end E:
> 
>     +-E
>    +
>   +
> S
> 
> And what does the chip do if there is
> traffic congestion? Some papers are
> here, possibly an old problem giving
> 
> that processor "cubes" are nothing new.
> But a "cube" would be 3D and not 2D.
> This paper is old from 2007 or so:
> 
> Routing Algorithms for 2D NoC Architectures
> http://cva.stanford.edu/classes/ee382c/research/2DRouting.pdf
> 
> Bye

[toc] | [prev] | [next] | [standalone]


#896550 — I am using WebGPU, and not WebGL (Re: NACK retransmission might double Manhattan Distance)

FromMild Shock <janburse@fastmail.fm>
Date2026-08-02 00:47 +0200
SubjectI am using WebGPU, and not WebGL (Re: NACK retransmission might double Manhattan Distance)
Message-ID<114lt1j$qdjc$2@solani.org>
In reply to#896546
Hi,

WebGPU and WebGL are two different things. I explained
that towards you already like 3-5 times.

 > Of course we can make a special texture to handle it.

You still don't understand that I am using WebGPU,
and not WebGL. WebGPU has three improvements,
that from your talking are missing in WebGL?

- It has compute shaders
- It has arrays
- It has structs
- What else?

I didn't use structs in my example, although Gemini
nearly forced me to use structs. But you could
use a struct with fields and some of these arrays

to represent a queue. But here in this example
that is open source, I only used flat arrays. I
nowhere needed to abuse textures to store something:

11.4 Giga Lips with a Budget Laptop
https://github.com/Jean-Luc-Picard-2021/gigabudget

You can study the source code, the arrays have
CUDA inspired binding annotations but are not
CUDA but rather WGSL:

Hack VM as a Compute Shader in WGSL
@group(0) @binding(0) var<storage, read> code: array<i32>;
@group(0) @binding(1) var<storage, read_write> state: array<i32>;
https://github.com/Jean-Luc-Picard-2021/gigabudget/blob/main/course/example63/boot.mjs

You can say whether a buffer is read, or read_write.
Buffers can be transfered from CPU to GPU, before
running commands, and transfered back from GPU to

CPU after running commands. The use case that
you find on GitHub uses both. Namely also fetching
results via a buffer, to then show them in

the HTML page. Shouldn't be much a problem to
run the example at home locally, all you need is
a HTTPS server. But the example is not yet queues,

but it already shows the foundation, which is WebGPU
with its language WGSL and not WebGL with its language
GLSL. These are two different things.

I explained that towards you already like 3-5 times.

Bye

Chris M. Thomasson schrieb:
 > On 8/1/2026 5:22 AM, Mild Shock wrote:
 >> Hi,
 >>
 >> As easy as queues and FIFO objects might
 >> sound. They don't like congestion. NACK for
 >> retransmission might double the Manhattan Distance:
 > [...]
 >
 > You are going to need a place to allocate nodes in the compute 
shader. Of course we can make a special texture to handle it. But, we 
need to strive to avoid a wait condition. I don't want a compute shader 
to spin. Yes, CAS can be used, but, try to make it be used as a "state 
machine", where the transitions from states are atomic. Try to avoid it 
making a loop, where we loop on failure.


Mild Shock schrieb:
> Hi,
> 
> As easy as queues and FIFO objects might
> sound. They don't like congestion. NACK for
> retransmission might double the Manhattan Distance:
> 
> You have not only start
> S to end E communication:
> 
> +----E
> |
> |
> S
> 
> You might also have ACK or NACK
> from E or midpoints back to S:
> 
>     S'
>    +
>   +
> E'
> 
> Ok, I made that up, I have no idea what a flit is,
> when the author wrote this here:
> 
> "Packet flits are held in the FIFO which can
> be used to determine back pressure. Dropping flits
> in a NoC may not be possible since these
> architectures may not provide an end-to-end
> protocol for retransmission."
> 
> Routing Algorithms for 2D NoC Architectures
> http://cva.stanford.edu/classes/ee382c/research/2DRouting.pdf
> 
> Bye
> 
> Mild Shock schrieb:
>> Hi,
>>
>> Looking at the floor plan of a NPU:
>>
>> Getting peak TOPS on a Ryzen AI 7 350 NPU
>> https://destevez.net/2026/05/getting-peak-tops-on-a-ryzen-ai-7-350-npu/
>>
>> It seems to me comms between tiles takes
>> at least Manhattan Distance or L1 Norm time,
>> if there is no comms congestion
>>
>> But how does a packet travel? This way:
>>
>> +----E
>> |
>> |
>> S
>>
>> Or this way, from start S to end E:
>>
>>     +-E
>>    +
>>   +
>> S
>>
>> And what does the chip do if there is
>> traffic congestion? Some papers are
>> here, possibly an old problem giving
>>
>> that processor "cubes" are nothing new.
>> But a "cube" would be 3D and not 2D.
>> This paper is old from 2007 or so:
>>
>> Routing Algorithms for 2D NoC Architectures
>> http://cva.stanford.edu/classes/ee382c/research/2DRouting.pdf
>>
>> Bye

[toc] | [prev] | [next] | [standalone]


#896554 — Texture inside my compute shader makes no sense (Re: I am using WebGPU, and not WebGL)

FromMild Shock <janburse@fastmail.fm>
Date2026-08-02 02:40 +0200
SubjectTexture inside my compute shader makes no sense (Re: I am using WebGPU, and not WebGL)
Message-ID<114m3mh$qh7p$3@solani.org>
In reply to#896550
Hi,

 > It has textures to work with in the pipeline.

Hi,

Why would I use text inside my compute shader.
Could you tell me. The Hack VM doesn't do
textures. You are confused. There is nothing

about textures here:

11.4 Giga Lips with a Budget Laptop
https://github.com/Jean-Luc-Picard-2021/gigabudget

You can read the text , it says nowhere
consume or produce textures. Its not a rendering
application. I use the compute shader to run Prolog:

"At the end of 2025 we acquired a couple of
AI Laptops , that were still cheap, since
RAM prices had not yet rocketed. The intend
was to tap into the Copilot+ certified hardware,
and shave off some of the TOPS to do Prolog
inferencing. Amazingly our π-WAM can
churn 11.4 GIGA LIPS.

GPUs have evolved form lock-step to independent
thread scheduling. This made it possible to
port the Hack VM variant, that forms the basis
for our π-WAM, to WebGPU computer shaders.
Using NUM_SHADERS = 4096 we could produce
11.4 Giga Lips on a Ryzen AI 7 350 w/ Radeon 860M."

Bye

Mild Shock schrieb:
> Hi,
> 
> WebGPU and WebGL are two different things. I explained
> that towards you already like 3-5 times.
> 
>  > Of course we can make a special texture to handle it.
> 
> You still don't understand that I am using WebGPU,
> and not WebGL. WebGPU has three improvements,
> that from your talking are missing in WebGL?
> 
> - It has compute shaders
> - It has arrays
> - It has structs
> - What else?
> 
> I didn't use structs in my example, although Gemini
> nearly forced me to use structs. But you could
> use a struct with fields and some of these arrays
> 
> to represent a queue. But here in this example
> that is open source, I only used flat arrays. I
> nowhere needed to abuse textures to store something:
> 
> 11.4 Giga Lips with a Budget Laptop
> https://github.com/Jean-Luc-Picard-2021/gigabudget
> 
> You can study the source code, the arrays have
> CUDA inspired binding annotations but are not
> CUDA but rather WGSL:
> 
> Hack VM as a Compute Shader in WGSL
> @group(0) @binding(0) var<storage, read> code: array<i32>;
> @group(0) @binding(1) var<storage, read_write> state: array<i32>;
> https://github.com/Jean-Luc-Picard-2021/gigabudget/blob/main/course/example63/boot.mjs 
> 
> 
> You can say whether a buffer is read, or read_write.
> Buffers can be transfered from CPU to GPU, before
> running commands, and transfered back from GPU to
> 
> CPU after running commands. The use case that
> you find on GitHub uses both. Namely also fetching
> results via a buffer, to then show them in
> 
> the HTML page. Shouldn't be much a problem to
> run the example at home locally, all you need is
> a HTTPS server. But the example is not yet queues,
> 
> but it already shows the foundation, which is WebGPU
> with its language WGSL and not WebGL with its language
> GLSL. These are two different things.
> 
> I explained that towards you already like 3-5 times.
> 
> Bye
> 
> Chris M. Thomasson schrieb:
>  > On 8/1/2026 5:22 AM, Mild Shock wrote:
>  >> Hi,
>  >>
>  >> As easy as queues and FIFO objects might
>  >> sound. They don't like congestion. NACK for
>  >> retransmission might double the Manhattan Distance:
>  > [...]
>  >
>  > You are going to need a place to allocate nodes in the compute 
> shader. Of course we can make a special texture to handle it. But, we 
> need to strive to avoid a wait condition. I don't want a compute shader 
> to spin. Yes, CAS can be used, but, try to make it be used as a "state 
> machine", where the transitions from states are atomic. Try to avoid it 
> making a loop, where we loop on failure.
> 
> 
> Mild Shock schrieb:
>> Hi,
>>
>> As easy as queues and FIFO objects might
>> sound. They don't like congestion. NACK for
>> retransmission might double the Manhattan Distance:
>>
>> You have not only start
>> S to end E communication:
>>
>> +----E
>> |
>> |
>> S
>>
>> You might also have ACK or NACK
>> from E or midpoints back to S:
>>
>>     S'
>>    +
>>   +
>> E'
>>
>> Ok, I made that up, I have no idea what a flit is,
>> when the author wrote this here:
>>
>> "Packet flits are held in the FIFO which can
>> be used to determine back pressure. Dropping flits
>> in a NoC may not be possible since these
>> architectures may not provide an end-to-end
>> protocol for retransmission."
>>
>> Routing Algorithms for 2D NoC Architectures
>> http://cva.stanford.edu/classes/ee382c/research/2DRouting.pdf
>>
>> Bye
>>
>> Mild Shock schrieb:
>>> Hi,
>>>
>>> Looking at the floor plan of a NPU:
>>>
>>> Getting peak TOPS on a Ryzen AI 7 350 NPU
>>> https://destevez.net/2026/05/getting-peak-tops-on-a-ryzen-ai-7-350-npu/
>>>
>>> It seems to me comms between tiles takes
>>> at least Manhattan Distance or L1 Norm time,
>>> if there is no comms congestion
>>>
>>> But how does a packet travel? This way:
>>>
>>> +----E
>>> |
>>> |
>>> S
>>>
>>> Or this way, from start S to end E:
>>>
>>>     +-E
>>>    +
>>>   +
>>> S
>>>
>>> And what does the chip do if there is
>>> traffic congestion? Some papers are
>>> here, possibly an old problem giving
>>>
>>> that processor "cubes" are nothing new.
>>> But a "cube" would be 3D and not 2D.
>>> This paper is old from 2007 or so:
>>>
>>> Routing Algorithms for 2D NoC Architectures
>>> http://cva.stanford.edu/classes/ee382c/research/2DRouting.pdf
>>>
>>> Bye
> 

[toc] | [prev] | [next] | [standalone]


#896555 — Prolog inferencing and not canvasing fancy stuff (Re: Texture inside my compute shader makes no sense)

FromMild Shock <janburse@fastmail.fm>
Date2026-08-02 02:42 +0200
SubjectProlog inferencing and not canvasing fancy stuff (Re: Texture inside my compute shader makes no sense)
Message-ID<114m3q3$qhf7$1@solani.org>
In reply to#896554
Hi,

 > But, I still don't know what you main goal is?

It explicity says "Prolog inferencing" in
this phrase:

 > shave off some of the TOPS to do Prolog inferencing

It nowhere says draw some fancy stuff into
a Web canvas.

Bye

Mild Shock schrieb:
> Hi,
> 
>  > It has textures to work with in the pipeline.
> 
> Hi,
> 
> Why would I use text inside my compute shader.
> Could you tell me. The Hack VM doesn't do
> textures. You are confused. There is nothing
> 
> about textures here:
> 
> 11.4 Giga Lips with a Budget Laptop
> https://github.com/Jean-Luc-Picard-2021/gigabudget
> 
> You can read the text , it says nowhere
> consume or produce textures. Its not a rendering
> application. I use the compute shader to run Prolog:
> 
> "At the end of 2025 we acquired a couple of
> AI Laptops , that were still cheap, since
> RAM prices had not yet rocketed. The intend
> was to tap into the Copilot+ certified hardware,
> and shave off some of the TOPS to do Prolog
> inferencing. Amazingly our π-WAM can
> churn 11.4 GIGA LIPS.
> 
> GPUs have evolved form lock-step to independent
> thread scheduling. This made it possible to
> port the Hack VM variant, that forms the basis
> for our π-WAM, to WebGPU computer shaders.
> Using NUM_SHADERS = 4096 we could produce
> 11.4 Giga Lips on a Ryzen AI 7 350 w/ Radeon 860M."
> 
> Bye
> 
> Mild Shock schrieb:
>> Hi,
>>
>> WebGPU and WebGL are two different things. I explained
>> that towards you already like 3-5 times.
>>
>>  > Of course we can make a special texture to handle it.
>>
>> You still don't understand that I am using WebGPU,
>> and not WebGL. WebGPU has three improvements,
>> that from your talking are missing in WebGL?
>>
>> - It has compute shaders
>> - It has arrays
>> - It has structs
>> - What else?
>>
>> I didn't use structs in my example, although Gemini
>> nearly forced me to use structs. But you could
>> use a struct with fields and some of these arrays
>>
>> to represent a queue. But here in this example
>> that is open source, I only used flat arrays. I
>> nowhere needed to abuse textures to store something:
>>
>> 11.4 Giga Lips with a Budget Laptop
>> https://github.com/Jean-Luc-Picard-2021/gigabudget
>>
>> You can study the source code, the arrays have
>> CUDA inspired binding annotations but are not
>> CUDA but rather WGSL:
>>
>> Hack VM as a Compute Shader in WGSL
>> @group(0) @binding(0) var<storage, read> code: array<i32>;
>> @group(0) @binding(1) var<storage, read_write> state: array<i32>;
>> https://github.com/Jean-Luc-Picard-2021/gigabudget/blob/main/course/example63/boot.mjs 
>>
>>
>> You can say whether a buffer is read, or read_write.
>> Buffers can be transfered from CPU to GPU, before
>> running commands, and transfered back from GPU to
>>
>> CPU after running commands. The use case that
>> you find on GitHub uses both. Namely also fetching
>> results via a buffer, to then show them in
>>
>> the HTML page. Shouldn't be much a problem to
>> run the example at home locally, all you need is
>> a HTTPS server. But the example is not yet queues,
>>
>> but it already shows the foundation, which is WebGPU
>> with its language WGSL and not WebGL with its language
>> GLSL. These are two different things.
>>
>> I explained that towards you already like 3-5 times.
>>
>> Bye
>>
>> Chris M. Thomasson schrieb:
>>  > On 8/1/2026 5:22 AM, Mild Shock wrote:
>>  >> Hi,
>>  >>
>>  >> As easy as queues and FIFO objects might
>>  >> sound. They don't like congestion. NACK for
>>  >> retransmission might double the Manhattan Distance:
>>  > [...]
>>  >
>>  > You are going to need a place to allocate nodes in the compute 
>> shader. Of course we can make a special texture to handle it. But, we 
>> need to strive to avoid a wait condition. I don't want a compute 
>> shader to spin. Yes, CAS can be used, but, try to make it be used as a 
>> "state machine", where the transitions from states are atomic. Try to 
>> avoid it making a loop, where we loop on failure.
>>
>>
>> Mild Shock schrieb:
>>> Hi,
>>>
>>> As easy as queues and FIFO objects might
>>> sound. They don't like congestion. NACK for
>>> retransmission might double the Manhattan Distance:
>>>
>>> You have not only start
>>> S to end E communication:
>>>
>>> +----E
>>> |
>>> |
>>> S
>>>
>>> You might also have ACK or NACK
>>> from E or midpoints back to S:
>>>
>>>     S'
>>>    +
>>>   +
>>> E'
>>>
>>> Ok, I made that up, I have no idea what a flit is,
>>> when the author wrote this here:
>>>
>>> "Packet flits are held in the FIFO which can
>>> be used to determine back pressure. Dropping flits
>>> in a NoC may not be possible since these
>>> architectures may not provide an end-to-end
>>> protocol for retransmission."
>>>
>>> Routing Algorithms for 2D NoC Architectures
>>> http://cva.stanford.edu/classes/ee382c/research/2DRouting.pdf
>>>
>>> Bye
>>>
>>> Mild Shock schrieb:
>>>> Hi,
>>>>
>>>> Looking at the floor plan of a NPU:
>>>>
>>>> Getting peak TOPS on a Ryzen AI 7 350 NPU
>>>> https://destevez.net/2026/05/getting-peak-tops-on-a-ryzen-ai-7-350-npu/
>>>>
>>>> It seems to me comms between tiles takes
>>>> at least Manhattan Distance or L1 Norm time,
>>>> if there is no comms congestion
>>>>
>>>> But how does a packet travel? This way:
>>>>
>>>> +----E
>>>> |
>>>> |
>>>> S
>>>>
>>>> Or this way, from start S to end E:
>>>>
>>>>     +-E
>>>>    +
>>>>   +
>>>> S
>>>>
>>>> And what does the chip do if there is
>>>> traffic congestion? Some papers are
>>>> here, possibly an old problem giving
>>>>
>>>> that processor "cubes" are nothing new.
>>>> But a "cube" would be 3D and not 2D.
>>>> This paper is old from 2007 or so:
>>>>
>>>> Routing Algorithms for 2D NoC Architectures
>>>> http://cva.stanford.edu/classes/ee382c/research/2DRouting.pdf
>>>>
>>>> Bye
>>
> 

[toc] | [prev] | [next] | [standalone]


#896547 — Re: Tablet and phone UBS-C remote debugging (Re: Lamas in a cradle and Lamas on the edge [Red Pyjama])

FromTaskfreak <taskfreak@gmail.com>
Date2026-08-01 13:58 -0500
SubjectRe: Tablet and phone UBS-C remote debugging (Re: Lamas in a cradle and Lamas on the edge [Red Pyjama])
Message-ID<114lfkf$plpm$1@solani.org>
In reply to#896544
On 8/1/26 05:19, Mild Shock wrote:
> Hi,
> 
> Tablets and phone are more annoying to
> use with WebGPU. The usual browsers don't
> have a Chrome DevTools panel integrated,
> 
> so that one could do JavaScript Debugging
> directly on the device. Instead one has to
> use a desktop machine, and connect the
> 
> device via UBS-C , and start a Chrome
> Browser there . And then start a Chrome
> DevTools panel alone, that is pair with
> 
> the device, via UBS-C cable. So this way
> I already see where it crashes on the
> tablets and phone:
> 
> await output.mapAsync(GPUMapMode.READ)
> Unhandled Promise Rejection: OperationError
> 
> The above is the error that one can re-produce
> already here with this test:
> 
> 11.4 Giga Lips with a Budget Laptop
> https://github.com/Jean-Luc-Picard-2021/gigabudget
> 
> Not sure what exactly happens. Maybe
> a form of timeout or device lost, that the
> primitive HTML / JavaScript doesn't handle
> 
> gracefully yet. Maybe redimensioning the
> test, so that it consumes less time would
> help. Who knows? Will see. For production
> 
> use of a GPU integration I have to anyway
> provide work slicing it seems.
> 
> Bye
> 

I know that you are Hanson and I know that you are a cocksucker.

My question is, though, do you know, do, vomit, defecate, smell, 
evaporate, sweat, ooze in, ooze out, fart, see, hear, sense, taste, and 
GESTATE anything other than programming?

Programming is just a tool, you know. It is nothing by itself worth even 
mentioning.

[toc] | [prev] | [next] | [standalone]


#896556 — Chris M. Thomasson can ask 100 more questions (Was: Tablet and phone UBS-C remote debugging)

FromMild Shock <janburse@fastmail.fm>
Date2026-08-02 02:46 +0200
SubjectChris M. Thomasson can ask 100 more questions (Was: Tablet and phone UBS-C remote debugging)
Message-ID<114m40m$qhhl$1@solani.org>
In reply to#896547
Hi,

Chris M. Thomasson can ask 100 more questions.
I will happily answer them. But maybe I should
make a Wiki to explain the ever same things:

 > But, I still don't know what you main goal is?
The goal is "Prolog inferencing"

 > It has textures to work with in the pipeline.
I don't need textures for "Prolog inferencing"

98 more questions to go, don't give up!

Bye

Taskfreak schrieb:
> On 8/1/26 05:19, Mild Shock wrote:
>> Hi,
>>
>> Tablets and phone are more annoying to
>> use with WebGPU. The usual browsers don't
>> have a Chrome DevTools panel integrated,
>>
>> so that one could do JavaScript Debugging
>> directly on the device. Instead one has to
>> use a desktop machine, and connect the
>>
>> device via UBS-C , and start a Chrome
>> Browser there . And then start a Chrome
>> DevTools panel alone, that is pair with
>>
>> the device, via UBS-C cable. So this way
>> I already see where it crashes on the
>> tablets and phone:
>>
>> await output.mapAsync(GPUMapMode.READ)
>> Unhandled Promise Rejection: OperationError
>>
>> The above is the error that one can re-produce
>> already here with this test:
>>
>> 11.4 Giga Lips with a Budget Laptop
>> https://github.com/Jean-Luc-Picard-2021/gigabudget
>>
>> Not sure what exactly happens. Maybe
>> a form of timeout or device lost, that the
>> primitive HTML / JavaScript doesn't handle
>>
>> gracefully yet. Maybe redimensioning the
>> test, so that it consumes less time would
>> help. Who knows? Will see. For production
>>
>> use of a GPU integration I have to anyway
>> provide work slicing it seems.
>>
>> Bye
>>
> 
> I know that you are Hanson and I know that you are a cocksucker.
> 
> My question is, though, do you know, do, vomit, defecate, smell, 
> evaporate, sweat, ooze in, ooze out, fart, see, hear, sense, taste, and 
> GESTATE anything other than programming?
> 
> Programming is just a tool, you know. It is nothing by itself worth even 
> mentioning.
> 
> 

[toc] | [prev] | [next] | [standalone]


#896557 — npm install webgpu [Google Dawn] (Re: Chris M. Thomasson can ask 100 more questions)

FromMild Shock <janburse@fastmail.fm>
Date2026-08-02 03:03 +0200
Subjectnpm install webgpu [Google Dawn] (Re: Chris M. Thomasson can ask 100 more questions)
Message-ID<114m50h$qi3v$2@solani.org>
In reply to#896556
Hi,

Ok, following the instructions here:

npm install webgpu
https://github.com/dawn-gpu/node-webgpu

I can now run webgpu also from CLI:

 >node.exe dogelog.mjs
Dogelog Spieler 2.2.5, Node, JavaScript 26.4.0
(c) 1985-2026, XLOG Technologies AG, Schweiz

?- ensure_loaded(library(edge/furryhaze)).
true.

?- between(1,3,_), time(expedite((between(1,100,_),
between(1,100,_), between(1,100,_)), [size(4096)])), fail.
% Zeit 1037.994 ms, GC 0.000 ms, Lips 111 k
% Zeit 1091.131 ms, GC 0.000 ms, Lips 106 k
% Zeit 1045.274 ms, GC 0.000 ms, Lips 110 k
fail.

Same benchmark result as in the browser.
Now I can rent a bigger GPU by the hour
and do some easy CLI testing.

LoL

Bye

Mild Shock schrieb:
> Hi,
> 
> Chris M. Thomasson can ask 100 more questions.
> I will happily answer them. But maybe I should
> make a Wiki to explain the ever same things:
> 
>  > But, I still don't know what you main goal is?
> The goal is "Prolog inferencing"
> 
>  > It has textures to work with in the pipeline.
> I don't need textures for "Prolog inferencing"
> 
> 98 more questions to go, don't give up!
> 
> Bye
> 
> Taskfreak schrieb:
>> On 8/1/26 05:19, Mild Shock wrote:
>>> Hi,
>>>
>>> Tablets and phone are more annoying to
>>> use with WebGPU. The usual browsers don't
>>> have a Chrome DevTools panel integrated,
>>>
>>> so that one could do JavaScript Debugging
>>> directly on the device. Instead one has to
>>> use a desktop machine, and connect the
>>>
>>> device via UBS-C , and start a Chrome
>>> Browser there . And then start a Chrome
>>> DevTools panel alone, that is pair with
>>>
>>> the device, via UBS-C cable. So this way
>>> I already see where it crashes on the
>>> tablets and phone:
>>>
>>> await output.mapAsync(GPUMapMode.READ)
>>> Unhandled Promise Rejection: OperationError
>>>
>>> The above is the error that one can re-produce
>>> already here with this test:
>>>
>>> 11.4 Giga Lips with a Budget Laptop
>>> https://github.com/Jean-Luc-Picard-2021/gigabudget
>>>
>>> Not sure what exactly happens. Maybe
>>> a form of timeout or device lost, that the
>>> primitive HTML / JavaScript doesn't handle
>>>
>>> gracefully yet. Maybe redimensioning the
>>> test, so that it consumes less time would
>>> help. Who knows? Will see. For production
>>>
>>> use of a GPU integration I have to anyway
>>> provide work slicing it seems.
>>>
>>> Bye
>>>
>>
>> I know that you are Hanson and I know that you are a cocksucker.
>>
>> My question is, though, do you know, do, vomit, defecate, smell, 
>> evaporate, sweat, ooze in, ooze out, fart, see, hear, sense, taste, 
>> and GESTATE anything other than programming?
>>
>> Programming is just a tool, you know. It is nothing by itself worth 
>> even mentioning.
>>
>>
> 

[toc] | [prev] | [next] | [standalone]


#896562 — GPU elasticity was already invented in 2008 with CUDA (Re: npm install webgpu [Google Dawn])

FromMild Shock <janburse@fastmail.fm>
Date2026-08-03 00:01 +0200
SubjectGPU elasticity was already invented in 2008 with CUDA (Re: npm install webgpu [Google Dawn])
Message-ID<114oen0$rlg9$4@solani.org>
In reply to#896557
Hi,

Chris M. Thomasson schrieb:

 > Strive to never make a compute shader wait
 > on something, like an empty condition of a queue, stack.

You are such a moron. GPU elasticity was
already invented in 2008 with CUDA. I posted
this quote already:

"CUDA™ TEChNOLOGY UNLOCkS ThE
POWER OF TESLA MANY-CORE PROCESSORS

The CUDA C compiler simplifies many-core
programming by enabling code development
in a high-level language and optimizing code
to run on systems without knowledge of how

many cores are in the hardware. CUDA
applications automatically take advantage of
more cores or fewer cores in a system, so
they can scale from entry-level notebook

GPUs to high end GPUs in technical workstations
and further into racks of GPUs in data centers.
This allows developers to “code once” and
deploy on a range of systems, as well as scale

forward in time as future GPUs deliver more
performance per watt and more cores per
processor. The benefit for software users is
the opportunity to boost computing performance

simply by adding GPUs or using their existing GPUs in new ways"
https://www.nvidia.com/docs/IO/43395/NV_DS_Tesla_S1070_US_Jun08_NV_LR_Final.pdf

Today elasticity is on logical thread aka task level,
not only on "core" level or something. Don't know
exactly what CUDA did back them, maybe only

a submit elasticity, like a time sharing system. Today
you have quite some run elasticity on modern machines,
for your logical threads. Even in budget laptops

like a Ryzen AI 7 350 /w Radeon 850M.

Bye

Mild Shock schrieb:
> Hi,
> 
> Ok, following the instructions here:
> 
> npm install webgpu
> https://github.com/dawn-gpu/node-webgpu
> 
> I can now run webgpu also from CLI:
> 
>  >node.exe dogelog.mjs
> Dogelog Spieler 2.2.5, Node, JavaScript 26.4.0
> (c) 1985-2026, XLOG Technologies AG, Schweiz
> 
> ?- ensure_loaded(library(edge/furryhaze)).
> true.
> 
> ?- between(1,3,_), time(expedite((between(1,100,_),
> between(1,100,_), between(1,100,_)), [size(4096)])), fail.
> % Zeit 1037.994 ms, GC 0.000 ms, Lips 111 k
> % Zeit 1091.131 ms, GC 0.000 ms, Lips 106 k
> % Zeit 1045.274 ms, GC 0.000 ms, Lips 110 k
> fail.
> 
> Same benchmark result as in the browser.
> Now I can rent a bigger GPU by the hour
> and do some easy CLI testing.
> 
> LoL
> 
> Bye
> 
> Mild Shock schrieb:
>> Hi,
>>
>> Chris M. Thomasson can ask 100 more questions.
>> I will happily answer them. But maybe I should
>> make a Wiki to explain the ever same things:
>>
>>  > But, I still don't know what you main goal is?
>> The goal is "Prolog inferencing"
>>
>>  > It has textures to work with in the pipeline.
>> I don't need textures for "Prolog inferencing"
>>
>> 98 more questions to go, don't give up!
>>
>> Bye
>>
>> Taskfreak schrieb:
>>> On 8/1/26 05:19, Mild Shock wrote:
>>>> Hi,
>>>>
>>>> Tablets and phone are more annoying to
>>>> use with WebGPU. The usual browsers don't
>>>> have a Chrome DevTools panel integrated,
>>>>
>>>> so that one could do JavaScript Debugging
>>>> directly on the device. Instead one has to
>>>> use a desktop machine, and connect the
>>>>
>>>> device via UBS-C , and start a Chrome
>>>> Browser there . And then start a Chrome
>>>> DevTools panel alone, that is pair with
>>>>
>>>> the device, via UBS-C cable. So this way
>>>> I already see where it crashes on the
>>>> tablets and phone:
>>>>
>>>> await output.mapAsync(GPUMapMode.READ)
>>>> Unhandled Promise Rejection: OperationError
>>>>
>>>> The above is the error that one can re-produce
>>>> already here with this test:
>>>>
>>>> 11.4 Giga Lips with a Budget Laptop
>>>> https://github.com/Jean-Luc-Picard-2021/gigabudget
>>>>
>>>> Not sure what exactly happens. Maybe
>>>> a form of timeout or device lost, that the
>>>> primitive HTML / JavaScript doesn't handle
>>>>
>>>> gracefully yet. Maybe redimensioning the
>>>> test, so that it consumes less time would
>>>> help. Who knows? Will see. For production
>>>>
>>>> use of a GPU integration I have to anyway
>>>> provide work slicing it seems.
>>>>
>>>> Bye
>>>>
>>>
>>> I know that you are Hanson and I know that you are a cocksucker.
>>>
>>> My question is, though, do you know, do, vomit, defecate, smell, 
>>> evaporate, sweat, ooze in, ooze out, fart, see, hear, sense, taste, 
>>> and GESTATE anything other than programming?
>>>
>>> Programming is just a tool, you know. It is nothing by itself worth 
>>> even mentioning.
>>>
>>>
>>
> 

[toc] | [prev] | [next] | [standalone]


#896612 — Synthetic Multilanguage Autoformalization Dataset [Informath project] (Was: Lamas in a cradle and Lamas on the edge [Red Pyjama])

FromMild Shock <janburse@fastmail.fm>
Date2026-08-08 09:17 +0200
SubjectSynthetic Multilanguage Autoformalization Dataset [Informath project] (Was: Lamas in a cradle and Lamas on the edge [Red Pyjama])
Message-ID<1156l80$3p2i$1@solani.org>
In reply to#896505
Hi,

Why is nobody mentioning Agda here. It has
beautiful dependent types, and tactics are
just programs. Poor Henk Barendregt, not

everybody likes dependent types it seems:

Are we stuck with Lean?
https://mathoverflow.net/q/513742/

Does Depependent types require proof objects,
which waste large amounts of memory. Well,
if you are not good in erasing them.

But is there a Red Pyjama for Proof Assistants,
the baby cradle where LLMs can learn proof
assistant lingua and strategies. It seems

yes, synthetic data corpuses to the rescue:

We address this gap by introducing SMAD
(Synthetic Multilanguage Autoformalization
Dataset), a 400K 4-to-3 parallel corpus
covering four formal languages (Dedukti,
Agda, Coq, Lean) and three natural languages (
English, French, Swedish), generated via
the Informath project.
https://github.com/GrammaticalFramework/informath

But the corpus could be an accident, maybe rather
a toy from the https://www.grammaticalframework.org/
folks, will this have an impact?

Bye

Mild Shock schrieb:
> Hi,
> 
> Why does this Lama have a red pyjama.
> Oh, its a baby Lama. Its still in the cradle
> and needs some training:
> 
> RedPajama-Data-v2
> https://github.com/togethercomputer/RedPajama-Data
> 
> But then Andrej Karpathy recently showed
> GPT-2 training on rented GPUs for less
> than 100 USD in less then 2 hours.
> 
> So where do these grown up Lamas go.
> Well Georgi Gerganov prefered C++/C
> when he shouted Llama Llama Red Pyjama.
> 
> But you also find WebLLM, wrapping the
> underlying C++/C GPU interface via the
> W3C standard WebGPU / WGSL, with JavaScript:
> 
> In-Browser LLM Inference Engine
> https://webllm.mlc.ai/
> 
> My experience with WebLLM 6 months
> ago on an iPad Pro 2024, still a little early
> stage performance and robustness.
> 
> But hey hardware of AI mobile iGPUs is
> still evolving, and AI laptop, AI smartphones
> and AI tablets, will soon feature Chinese
> 
> hardware such some new Kirin AI in 2027.
> 
> Bye
> 
> Mild Shock schrieb:
>> Hi,
>>
>> Remember when first all local AI was Python
>> and PyTorch APIs. And then suddently people started
>> using bare metal C/C++ Code. Here is the story:
>>
>> How it started:
>>
>> GPT-J or GPT-J-6B is an open-source large
>> language model (LLM) developed by EleutherAI
>> in 2021. As the name suggests, it is a
>> generative pre-trained transformer model
>> designed to produce human-like text that
>> continues from a prompt.
>> https://www.eleuther.ai/
>>
>> How it was going [Georgi Gerganov]:
>>
>> So a few days later comes out the LLaMA, I do
>> some calculations and I figure out “Okay, 65
>> billion parameters. You probably need about
>> 40 gigs of RAM, with 4-bit quantization. So
>> this can run on a MacBook. Why not do it?”
>>
>> Why I was able to do it so quickly - basically,
>> for all that I saw it’s pretty much GPT-J architecture
>> with some modifications, like some extra memorization
>> layers. It’s minor changes. Basically, again, the
>> existing code for the GPT-J, I just simply
>> modified it there, it happened pretty quickly.
>> https://changelog.com/podcast/532
>>
>> Georgi Gerganov, Bulgarian, now with Hugging
>> Face, ggml-cann also running on Chinese AI chips.
>> ggml Manifesto https://github.com/ggml-org/ggml
>>
>> Bye
> 

[toc] | [prev] | [next] | [standalone]


#896615 — Re: Synthetic Multilanguage Autoformalization Dataset [Informath project] (Was: Lamas in a cradle and Lamas on the edge [Red Pyjama])

Fromx3 <x@x.net>
Date2026-08-08 11:45 -0700
SubjectRe: Synthetic Multilanguage Autoformalization Dataset [Informath project] (Was: Lamas in a cradle and Lamas on the edge [Red Pyjama])
Message-ID<1157th5$1nusa$1@dont-email.me>
In reply to#896612
On 8/4/26 05:42, Mild Shock wrote:
 >
 > Have Fun!
 >
 > Bye
 >
 > Mild Shock schrieb:
 >

I am thinking that mind uploading would require
advanced microscopy to read all of the logic
within the connections between the coding neurons
in the brain, the axons, dendrites, and synapses,
as well as massively parallel computing to simulate
the operation of such an uploaded brain in reasonable
amounts of time.

Then of course there is the series 'Upload'.

The moral of the story of course is that the secret
to immortal life is that you need to get a subscription
to Amazon Prime.


[toc] | [prev] | [next] | [standalone]


#896619 — Nice try Rossy Boy --> **plonk** (Was: Synthetic Multilanguage Autoformalization Dataset [Informath project])

FromMild Shock <janburse@fastmail.fm>
Date2026-08-08 23:02 +0200
SubjectNice try Rossy Boy --> **plonk** (Was: Synthetic Multilanguage Autoformalization Dataset [Informath project])
Message-ID<11585h6$4p63$1@solani.org>
In reply to#896615
Hi,

Nice try Rossy Boy --> **plonk**

Bye

P.S.: Woa!
My killfile is growing, and growing...

x3 schrieb:
> On 8/4/26 05:42, Mild Shock wrote:
>  >
>  > Have Fun!
>  >
>  > Bye
>  >
>  > Mild Shock schrieb:
>  >
> 
> I am thinking that mind uploading would require
> advanced microscopy to read all of the logic
> within the connections between the coding neurons
> in the brain, the axons, dendrites, and synapses,
> as well as massively parallel computing to simulate
> the operation of such an uploaded brain in reasonable
> amounts of time.
> 
> Then of course there is the series 'Upload'.
> 
> The moral of the story of course is that the secret
> to immortal life is that you need to get a subscription
> to Amazon Prime.
> 
> 
> 

[toc] | [prev] | [next] | [standalone]


#896620 — Ethernal September Idiots Gone (Was: Nice try Rossy Boy --> **plonk**)

FromMild Shock <janburse@fastmail.fm>
Date2026-08-08 23:15 +0200
SubjectEthernal September Idiots Gone (Was: Nice try Rossy Boy --> **plonk**)
Message-ID<11586ad$4pp0$1@solani.org>
In reply to#896619
Hi,

Noice, this here works:

name="Spider Monkey"
enabled="yes"
type="20"
action="Delete"
condition="AND (\"organization\",is,A noiseless patient Spider)"

Furture and Present Ethernal September Idiots gone.

Bye

Mild Shock schrieb:
> Hi,
> 
> Nice try Rossy Boy --> **plonk**
> 
> Bye
> 
> P.S.: Woa!
> My killfile is growing, and growing...
> 
> x3 schrieb:
>> On 8/4/26 05:42, Mild Shock wrote:
>>  >
>>  > Have Fun!
>>  >
>>  > Bye
>>  >
>>  > Mild Shock schrieb:
>>  >
>>
>> I am thinking that mind uploading would require
>> advanced microscopy to read all of the logic
>> within the connections between the coding neurons
>> in the brain, the axons, dendrites, and synapses,
>> as well as massively parallel computing to simulate
>> the operation of such an uploaded brain in reasonable
>> amounts of time.
>>
>> Then of course there is the series 'Upload'.
>>
>> The moral of the story of course is that the secret
>> to immortal life is that you need to get a subscription
>> to Amazon Prime.
>>
>>
>>
> 

[toc] | [prev] | [next] | [standalone]


#896561 — Even send_color and recv_color can block [Cerebras Waver] (Re: The Wuhan Virus that destroyed Python [ggml Manifesto])

FromMild Shock <janburse@fastmail.fm>
Date2026-08-02 23:39 +0200
SubjectEven send_color and recv_color can block [Cerebras Waver] (Re: The Wuhan Virus that destroyed Python [ggml Manifesto])
Message-ID<114oddm$rkoo$3@solani.org>
In reply to#896394
Hi,

If only the fucking moron Chris M. Thomasson would
stop spamming his nonsense, he doesn't listen at
all. Problem, he cannot read, he knows nothing.

Its very common that compute shaders can block,
when they are used for General Purpose computation
on GPUs (GPGPU). If only he would pull out his

finger from his asshole, and stop thinking in his
WebGL legacy code stash nonsense. Even the
Cerebras Waver has blocking:

"Cerebras Software Language (CSL), send_color
and recv_color are parameters passed to tile
programs to manage data routing and virtual
channels (called colors) across processing
elements (PEs) on the wafer

Yes, both send and receive operations can block
on a Cerebras Processing Element (PE), primarily
due to the system's hardware-enforced backpressure
mechanism. Because the Cerebras Wafer-Scale Engine
(WSE) relies on a fine-grained,

dataflow-driven architecture, blocking prevents
data loss when hardware resources are
fully saturated."

Blocking and Unblocking
https://sdk.cerebras.ai/computing-with-cerebras#blocking-and-unblocking

Chris M. Thomasson is an annoyance and an idiot.
He is a total waste of time. And represents those
people who cannot use their brain.

Bye

Chris M. Thomasson schrieb:
 > On 8/1/2026 5:47 PM, Mild Shock wrote:
 >> Hi,
 >>
 >> Chris M. Thomasson can ask 100 more questions.
 >> I will happily answer them. But maybe I should
 >> make a Wiki to explain the ever same things:
 >>
 >>  > But, I still don't know what you main goal is?
 >> The goal is "Prolog inferencing"
 >>
 >>  > It has textures to work with in the pipeline.
 >> I don't need textures for "Prolog inferencing"
 >>
 >> 98 more questions to go, don't give up!
 > [...]
 >
 > Fwiw, I have several compute shaders that do what I want. Mainly 
building vector fields, etc.... And yes I use textures for some input 
and output, uniforms mainly for the settings, etc. Just, make sure to 
code things up to a point where your compute shader never needs to wait 
for something... Think of striving for wait-free algorithms.
 >
 > For instance, this is 100% wait free.
 >
 > void add_hit(ct_plane2d plane, vec2 p, vec3 weight)
 > {
 >      vec2 uv = ct_plane2d_unproject(plane, p);
 >      ivec2 px = ivec2(uv * u_resolution);
 >
 >      if (px.x >= 0 && px.x < int(u_resolution.x) &&
 >          px.y >= 0 && px.y < int(u_resolution.y))
 >      {
 >          imageAtomicAdd(accum_r,    px, weight.r);
 >          imageAtomicAdd(accum_g,    px, weight.g);
 >          imageAtomicAdd(accum_b,    px, weight.b);
 >          imageAtomicAdd(accum_hits, px, 1.0f);
 >      }
 > }
 >
 >
 > Notice how I separated my accumulation buffer into different textures?
 >
 > layout(binding = 0, r32f) uniform coherent image2D accum_r;
 > layout(binding = 1, r32f) uniform coherent image2D accum_g;
 > layout(binding = 2, r32f) uniform coherent image2D accum_b;
 > layout(binding = 3, r32f) uniform coherent image2D accum_hits;  // 
alpha / hit counter
 >
 > Works great and runs really fast.

Mild Shock schrieb:
> Hi,
> 
> Remember when first all local AI was Python
> and PyTorch APIs. And then suddently people started
> using bare metal C/C++ Code. Here is the story:
> 
> How it started:
> 
> GPT-J or GPT-J-6B is an open-source large
> language model (LLM) developed by EleutherAI
> in 2021. As the name suggests, it is a
> generative pre-trained transformer model
> designed to produce human-like text that
> continues from a prompt.
> https://www.eleuther.ai/
> 
> How it was going [Georgi Gerganov]:
> 
> So a few days later comes out the LLaMA, I do
> some calculations and I figure out “Okay, 65
> billion parameters. You probably need about
> 40 gigs of RAM, with 4-bit quantization. So
> this can run on a MacBook. Why not do it?”
> 
> Why I was able to do it so quickly - basically,
> for all that I saw it’s pretty much GPT-J architecture
> with some modifications, like some extra memorization
> layers. It’s minor changes. Basically, again, the
> existing code for the GPT-J, I just simply
> modified it there, it happened pretty quickly.
> https://changelog.com/podcast/532
> 
> Georgi Gerganov, Bulgarian, now with Hugging
> Face, ggml-cann also running on Chinese AI chips.
> ggml Manifesto https://github.com/ggml-org/ggml
> 
> Bye

[toc] | [prev] | [next] | [standalone]


#896603 — GPU Elasticity: Collective Communications Libraries (Re: The Wuhan Virus that destroyed Python [ggml Manifesto])

FromMild Shock <janburse@fastmail.fm>
Date2026-08-07 14:35 +0200
SubjectGPU Elasticity: Collective Communications Libraries (Re: The Wuhan Virus that destroyed Python [ggml Manifesto])
Message-ID<1154jf1$296j$2@solani.org>
In reply to#896394
Hi,

How it started, NVIDIA being cool:

NCCL provides routines such as all-gather,
all-reduce, broadcast, reduce, reduce-scatter,
and point-to-point send and receive. These
routines are optimized to achieve high
bandwidth and low latency over PCIe,
NVIDIA NVLink™, and other high-speed
interconnects within a node and over
NVIDIA networking across nodes.
https://developer.nvidia.com/nccl

How its going, vLLM trying to be cool:

[RFC]: Native Weight Syncing APIs
However, there are no standardized methods for
performing online weight syncing. Open source projects
like SkyRL, VeRL, and TRL need to include their
own implementations of the weight syncing
infrastructure, leading to added complexity
for developers seeking to adopt vLLM as their
inference server for post-training workloads.
https://github.com/vllm-project/vllm/issues/31848

How much Workers are enough? I guess it depends
on I/O parallelism, CPU Memory parallelism, CPU
Processing parallelism, and now also

GPU Memory parallelism and GPU Processing
parallelism, and last but least you might have
a couple DMAs sitting here and there,

or even invoking a sort of RDMA. Quite amazing!

Bye

Mild Shock schrieb:
> Hi,
> 
> Remember when first all local AI was Python
> and PyTorch APIs. And then suddently people started
> using bare metal C/C++ Code. Here is the story:
> 
> How it started:
> 
> GPT-J or GPT-J-6B is an open-source large
> language model (LLM) developed by EleutherAI
> in 2021. As the name suggests, it is a
> generative pre-trained transformer model
> designed to produce human-like text that
> continues from a prompt.
> https://www.eleuther.ai/
> 
> How it was going [Georgi Gerganov]:
> 
> So a few days later comes out the LLaMA, I do
> some calculations and I figure out “Okay, 65
> billion parameters. You probably need about
> 40 gigs of RAM, with 4-bit quantization. So
> this can run on a MacBook. Why not do it?”
> 
> Why I was able to do it so quickly - basically,
> for all that I saw it’s pretty much GPT-J architecture
> with some modifications, like some extra memorization
> layers. It’s minor changes. Basically, again, the
> existing code for the GPT-J, I just simply
> modified it there, it happened pretty quickly.
> https://changelog.com/podcast/532
> 
> Georgi Gerganov, Bulgarian, now with Hugging
> Face, ggml-cann also running on Chinese AI chips.
> ggml Manifesto https://github.com/ggml-org/ggml
> 
> Bye

[toc] | [prev] | [next] | [standalone]


#896604 — What are Flits and Phits? [Network on a Chip] (Was: GPU Elasticity: Collective Communications Libraries)

FromMild Shock <janburse@fastmail.fm>
Date2026-08-07 18:05 +0200
SubjectWhat are Flits and Phits? [Network on a Chip] (Was: GPU Elasticity: Collective Communications Libraries)
Message-ID<1154vo5$2mto$1@solani.org>
In reply to#896603
Hi,

Recently there was a paper somebody mentioning
a flit doing a ACK or NACK, to express
backpressure inside a Network on a Chip.

But what is a flit? It seems multiple
flits can be used to create the message
passing in one directiob before the

ACK or NACK in the other direction?

"The growing need for performance from
computing systems drove the industry into
the multi-core and many-core arena. In this
setup, the execution of a kernel (a program)
is split across multiple processors and the
computation happens in parallel

Flits represent logical units of information,
while phits represent the physical domain,
that is, phits represent the number of bits
that can be transferred in parallel in a
single cycle. Consider the Cray T3D. It has
an interconnection network which uses

flit level message flow control wherein each
flit is composed of eight 16-bit phits. That
means its flit size is 128bits and phit size
is 16bits. Also consider the IBM SP2 switch.
It also uses the flit level message flow
control, but its flit size is equal to its
phit size, which is set to 8 bits."
https://en.wikipedia.org/wiki/Flit_(computer_networking)#Example

Well my idea how this is realized in silicon
is rather foggy, I mean even the Hack project
from Nand 2 Tetris, does not show some gate level
schemes for flits and phits.

Could be an interesting extension. But somehow
the image of flits and phits inspired my channel
objects here below. But I am afraid they are fire
and forget, no ACK and NACK:

π-WAM Contest: 1 Million Packets with Prolog
https://medium.com/2989/ec3e91551773

Its amazing that a max_size(1) buffer
can beat an unbounded buffer!

LoL

Bye

Mild Shock schrieb:
> Hi,
> 
> How it started, NVIDIA being cool:
> 
> NCCL provides routines such as all-gather,
> all-reduce, broadcast, reduce, reduce-scatter,
> and point-to-point send and receive. These
> routines are optimized to achieve high
> bandwidth and low latency over PCIe,
> NVIDIA NVLink™, and other high-speed
> interconnects within a node and over
> NVIDIA networking across nodes.
> https://developer.nvidia.com/nccl
> 
> How its going, vLLM trying to be cool:
> 
> [RFC]: Native Weight Syncing APIs
> However, there are no standardized methods for
> performing online weight syncing. Open source projects
> like SkyRL, VeRL, and TRL need to include their
> own implementations of the weight syncing
> infrastructure, leading to added complexity
> for developers seeking to adopt vLLM as their
> inference server for post-training workloads.
> https://github.com/vllm-project/vllm/issues/31848
> 
> How much Workers are enough? I guess it depends
> on I/O parallelism, CPU Memory parallelism, CPU
> Processing parallelism, and now also
> 
> GPU Memory parallelism and GPU Processing
> parallelism, and last but least you might have
> a couple DMAs sitting here and there,
> 
> or even invoking a sort of RDMA. Quite amazing!
> 
> Bye
> 
> Mild Shock schrieb:
>> Hi,
>>
>> Remember when first all local AI was Python
>> and PyTorch APIs. And then suddently people started
>> using bare metal C/C++ Code. Here is the story:
>>
>> How it started:
>>
>> GPT-J or GPT-J-6B is an open-source large
>> language model (LLM) developed by EleutherAI
>> in 2021. As the name suggests, it is a
>> generative pre-trained transformer model
>> designed to produce human-like text that
>> continues from a prompt.
>> https://www.eleuther.ai/
>>
>> How it was going [Georgi Gerganov]:
>>
>> So a few days later comes out the LLaMA, I do
>> some calculations and I figure out “Okay, 65
>> billion parameters. You probably need about
>> 40 gigs of RAM, with 4-bit quantization. So
>> this can run on a MacBook. Why not do it?”
>>
>> Why I was able to do it so quickly - basically,
>> for all that I saw it’s pretty much GPT-J architecture
>> with some modifications, like some extra memorization
>> layers. It’s minor changes. Basically, again, the
>> existing code for the GPT-J, I just simply
>> modified it there, it happened pretty quickly.
>> https://changelog.com/podcast/532
>>
>> Georgi Gerganov, Bulgarian, now with Hugging
>> Face, ggml-cann also running on Chinese AI chips.
>> ggml Manifesto https://github.com/ggml-org/ggml
>>
>> Bye
> 

[toc] | [prev] | [next] | [standalone]


#896625 — Cristallina: Thank you for the Beam (Was: The Wuhan Virus that destroyed Python [ggml Manifesto])

FromMild Shock <janburse@fastmail.fm>
Date2026-08-09 21:19 +0200
SubjectCristallina: Thank you for the Beam (Was: The Wuhan Virus that destroyed Python [ggml Manifesto])
Message-ID<115ajs3$6g3f$1@solani.org>
In reply to#896394
Hi,

How it started:

Filming a vitamin B12 photoreceptor in action
https://www.psi.ch/de/news/science-features/filming-a-vitamin-b12-photoreceptor-in-action

How its going:

Elon Musk's potential FEL route could challenge EUV lithography
https://www.kucoin.com/news/flash/elon-musk-s-potential-fel-route-could-challenge-euv-lithography

Who will win the Nano Atom mover race,

will the USA OutChip its competitor China
and its supplier Asia in the next years?

Bye

Mild Shock schrieb:
> Hi,
> 
> Remember when first all local AI was Python
> and PyTorch APIs. And then suddently people started
> using bare metal C/C++ Code. Here is the story:
> 
> How it started:
> 
> GPT-J or GPT-J-6B is an open-source large
> language model (LLM) developed by EleutherAI
> in 2021. As the name suggests, it is a
> generative pre-trained transformer model
> designed to produce human-like text that
> continues from a prompt.
> https://www.eleuther.ai/
> 
> How it was going [Georgi Gerganov]:
> 
> So a few days later comes out the LLaMA, I do
> some calculations and I figure out “Okay, 65
> billion parameters. You probably need about
> 40 gigs of RAM, with 4-bit quantization. So
> this can run on a MacBook. Why not do it?”
> 
> Why I was able to do it so quickly - basically,
> for all that I saw it’s pretty much GPT-J architecture
> with some modifications, like some extra memorization
> layers. It’s minor changes. Basically, again, the
> existing code for the GPT-J, I just simply
> modified it there, it happened pretty quickly.
> https://changelog.com/podcast/532
> 
> Georgi Gerganov, Bulgarian, now with Hugging
> Face, ggml-cann also running on Chinese AI chips.
> ggml Manifesto https://github.com/ggml-org/ggml
> 
> Bye

[toc] | [prev] | [standalone]


Page 5 of 5 — ← Prev page 1 2 3 4 [5]

Back to top | Article view | sci.physics


csiph-web