Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]

Groups > sci.physics.relativity > #671403

The new MIMD Warp is the cherry on top (Re: The Wider von Neumann Neck)

Cross-posted to 2 groups.

Show all headers | View raw

Hi,

But I do grouping of Hack VMs for my pi-WAM in
32 wide work groups. And the there are 4096
/ 32 = 128 such work groups.

Traditionally work groups were executed lockstep:

In GPU architecture, a warp (or wavefront in AMD
terminology) is the fundamental unit of execution,
typically comprising 32 scalar threads. Warps
execute in a SIMT (Single Instruction, Multiple
Thread) fashion, where all 32 threads execute
the same instruction in synchronized lockstep
over different data

New GPUs offer independent thread scheduling:

Modern GPU architectures (such as NVIDIA's Volta
and later) feature Independent Thread Scheduling,
maintaining independent execution states even for
threads within the same warp. This allows the GPU
to yield and resume threads dynamically, essentially
acting as a hardware-level MIMD processor running
on SIMD execution lanes.

I guess MIMD drastically increases the arithmetic
bandwidth for control flow based WGSL code, while
some group arrangement can also increase

the memory bandwidth. By kind of concurrently
flushing L1/L2 caches and reloading L1/L2 caches,
creating some simple sequential systolic computing.

At least I have used a memory layout where threads
from a workgroup are adjacent. Standard processors
continuously fetch data from memory, they suffer from the

"Von Neumann bottleneck". Systolic computing bypasses
  this by feeding data into an array of Processing
Elements (PEs) in a wave-like flow.

Bye

Mild Shock schrieb:
> Hi,
> 
> You are a fucking moron, arent you?
> 
> Most of the stuff in my pi-WAM happens
> inside the L1 and L2 caches of the GPU.
> Which is faster than normal RAM and has
> 
> a wider von Neuann Neck. You can try
> yourself, in case you find an AI Laptop
> with similary specs as the Radeon 860M.
> 
> The example is open source:
> 
> 11.4 Giga Lips with a Budget Laptop
> https://github.com/Jean-Luc-Picard-2021/gigabudget
> 
> I already wrote pi-WAM is designed to
> not use memory contention. In particalur
> it also uses local variables like pc and
> 
> accu of the idependent thread states,
> which seems to be also pretty speedy.
> 
> Bye
> 
> Tanner Babadzhan schrieb:
>> Mild Shock wrote:
>>
>>> These novel GPUs , that are part of AI Laptops, feature Unified Memory
>>> Architecture (UMA).
>>> In the case of my Ryzen the main memory is 32 GB,
>>
>> you are in error talking bullshit, the bottleneck there is the max 4 
>> GB/s,
>> 4 times by paralleling, however the proper gddr5/6 gpu arrays goes up to
>> 4,000 GB/s by parallel design
>>
>> GDDR7 (2025–2026 standard)
>>      Max Bandwidth: 1,792 GB/s (RTX 5090, 32GB)
>>
> 

Back to sci.physics.relativity | Previous | Next — Previous in thread | Next in thread | Find similar | Unroll thread

Thread

Implementing Gas for a Compute Shader [Avoid TDR] (Re: AI dooms day escape: Güttinger Wald) Mild Shock <janburse@fastmail.fm> - 2026-07-09 10:53 +0200
  Re: Implementing Gas for a Compute Shader [Avoid TDR] (Re: AI dooms day escape: Güttinger Wald) Ryann Likunov <ka@ion.ru> - 2026-07-09 14:03 +0000
    FYI: Unified Memory Architecture (UMA) (Re: Implementing Gas for a Compute Shader [Avoid TDR]) Mild Shock <janburse@fastmail.fm> - 2026-07-09 19:41 +0200
      Re: FYI: Unified Memory Architecture (UMA) (Re: Implementing Gas for a Compute Shader [Avoid TDR]) Tanner Babadzhan <daz@atnt.ru> - 2026-07-09 20:15 +0000
        The Wider von Neumann Neck (Was: FYI: Unified Memory Architecture (UMA)) Mild Shock <janburse@fastmail.fm> - 2026-07-10 07:48 +0200
          The new MIMD Warp is the cherry on top (Re: The Wider von Neumann Neck) Mild Shock <janburse@fastmail.fm> - 2026-07-10 08:09 +0200
            Mac Neo: The dwarf with giant GPU muscles [macOS IOGPUFamily] (Re: The new MIMD Warp is the cherry on top) Mild Shock <janburse@fastmail.fm> - 2026-07-10 08:30 +0200
          Re: The Wider von Neumann Neck (Was: FYI: Unified Memory Architecture (UMA)) Landon Bahmutov <alaavh@ohbotlo.ru> - 2026-07-10 12:53 +0000
          Re: The Wider von Neumann Neck (Was: FYI: Unified Memory Architecture (UMA)) Olin Bagramov <laorb@ama.ru> - 2026-07-10 12:59 +0000
            Dumbwit, just run it on your RTX 5070 trash (Was: The Wider von Neumann Neck) Mild Shock <janburse@fastmail.fm> - 2026-07-10 15:44 +0200
              We are waiting Dumbwit: 1 Month, 3 Months, .. [node.js dawn] (Was: Dumbwit, just run it on your RTX 5070 trash) Mild Shock <janburse@fastmail.fm> - 2026-07-10 16:27 +0200
                Re: We are waiting Dumbwit: 1 Month, 3 Months, .. [node.js dawn] (Was: Dumbwit, just run it on your RTX 5070 trash) Russell Tuinov <ovul@ss.ru> - 2026-07-10 17:40 +0000
              Re: Dumbwit, just run it on your RTX 5070 trash (Was: The Wider von Neumann Neck) Lecel Bazulev <eccuz@ezelll.ru> - 2026-07-10 17:31 +0000
              We are still waiting for results! [Confused Dumbwit] (Was: Dumbwit, just run it on your RTX 5070 trash) Mild Shock <janburse@fastmail.fm> - 2026-07-10 22:44 +0200
                Re: We are still waiting for results! [Confused Dumbwit] (Was: Dumbwit, just run it on your RTX 5070 trash) Rian Babuh <baaaau@bbuaauba.ru> - 2026-07-10 21:26 +0000
                404 Brain not Found [GPU saturation] (Was: We are still waiting for results! [Confused Dumbwit]) Mild Shock <janburse@fastmail.fm> - 2026-07-10 23:30 +0200
                I nowhere talked about 10GB/s (Was: 404 Brain not Found [GPU saturation]) Mild Shock <janburse@fastmail.fm> - 2026-07-10 23:37 +0200
                Re: 404 Brain not Found [GPU saturation] (Was: We are still waiting for results! [Confused Dumbwit]) Wilfred Durmanov <roauw@odudv.ru> - 2026-07-10 21:44 +0000
                I nowhere said something about AI (Was: 404 Brain not Found [GPU saturation] (Was: We are still waiting for results! [Confused Dumbwit]) Mild Shock <janburse@fastmail.fm> - 2026-07-10 23:48 +0200
                Re: I nowhere said something about AI (Was: 404 Brain not Found [GPU saturation] (Was: We are still waiting for results! [Confused Dumbwit]) Junior Romagna <rr@rum.it> - 2026-07-10 21:59 +0000
                What do you not understand in "budget"? (Was: I nowhere said something about AI) Mild Shock <janburse@fastmail.fm> - 2026-07-11 00:02 +0200
                SWI makes only MLips not GLips (Was: What do you not understand in "budget"?) Mild Shock <janburse@fastmail.fm> - 2026-07-11 00:04 +0200
                Re: What do you not understand in "budget"? (Was: I nowhere said something about AI) Loman Barabashev <mahasm@aell.ru> - 2026-07-11 12:25 +0000
                micro penis got hurt by "budget" (Was: What do you not understand in "budget"?) Mild Shock <janburse@fastmail.fm> - 2026-07-12 19:17 +0200
                Re: What do you not understand in "budget"? (Was: I nowhere said something about AI) Ross Finlayson <ross.a.finlayson@gmail.com> - 2026-07-12 17:26 -0700
                herpes blister rossy boy is confused (Was: What do you not understand in "budget"?) Mild Shock <janburse@fastmail.fm> - 2026-07-13 06:51 +0200
                Re: herpes blister rossy boy is confused (Was: What do you not understand in "budget"?) Patryck Morozov <zzcm@mro.ru> - 2026-07-13 10:43 +0000
                nothing gets blocked except your brain [LPDDR5X-RAM] (Was: herpes blister rossy boy is confused) Mild Shock <janburse@fastmail.fm> - 2026-07-13 13:20 +0200
                flogging a dead horse PCI VRAM graphic cards (Was: nothing gets blocked except your brain [LPDDR5X-RAM]) Mild Shock <janburse@fastmail.fm> - 2026-07-13 13:51 +0200
                Re: nothing gets blocked except your brain [LPDDR5X-RAM] (Was: herpes blister rossy boy is confused) Roberto Bahmetov <tr@mrtt.ru> - 2026-07-13 14:20 +0000
                Re: herpes blister rossy boy is confused (Was: What do you not understand in "budget"?) Ross Finlayson <ross.a.finlayson@gmail.com> - 2026-07-13 07:48 -0700
                Re: herpes blister rossy boy is confused (Was: What do you not understand in "budget"?) Nel Baturov <orlu@bbeabuerln.ru> - 2026-07-13 15:16 +0000
                Re: herpes blister rossy boy is confused (Was: What do you not understand in "budget"?) Ross Finlayson <ross.a.finlayson@gmail.com> - 2026-07-13 10:56 -0700
                Re: herpes blister rossy boy is confused (Was: What do you not understand in "budget"?) Obelin Baisaroff <bbs@eieai.ru> - 2026-07-13 18:39 +0000

csiph-web