2008: 4 Blades + Tesla S1070 versus 2026: 1 AI Laptop (Re: Little Data Center on Your Palm [AI Laptops for 500 USD])

From	Mild Shock <janburse@fastmail.fm>
Newsgroups	sci.logic, comp.lang.prolog, sci.physics
Subject	2008: 4 Blades + Tesla S1070 versus 2026: 1 AI Laptop (Re: Little Data Center on Your Palm [AI Laptops for 500 USD])
Date	2026-07-24 18:15 +0200
Message-ID	<114032v$b7pi$1@solani.org> (permalink)
References	<113r42n$8g50$2@solani.org> <114025e$b6ui$2@solani.org>

Cross-posted to 3 groups.

Show all headers | View raw

Hi,

Feature    2008: 4 Blades + Tesla S1070
CPU Cores    16
CPU Clock (GHz)    2.5
CPU IPC (est.)    1
CPU Throughput (units)    16 x 2.5 ×1.0=40
GPU Cores    960 (4x T10P)
GPU Clock (GHz)    1.5
GPU IPC (est.)    ~1.0 (FMA)
GPU Throughput (units)    960 x 1.5x1.0=1440
Total Compute (CPU+GPU)    40 + 1440 = 1480
Memory Capacity    16-20 GB (DDR2)
Storage I/O    ~400 MB/s (HDDs)
Power Consumption    ~1500 W
Physical Size    8-12 RU + 1U GPU
Cost (2008 USD)    ~$33,000

Feature    2026: 1 Al Laptop
CPU Cores    Aug 16
CPU Clock (GHz)    4.5
CPU IPC (est.)    2
CPU Throughput (units)    16 x 4.5 ×2.0=144 (or 72 for 8c)
GPU Cores    4096
GPU Clock (GHz)    ~2.0
GPU IPC (est.)    ~1.5 (modern)
GPU Throughput (units)    4096 x 2.0x1.5=12288
Total Compute (CPU+GPU)    144 + 12288 = 12432 (or 72+12288 for 8c)
Memory Capacity    16-32 GB (DDR5)
Storage I/O    ~7000 MB/s (NVMe)
Power Consumption    ~50-100 W
Physical Size    1 laptop bag
Cost (2008 USD)    ~$500-1000

Feature    Winner
CPU Cores    Tie
CPU Clock (GHz)    Laptop (1.8x faster)
CPU IPC (est.)    Laptop (2x better)
CPU Throughput (units)    Laptop: 1.8-3.6x faster
GPU Cores    Laptop: 4.3x more cores
GPU Clock (GHz)    Laptop (1.33x faster)
GPU IPC (est.)    Laptop (1.5x better)
GPU Throughput (units)    Laptop: 8.5x more GPU throughput
Total Compute (CPU+GPU)    Laptop: 8.4x more total compute
Memory Capacity    Laptop (more, faster)
Storage I/O    Laptop: 17x faster
Power Consumption    Laptop: 15-30x more efficient
Physical Size    Laptop
Cost (2008 USD)    Laptop: 33-66x cheaper

Bye

Mild Shock schrieb:
> Hi,
> 
> Now you can compare this here from 2008
> with modern AI Laptops for 500-1000 USD:
> 
> Google spotlights data center inner workings
> https://web.archive.org/web/20131019063218/http://news.cnet.com/8301-10784_3-9955184-7.html 
> 
> 
> There is a striking similarity, only what
> once occupied a rack, has now the size
> of your plam, all inside one silicon chip:
> 
> - Multiple CPU cores on the same chip
> - Multiple GPU units on the same chip
> - Network on the same chip communication
> - Crossbar caches on the same chip
> - Disk controllers on the same chip
> - Multi channel RAM access on the same chip
> 
> Pretty cool!
> 
> Bye
> 
> P.S.: Example such devices with iGPU:
> 
> Intel(R) Core(TM) Ultra 7 258V
> AMD Ryzen AI 7 350 w/ Radeon 860M
> Apple A18 Pro, Darwin Kernel Version 25.5.0
> Snapdragon(R) X - X126100 - Qualcomm(R) Oryon(TM) CPU
> 
> 
> Mild Shock schrieb:
>> Hi,
>>
>> Remember when first all local AI was Python
>> and PyTorch APIs. And then suddently people started
>> using bare metal C/C++ Code. Here is the story:
>>
>> How it started:
>>
>> GPT-J or GPT-J-6B is an open-source large
>> language model (LLM) developed by EleutherAI
>> in 2021. As the name suggests, it is a
>> generative pre-trained transformer model
>> designed to produce human-like text that
>> continues from a prompt.
>> https://www.eleuther.ai/
>>
>> How it was going [Georgi Gerganov]:
>>
>> So a few days later comes out the LLaMA, I do
>> some calculations and I figure out “Okay, 65
>> billion parameters. You probably need about
>> 40 gigs of RAM, with 4-bit quantization. So
>> this can run on a MacBook. Why not do it?”
>>
>> Why I was able to do it so quickly - basically,
>> for all that I saw it’s pretty much GPT-J architecture
>> with some modifications, like some extra memorization
>> layers. It’s minor changes. Basically, again, the
>> existing code for the GPT-J, I just simply
>> modified it there, it happened pretty quickly.
>> https://changelog.com/podcast/532
>>
>> Georgi Gerganov, Bulgarian, now with Hugging
>> Face, ggml-cann also running on Chinese AI chips.
>> ggml Manifesto https://github.com/ggml-org/ggml
>>
>> Bye
>

Thread

The Wuhan Virus that destroyed Python [ggml Manifesto] Mild Shock <janburse@fastmail.fm> - 2026-07-22 21:01 +0200
  Deadlock Exorcism: Switch from Push to Pull [A pi-calculus Specification of Prolog] (Re: The Wuhan Virus that destroyed Python [ggml Manifesto]) Mild Shock <janburse@fastmail.fm> - 2026-07-23 00:25 +0200
    Why do you even need a mpmc queue? [Thunder Kittens] (Re: Deadlock Exorcism: Switch from Push to Pull) Mild Shock <janburse@fastmail.fm> - 2026-07-23 08:45 +0200
      Trivial balancing example for (int i=0; i<global_id; i++) (Re: Why do you even need a mpmc queue? [Thunder Kittens]) Mild Shock <janburse@fastmail.fm> - 2026-07-23 08:55 +0200
        The Pixel Phone AI Experiment Song (Enqueue/dequeue need not be fast and can spinn ["fairness" questions]) Mild Shock <janburse@fastmail.fm> - 2026-07-23 09:19 +0200
          Enqueue/dequeue need not be fast and can spinn ["fairness" questions] (Re: The Pixel Phone AI Experiment Song (Enqueue/dequeue need not be fast and can spinn ["fairness" questions]) Mild Shock <janburse@fastmail.fm> - 2026-07-23 09:23 +0200
      And, where did I talk about rockets? [Hint its about xAI's Grok] (Re: Why do you even need a mpmc queue? [Thunder Kittens]) Mild Shock <janburse@fastmail.fm> - 2026-07-25 01:25 +0200
  Potential Python Recovery: Free Threading [3.13 release] (Re: The Wuhan Virus that destroyed Python [ggml Manifesto]) Mild Shock <janburse@fastmail.fm> - 2026-07-23 10:21 +0200
  The things XILINX braught to the AMD table (Re: The Wuhan Virus that destroyed Python [ggml Manifesto]) Mild Shock <janburse@fastmail.fm> - 2026-07-23 18:48 +0200
    NVIDIA evacuated its Chinese market [Tau Scaling] (Re: The things XILINX braught to the AMD table) Mild Shock <janburse@fastmail.fm> - 2026-07-23 19:13 +0200
      Micro penis mother sung arias (Re: NVIDIA evacuated its Chinese market [Tau Scaling]) Mild Shock <janburse@fastmail.fm> - 2026-07-24 14:40 +0200
        Micro penis brain is in constant hiatus (Re: Micro penis mother sung arias) Mild Shock <janburse@fastmail.fm> - 2026-07-24 15:27 +0200
          Ignoramus or Ignorabimus: I don't care [(Re: Micro penis brain is in constant hiatus (Re: Micro penis mother sung arias) Mild Shock <janburse@fastmail.fm> - 2026-07-24 15:35 +0200
            You are a moron, brainless putin payed (Re: Ignoramus or Ignorabimus: I don't care) Mild Shock <janburse@fastmail.fm> - 2026-07-24 18:01 +0200
              Yeah keep reading my posts, uninspired fool (Re: You are a moron, brainless putin payed) Mild Shock <janburse@fastmail.fm> - 2026-07-24 19:47 +0200
            Out of the blue accusation span 15 days [Empirical USENET study] (Re: Ignoramus or Ignorabimus: I don't care) Mild Shock <janburse@fastmail.fm> - 2026-07-24 20:27 +0200
  Little Data Center on Your Palm [AI Laptops for 500 USD] (Re: The Wuhan Virus that destroyed Python [ggml Manifesto]) Mild Shock <janburse@fastmail.fm> - 2026-07-24 17:59 +0200
    2008: 4 Blades + Tesla S1070 versus 2026: 1 AI Laptop (Re: Little Data Center on Your Palm [AI Laptops for 500 USD]) Mild Shock <janburse@fastmail.fm> - 2026-07-24 18:15 +0200
  Hurry the blue bus doesnt stop indefinitely (Re: The Wuhan Virus that destroyed Python [ggml Manifesto]) Mild Shock <janburse@fastmail.fm> - 2026-07-24 20:37 +0200
    Not SIMD, a MIMD design for NVIDIA Volta (Re: Hurry the blue bus doesnt stop indefinitely) Mild Shock <janburse@fastmail.fm> - 2026-07-24 20:58 +0200
      Could take 3-4 months find machine / browser (Re: Not SIMD, a MIMD design for NVIDIA Volta) Mild Shock <janburse@fastmail.fm> - 2026-07-24 21:16 +0200

csiph-web