NPUs (Neural Processing Units) are the new normal

From	Mild Shock <janburse@fastmail.fm>
Newsgroups	sci.physics
Subject	NPUs (Neural Processing Units) are the new normal
Date	2025-10-15 16:15 +0200
Message-ID	<10coa9b$12ucf$6@solani.org> (permalink)

Show all headers | View raw

Hi,

It seems I am having problems pacing with
all the new fancy toys. Wasn't able to really
benchmark my NPU from a Desktop AI machine,

picked the wrong driver. Need to try again.
What worked was benchmarking Mobile AI machines.
I just grabbed Geekbench AI and some devices:

USA Fab, M4:

     sANN    hANN    qANN
iPad CPU    4848    7947    6353
iPad GPU    9752    11383    10051
iPad NPU    4873    36544    *51634*

China Fab, Snapdragon:

     sANN    hANN    qANN
Redmi CPU    1044    950    1723
Redmi GPU    480    905    737
Redmi NNAPI    205    205    469
Redmi QNN    226    226    *10221*

Speed-Up via NPU is factor 10x. See the column
qANN which means quantizised artificial neural
networks, when NPU or QNN is picked.

The mobile AI NPUs are optimized using
mimimal amounts of energy, and minimal amounts
of space squeezing (distilling) everything

into INT8 and INT4.

Bye

Back to sci.physics | Previous | Next — Next in thread | Find similar | Unroll thread

Thread

NPUs (Neural Processing Units) are the new normal Mild Shock <janburse@fastmail.fm> - 2025-10-15 16:15 +0200
  AI most hated by formal verification (Re: Fuzzy Alert: Boris the Loris on the Dancefloor) Mild Shock <janburse@fastmail.fm> - 2025-11-26 17:03 +0100
    Googles TPU muscle in 2017 [Prolog Community is Sleepy Joe] (Was: Zeus: A Language for Expressing Algorithms in Hardware) Mild Shock <janburse@fastmail.fm> - 2025-11-27 15:22 +0100
    The tables have turned: GigaLIP on the Laptop? (Re: 100% serious Giga Logical Inferences per Second (GLIPS)) Mild Shock <janburse@fastmail.fm> - 2025-11-28 15:13 +0100

csiph-web