Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]
Groups > comp.lang.prolog > #14869
| From | Mild Shock <janburse@fastmail.fm> |
|---|---|
| Newsgroups | comp.lang.prolog |
| Subject | Hades: fast hardware synthesis tools and a reconfigurable coprocessor (Re: With MedGamma I can analyse my own broken ribs) |
| Date | 2025-09-29 22:57 +0200 |
| Message-ID | <10bersh$98qq$2@solani.org> (permalink) |
| References | <vmrajs$apg0$1@solani.org> <10beqcj$980p$1@solani.org> |
Hi, I hope it doesn't turn my laptop into a frying pan. The thingy had a few hickups recently, like using 100% CPU and doing nothing. Maybe IntelliJs fork join framework was overdoing it. But NPUs are physically designed for efficient AI math - more computations per watt, less heat generated. Lets see. But whats the technology behind FastFlowLM? It might be a result of: GAIA: An Open-Source Project from AMD for Running Local LLMs on Ryzen™ AI. GAIA seems to be an important piece of the Ryzen AI story. Initially GAIA wanted to Provide a unified software stack for Ryzen AI NPUs. But AMD shifted focus to DirectML integration with Windows. GAIA Absorbed into AMD's ROCm Ecosystem, on the other hand XDNA (2024) AMD's commercial NPU architecture goes full circle back to Niklaus Wirth: Hades: fast hardware synthesis tools and a reconfigurable coprocessor https://www.research-collection.ethz.ch/entities/publication/23b3a0e4-e5e7-44fe-9b5d-ab43e21859b2 It has FPGA-inspired reconfigurable fabric! Bye P.S.: Shit, I should have such a little toy compiler as well somewhere in my notes I took during a lecture. Array with For Loop to model a hardware bus is really funny. Mild Shock schrieb: > Hi, > > Is there a silver lining of AI democratization? > With MedGamma I can analyse my own broken ribs. > If only I had a body scanner. I am currently exploring > > options of LLM models that I could run on > my new AI soaked AMD Ryzen AI 7 350 laptop. > While Qualcomm spear headed LLM players with > > their LM Studio. There is FastFlowLM > that can do Ryzen, and would utilize the NPU. For > example to run a distilled DeepSeek would amount to: > > flm run deepseek-r1:8b > > And yes there is MedGamma: > > MedGemma:4B (Multimodal) Running Exclusively on AMD Ryzen™ AI NPU > https://www.youtube.com/watch?v=KWzXZEOcgK4 > > Bye > > Mild Shock schrieb: >> Hi, >> >> How it started (released January 20, 2025): >> >> Despite trailing the U.S., China continues to make >> significant strides in AI development. A notable example >> is the Chinese startup DeepSeek, which released an AI >> model named R1. This model demonstrates reasoning >> capabilities comparable to leading U.S. models and is >> available as open-source software, allowing free use and >> commercialization. However, R1 faces issues with censorship, >> likely influenced by Chinese regulations. >> https://en.wikipedia.org/wiki/DeepSeek#Release_history >> >> How its going (released January 21, 2025): >> >> In a strategic move to further solidify its leadership, >> President Donald Trump announced the Stargate initiative. >> This $500 billion investment, a collaboration between OpenAI, >> Oracle, and SoftBank, aims to develop extensive AI >> infrastructure across the U.S., including data centers >> and energy facilities. The project is expected to create >> over 100,000 jobs and enhance the nation's AI capabilities. >> https://en.wikipedia.org/wiki/The_Stargate_Project >> >> With SoftBank they basically call Japan for help! >> >> LoL >> >> Bye >
Back to comp.lang.prolog | Previous | Next — Previous in thread | Next in thread | Find similar | Unroll thread
USA is still Shitting its Pants [Artificial Intelligence] Mild Shock <janburse@fastmail.fm> - 2025-01-22 18:41 +0100
With MedGamma I can analyse my own broken ribs (Was: USA is still Shitting its Pants [Artificial Intelligence]) Mild Shock <janburse@fastmail.fm> - 2025-09-29 22:32 +0200
Hades: fast hardware synthesis tools and a reconfigurable coprocessor (Re: With MedGamma I can analyse my own broken ribs) Mild Shock <janburse@fastmail.fm> - 2025-09-29 22:57 +0200
Linus Torvalds has it possibly all wrong [Artificial Intelligence] (Was: Hades: fast hardware synthesis tools and a reconfigurable coprocessor) Mild Shock <janburse@fastmail.fm> - 2025-09-30 08:40 +0200
csiph-web