Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]
Groups > alt.comp.os.windows-11 > #36371
| From | Andy Burns <usenet@andyburns.uk> |
|---|---|
| Newsgroups | alt.comp.os.windows-11, alt.comp.os.windows-10 |
| Subject | Re: Adobe is panicking |
| Date | 2026-10-16 14:15 +0100 |
| Message-ID | <njemc0Ft2g7U1@mid.individual.net> (permalink) |
| References | (7 earlier) <11at1rj$38b1f$1@dont-email.me> <xn0pw35wnht32ea01o@news.individual.net> <njei7rFsdhsU1@mid.individual.net> <xn0pw379lhuwq5r01q@news.individual.net> <11at77b$3abni$1@dont-email.me> |
Cross-posted to 2 groups.
Paul wrote: > If an MoE fits within the VRAM on a video card, they tell me the output > tokens can be produced by the video card itself. I've understood that, but also that MoE (mixture of experts) don't need the entire model in VRAM all the time, they can page in different sections one after the other, but then the bottleneck isn't amount of memory, but memory bandwidth (i.e number of PCIe lanes and PCI generation). > If the model does not happen to fit, some amount of thinking can be > done on the video card, but the output tokens are done via matrix > multiply using CPU cores. Which is, well, dog slow. That's why the > runtime for queries on my machine are so long. It only has a 4GB > video card. I almost got sucked into buying a used nVidia data centre card (P40 w/24GB) the other week, they're kind-of trailing edge for what's still semi-useful, about £250 plus a new PSU and 3D print your own fan shroud and put up with the noise and electricity use while it's in use. > It really needs a 48GB video card. Intel just came out with a card > for Inference, which is 480GB and LPDDR5x (relatively slow) memory, > no HBM. Should be $15K-$20K or so, so out of reach really. It would > be tons better, but still a joke compared to the machines we get to > use on the Internet. Yep, it all zooms out of reach over the horizon really quickly ...
Back to alt.comp.os.windows-11 | Previous | Next — Previous in thread | Next in thread | Find similar | Unroll thread
Adobe is panicking MegaNZ <MegaNZ@newsgroups.com> - 2026-10-09 00:29 +0100
Re: Adobe is panicking Paul <nospam@needed.invalid> - 2026-10-09 01:59 -0400
Re: Adobe is panicking Steve Hayes <hayesstw@telkomsa.net> - 2026-10-10 06:22 +0200
Re: Adobe is panicking WolfFan <akwolffan@zoho.com> - 2026-10-11 10:13 -0400
Re: Adobe is panicking "....winston" <winstonmvp@gmail.com> - 2026-10-09 03:21 -0400
Re: Adobe is panicking dillinger <dillinger@not.invalid> - 2026-10-09 20:02 +0200
Re: Adobe is panicking "....winston" <winstonmvp@gmail.com> - 2026-10-09 20:53 -0400
Re: Adobe is panicking Paul <nospam@needed.invalid> - 2026-10-09 21:46 -0400
Re: Adobe is panicking "....winston" <winstonmvp@gmail.com> - 2026-10-13 13:49 -0400
Re: Adobe is panicking Paul <nospam@needed.invalid> - 2026-10-13 16:38 -0400
Re: Adobe is panicking "....winston" <winstonmvp@gmail.com> - 2026-10-15 11:35 -0400
Re: Adobe is panicking "Jeff Gaines" <jgnewsid@outlook.com> - 2026-10-15 20:50 +0000
Re: Adobe is panicking "....winston" <winstonmvp@gmail.com> - 2026-10-16 02:04 -0400
[OT[: "24/7/365" (was: Re: Adobe is panicking) "J. P. Gilliver" <G6JPG@255soft.uk> - 2026-10-16 08:16 +0100
Re: [OT[: "24/7/365" "Carlos E.R." <robin_listas@es.invalid> - 2026-10-16 12:20 +0200
Re: [OT[: "24/7/365" "....winston" <winstonmvp@gmail.com> - 2026-10-16 10:52 -0400
Re: [OT[: "24/7/365" "J. P. Gilliver" <G6JPG@255soft.uk> - 2026-10-16 18:39 +0100
Re: [OT[: "24/7/365" Frank Slootweg <this@ddress.is.invalid> - 2026-10-16 17:51 +0000
Re: [OT[: "24/7/365" "J. P. Gilliver" <G6JPG@255soft.uk> - 2026-10-16 20:44 +0100
Re: [OT[: "24/7/365" Frank Slootweg <this@ddress.is.invalid> - 2026-10-17 09:55 +0000
Re: [OT[: "24/7/365" Daniel70 <daniel47@nomail.afraid.org> - 2026-10-17 22:09 +1100
Re: [OT[: "24/7/365" "Jeff Gaines" <jgnewsid@outlook.com> - 2026-10-17 11:18 +0000
Re: [OT[: "24/7/365" Frank Slootweg <this@ddress.is.invalid> - 2026-10-17 11:45 +0000
Re: [OT[: "24/7/365" Daniel70 <daniel47@nomail.afraid.org> - 2026-10-17 23:28 +1100
Re: [OT[: "24/7/365" Frank Slootweg <this@ddress.is.invalid> - 2026-10-17 15:37 +0000
Re: [OT[: "24/7/365" "Carlos E.R." <robin_listas@es.invalid> - 2026-10-17 19:42 +0200
Re: [OT[: "24/7/365" "J. P. Gilliver" <G6JPG@255soft.uk> - 2026-10-17 21:00 +0100
Re: [OT[: "24/7/365" Frank Slootweg <this@ddress.is.invalid> - 2026-10-18 09:46 +0000
Re: [OT[: "24/7/365" "J. P. Gilliver" <G6JPG@255soft.uk> - 2026-10-18 11:07 +0100
Re: [OT[: "24/7/365" "Jeff Gaines" <jgnewsid@outlook.com> - 2026-10-18 10:08 +0000
Re: [OT[: "24/7/365" "Jeff Gaines" <jgnewsid@outlook.com> - 2026-10-18 10:09 +0000
Re: [OT[: "24/7/365" "J. P. Gilliver" <G6JPG@255soft.uk> - 2026-10-18 11:48 +0100
Re: [OT[: "24/7/365" Frank Slootweg <this@ddress.is.invalid> - 2026-10-18 11:49 +0000
Re: [OT[: "24/7/365" "Jeff Gaines" <jgnewsid@outlook.com> - 2026-10-18 13:01 +0000
Re: [OT[: "24/7/365" "....winston" <winstonmvp@gmail.com> - 2026-10-16 15:48 -0400
Re: [OT[: "24/7/365" "J. P. Gilliver" <G6JPG@255soft.uk> - 2026-10-17 01:06 +0100
Re: [OT[: "24/7/365" Daniel70 <daniel47@nomail.afraid.org> - 2026-10-17 19:59 +1100
Re: [OT[: "24/7/365" (was: Re: Adobe is panicking) Mark Lloyd <nomail@here.invalid> - 2026-10-16 15:40 +0000
Re: Adobe is panicking "Jeff Gaines" <jgnewsid@outlook.com> - 2026-10-16 07:42 +0000
Re: Adobe is panicking "....winston" <winstonmvp@gmail.com> - 2026-10-16 11:06 -0400
Re: Adobe is panicking "Jeff Gaines" <jgnewsid@outlook.com> - 2026-10-16 19:27 +0000
Re: Adobe is panicking "....winston" <winstonmvp@gmail.com> - 2026-10-16 15:40 -0400
Re: Adobe is panicking "Jeff Gaines" <jgnewsid@outlook.com> - 2026-10-16 19:43 +0000
Re: Adobe is panicking Lars Poulsen <lars@beagle-ears.com> - 2026-10-13 18:52 -0700
Re: Adobe is panicking Brian Gregory <void-invalid-dead-dontuse@email.invalid> - 2026-10-11 19:21 +0100
Re: Adobe is panicking Andy Burns <usenet@andyburns.uk> - 2026-10-11 22:39 +0100
Re: Adobe is panicking Paul <nospam@needed.invalid> - 2026-10-12 00:00 -0400
Re: Adobe is panicking Brian Gregory <void-invalid-dead-dontuse@email.invalid> - 2026-10-12 14:06 +0100
Re: Adobe is panicking Paul <nospam@needed.invalid> - 2026-10-12 18:24 -0400
Re: Adobe is panicking Brian Gregory <void-invalid-dead-dontuse@email.invalid> - 2026-10-15 23:15 +0100
Re: Adobe is panicking "Jeff Gaines" <jgnewsid@outlook.com> - 2026-10-16 07:53 +0000
Re: Adobe is panicking Paul <nospam@needed.invalid> - 2026-10-16 07:29 -0400
Re: Adobe is panicking "Jeff Gaines" <jgnewsid@outlook.com> - 2026-10-16 11:37 +0000
Re: Adobe is panicking Andy Burns <usenet@andyburns.uk> - 2026-10-16 13:05 +0100
Re: Adobe is panicking "Jeff Gaines" <jgnewsid@outlook.com> - 2026-10-16 12:28 +0000
Re: Adobe is panicking Paul <nospam@needed.invalid> - 2026-10-16 09:01 -0400
Re: Adobe is panicking "Jeff Gaines" <jgnewsid@outlook.com> - 2026-10-16 13:13 +0000
Re: Adobe is panicking Andy Burns <usenet@andyburns.uk> - 2026-10-16 14:23 +0100
Re: Adobe is panicking "Jeff Gaines" <jgnewsid@outlook.com> - 2026-10-16 13:58 +0000
Re: Adobe is panicking Paul <nospam@needed.invalid> - 2026-10-16 15:13 -0400
Re: Adobe is panicking "Jeff Gaines" <jgnewsid@outlook.com> - 2026-10-16 19:29 +0000
Re: Adobe is panicking Andy Burns <usenet@andyburns.uk> - 2026-10-16 21:12 +0100
Re: Adobe is panicking Andy Burns <usenet@andyburns.uk> - 2026-10-16 21:14 +0100
Re: Adobe is panicking "J. P. Gilliver" <G6JPG@255soft.uk> - 2026-10-17 00:33 +0100
Re: Adobe is panicking Andy Burns <usenet@andyburns.uk> - 2026-10-17 09:26 +0100
Re: Adobe is panicking Andy Burns <usenet@andyburns.uk> - 2026-10-16 14:15 +0100
Re: Adobe is panicking Paul <nospam@needed.invalid> - 2026-10-16 10:08 -0400
csiph-web