Groups | Search | Server Info | Login | Register
| From | Carl Fink <carlf@panix.com> |
|---|---|
| Newsgroups | comp.ai |
| Subject | Re: Is it possible to train generative AI on CPU only? |
| Date | 2024-12-01 20:23 -0500 |
| Organization | PANIX Public Access Internet and UNIX, NYC |
| Message-ID | <slrnvkpm74.66m.carlf@panix2.panix.com> (permalink) |
| References | <slrnvkheem.ifa.carlf@panix2.panix.com> <vigoqo$27qul$1@dont-email.me> |
On 2024-12-01, Tristan Miller <psychonaut@nothingisreal.com> wrote: > Yes, it's absolutely possible to train generative AI on a CPU rather > than a GPU, but whether this is feasible depends entirely on what sort > of model you are expecting to end up with, how much training time you're > willing to tolerate, and how much RAM you have available. Without > further details on your requirements it's difficult to make any specific > recommendations. I've seen a few reports comparing CPU and GPU training > of LoRA models for Stable Diffusion, for example, that indicate that CPU > training can require four times more memory and/or forty times more > time. If you don't already have the requisite GPU hardware and don't > want to buy it yourself, it might be economical to rent the processing > power from a cloud service. Can you link to those reports, or tell me where to search (e. g. a journal name)? This box has 48 GB of RAM. As I wrote originally, I'm fine with long processing times, although 40x seems very long. Thank you. -- Carl Fink carl@finknetwork.com https://reasonablyliterate.com https://nitpicking.com If you want to make a point, somebody will take the point and stab you with it. -Kenne Estes
Back to comp.ai | Previous | Next — Previous in thread | Next in thread | Find similar
Is it possible to train generative AI on CPU only? Carl Fink <carlf@panix.com> - 2024-11-28 14:05 -0500
Re: Is it possible to train generative AI on CPU only? Tristan Miller <psychonaut@nothingisreal.com> - 2024-11-30 23:56 -0500
Re: Is it possible to train generative AI on CPU only? Carl Fink <carlf@panix.com> - 2024-12-01 20:23 -0500
Re: Is it possible to train generative AI on CPU only? Tristan Miller <psychonaut@nothingisreal.com> - 2024-12-02 18:46 -0500
Re: Is it possible to train generative AI on CPU only? Carl Fink <carlf@panix.com> - 2024-12-04 09:47 -0500
csiph-web