Groups | Search | Server Info | Login | Register


Groups > comp.ai > #334

Re: Is it possible to train generative AI on CPU only?

From Carl Fink <carlf@panix.com>
Newsgroups comp.ai
Subject Re: Is it possible to train generative AI on CPU only?
Date 2024-12-01 20:23 -0500
Organization PANIX Public Access Internet and UNIX, NYC
Message-ID <slrnvkpm74.66m.carlf@panix2.panix.com> (permalink)
References <slrnvkheem.ifa.carlf@panix2.panix.com> <vigoqo$27qul$1@dont-email.me>

Show all headers | View raw


On 2024-12-01, Tristan Miller <psychonaut@nothingisreal.com> wrote:

> Yes, it's absolutely possible to train generative AI on a CPU rather 
> than a GPU, but whether this is feasible depends entirely on what sort 
> of model you are expecting to end up with, how much training time you're 
> willing to tolerate, and how much RAM you have available.  Without 
> further details on your requirements it's difficult to make any specific 
> recommendations.  I've seen a few reports comparing CPU and GPU training 
> of LoRA models for Stable Diffusion, for example, that indicate that CPU 
> training can require four times more memory and/or forty times more 
> time.  If you don't already have the requisite GPU hardware and don't 
> want to buy it yourself, it might be economical to rent the processing 
> power from a cloud service.

Can you link to those reports, or tell me where to search (e. g. a journal
name)?

This box has 48 GB of RAM. As I wrote originally, I'm fine with long
processing times, although 40x seems very long. 

Thank you.
-- 
Carl Fink                                                  carl@finknetwork.com 
https://reasonablyliterate.com                           https://nitpicking.com 
If you want to make a point, somebody will take the point and stab you with it. 
	-Kenne Estes

Back to comp.ai | Previous | NextPrevious in thread | Next in thread | Find similar


Thread

Is it possible to train generative AI on CPU only? Carl Fink <carlf@panix.com> - 2024-11-28 14:05 -0500
  Re: Is it possible to train generative AI on CPU only? Tristan Miller <psychonaut@nothingisreal.com> - 2024-11-30 23:56 -0500
    Re: Is it possible to train generative AI on CPU only? Carl Fink <carlf@panix.com> - 2024-12-01 20:23 -0500
      Re: Is it possible to train generative AI on CPU only? Tristan Miller <psychonaut@nothingisreal.com> - 2024-12-02 18:46 -0500
        Re: Is it possible to train generative AI on CPU only? Carl Fink <carlf@panix.com> - 2024-12-04 09:47 -0500

csiph-web