Groups | Search | Server Info | Login | Register

Groups > comp.ai > #335

Re: Is it possible to train generative AI on CPU only?

From Tristan Miller <psychonaut@nothingisreal.com>
Newsgroups comp.ai
Subject Re: Is it possible to train generative AI on CPU only?
Date 2024-12-02 18:46 -0500
Organization A noiseless patient Spider
Message-ID <vileso$3kcau$1@dont-email.me> (permalink)
References <slrnvkheem.ifa.carlf@panix2.panix.com> <vigoqo$27qul$1@dont-email.me> <slrnvkpm74.66m.carlf@panix2.panix.com>

Show all headers | View raw

Dear Carl,

On 2024-12-01 19:23, Carl Fink wrote:
> Can you link to those reports, or tell me where to search (e. g. a journal
> name)?
> 
> This box has 48 GB of RAM. As I wrote originally, I'm fine with long
> processing times, although 40x seems very long.

I'm afraid I was reporting only half-remembered results from the last 
time I looked into the question, which would have been months ago.  I 
did a quick web search just now and came up with a couple queries from 
the Kohya's GUI GitHub project that roughly accord with my recollection:

https://github.com/bmaltais/kohya_ss/discussions/679
https://github.com/bmaltais/kohya_ss/issues/2632

The first of these claims CPU training time of about 40×, and the second 
claims 4× for both time and memory.  They both refer to Stable Diffusion.

There's also this LoRA finetuning guide for LLaMA that provides detailed 
CPU time and memory metrics for various models: https://rentry.org/cpu-lora

Regards,
Tristan

-- 
=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-
                   Tristan Miller
Free Software developer, ferret herder, logologist
              https://logological.org/
=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-

Back to comp.ai | Previous | Next — Previous in thread | Next in thread | Find similar

Thread

Is it possible to train generative AI on CPU only? Carl Fink <carlf@panix.com> - 2024-11-28 14:05 -0500
  Re: Is it possible to train generative AI on CPU only? Tristan Miller <psychonaut@nothingisreal.com> - 2024-11-30 23:56 -0500
    Re: Is it possible to train generative AI on CPU only? Carl Fink <carlf@panix.com> - 2024-12-01 20:23 -0500
      Re: Is it possible to train generative AI on CPU only? Tristan Miller <psychonaut@nothingisreal.com> - 2024-12-02 18:46 -0500
        Re: Is it possible to train generative AI on CPU only? Carl Fink <carlf@panix.com> - 2024-12-04 09:47 -0500

csiph-web