Groups | Search | Server Info | Login | Register


Groups > comp.ai > #336

Re: Is it possible to train generative AI on CPU only?

From Carl Fink <carlf@panix.com>
Newsgroups comp.ai
Subject Re: Is it possible to train generative AI on CPU only?
Date 2024-12-04 09:47 -0500
Organization PANIX Public Access Internet and UNIX, NYC
Message-ID <slrnvl0qj2.aoc.carlf@panix1.panix.com> (permalink)
References <slrnvkheem.ifa.carlf@panix2.panix.com> <vigoqo$27qul$1@dont-email.me> <slrnvkpm74.66m.carlf@panix2.panix.com> <vileso$3kcau$1@dont-email.me>

Show all headers | View raw


On 2024-12-02, Tristan Miller <psychonaut@nothingisreal.com> wrote:

> I'm afraid I was reporting only half-remembered results from the last 
> time I looked into the question, which would have been months ago.  I 
> did a quick web search just now and came up with a couple queries from 
> the Kohya's GUI GitHub project that roughly accord with my recollection:
>
> https://github.com/bmaltais/kohya_ss/discussions/679
> https://github.com/bmaltais/kohya_ss/issues/2632
>
> The first of these claims CPU training time of about 40×, and the second 
> claims 4× for both time and memory.  They both refer to Stable Diffusion.
>
> There's also this LoRA finetuning guide for LLaMA that provides detailed 
> CPU time and memory metrics for various models: https://rentry.org/cpu-lora

Thank you!
-- 
Carl Fink                                                  carl@finknetwork.com 
https://reasonablyliterate.com                           https://nitpicking.com 
If you want to make a point, somebody will take the point and stab you with it. 
	-Kenne Estes

Back to comp.ai | Previous | NextPrevious in thread | Find similar


Thread

Is it possible to train generative AI on CPU only? Carl Fink <carlf@panix.com> - 2024-11-28 14:05 -0500
  Re: Is it possible to train generative AI on CPU only? Tristan Miller <psychonaut@nothingisreal.com> - 2024-11-30 23:56 -0500
    Re: Is it possible to train generative AI on CPU only? Carl Fink <carlf@panix.com> - 2024-12-01 20:23 -0500
      Re: Is it possible to train generative AI on CPU only? Tristan Miller <psychonaut@nothingisreal.com> - 2024-12-02 18:46 -0500
        Re: Is it possible to train generative AI on CPU only? Carl Fink <carlf@panix.com> - 2024-12-04 09:47 -0500

csiph-web