Groups | Search | Server Info | Login | Register

Groups > comp.ai > #332

Is it possible to train generative AI on CPU only?

Path csiph.com!weretis.net!feeder9.news.weretis.net!panix!.POSTED.panix6.panix.com!nan.users.panix.com!robomod!not-for-mail
From Carl Fink <carlf@panix.com>
Newsgroups comp.ai
Subject Is it possible to train generative AI on CPU only?
Date Thu, 28 Nov 2024 14:05:34 EST
Organization PANIX Public Access Internet and UNIX, NYC
Approved comp.ai Approval Key <comp-ai-approval-key@nan.users.panix.com>
Message-ID <slrnvkheem.ifa.carlf@panix2.panix.com> (permalink)
Reply-To carl@finknetwork.com
Injection-Info reader2.panix.com; posting-host="panix6.panix.com:166.84.1.6"; logging-data="22400"; mail-complaints-to="abuse@panix.com"
User-Agent slrn/1.0.3 (NetBSD)
X-Comp-AI-Policy https://logological.org/comp.ai
X-Comp-AI-Info-1 Send submissions to comp-ai@nan.users.panix.com
X-Comp-AI-Info-2 Send technical complaints to comp-ai-request@nan.users.panix.com
X-Comp-AI-Info-3 Send complaints about policy to comp-ai-request@nan.users.panix.com
X-Comp-AI-Info-4 GnuPG Public Key at https://logological.org/81A27838.txt
X-Comment-1 The moderators do not necessarily agree or disagree with this article.
X-Comment-2 Moderators do not verify the accuracy of posted information.
X-Comment-3 Acceptance does not convey approval of any external references.
X-Robomod STUMP by ichudov@algebra.com (Igor Chudov), C++/Perl/Unix Consulting
X-Moderation-1 See https://savannah.gnu.org/projects/stump
X-Spam-Relay-Country DE US US
Authentication-Results mail2.panix.com; dkim=pass (Good 1024 bit rsa-sha256 signature) header.d=panix.com header.a=rsa-sha256
Authentication-Results mail2.panix.com; dmarc=pass (p=none dis=none) header.from=panix.com
Authentication-Results mail2.panix.com; spf=fail smtp.mailfrom=panix.com
DKIM-Signature v=1; a=rsa-sha256; c=simple/simple; d=panix.com; s=panix; t=1732819414; bh=nDmlnLEQS8f5wlIGlDbcTKoJh5EKpyRfTDgYpIf6v4Y=; h=To:From:Subject:Date:Reply-To; b=AvT2o/hUMLhVVUSsbu5M0VxS4iWyD6/Pdtq4uheAVgdgj+HakAUJvJQBeKvT8R+zV ABlc2icaxcinXp2pNz8nMqP/TmpN61aIEIeBGdBoxXma8b8igafS6LYzBe9COw+h8I Wh8za0EdBD3YF+FbpvyxvSMjMRw3pX9XanFXX1h8=
X-Auth PGPMoose V2.0 PGP comp.ai iQEcBAEBAgAGBQJnSL7+AAoJEKl0hmeBong4oxQH/31Au75bJiuJ2y6HJdPEvKG1 iovejuczTvsdTQ93RqaaYWO3iIKtZOJmsceBDiAITfxOXR4J9svlLac0JEfrCAMg Aw74AlHMjgnEf+Hgm1poa3/x0gsGrMZy36K6G756ioTZ5LJpWOqcatDbl/lcX+9n eP3I29RQjYmBH9EtKTZf6TciBtfdskj8m699HIFIXXuUQh3iNagf5fqwMhKER453 XRI8KTiJP1SKmfzipCEkyMiiWyzVs4rnPXFmPDtL2H/X5bn0x0QbQjBH9J8f3QCY glQIILPDLv5AJA8PAYkLdupAsqO03QqLRsaX0VZhivKwqYgWHtF4TePxiX4k8qo= =g1RC
Xref csiph.com comp.ai:332

Show key headers only | View raw

I have a system with a very high-end CPU (for a workstation), a 12th
generation Intel i9, but a low-end GPU (Radeon RX470 with 6 gb of RAM).

Is it possible to do any sort of AI training on that setup, say if you're
willing to process at 5% of an nVidia GPU's speed? I just want to play with
it, see if it's worth investing more money, at this point. I don't mind, if,
say, training a LORA takes an hour per photo, or even 6 hours per photo.

Sorry if I mangled any terminology, this is not my field and I'm (as you
guessed by now) just starting to learn it.

Thanks.
-- 
Carl Fink                                                  carl@finknetwork.com 
https://reasonablyliterate.com                           https://nitpicking.com 
If you want to make a point, somebody will take the point and stab you with it. 
	-Kenne Estes

Back to comp.ai | Previous | Next — Next in thread | Find similar

Thread

Is it possible to train generative AI on CPU only? Carl Fink <carlf@panix.com> - 2024-11-28 14:05 -0500
  Re: Is it possible to train generative AI on CPU only? Tristan Miller <psychonaut@nothingisreal.com> - 2024-11-30 23:56 -0500
    Re: Is it possible to train generative AI on CPU only? Carl Fink <carlf@panix.com> - 2024-12-01 20:23 -0500
      Re: Is it possible to train generative AI on CPU only? Tristan Miller <psychonaut@nothingisreal.com> - 2024-12-02 18:46 -0500
        Re: Is it possible to train generative AI on CPU only? Carl Fink <carlf@panix.com> - 2024-12-04 09:47 -0500

csiph-web