search

SmerkyG / gptcore

Fast modular code to create and train cutting edge LLMs
Apache License 2.0
62 stars 9 forks source link

question RE HW requirements #7

Open wolfspyre opened 5 months ago

wolfspyre commented 5 months ago

will this work (albeit slowly) on cpu-only systems? or is cuda a hard requirement?

SmerkyG commented 5 months ago

I've definitely used it on CPU in the past, but not recently!

On Tue, Mar 26, 2024, 3:24 PM Wolf Noble @.***> wrote:

will this work (albeit slowly) on cpu-only systems? or is cuda a hard requirement?

— Reply to this email directly, view it on GitHub https://github.com/SmerkyG/gptcore/issues/7, or unsubscribe https://github.com/notifications/unsubscribe-auth/ACDK33UKYQRXB3NURXUFQGTY2HYP7AVCNFSM6AAAAABFJZE6LGVHI2DSMVQWIX3LMV43ASLTON2WKOZSGIYDSNBUG44DMMA . You are receiving this because you are subscribed to this thread.Message ID: @.***>

SmerkyG commented 5 months ago

I recall there were some minor caveats with regard to dataset loading and Windows, where pickling didn't work for data loader if you made it use multiple workers. So you may need adjustments to the configs like that.

On Tue, Mar 26, 2024, 3:51 PM Dan Goldstein @.***> wrote:

I've definitely used it on CPU in the past, but not recently!

On Tue, Mar 26, 2024, 3:24 PM Wolf Noble @.***> wrote:

will this work (albeit slowly) on cpu-only systems? or is cuda a hard requirement?

— Reply to this email directly, view it on GitHub https://github.com/SmerkyG/gptcore/issues/7, or unsubscribe https://github.com/notifications/unsubscribe-auth/ACDK33UKYQRXB3NURXUFQGTY2HYP7AVCNFSM6AAAAABFJZE6LGVHI2DSMVQWIX3LMV43ASLTON2WKOZSGIYDSNBUG44DMMA . You are receiving this because you are subscribed to this thread.Message ID: @.***>

wolfspyre commented 5 months ago

good to know... I'll test on ubu x86_64