FLock-io / llm-loss-validator

Validator that computes the validation loss for a huggingface-compatible LLM
Apache License 2.0
33 stars 27 forks source link

Request for macOS GPU Support #46

Open manwallet opened 3 months ago

manwallet commented 3 months ago

Hello,

I am currently using your software on macOS with the Apple M1 Ultra. However, I have noticed that the GPU performance on macOS is not being fully utilized, which significantly impacts overall efficiency.

Additionally, the unified memory architecture on Mac has a significant advantage when handling large datasets. If GPU resources could be fully leveraged, I believe performance would see a substantial improvement.

I hope you can consider adding support for macOS GPUs. Thank you for your hard work!

mizandon commented 1 month ago

Flock-ai not verified issu