CI: Add unit tests for loss validator

FLock-io / llm-loss-validator

Validator that computes the validation loss for a huggingface-compatible LLM

Apache License 2.0

28 stars 23 forks source link

Open nickcom007 opened 3 months ago

nickcom007 commented 3 months ago

I'm not sure whether it's doable through Github Action since we need to test with GPU.

But it's good to at least of some tests that core team can run locally to verify whether it works or not.

If you want to take this issue, please comment below to get assigned.

vatsalkshah commented 3 months ago

Github did recently start supporting GPU hosted runners.