Multi-device training tracking issue

EricLBuehler / xlora

X-LoRA: Mixture of LoRA Experts

Apache License 2.0

178 stars 8 forks source link

Closed EricLBuehler closed 9 months ago

EricLBuehler commented 9 months ago

This is a tracking issue for multiple device support for the classifier.

EricLBuehler commented 9 months ago

huggingface/accelerate#2395: device_map does not apply as our classifier is small.