microsoft-phi2:max() arg is an empty sequence

lyogavin / airllm

AirLLM 70B inference with single 4GB GPU

Apache License 2.0

4.01k stars 332 forks source link

Open zazaji opened 8 months ago

zazaji commented 8 months ago

我用以下的代码来加载microsoft-phi2， from airllm import AutoModel 报错：

270, in split_and_save_layers
    if max(shards) > shard:
       ^^^^^^^^^^^
ValueError: max() arg is an empty sequence

lyogavin commented 8 months ago

This is on Mac, right?

On Mac microsoft-phi2 is not supported yet, Mac versoin only support llama series models now. we'll support it later.