search

exo-explore / exo

Run your own AI cluster at home with everyday devices 📱💻 🖥️⌚
GNU General Public License v3.0
15.84k stars 840 forks source link

Removing download task for Shard(model_id='mlabonne/Meta-Llama-3.1-8B-Instruct-abliterated', start_layer=0, end_layer=31, n_layers=32): #233

Open csmVIc opened 2 months ago

csmVIc commented 2 months ago

As shown in the picture，Removing download task for Shard，its loading progress is always 0

Snipaste_2024-09-25_15-09-01
Admpeace commented 1 month ago

me too

AlexCheema commented 1 month ago

This will be fixed with #139 with the torch inference engine