togethercomputer / Dragonfly

Other
65 stars 11 forks source link

KeyError: 'dragonfly' when importing the huggingface checkpoints #10

Closed vjz3qz closed 3 months ago

vjz3qz commented 3 months ago

I'm looking to import the Dragonfly checkpoints from huggingface, but I keep getting a model config key error. I've ensure that I have read token for huggingface and accepted terms. Let me know if there is a solution to this issue.

Screenshot 2024-06-08 at 10 20 50 AM Screenshot 2024-06-08 at 10 21 18 AM Screenshot 2024-06-08 at 10 21 28 AM
rthapa84 commented 3 months ago

Hey, thank you for reaching out. First, please make sure you follow the installation instruction on readme to make sure you install the right packages. And second, please follow the instruction in this script to load and run our model (https://github.com/togethercomputer/Dragonfly/blob/main/test_dragonfly.py). At the moment, Dragonfly is not integrated fully with Transformer package, and therefore, you cannot load it that way.

vjz3qz commented 3 months ago

Thanks for letting me know! That works. Would love to know once Dragonfly is fully integrated with the Transformers package.