Description of changes:
Implement the feature of converting models from flexflow format to huggingface format and upload models to huggingface hub. Completed reconvert methods for models:
[x] llama
[ ] falcon
[x] opt
[x] mpt
[x] starcoder
Included an example script for downloading a model from huggingface, convert it to flexflow format, reconvert the format back to the huggingface model format(mainly modifying the weights), and eventually uploading it back to huggingface.
TODO:
Now the conversion of qkv weights for falcon models is facing some issues to fix.
Description of changes: Implement the feature of converting models from flexflow format to huggingface format and upload models to huggingface hub. Completed reconvert methods for models:
Included an example script for downloading a model from huggingface, convert it to flexflow format, reconvert the format back to the huggingface model format(mainly modifying the weights), and eventually uploading it back to huggingface.
TODO:
Related Issues:
Linked Issues:
Issues closed by this PR:
This change is