Open michaelfeil opened 1 year ago
Is it possible to integrate converter scripts for the GPTBigCodeForCausalLM architecture from the transformers libary?
This would enable integration of models like Starcoder / Santacoder.
With this, community projects like https://github.com/fauxpilot/fauxpilot/issues/200 would have a great benefit.
Agree ! Maybe starcoder is the SOTA model until 2023.05.25 of the <20B models. It would bring great benefits to the people who use it.
Is it possible to integrate converter scripts for the GPTBigCodeForCausalLM architecture from the transformers libary?
This would enable integration of models like Starcoder / Santacoder.
With this, community projects like https://github.com/fauxpilot/fauxpilot/issues/200 would have a great benefit.