Added class to handle Bonito using transformers library

BatsResearch / bonito

A lightweight library for generating synthetic instruction tuning datasets for your data without GPT.

BSD 3-Clause "New" or "Revised" License

693 stars 46 forks source link

Added class to handle Bonito using transformers library #20

Closed sw241395 closed 4 months ago

sw241395 commented 7 months ago

Have added a class to handle the Bonito model using the transformers library. Should make things easier for end users who want to use the model but use a CPU or a quantised version of the model.

Happy to make any changes.

nihalnayak commented 7 months ago

Hi @sw241395! Thank you for the PR. We don't plan on adding support for CPUs or quantized models natively to the package. I will keep this PR open for now and revisit it if there is a huge demand.

sw241395 commented 7 months ago

Yeah that's fine. Thanks for taking a look

nihalnayak commented 4 months ago

I am closing this PR since we haven't received a request for this feature. I will come back to this PR if needed in the future. Thank you again for PR! 😄