search

csinva / imodelsX

Scikit-learn friendly library to interpret, and prompt-engineer text datasets using large language models.
https://csinva.io/imodelsX/
MIT License
161 stars 26 forks source link

Batching in Embgam #3

Closed divyanshuaggarwal closed 1 year ago

divyanshuaggarwal commented 1 year ago

A pull request to implement batching while calculating transformers embeddings for the n-grams. This will make the process faster and more efficient.