search

yamalight / litlytics

🔥 LitLytics - an affordable, simple analytics platform that leverages LLMs to automate data analysis
https://litlytics.app
GNU Affero General Public License v3.0
93 stars 4 forks source link

Evaluate using ONNX for local LLMs #1

Open yamalight opened 2 months ago

yamalight commented 2 months ago

Evaluate using https://github.com/xenova/transformers.js as local executor or fallback for when webgpu is not available

yamalight commented 1 month ago

https://huggingface.co/blog/transformersjs-v3 - v3 is out, might be worth digging into it now more than ever.