microsoft / onnxruntime-genai

Generative AI extensions for onnxruntime
MIT License
514 stars 127 forks source link

Check out TurnkeyML-LLM #854

Open jeremyfowers opened 2 months ago

jeremyfowers commented 2 months ago

Hi OGA community, I would like to let you know about our new work TurnkeyML-LLM, which can do some cool things on top of OGA.

Some features you may find interesting:

You can learn more about the project in the LLM readme, including the commands to try each of the features above.

The team would love to hear your feedback! You can contact us at turnkeyml@amd.com or by filing an issue on the TurnkeyML repo.

natke commented 2 months ago

This is so cool @jeremyfowers! We will have a play with it and be in touch!