search

microsoft / vcpkg

C++ Library Manager for Windows, Linux, and MacOS
MIT License
22.75k stars 6.29k forks source link

[New Port Request] <TinyChatEngine> #33432

Open ilongshan opened 1 year ago

ilongshan commented 1 year ago

Library name

TinyChatEngine

Library description

TinyChatEngine: On-Device LLM Inference Library

Source repository URL

https://github.com/mit-han-lab/TinyChatEngine

Project homepage (if different from the source repository)

https://mit-han-lab.github.io/TinyChatEngine/

Anything else that is useful to know when adding (such as optional features the library may have that should be included)

Running large language models (LLMs) on the edge is useful: running copilot services (coding, office, smart reply) on laptops, in-car entertainment systems, vision-language assistants in robots or spaceships. Users can get instant responses without transmitting any local data to the internet, addressing privacy concerns, as sensitive data remains localized and reduces the risk of potential breaches.

TinyChat project consists of LLM model compression algorithms and TinyChatEngine, the inference engine that implements the compressed LLM targeting edge devices.

github-actions[bot] commented 10 months ago

This is an automated message. Per our repo policy, stale issues get closed if there has been no activity in the past 60 days. The issue will be automatically closed in 14 days. If you wish to keep this issue open, please add a new comment.

ilongshan commented 10 months ago

Hope it can be added

github-actions[bot] commented 8 months ago

This is an automated message. Per our repo policy, stale issues get closed if there has been no activity in the past 60 days. The issue will be automatically closed in 14 days. If you wish to keep this issue open, please add a new comment.

ilongshan commented 8 months ago

Hope it can be added

github-actions[bot] commented 5 months ago

This is an automated message. Per our repo policy, stale issues get closed if there has been no activity in the past 60 days. The issue will be automatically closed in 14 days. If you wish to keep this issue open, please add a new comment.

ilongshan commented 5 months ago

Hope it can be added

github-actions[bot] commented 3 months ago

This is an automated message. Per our repo policy, stale issues get closed if there has been no activity in the past 60 days. The issue will be automatically closed in 14 days. If you wish to keep this issue open, please add a new comment.

ilongshan commented 3 months ago

Comment to keep it open

github-actions[bot] commented 1 month ago

This is an automated message. Per our repo policy, stale issues get closed if there has been no activity in the past 60 days. The issue will be automatically closed in 14 days. If you wish to keep this issue open, please add a new comment.

ilongshan commented 1 month ago

Comment to keep it open