-
### Software
Desktop Application
### Operating System / Platform
Windows
### Your Pieces OS Version
Pieces OS 10.1.4
### Early Access Program
- [ ] Yes, this is related to an Earl…
-
### System Info
colab T4
### Who can help?
@
### Information
- [X] The official example scripts
- [ ] My own modified scripts
### Tasks
- [X] An officially supported task in the `examples` fold…
-
after i ran `pip install tensorrt_llm-0.9.0-cp310-cp310-win_amd64.whl --extra-index-url https://pypi.nvidia.com --extra-index-url https://download.pytorch.org/whl/cu121` i got the error `ERROR: tensor…
-
Hi, I run the code locally not docker. And I have been stuck with the qt package for a long time. The error message says: qt.qpa.xcb: could not connect to display :0
qt.qpa.plugin: Could not load the…
-
### Is your feature request related to a problem? Please describe.
Re: [Conversation between Eric and I](https://github.com/microsoft/autogen/pull/2375#issuecomment-2091056580) We should have the abi…
-
The security solution's AI Assistant has the ability to anonymize sensitive information before communicating with LLMs (https://www.elastic.co/docs/current/serverless/security/ai-assistant#anonymizati…
-
Hello,
Similarly to #3, I've tried reproducing the `demo.py` benchmark on an H100 and an A6000 and I'm also seeing no speedup on these platforms at lower precisions.
It was mentioned this is du…
-
The model was set using /Model command
Unexpected error: litellm.NotFoundError: AnthropicException -
b'{"type":"error","error":{"type":"not_found_error","message":"model: anthropic.claude-3-5…
-
## 🐛 Bug
see title
## To Reproduce
Steps to reproduce the behavior:
1. follow instructions to install mlc from nightly (NOT using conda, just in my venv)
1. run `mlc_llm serve HF://mlc-ai…
-
Add support for other LLMs, particularly claude, through the LangChain libraries. This should be fairly straightforward given that Claude is supported by LangChain.
https://js.langchain.com/v0.1/do…