-
### 🔖 Feature description
I think support for Azure Openai API would be great.
as so many developers and organizations use Azure to fulfill their Cloud Needs.
So adding up a support for azure O…
-
### What happened?
Doesn't seem like `logprobs` are being logged or sent to Langfuse.
### Relevant log output
_No response_
### Twitter / LinkedIn details
https://www.linkedin.com/in/davidm…
-
Aider version: 0.62.1
Python version: 3.11.8
Platform: Linux-6.1.112+-x86_64-with-glibc2.38
Python implementation: CPython
Virtual environment: Yes
OS: Linux 6.1.112+ (64bit)
Git version: git ve…
-
## Optimize the LLM kernel
- [ ] Translate current implementation to more efficient implementation (more efficient and still cross-platform)
- [ ] Multi-thread/Multi-process optimization (@om-ra…
-
Integrate at least one model through [Amazon Bedrock](https://aws.amazon.com/bedrock/).
-
I would like to inquire about the concurrent request capacity of an NVIDIA A100 80 GB GPU when employing the Llama-2-13b model with full document capabilities within the H2OGPT ecosystem for productio…
-
I'm encountering a ModuleNotFoundError when trying to import the py-zerox module in my Python project, despite having installed it successfully.
Environment
Python Version: 3.12
Install…
-
### Description
llm = LLM(
model="custom-model-name",
base_url="https://api.your-provider.com/v1",
api_key="your-api-key"
)
agent = Agent(llm=llm, ...)
An error is reported when the…
-
### What happened?
I was trying to run litellm with WIFI turned off for a local model, but it wasn't able to run with failure connecting to openai server? Is it expected?
### Relevant log output
_…
-
### Issue
Hello!
Please add GitHub Copilot as model provider.
Should be possible like this: https://github.com/olimorris/codecompanion.nvim/blob/5c5a5c759b8c925e81f8584a0279eefc8a6c6643/lua/cod…