-
Hello!
I'm still not able to install deepsparse with numpy>=1.22 with pip install.
The pipy version does not seem to include the modification.
ERROR: Cannot install deepsparse and numpy>=1.22 be…
-
## Spend Tracking
- [ ] Expose /user/delete endpoint [Feature]: Expose /user/delete endpoint #1711
- [ ] End User Emails when a key is near its budget
- [ ] Azure cost tracking: Set Base model …
-
**Describe the bug**
`RecursionError: maximum recursion depth exceeded while getting the str of an object`
**Expected behavior**
I want to the convert a LlaMa model into ONNX and then benchmark i…
-
While finalizing [CM-MLPerf BERT inference benchmark tutorial for SCC'23](https://github.com/mlcommons/ck/blob/master/docs/tutorials/scc23-mlperf-inference-bert.md) here a few missing things that we c…
-
Hi.
The paper describes 8-bit quantization combined with pruning, which is fantastic.
My question: has any research been done for 4-bit quantization? Since GPU memory is notoriously expensive, 4…
-
**Describe the bug**
When running the steps from the ultralytics yolov8 tutorial: https://github.com/neuralmagic/sparseml/blob/main/integrations/ultralytics-yolov8/tutorials/sparse-transfer-learning.…
-
**Describe the bug**
A clear and concise description of what the bug is.
Hey Team, trying to quantize mistral 8*22b with W8A8 recipe and failed with two issues with different versions:
1)
`…
-
## UI v2.0 Improvements
- [x] Proxy SSO Login - Add OpenID, Azure AD https://github.com/BerriAI/litellm/issues/1658
- [x] [Feature-UI]: UI Static Web App on Proxy
- [ ] [Feature-UI]: Show users t…
-
- [ ] Create philosophical shorts for why LLM may actually "understand"
- [ ] Create a weekly target
- [ ] Reflect on how I would trickle from year to daily vision
- [ ] Create gigs on fastwork
- [ ] …
-
Tracking list of new models / endpoints / providers we plan on adding this week.
Comment any new models/providers/endpoints you want us to add below 👇
- [ ] Predibase lorax support - https://git…