-
deployments.invoke sometimes trigger JSONDecodeError
sdk version: 2.0.8 (it was already occuring with 2.0.6)
## Here is my code
```python
from typing import Optional
from django.conf import s…
-
I am trying benchmarking new models, e.g.:
`glm-4-9b-chat, , THUDM/glm-4-9b-chat, , , 1, transformers, , ,`
```
python eq-bench.py --benchmarks eq-bench -v -r 1
...
Running benchmark 1 of 1…
-
### Your current environment
```text
Collecting environment information...
PyTorch version: N/A
Is debug build: N/A
CUDA used to build PyTorch: N/A
ROCM used to build PyTorch: N/A
OS: Ubuntu 22.04.…
-
Support the Mistral Platform, as documented here:
- docs: https://docs.mistral.ai/platform/overview
- login: https://console.mistral.ai/
Requirements:
- [x] Add Mistral Vendor
- [x] Add Mistral ve…
-
Hello!
Within the past week, I've been getting this error on Google Colab whenever I try to run any evals:
```
Traceback (most recent call last):
File "/usr/lib/python3.10/runpy.py", line 1…
-
**Describe the bug**
Attempting to run 'pip install langflow -U --pre' results in PIP resolvers.py error '_vendor.resolvelib.resolvers.ResolutionTooDeep: 200000'
**Version**
- Current installed …
-
TLDR
I am running the script [huggingface_model_neuron.ipynb](https://github.com/CambioML/uniflow/blob/main/example/transform/huggingface_model_neuron.ipynb) on AWS EC2 Inf2.xlarge and running client…
-
### System Info
Request failed during generation: Server error: 'FlashMixtral' object has no attribute 'compiled_model'
server/text_generation_server/models/flash_mistral.py 516
### Information
…
icyxp updated
5 months ago
-
### Your current environment
```text
Collecting environment information...
PyTorch version: N/A
Is debug build: N/A
CUDA used to build PyTorch: N/A
ROCM used to build PyTorch: N/A
OS: Arch …
-
] - event compiled client and server successfully in 925 ms (306 modules)
[0] - wait compiling...
[0] - event compiled client and server successfully in 151 ms (306 modules)
[1] 2024-03-06 10:51:50…