-
### 📝 Description of the feature
Hi,
it would be great, if you could exit the server instance (check in license) once one uses the python del operator and once the python process finishes.
### 💡 S…
-
## 🐛 Bug
I get the following warning when using Prometheus inside of `ls.Logger`:
```
WARNING:litserve.loggers:Logger PrometheusLogger is not picklable and might not work properly.
```
Then…
-
should I delete the unfinished python server in this branch?
-
### Is your feature request related to a problem? Please describe.
- add tests for enums (string, numeric) after switching to fake petstore spec.
For https://github.com/OpenAPITools/openapi-gen…
-
Hi,
When running python/llm/example/GPU/HuggingFace/LLM/codeshell/server.py
python server.py --checkpoint-path /home/user/Qwen2-7B-Instruct --device xpu --multi-turn --max-context 1024
40+ pyt…
-
**Description**
We're seeing a `Windows fatal exception: access violation` running `vaex-core` 4.18.1 on windows with Python 3.9, not sure if the issue also affects other Python versions. I mentioned…
-
### What happened? (You can include a screenshot if it helps explain)
The `simulator.server` option does not get mapped to a correct `ErtConfig` entry. It will only error if accompanied by `queue_sys…
-
I build from source and the version of flashinfer is 0.1.6
```
pip install -e .
Obtaining file:///home/hutl/api/flashinfer/python
Preparing metadata (setup.py) ... done
Installing collected pac…
-
Currently, the main server sends code to the worker server for execution. However, the worker server is returning a dummy output:
```json
{ "output": "Dummy Output from worker" }
```
We need to m…
-