-
I am trying to deploy niftynet trained model in tensorflow serving. But I have encountered the following problems:
(1) I cannot freeze the model with freeze_graph.py provided in tensorflow.
(2) It…
-
@jeyhunkarimov
From what I understand, we have to maintain a state of the ML algorithms. By state I understand something similar to a model that we maintain and update based on the training data:
…
-
### Description
在本机上(ubuntu20.0.4,12核cpu),执行如下命令:
sudo docker run --rm -p 8001:8001 -p8000:8000 -p 8002:8002 -v /home/openmldb/jd-recommendation/oneflow_process/model:/models -v /home/openmldb/jd-re…
-
When I run `apc-ups-exporter` I get the following error.
```
The configured Network Information Server is: 127.0.0.1:3551.
Resetting all metrics...
Starting background metrics collection...
…
-
Things we are looking forward to covering:
- Flask API wrapper around the ML model
- Writing Dockerfiles(we will be using nvidia-docker)
- Horizontal scaling and load balancing
- Using a cloud p…
-
Now that vllm supports llama2 properly, would be awesome to have a peft weight-sharing worker like for regular model serving. The comment at the end of this issue is probably enough to spike one:
htt…
-
**Abstract**
We introduce a simple data model and API tailored for serving the social graph, and TAO, an implementation
of this model. TAO is a geographically distributed data store that provides …
-
**Is your feature request related to a problem? If so, please describe.**
Currently the kserve inference [swagger UI](https://kserve.github.io/website/0.10/get_started/swagger_ui/) does not work …
-
Follow the installation guide in https://pylot.readthedocs.io/en/latest/manual_installation.html. I try to run pylot in my base system. The simulation is started successfully, howerver, when running p…
-
my current environment:
```
0.4.2
```
my bug:
i deployed hermes-2-pro-mistral-7b model with multi lora adapters. after applying a large multi adapter load on it, i started receiving an erro…