-
**UPD:** the missing `std::shared_ptr` support context is in the message https://github.com/mono/CppSharp/issues/1860#issuecomment-2297731111. Currently this support seems missing, and `shared_ptr`/`u…
-
[root@localhost iitp_trash]# nsml submit t0023/tr-3/87 checkpoint
...Warning: Your session has a total size of over 10 MB You may want to add unnecessary files and directories to the ignore list (e…
-
I have deployed the yolov3 object detection model on the TF server. I can successfully do inference on the single image now I want to test server capacity for multiple batches of images but when I try…
-
I'm using the Flan-t5 XXL of the shelf model in our project and for deployment we have converted it to ctranslate2 version using following command
**ct2-transformers-converter --model ~/input_folder…
gk-kd updated
4 months ago
-
### System Info
cargo version
cargo 1.80.1 (376290515 2024-07-16)
Haven't been able to run the docker file to get more details..
I am trying to run the docker on CPU
### Information
- [X] Docke…
-
I use tutorials/Quick_Deploy/vLLM to deploy codeLlama 7B, then I call metrics API, and a part of the metrics info is:
`
nv_inference_request_summary_us_count{model="triton-vllm-code-llama-model",v…
-
I successfully deploy baichuan1 13b model, and it gives three ports. How can i test Metrics Service at 0.0.0.0:8002?
I1118 07:23:26.676895 28532 grpc_server.cc:2451] Started GRPCInferenceService at…
-
### The bug
There is a problem when I delete some photos from file manager, or Google Photo, in general outside Immich app, when the photo isn't yet uploaded to the server.
The photos in Immich ap…
-
### Checklist
- [X] The issue exists after disabling all extensions
- [X] The issue exists on a clean installation of webui
- [ ] The issue is caused by an extension, but I believe it is caused by a …
-
How soon will the code be released?