-
This is just a cosmetical change, but it would be super nice to rename the repository, so that it's totally clear, that this is a worker in the RunPod universe using kebab case.
The official worke…
-
I am trying to use this worker with custom nodes. When I deploy using your docker image, all works smoothly on RunPod as expected. However, when I fork the repo, create a local image, then push and de…
-
https://github.com/runpod-workers/cog-worker/blob/main/src/handler.py#L49
600 seems low, especially for some jobs we are running we hit this timeout pretty often. Can we up this to what the actual …
-
Hi,
I'm a hobbyist and occasionally would like to create images or run queries. Serverless seems like a good fit with cost control.
I tried to use this image for a serverless installation on runpod,…
-
I was trying to run a clean comfy instance with custom models and nodes. So I tried setting up the serverless endpoint using `timpietruskyblibla/runpod-worker-comfy:3.0.0-base` docker image, however i…
-
When trying to use the completions endpoint (rather than chat_completions) on a vLLM runpod serverless instance I get a server error. This happens with all models that I've tried. The chat_completions…
-
I've been investigating a performance issue with SGLang on RunPod's serverless platform. Here are my key findings:
I identified that SGLang performs significantly worse on the serverless setup comp…
-
I'm a bit unclear about what the expected UX is for this application.
There isn't any way to actually access runpod deployed UI via a browser right?
Is the methodology described in "How to get the…
-
When using the `0.0.9` of this image, we receive this error:
```json
{
"delayTime": 14006,
"error": "{\"error_type\": \"\", \"error_message\": \"Extra data: line 1 column 5 (char 4)\", \"err…
-
docker.io/runpod/worker-vllm:stable-cuda12.1.0