-
Hi,
Im trying to get an example working with Ray on Databricks. Essentially having multiple replicas of the model. Is it possible to load a model with tensor parallelism inside a notebook?
Thank…
-
### Steps to reproduce
Repro repo: https://github.com/jscheid/prevent-writes-test
Possibly related to #36830.
I've been hunting down an issue in our multi-db, passenger-based, postgres-based …
-
**What would you like to be added**:
Currently, when storing the workload model subscription message to the map, only one IP has been stored. In multi IP scenarios, the map data structure and relat…
-
### Your current environment
vllm == 0.5.5.
### 🐛 Describe the bug
when we deploy the `microsoft/Phi-3.5-vision-instruct`,
it will randomly hit this issue.
```
[1;36m(VllmWorkerProcess p…
-
**This is my current option, but I find that the audio quality after processing and merging is not as good as the audio quality of these different models when processed separately**
![image](https:…
-
message when running `cooltools compute-expected`
```
INFO:numexpr.utils:NumExpr defaulting to 8 threads.
```
`--nproc` does not seem to affect or control it ...
-
At the moment we have as default `multiprocessing=False`, but I wonder what was/is the reasoning behind it.
When browsing the web, I can find the following statement:
* multi-threading is good for…
-
what is the structure of the training set?
(vnegnn) mou@trailblazer:~/dnapr/vnegnn$ python process_dataset.py --input_path data/scpdb/scpdb_subset_puresnet/raw/ --output_path data/scpdb/scpdb_subset_…
-
Hi, very nifty python package you've compiled here. However, whenever I use multiple toaster messages within a python file (I have one go off for each function in my file), I notice a significant dela…
-
This would be importing a feature to binary processing that multi-label processing already has.
For binary images that contain significant volumes of black pixels, we can skip processing the black …