-
https://platform.openai.com/docs/guides/batch/overview
![1724574870797](https://github.com/user-attachments/assets/787b06d4-91be-4f52-bf80-75f4179c594f)
-
I skipped implementing the [batching section of the JSON-RPC specification](https://www.jsonrpc.org/specification#batch), but it would be nice to implement that for some of the more bursty RPCs. I thi…
-
When we run `examples/1_SimpleNet/simplenet.py`, the final thing that's executed is effectively
```
a = [0.0, 1.0, 2.0, 3.0, 4.0]
model(torch.Tensor(a))
```
This would also work with batching e…
-
Hey! Thanks for the amazing work.
I was trying to run the code in batches of 8. Ran into an issue with torch.stack as all images for Corvi2023 are not resized to the same dimensions. I was wondering …
-
Thanks for the amazing work! It really is super fast at bs=1.
Can batch usecases, or dynamic batching be supported?
-
### Component(s)
processor/interval
### Is your feature request related to a problem? Please describe.
`intervalprocessor` exports all metrics strictly on interval. with sufficient scale, thi…
-
During my work with draw calls (https://github.com/david-vanderson/dvui/issues/83#issuecomment-2267644939), I created the following new API design
Currently:
1. dvui allocates temporary memory
…
-
### Description
As the project develops, many of our tools work with lists of Audio objects with the goal to be that they can be optimized into Pydra workflows and have easy to use pipelines, especia…
-
## Context
The batching server currently does not configure CORS and by default, all requests from a browser are disabled. We want to enable CORS in order to be able to query prices from the portal…
ebma updated
19 hours ago
-
Hi,
Thank you for the great work you've done on this model! Is there any way to batch the model using `funasr`? I've been trying to batch with padding and set the `padding_mask` to mask out the un…