-
For each of the items here, we should make sure all compositions (vmap, vmap x vjp) have a batching rule. All of these items should be actionable (in that it is possible to write a batching rule and w…
-
### Description
The idea of this issue is to try to optimize the step that computes the state root. Indeed, the longest part of this step is the multiple Keccak calculations and t…
-
Hi,
I was trying out and benchmarking different single-device Mixture of Experts layer implementations, and I naively assumed vmap could be of help in this task. In some cases a simple vmap-based i…
-
My non-technical contribution...
The batching function in 2.0 isn't working fully. (Rithvik you might recall you linked me to a preview of this some months ago to fix an issue of mine, so the compa…
-
I would love to see the [example](https://github.com/MozillaReality/three-batch-manager/tree/master/example) as a live website using Netlify or Github pages.
Also a small comparison between a scene…
-
**Describe the bug**
The way that the LBC reconciles SG rules is to revoke old rules, then add new ones, which I think is liable to cause downtime in a variety of scenarios. See here for the implem…
-
It appears that configuring batch with a period policy blocks graceful termination of a Benthos process. Configuration and sample output shown below.
When I remove the period policy and only have b…
-
* `bool is_thread_safe`? `int max_num_threads()` ?
* Should we/how can we avoid explosion of threads in hierarchies?
* `ad_batching_cost_model` 'linear' 'flops' 'benchmark'
* `ad_batching_max_n…
-
When I was converting the Bai Chuan model and wanted to enable inflight batching, an error occurred. The error message is as follows:
[10/30/2023-09:28:34] [TRT] [W] Unused Input: position_ids
[10…
-
Currently, there is serious mismatch between CMFBibAT and collective.citationstyles.
CMFBibAT provides page template views with citations on them, and, using a viewlet and JS, citationstyles hides th…