-
I have tried both the single gpu and multi gpu versions of the code. The single gpu, float32 run works only on the smaller resolution; when I run it on the 768 I get a Out of memory error on anythin…
-
It seems to me that rayon's awareness of iterators, types and mutability ought to make automatic GPU offloading a feasible project.
An idea would be to use compiler plugins/proc-macros that precom…
-
Hi, I am a snabb user and I am really appreciate group of snabb that provide this outstanding tool. Now, I need to convert https traffic to http traffic.
Can Snabb support ssl offloading with s…
-
Currently not supported, build doesn't succeed.
-
**Is your feature request related to a problem? Please describe.**
When reusing a prompt text encoder embeds are recomputed, this can be time consuming for something like T5-XXL with offloading or …
-
Is their any guidance or feature for private key offloading in BouncyCastle? (similar to [this](https://github.com/aws/s2n-tls/blob/main/docs/usage-guide/topics/ch12-private-key-ops.md) in s2n-tls)
…
-
### **Proposal Summary: Offloading Trust**
The problem we met to solve is how browsers can help prevent hidden tracking without breaking federation protocols for Research and Education federations.…
-
Estuary pins all content that gets uploaded to it. This is great for now, especially to give users some sort of guarantee of storage and to make deal initiation easy (our proof buddy would just live n…
-
Right now everything is hardcoded, but we really need to make these env vars and document them for self-hosters:
https://github.com/triggerdotdev/trigger.dev/blob/04645e83293ab8a04a094a84697b20b2b0…
-
When run with `pipe.enable_model_cpu_offload()`, it shows an error:
```
RuntimeError: Expected all tensors to be on the same device, but found at least two devices, cpu and cuda:0! (when checking ar…