-
The `batch_calc_X` interface currently expects an `N` parameter but this is clunky when being used for batches of linear Gaussian models with different matrices.
This could be made into a kwarg?
-
## Overview of Problem
Last week, we had to change an environmental variable in Rancher to get irIIIFService to work correctly with DSpace 7. Doing this required a restart and caused Redis to lose…
-
Hey everyone! It should function finally! Please update Unsloth via (if you're on a local machine - Colab / Kaggle no need to update, just refresh)
>
> ```shell
> pip uninstall unsloth -y
> pip i…
-
Hello, currently Lumina-T2I only supports Web Demo and CLI. I would like to ask how to achieve batch generation, that is, to continuously generate multiple prompts. Looking forward to your reply, than…
-
System config:
- CPU arch x86_64
- GPU: H200
- Tensorrt-LLM:v0.14.0
- OS: ubuntu-22.04
- runtime-env: docker container build from sources via official [build script](https://techcommunity.microsoft.c…
-
### Describe the issue as clearly as possible:
Perform batched generation. The problem occurs because CFGGuide.copy() which does not copy the attribute regex_fsm. https://github.com/outlines-dev/outl…
-
I'm trying to generate vanity wallet addresses, which are originally in ed25519, so I start by generating random bytes from a PRNG enough to cast into a secret key and then generate key pairs, but I r…
-
Reproduction with current main branch:
>set batch count to something high
>start by clicking generate
>let it generate some images
>click interrupt
>generate button goes back to normal, as if i…
-
### System Info
We are deploying the model meta-llama/Meta-Llama-3.1-70B-Instruct with FP8 quantization and everything works perfectly for hours until the server crashes with this error:
2024-10-…
-
Not sure if it's a bug, or me not understanding how this should work. But let's say I have this basic prompt
Prompt: Beautiful {dog|house}
Negative: ugly
with a specific seed.
And I set that D…