-
Our modules only work with generation under two conditions: batch_size = 1 or every single sample in a batch has the same length. The main culprit is this line of code: https://github.com/pytorch/torc…
-
Great job!
We found that Quest is implemented on the previous version of flashinfer and some common feature are not support currently.
* bsz > 1
* GQA
* CUDA graph
Is there any plan to update t…
-
In my training script, I set the **per_device_train_batch_size = 4** in the TrainingArguments.
But the **train_batch_size** in the **trainer_state.json** of each checkpoint is **2**.
When I tried …
-
f1, f2 = torch.split(features, [bsz, bsz], dim=0)
RuntimeError: start (4) + length (4) exceeds dimension size (4).
-
The re-written rope example has quite different indexing when input `q` / `cos` / `sin` is defined with static or dynamic shapes.
I think this is coming from the inconsistent fusion definition. i.e…
-
I run the scripts/search_dist.sh of llama_hf model using A800 with 8 gpus
`export NUM_NODES=1
export NUM_GPUS_PER_NODE=8
MODEL_SIZE="llama-13b"
MEMORY=75
MODEL_ARGS="
--model_size ${MODE…
-
Hi, I'm trying to use ANCHORED FEATURE REGULARIZER as you suggested, but I'm having a problem that when Batch_size=1, lowerbound_loss is always 0. After checking the code, it's caused by the following…
-
hello ,i'm reading your paper and running your code,i want to know what does --bsz mean?
looking forward to your reply
-
> Traceback (most recent call last):
File "inference_t2i.py", line 372, in
gen_token_ids = model.t2i_generate(
File "Show-o/models/modeling_showo.py", line 108, in t2i_generate
cond_l…
-
我看了这篇[#25 ](https://github.com/soxft/busuanzi/issues/25#issuecomment-2082193456) 数据是迁移成功了,但访客数据异常且不会新增。地址:
我发现两份/data/bsz/config.yaml 配置项不一致,我将新的配置与旧的修改一致。
通过查看redis容器数据已经是成功的迁移了过来
…