LargeWorldModel LWM issues

LargeWorldModel / LWM

Apache License 2.0

7.1k stars 549 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

Removing Truncation/Padding during Prefix Tokenization

#83 tsrikris opened 3 weeks ago
0
Asking to pad but the tokenizer does not have a padding token

#82 gabeweisz opened 1 month ago
0
checkpoints for run_sample_video.sh

#81 junsukha opened 2 months ago
0
I wonder if you will release the tokenized dataset.

#80 lzy-ps opened 2 months ago
0
A question on your implementation of decoder phase of llama

#79 wangtianxia-sjtu opened 3 months ago
0
Hang in vision_generation.py with newer versions of Jax

#78 gabeweisz closed 2 months ago
1
Error while running bash command: run_sample_video.sh | Error: "TypeError: missing a required argument: 'segment_ids'"

#77 samitm-123 opened 3 months ago
6
Fix step idx logging and eval frequency

#76 ntoxeg opened 3 months ago
0
Quantize model weights

#75 befman123 opened 4 months ago
0
Any consideration on why use 4 sp & 32 tp?

#74 ParanoidHW opened 5 months ago
0
vison-language model training data example for videos

#73 Minyoung1005 opened 5 months ago
0
fix: check aux length to avoid exception

#72 RealHurrison opened 5 months ago
0
Question about loading LLaMA-2 7B on the LLM context extension stage

#71 ImKeTT opened 5 months ago
0
Interesting Problems of Accuracy & Inference Speed with run_eval_needle.sh

#70 Treemann opened 5 months ago
0
what is the "_missing_keys"?

#69 wangli68 opened 5 months ago
0
Fix logging issue in llama.py

#68 Treemann opened 5 months ago
0
vision model initialization

#67 wangli68 opened 5 months ago
0
Minimum GPU memory capacity required to run

#66 yumianhuli2 closed 5 months ago
1
Weight conversion scripts

#65 fmmoret opened 6 months ago
1
Great work! Any plan for the vision-language models in Pytorch?

#64 WilTay1 opened 6 months ago
0
Can it be used in the environment H100 ?

#63 wangli68 opened 6 months ago
0
ValueError: Incompatible shapes for broadcasting: (2, 1, 1, 526464) and requested shape (2, 1, 32768, 32768)

#62 scsonic opened 6 months ago
2
DP FSDP & SP

#61 wangpengfei1013 opened 6 months ago
0
RESOURCE_EXHAUSTED: XLA:TPU compile permanent

#60 infocodiste opened 6 months ago
0
AttributeError: module 'jax.numpy' has no attribute 'DeviceArray' when run sample_video.sh

#59 ersanliqiao opened 6 months ago
0
Request for publicizing the LWM-1K/8K JAX or PyTorch model

#58 iamlockelightning opened 6 months ago
0
Does support text to image and video geneation training ?

#57 ersanliqiao opened 6 months ago
0
How to setup conversation with vision chat?

#56 kylekam opened 7 months ago
1
pytorch model & ring attention

#55 LzhinFdu opened 7 months ago
4
run run_sample_video.sh config

#54 wangli68 opened 7 months ago
0
run run_samle_image.sh error

#53 wangli68 opened 7 months ago
0
Getting memory error while running run_vision.sh

#52 PraneethKumar126 opened 7 months ago
0
When will you support text to video in pytorch?

#51 459737087 opened 7 months ago
0
`model_max_length` why is it 2048?

#50 denadai2 opened 7 months ago
1
LlamaForCausalLM requires the PyTorch library but it was not found in your environment

#49 459737087 closed 7 months ago
1
ValueError: bytes is too large when running scripts/run_train_text.sh

#48 liu21yd opened 7 months ago
1
Example Data for vision language training (What is the format?)

#47 EthanC111 opened 7 months ago
1
How to set the input length parameter to support long context window e.g. 256k inputs?

#46 dzyjjpy opened 7 months ago
1
We need API

#45 lueluelue2006 opened 7 months ago
0
NCCL Error when running the Jax LWM-Chat-32K-Jax

#44 yfb-xieyu closed 7 months ago
1
error when run run_sample_img.sh

#43 onmygame closed 7 months ago
1
NCCL Error when running the Jax LWM-Chat-1M-Jax

#42 jeffchy opened 7 months ago
0
AttributeError: module 'jax.numpy' has no attribute 'DeviceArray'

#41 zhongJY1998 closed 5 months ago
1
TypeError: unsupported operand type(s) for |: 'type' and 'NoneType'

#40 dzyjjpy closed 7 months ago
5
Mesh dim setting error

#39 yfb-xieyu closed 7 months ago
1
Update README.md

#38 I-E-E-E opened 7 months ago
0
out of memory error

#37 lucky2046 closed 7 months ago
3
bash run_vision_chat.sh -- cause flax.errors.ScopeParamNotFoundError: Could not find parameter named "embedding" in scope "/transformer/wte"

#36 jackyin68 opened 7 months ago
6
Request for guidance on fine-tuning a model with custom data

#35 awzhgw opened 7 months ago
2
Great work! Any plan to train a smaller version, e.g. around 3B?

#34 StarCycle opened 7 months ago
4