issues
search
Modalities
/
modalities
A framework for training multimodal foundation models.
MIT License
38
stars
3
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
Include torch compile
#135
flxst
opened
1 month ago
0
fix: #97 Unused attributes in a component's config yaml are just ignored by Pydantic
#134
lllAlexanderlll
closed
1 month ago
2
Apply Torch-Compile
#133
mali-git
opened
1 month ago
0
Refactor RMSNorm Implementation
#132
mali-git
opened
1 month ago
1
fix: deactivation of model evaluation mode
#131
flxst
closed
1 month ago
0
First optimizer changes towards improved loss stability
#130
le1nux
closed
3 weeks ago
0
Investigation: Loss spikes when loss developes close to convergence
#129
le1nux
opened
1 month ago
1
Resolve Model Class Within Modalities
#128
mali-git
closed
1 month ago
0
debug: adapt to new accelerate API
#127
mali-git
closed
2 months ago
0
Fix Bug when using RoPE embeddings together with gradient activation
#126
le1nux
opened
2 months ago
1
Log Acivations and Attention Scores
#125
mali-git
closed
1 month ago
0
Fix installation
#124
rrutmann
closed
1 month ago
0
Improve indexation of the cummulated_loss_tensor in the Trainer class
#123
le1nux
opened
2 months ago
0
Parameter norm logging
#122
le1nux
opened
2 months ago
0
Config logging to W&B
#121
le1nux
closed
2 months ago
0
Gradient clipping component
#120
le1nux
closed
2 months ago
0
Mamba TODOs
#119
rrutmann
closed
1 month ago
0
refactor: fixed loss logging during gradient accumulation and gradient clipping
#118
le1nux
closed
2 months ago
1
Improve CLI user friendliness
#117
flxst
opened
2 months ago
0
11 implement moe
#116
AbasKhan
opened
2 months ago
0
fix: fixed tensor reshape operations
#115
le1nux
closed
2 months ago
3
feat: added shell scripts for chunking files into parts and combining…
#114
le1nux
closed
1 month ago
1
Mamba
#113
mrudat-iais
closed
1 month ago
1
Fix getting started example
#112
flxst
closed
2 months ago
2
Fix linting inconsistencies (isort)
#111
flxst
closed
1 month ago
0
Linting inconsistencies (isort)
#110
flxst
closed
1 month ago
0
Suppress pydantic warnings in CLI help message
#109
flxst
closed
1 month ago
0
pydantic warnings in CLI help message
#108
flxst
closed
1 month ago
0
Improving throughput for PackedDataGenerator
#107
le1nux
closed
2 months ago
0
Repeating dataloader
#106
le1nux
closed
2 months ago
0
unused method get_callback_interval_in_batches_per_rank
#105
le1nux
opened
2 months ago
0
Extend FSDP Warmstart test by using a fixed seed
#104
fromm-m
closed
1 month ago
1
fix: fix loss normalization for logging
#103
mali-git
closed
2 months ago
1
Adapt text generation fct. to new tokenizer API
#102
mali-git
closed
2 months ago
2
Fix/98 unstable unittests
#101
luzian-hahn
closed
3 months ago
0
Grad norm logging
#100
le1nux
closed
2 months ago
0
Independent checkpointing and evaluation period
#99
le1nux
closed
2 months ago
0
Fix failing test_e2e_training_run_wout_ckpt
#98
le1nux
closed
3 months ago
3
Unused attributes in a component's config yaml are just ignored by Pydantic
#97
le1nux
closed
1 month ago
1
Tokenization
#96
mali-git
closed
3 months ago
0
Refactor Tokenization
#95
mali-git
closed
3 months ago
0
Integrate the audio modality in CoCa
#94
manasMauryax
opened
3 months ago
0
Remove legacy config files
#93
spravil
closed
1 month ago
0
Integrate Memory Augmented Language Models through Mixture of Word Experts
#92
mali-git
closed
1 month ago
0
Integrate MoE-Mamba
#91
mali-git
opened
3 months ago
0
Better component registry and import structure
#90
spravil
opened
3 months ago
0
Integrate GaLore Optimizer
#89
mali-git
opened
3 months ago
0
Add Webdataset
#88
spravil
opened
3 months ago
2
Log Learning Rate
#87
mali-git
closed
3 months ago
0
Update Readme
#86
mali-git
opened
3 months ago
1
Previous
Next