issues
search
mosaicml
/
llm-foundry
LLM training code for Databricks foundation models
https://www.databricks.com/blog/introducing-dbrx-new-state-art-open-llm
Apache License 2.0
3.99k
stars
525
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
Load config on rank 0 first
#1371
dakinggg
closed
2 months ago
0
Fix hf dataset hang on small dataset
#1370
dakinggg
closed
2 months ago
0
use default eval interval from composer
#1369
milocress
closed
1 month ago
1
Add missing init
#1368
KuuCi
closed
2 months ago
0
Add option to unfuse Wqkv
#1367
snarayan21
closed
2 months ago
1
Enhanced Logging for convert_delta_to_json and convert_text_to_mds
#1366
vanshcsingh
closed
2 months ago
0
Readd Clear Resolver
#1365
KuuCi
closed
2 months ago
0
Add logging to data-prep scripts
#1364
vanshcsingh
closed
2 months ago
1
Update StreamingTextDataset to support truncation with multiple truncated items out.
#1363
LingxiaoShawn
closed
1 month ago
2
Variable num experts
#1362
ShashankMosaicML
closed
2 months ago
0
Command utils + train
#1361
KuuCi
closed
2 months ago
1
update runners
#1360
KevDevSha
closed
2 months ago
0
Make ICL dataloaders build lazily
#1359
josejg
closed
2 months ago
0
Add LoadPlanner and SavePlanner registries
#1358
irenedea
closed
2 months ago
0
Expose flag for should_save_peft_only
#1357
irenedea
closed
2 months ago
0
Add flag for saving only composer checkpoint
#1356
irenedea
closed
2 months ago
0
Add convert_delta_to_json to CLI
#1355
KuuCi
closed
2 months ago
4
Add convert_finetuning_dataset to CLI
#1354
KuuCi
closed
2 months ago
3
Fix MLFlow Save Model for TE
#1353
j316chuck
closed
2 months ago
0
Add convert_text_to_mds to CLI
#1352
KuuCi
closed
2 months ago
3
Allow train.py-like config for eval.py
#1351
josejg
closed
2 months ago
4
Add EnvironmentLogger Callback
#1350
josejg
closed
1 month ago
2
Add convert_dataset_json to CLI
#1349
KuuCi
closed
2 months ago
3
Add convert_dataset_hf to CLI
#1348
KuuCi
closed
2 months ago
3
Add fp32 to the set of valid inputs to attention layer
#1347
j316chuck
closed
2 months ago
2
Log extraneous keys
#1346
j316chuck
closed
2 months ago
1
Add Eval to Foundry CLI
#1345
KuuCi
closed
2 months ago
4
Log all extraneous_keys in one go for ease of development
#1344
josejg
closed
2 months ago
1
[MCLOUD-4910] Escape UC names during data prep
#1343
naren-loganathan
closed
2 months ago
2
Bump sentencepiece from 0.1.97 to 0.2.0
#1342
dependabot[bot]
closed
2 months ago
1
Update accelerate requirement from <0.26,>=0.25 to >=0.32.1,<0.33
#1341
dependabot[bot]
closed
2 months ago
1
Bump fsspec from 2023.6.0 to 2024.6.1
#1340
dependabot[bot]
closed
2 months ago
1
Nicer error message for undefined symbol
#1339
dakinggg
closed
3 months ago
0
Avoid HF race condition
#1338
dakinggg
closed
3 months ago
0
Add CLI for train.py
#1337
KuuCi
closed
2 months ago
5
Deepcopy config in callbacks_with_config
#1336
mvpatel2000
closed
3 months ago
0
Add a config arg to just save an hf checkpoint
#1335
dakinggg
closed
3 months ago
0
Adding a child class of hf's rotary embedding to make hf generate work on multiple gpus.
#1334
ShashankMosaicML
closed
3 months ago
0
Fix registry for callbacks with configs
#1333
mvpatel2000
closed
3 months ago
0
Currently multi-gpu generate does not work with hf.generate for hf checkpoints. This PR fixes that.
#1332
ShashankMosaicML
closed
3 months ago
0
Bump onnx from 1.14.0 to 1.16.1
#1331
dependabot[bot]
closed
3 months ago
0
Update datasets requirement from <2.20,>=2.19 to >=2.20.0,<2.21
#1330
dependabot[bot]
opened
3 months ago
1
Bump onnxruntime from 1.15.1 to 1.18.1
#1329
dependabot[bot]
closed
3 months ago
0
Bump einops from 0.7.0 to 0.8.0
#1328
dependabot[bot]
closed
3 months ago
0
Update transformers requirement from <4.41,>=4.40 to >=4.42.3,<4.43
#1327
dependabot[bot]
closed
3 months ago
0
Bump version
#1326
b-chu
closed
3 months ago
2
Composer lora weights conversion
#1325
zhao-lun
closed
3 months ago
3
Fixing sequence_id =-1 bug, adding tests
#1324
ShashankMosaicML
closed
3 months ago
0
Registry docs update
#1323
dakinggg
closed
3 months ago
0
Add dependabot
#1322
dakinggg
closed
3 months ago
0
Previous
Next