issues
search
allenai
/
OLMo
Modeling, training, eval, and inference code for OLMo
https://allenai.org/olmo
Apache License 2.0
4.2k
stars
392
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
Expose memmap_dtype in the data configuration
#595
leon-g-xu
closed
1 month ago
2
Expose memmap dtype in data config
#594
leon-g-xu
closed
1 month ago
2
Inspect training data without data indices
#593
2015aroras
closed
1 month ago
0
training directly from object storage?
#592
joellliu
closed
4 weeks ago
2
OLMoThreadError
#591
lecifire
closed
5 days ago
2
Update README HF examples to use OLMo-1.7-7B
#590
2015aroras
closed
1 month ago
0
Update docs with new HF checkpoint information
#589
2015aroras
closed
1 month ago
0
Clarify that "auto" methods do not work with HF OLMo checkpoints
#588
2015aroras
closed
1 month ago
0
Storage cleaner improvements
#587
2015aroras
closed
1 month ago
0
Problem with HF loading from model checkpoint
#586
ryanyxw
closed
1 month ago
5
Add documentation for OLMo checkpoints
#585
2015aroras
closed
1 month ago
0
Problems with multi-epoch training
#584
Muennighoff
opened
1 month ago
0
OLMo-1B's results seem very bad on olmo-eval
#583
Ivan-Zhou
closed
1 month ago
0
Allow hybrid sharding to have multiple replicas in a node
#582
2015aroras
closed
1 month ago
0
You should probably TRAIN this model on a down-stream task to be able to use it for predictions and inference.
#581
mclanza
closed
1 month ago
6
Update ignore_index parameter for flash attention
#580
2015aroras
closed
1 month ago
0
Update train.py
#579
MLgdg
closed
1 month ago
1
PyTorch 2.3 Support for for OLMo
#578
prakamya-mishra
opened
1 month ago
0
[wip] comparing vanilla torch model and clipping with OLMo FSDP, no_shard and OLMo clipping
#577
ananyahjha93
opened
1 month ago
3
[wip] comparing vanilla torch model and clipping with OLMo FSDP no_shard and OLMo clipping
#576
ananyahjha93
closed
1 month ago
0
Add Weka storage support
#575
2015aroras
closed
1 month ago
0
Fix GPU tests CI
#574
epwalsh
closed
1 month ago
0
Optionally load trainer state
#573
Muennighoff
opened
1 month ago
2
remove last name
#572
mitchellnw
closed
1 month ago
0
Inference using llama.cpp
#571
nopperl
opened
2 months ago
0
Support DDP
#570
Muennighoff
opened
2 months ago
0
Increment torch version
#569
Muennighoff
closed
1 month ago
3
mask instances with too many repetitions
#568
epwalsh
closed
2 months ago
0
Reverse weight decay
#567
AkshitaB
opened
2 months ago
3
why customized optimizers?
#566
joellliu
closed
1 month ago
6
Fix a couple typos in docs
#565
dumitrac
closed
2 months ago
0
Add (unrefined) script for converting OLMo checkpoints to new HF format
#564
2015aroras
closed
2 months ago
0
RuntimeError: PytorchStreamReader failed reading zip archive: failed finding central directory
#563
Jimmy-Yang1217
opened
2 months ago
2
Add back original legacy unsharding implementation
#562
2015aroras
closed
2 months ago
1
Delay device mesh import
#561
2015aroras
closed
2 months ago
0
the loss spike
#560
bpwl0121
opened
2 months ago
7
No module named 'torch.distributed.device_mesh'
#559
prakamya-mishra
closed
2 months ago
6
Release v0.3.0
#558
2015aroras
closed
2 months ago
0
Flash attention 2.0 support
#557
johnhalloran321
closed
2 months ago
3
Make hf_olmo support new transformers versions
#556
2015aroras
closed
2 months ago
0
Catch and ignore CommError during W&B cancel check
#555
2015aroras
closed
2 months ago
1
Break at 1 epoch "Training epoch complete", can't pretraining beyond 1 epoch ?
#554
Xuekai-Zhu
opened
2 months ago
3
Checkpoints for instruction-tuned model
#553
alexnikulkov
closed
2 months ago
1
OLMoThreadError
#552
juripapay
opened
2 months ago
4
use correct PG when collecting metrics with HYBRID shard
#551
epwalsh
closed
2 months ago
0
Issue training on multiple nodes
#550
edwardsp
opened
2 months ago
3
Gradient Checkpointing
#549
fakerybakery
opened
2 months ago
2
Rename OLMoModelForCausalLM to OLMoForCausalLM
#548
2015aroras
closed
2 months ago
0
Add OLMo 1.7-7b README + Config
#547
2015aroras
opened
2 months ago
3
Add checkpoint csv for OLMo 1.7
#546
2015aroras
closed
2 months ago
0
Previous
Next