DRAGNLabs 301r_retnet issues

DRAGNLabs / 301r_retnet

2 stars 1 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

lr_find

#86 DrewGalbraith opened 1 month ago
0
User Scripts and User Configs not empty

#85 DrewGalbraith opened 1 month ago
0
No shabangs and stuff

#84 DrewGalbraith opened 1 month ago
0
Correct a pathin grid search

#83 DrewGalbraith closed 1 month ago
2
fix padding

#82 JayOrten closed 1 month ago
1
various-fixes

#81 JayOrten closed 1 month ago
0
Logging Inconsistent For LongNet

#80 nprisbrey opened 2 months ago
1
Errors in evaluation section of README

#79 DrewGalbraith opened 2 months ago
1
Performer

#78 DrewGalbraith opened 2 months ago
0
Duplicate paths in the yaml

#77 DrewGalbraith opened 2 months ago
1
Tboard dammit

#76 DrewGalbraith closed 2 months ago
2
Checkpoint by time is not working

#75 DrewGalbraith closed 2 months ago
1
Iss73

#74 DrewGalbraith closed 1 month ago
3
LongNet integration broke eval_suite.py

#73 DrewGalbraith opened 2 months ago
3
Remove incorrect items.

#72 KimballNJardine closed 2 months ago
0
Update total model parameters computation, adds ability to define model label

#71 JayOrten closed 2 months ago
0
HF Class not instantiating correctly (logit vs logits)

#70 DrewGalbraith opened 2 months ago
2
Update README.md with instructions for data preprocessing and training

#69 JayOrten closed 3 months ago
1
Clarify dependencies

#68 DrewGalbraith opened 3 months ago
3
Ckpt by time

#67 DrewGalbraith closed 2 months ago
0
Link huggingface repo

#66 DrewGalbraith closed 3 months ago
0
Fix file_name formatting in CustomModelCheckpoint constructor

#65 JayOrten closed 3 months ago
0
Correct lm_eval dependency

#64 DrewGalbraith closed 3 months ago
0
Complexity analysis

#63 jeffeardley closed 3 months ago
2
Make Models Trainable Locally

#62 nprisbrey closed 3 months ago
1
Add the tokenizer for c4 to repo

#61 DrewGalbraith closed 3 months ago
6
Restructure ckpt naming conventions

#60 DrewGalbraith closed 3 months ago
1
Memory tracking

#59 DrewGalbraith closed 3 months ago
0
Split data random

#58 calvin-seamons opened 3 months ago
4
Replace fp16 with valid precision option

#57 DrewGalbraith closed 3 months ago
0
Add subprocess import

#56 DrewGalbraith closed 3 months ago
0
Update README with more detailed steps + minor changes

#55 JayOrten closed 3 months ago
0
Add nvidia-smi to save ckpt loop

#54 DrewGalbraith closed 3 months ago
0
Remove tboard_path unneeded.

#53 KimballNJardine closed 3 months ago
0
Nshot

#52 DrewGalbraith closed 3 months ago
0
Save training configuration alongside checkpoints/logs

#51 JayOrten closed 3 months ago
1
Checkpoints from the same epoch will overwrite one another

#50 DrewGalbraith opened 3 months ago
4
Remove Tboard path

#49 jtappen1 closed 3 months ago
1
Long net Integration

#48 JacksonSearle closed 3 months ago
5
Fix iterator bug

#47 JayOrten closed 3 months ago
1
Add perplexity metric

#46 JayOrten closed 3 months ago
0
Allow non-Slurm data tokenization in parallel

#45 nprisbrey closed 3 months ago
0
Implement dynamic padding

#44 JayOrten closed 3 months ago
0
We need some yaml standardization updates and code carbon log levels are too loud so i will make them quieter also adding a missing dask dependency and also

#43 DrewGalbraith closed 3 months ago
0
Fix iterator bug, add doc strings

#42 JayOrten closed 3 months ago
0
Carbon

#41 DrewGalbraith closed 3 months ago
3
add every n steps parameter

#40 JayOrten closed 3 months ago
0
Improved data pipeline

#39 JayOrten closed 3 months ago
0
Move /runs inside /models

#38 KimballNJardine closed 3 months ago
1
Move .py files to new folder

#37 KimballNJardine closed 3 months ago
1