search

allenai / OLMo

Modeling, training, eval, and inference code for OLMo
https://allenai.org/olmo
Apache License 2.0
4.2k stars 392 forks source link

Amberish 7B hero run #629

Open epwalsh opened 2 weeks ago

epwalsh commented 2 weeks ago

As discussed.

W&B group: https://wandb.ai/ai2-llm/olmo-medium/groups/amberish7/workspace

Babysitting the run

To restart the run:

  1. Checkout this branch: 
    git checkout epwalsh/amberish && git pull
  2. Ensure the --load_path argument is being passed to the training script at the bottom of scripts/beaker/amberish7.sh.
  3. Push changes if you made any: 
    git push
  4. Finally, run the launch script: 
    ./scripts/beaker/amberish7-launch.sh