Lachlan stanford - Githubissues

StrongResearch / isc-demos

Deep learning examples for the Instant Super Computer

11 stars 0 forks source link

Lachlan stanford #78

Open StrongLachlanM opened 8 months ago

StrongLachlanM commented 8 months ago

Description

Adds CLIP, BLIP and CompRx

Model details

CLIP, BLIP, CompRx

Steps to reproduce any training

12 nodes, all settings are in config and isc files by default.

Training results

A gist of logs, a link to tensorboard etc if relevant.

Things done

General:

[ ] Linting (ruff, black, isort)

If adding a demo model training script:

[x] Atomic saving - saving is done atomically to avoid corruption
[x] Checkpointing - model can successfully save a checkpoint and resume.
[ ] Completed a full run