stanford-crfm / haliax

Named Tensors for Legible Deep Learning in JAX
Apache License 2.0
154 stars 11 forks source link

Add replica axes #87

Closed blahBlahhhJ closed 6 months ago

blahBlahhhJ commented 6 months ago

to implement pure dp in levanter

dlwh commented 6 months ago

we should probably just move these to levanter. If you bump the haliax dependency in Levanter this should auto-start working once the build is published