Fix attr error for attention_classes when using act ckpt

mosaicml / llm-foundry

LLM training code for Databricks foundation models

https://www.databricks.com/blog/introducing-dbrx-new-state-art-open-llm

Apache License 2.0

3.99k stars 525 forks source link

Fix attr error for attention_classes when using act ckpt #1230

Closed cli99 closed 4 months ago

cli99 commented 4 months ago

attention_classes was recently changed to type TypedRegistry, thus get_all() shall be used instead of keys() . keys() causes attribute not found error.