search

databricks / dbrx

Code examples and resources for DBRX, a large language model developed by Databricks
https://www.databricks.com/
Other
2.5k stars 236 forks source link

Why pretrainModel class "_supports_sdpa" is False? #23

Open duguwanglong opened 6 months ago

duguwanglong commented 6 months ago

The most models' pretrainModel class attribute _supports_sdpa are True, why DBRX set False?