Closed echarlaix closed 4 weeks ago
StaticCache
_prepare_generation_config
MixtralModelPatcher
The docs for this PR live here. All of your documentation changes will be reflected on that endpoint. The docs are available until 30 days after the last update.
@eaidova let me know if that works for you
StaticCache
was introduced in transformers v4.38.0_prepare_generation_config
was introduced in transformers v4.39.0MixtralModelPatcher
for transformers < v4.37.0