search

mistralai / mistral-inference

Official inference library for Mistral models
https://mistral.ai/
Apache License 2.0
9.37k stars 817 forks source link

Adds attention mask with `model.forward(..., cache=None)`. #89

Open andsteing opened 7 months ago

andsteing commented 7 months ago

This should fix #88.