Mistral Sliding Window Attention (SWA)

marella / ctransformers

Python bindings for the Transformer models implemented in C/C++ using GGML library.

MIT License

1.76k stars 137 forks source link

Open stygmate opened 7 months ago

stygmate commented 7 months ago

Does ctransformers support Sliding Window Attention (SWA) ?

ollie2a commented 6 months ago

Mistral works with ctransformer - I tested v0.2 ...