Closed EntroSanity closed 7 months ago
This pull request add FlashAttention along with its prerequisite packages into dependency installation process; also include a reference table for model id vs vram usage.
This pull request add FlashAttention along with its prerequisite packages into dependency installation process; also include a reference table for model id vs vram usage.