3090 Can I run this program? - Githubissues

microsoft / vattention

Dynamic Memory Management for Serving LLMs without PagedAttention

MIT License

248 stars 16 forks source link

3090 Can I run this program? #17

Open LiDaTaoTao opened 3 months ago

LiDaTaoTao commented 3 months ago

3090 Can I run this program?

apanwariisc commented 3 months ago

yes, you should be able to run vattention (with 2MB pages) as long as you meet the specified dependencies.