sozercan / aikit

🏗️ Fine-tune, build, and deploy open-source LLMs easily!
https://sozercan.github.io/aikit/
MIT License
297 stars 26 forks source link

feat: arm64 support #290

Closed sozercan closed 4 weeks ago

sozercan commented 1 month ago

What this PR does / why we need it: adds support for arm64/aarch64 for inference. it does not include cuda with arm64

Which issue(s) this PR fixes (optional, using fixes #<issue number>(, fixes #<issue_number>, ...) format, will close the issue(s) when the PR gets merged): Fixes #67

Special notes for your reviewer: