search

hyperonym / basaran

Basaran is an open-source alternative to the OpenAI text completion API. It provides a compatible streaming API for your Hugging Face Transformers-based text generation models.
MIT License
1.29k stars 81 forks source link

feat(model): add MPS support for Apple Silicon #237

Closed fakerybakery closed 10 months ago

fakerybakery commented 10 months ago

This PR adds MPS support for Apple Silicon machines running macOS. It resolves issue #173 and is the successor to PR #172.

codecov-commenter commented 10 months ago

Codecov Report

Patch coverage: 66.66% and project coverage change: -0.53% :warning:

Comparison is base (a602fcc) 94.29% compared to head (631acd0) 93.76%.

:exclamation: Your organization is not using the GitHub App Integration. As a result you may experience degraded service beginning May 15th. Please install the Github App Integration for your organization. Read more.

Additional details and impacted files ```diff @@ Coverage Diff @@ ## master #237 +/- ## ========================================== - Coverage 94.29% 93.76% -0.53% ========================================== Files 7 7 Lines 333 337 +4 ========================================== + Hits 314 316 +2 - Misses 19 21 +2 ``` | [Files Changed](https://app.codecov.io/gh/hyperonym/basaran/pull/237?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=hyperonym) | Coverage Δ | | |---|---|---| | [basaran/model.py](https://app.codecov.io/gh/hyperonym/basaran/pull/237?src=pr&el=tree&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=hyperonym#diff-YmFzYXJhbi9tb2RlbC5weQ==) | `87.57% <66.66%> (-0.96%)` | :arrow_down: |

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.

peakji commented 10 months ago

LGTM! Thanks @fakerybakery !