Mac OS: Bringing metal support - Githubissues

balisujohn / tortoise.cpp

A ggml (C++) re-implementation of tortoise-tts

MIT License

152 stars 15 forks source link

Mac OS: Bringing metal support #14

Open baileyheading opened 3 months ago

baileyheading commented 3 months ago

Work is underway to get metal working for this project. Keen to get help from anyone interested.

TODO:

[ ] add conv_tranpose_1d for metal (already has cpu implementation)
[ ] modify ggml_pad backend and added ggml_pad_ext for metal
[ ] add pad_reflect_1d to metal (already has cpu implementation)
[ ] add unfold_1d to metal (already has cpu implementation)

Existing PRs from @balisujohn decent example to follow for the changes done to CUDA already: https://github.com/ggerganov/ggml/pulls/balisujohn

balisujohn commented 3 months ago

for conv transpose 1d you can make a new PR directly to ggml with the metal kernel to get feedback, for the ones which are still being added via pending PRs, you can make a PR into my PR branches and I will accept it which should give you credit in the final PR for each op, and you can then get feedback from ggml contributors via the open PR discussions.

Previous