search

dstackai / dstack

dstack is a lightweight, open-source alternative to Kubernetes & Slurm, simplifying AI container orchestration with multi-cloud & on-prem support. It natively supports NVIDIA, AMD, & TPU.
https://dstack.ai/docs
Mozilla Public License 2.0
1.53k stars 154 forks source link

[Docs] Add Ollama example #1624

Open peterschmidt85 opened 2 months ago

Ayush9026 commented 2 months ago

@peterschmidt85 sir i will solve this issue.

peterschmidt85 commented 2 months ago

@peterschmidt85 sir i will solve this issue.

@Ayush9026 Sure, feel free to do it.

Guidelines:

  1. Ollama should be under the Deployment category on https://dstack.ai/examples/
  2. It should follow the style and formatting of other examples at https://dstack.ai/examples/
  3. It should provide a balance between a minimum of information but include all the essential tips
peterschmidt85 commented 2 months ago

@Bihan please comment if Ollama works or not on AMD and TPU @Ayush9026 If Ollama doesn't work with AMD or TPU, this should be stated (and ideally with the links to the corresponding GitHub issues on the Ollama GitHub repo

Bihan commented 2 months ago

@Bihan please comment if Ollama works or not on AMD and TPU @Ayush9026 If Ollama doesn't work with AMD or TPU, this should be stated (and ideally with the links to the corresponding GitHub issues on the Ollama GitHub repo

@Ayush9026 Currently, Ollama does not support TPU See Issue. With AMD I have reported a potential bug which describes the issue.

cc @peterschmidt85

github-actions[bot] commented 1 month ago

This issue is stale because it has been open for 30 days with no activity.

github-actions[bot] commented 2 days ago

This issue is stale because it has been open for 30 days with no activity.