search

WasmEdge / docs

https://wasmedge.org/docs/
Apache License 2.0
17 stars 57 forks source link

Add Podman + Wasm + GPU section #223

Closed CaptainVincent closed 6 months ago

CaptainVincent commented 6 months ago

Explanation

Add podman execution version (full steps).

Related issue

None, internal request.

What type of PR is this

Documentation.

Proposed Changes

Add other container manager clients support is more user-friendly, especially since support for CDI toolchain is not yet fully mature. This also records a tested and runnable combination for end user.

alabulei1 commented 6 months ago

Hello, I am a code review bot on flows.network. Here are my reviews of code commits in this PR.

Commit 80c829c3b0f0843a93436e0cbd06d82937f80514

Key Changes:

  1. Addition of a new section titled "Podman + WASM + GPU" in the documentation.
  2. Provides instructions for setting up GPU support using Podman, Crun with Wasmedge, and CDI for host GPU device usage.
  3. Includes prerequisite information such as having a GPU device (specifically tested with NVIDIA GPUs on Linux), installing the NVIDIA GPU driver, NVIDIA Container Toolkit, or nvidia-container-toolkit-base package, and needing Podman version 4.x or higher.
  4. Offers guidance on installation and verification of NVIDIA driver, toolkit, and Podman.
  5. Provides steps for generating the CDI specification file for host GPU device mapping.
  6. Instructions for setting up the container runtime (crun with wasmedge) and enabling the plugin system.
  7. Includes commands for downloading the ggml plugin and demo application for running inference models with GPU acceleration.

Potential Problems:

  1. No mention of specific operating system compatibility where these steps can be applied, assuming it's for Linux due to the NVIDIA GPU drivers and toolkit installation instructions.
  2. Reliance on Linuxbrew for Podman installation might limit the audience as Linuxbrew is not a widely adopted package manager.
  3. Lack of specific details on setting up crun with wasmedge may lead to confusion for users unfamiliar with these tools.
  4. The complexity of the setup involving manual compilation and installation of components may deter users looking for a more straightforward GPU + WASM setup.
  5. Incomplete information for running the demo, such as missing information on how to obtain the podman and crun paths.
CaptainVincent commented 6 months ago

We should have a complete guide, not a simplified one.

Ok, I will add those part.