search

meta-llama / llama-stack-apps

Agentic components of the Llama Stack APIs
MIT License
3.9k stars 562 forks source link

llama stack run: error: File local-ollama does not exist. Did you run `llama stack build`? #72

Open JoseGuilherme1904 opened 2 months ago

JoseGuilherme1904 commented 2 months ago

llama stack build Enter value for name (required): ollama Enter value for distribution (default: local) (required): local-ollama Enter value for api_providers (optional): Enter value for image_type (default: conda) (required): Build ollama exists; will reconfigure Conda environment 'llamastack-ollama' exists. Checking Python version... Environment 'llamastack-ollama' already has Python 3.10. No action needed. Requirement already satisfied: llama-toolchain in /tmp/a/llama/conda/envs/llamastack-ollama/lib/python3.10/site-packages (0.0.15) Requirement already satisfied: blobfile in /home/guilherme/.local/lib/python3.10/site-packages (from llama-toolchain) (3.0.0) Requirement already satisfied: fire in /home/guilherme/.local/lib/python3.10/site-packages (from llama-toolchain) (0.6.0) Requirement already satisfied: httpx in /home/guilherme/.local/lib/python3.10/site-packages (from llama-toolchain) (0.27.2) Requirement already satisfied: huggingface-hub in /home/guilherme/.local/lib/python3.10/site-packages (from llama-toolchain) (0.24.7) Requirement already satisfied: llama-models>=0.0.15 in /tmp/a/llama/conda/envs/llamastack-ollama/lib/python3.10/site-packages (from llama-toolchain) (0.0.15) Requirement already satisfied: pydantic in /home/guilherme/.local/lib/python3.10/site-packages (from llama-toolchain) (2.8.2) Requirement already satisfied: requests in /home/guilherme/.local/lib/python3.10/site-packages (from llama-toolchain) (2.32.3) Requirement already satisfied: termcolor in /home/guilherme/.local/lib/python3.10/site-packages (from llama-toolchain) (2.3.0) Requirement already satisfied: PyYAML in /home/guilherme/.local/lib/python3.10/site-packages (from llama-models>=0.0.15->llama-toolchain) (6.0.1) Requirement already satisfied: jinja2 in /home/guilherme/.local/lib/python3.10/site-packages (from llama-models>=0.0.15->llama-toolchain) (3.1.2) Requirement already satisfied: tiktoken in /home/guilherme/.local/lib/python3.10/site-packages (from llama-models>=0.0.15->llama-toolchain) (0.6.0) Requirement already satisfied: pycryptodomex>=3.8 in /tmp/a/llama/conda/envs/llamastack-ollama/lib/python3.10/site-packages (from blobfile->llama-toolchain) (3.20.0) Requirement already satisfied: urllib3<3,>=1.25.3 in /home/guilherme/.local/lib/python3.10/site-packages (from blobfile->llama-toolchain) (2.2.1) Requirement already satisfied: lxml>=4.9 in /home/guilherme/.local/lib/python3.10/site-packages (from blobfile->llama-toolchain) (5.3.0) Requirement already satisfied: filelock>=3.0 in /home/guilherme/.local/lib/python3.10/site-packages (from blobfile->llama-toolchain) (3.13.1) Requirement already satisfied: six in /tmp/a/llama/conda/envs/llamastack-ollama/lib/python3.10/site-packages (from fire->llama-toolchain) (1.16.0) Requirement already satisfied: anyio in /home/guilherme/.local/lib/python3.10/site-packages (from httpx->llama-toolchain) (3.7.1) Requirement already satisfied: certifi in /tmp/a/llama/conda/envs/llamastack-ollama/lib/python3.10/site-packages (from httpx->llama-toolchain) (2024.8.30) Requirement already satisfied: httpcore==1. in /home/guilherme/.local/lib/python3.10/site-packages (from httpx->llama-toolchain) (1.0.2) Requirement already satisfied: idna in /tmp/a/llama/conda/envs/llamastack-ollama/lib/python3.10/site-packages (from httpx->llama-toolchain) (3.8) Requirement already satisfied: sniffio in /home/guilherme/.local/lib/python3.10/site-packages (from httpx->llama-toolchain) (1.3.0) Requirement already satisfied: h11<0.15,>=0.13 in /home/guilherme/.local/lib/python3.10/site-packages (from httpcore==1.->httpx->llama-toolchain) (0.14.0) Requirement already satisfied: fsspec>=2023.5.0 in /home/guilherme/.local/lib/python3.10/site-packages (from huggingface-hub->llama-toolchain) (2023.10.0) Requirement already satisfied: packaging>=20.9 in /home/guilherme/.local/lib/python3.10/site-packages (from huggingface-hub->llama-toolchain) (23.2) Requirement already satisfied: tqdm>=4.42.1 in /home/guilherme/.local/lib/python3.10/site-packages (from huggingface-hub->llama-toolchain) (4.66.2) Requirement already satisfied: typing-extensions>=3.7.4.3 in /home/guilherme/.local/lib/python3.10/site-packages (from huggingface-hub->llama-toolchain) (4.12.2) Requirement already satisfied: annotated-types>=0.4.0 in /home/guilherme/.local/lib/python3.10/site-packages (from pydantic->llama-toolchain) (0.7.0) Requirement already satisfied: pydantic-core==2.20.1 in /home/guilherme/.local/lib/python3.10/site-packages (from pydantic->llama-toolchain) (2.20.1) Requirement already satisfied: charset-normalizer<4,>=2 in /home/guilherme/.local/lib/python3.10/site-packages (from requests->llama-toolchain) (3.3.2) Requirement already satisfied: exceptiongroup in /home/guilherme/.local/lib/python3.10/site-packages (from anyio->httpx->llama-toolchain) (1.2.2) Requirement already satisfied: MarkupSafe>=2.0 in /home/guilherme/.local/lib/python3.10/site-packages (from jinja2->llama-models>=0.0.15->llama-toolchain) (2.1.3) Requirement already satisfied: regex>=2022.1.18 in /home/guilherme/.local/lib/python3.10/site-packages (from tiktoken->llama-models>=0.0.15->llama-toolchain) (2023.10.3) Installing pip dependencies: fastapi uvicorn ollama accelerate codeshield torch transformers codeshield matplotlib pillow pandas scikit-learn torch transformers blobfile chardet pypdf sentence-transformers faiss-cpu Requirement already satisfied: fastapi in /home/guilherme/.local/lib/python3.10/site-packages (0.114.2) Requirement already satisfied: uvicorn in /home/guilherme/.local/lib/python3.10/site-packages (0.30.6) Requirement already satisfied: ollama in /tmp/a/llama/conda/envs/llamastack-ollama/lib/python3.10/site-packages (0.3.3) Requirement already satisfied: accelerate in /home/guilherme/.local/lib/python3.10/site-packages (0.21.0) Requirement already satisfied: codeshield in /tmp/a/llama/conda/envs/llamastack-ollama/lib/python3.10/site-packages (1.0.1) Requirement already satisfied: torch in /tmp/a/llama/conda/envs/llamastack-ollama/lib/python3.10/site-packages (2.4.1) Requirement already satisfied: transformers in /tmp/a/llama/conda/envs/llamastack-ollama/lib/python3.10/site-packages (4.44.2) Requirement already satisfied: matplotlib in /tmp/a/llama/conda/envs/llamastack-ollama/lib/python3.10/site-packages (3.9.2) Requirement already satisfied: pillow in /home/guilherme/.local/lib/python3.10/site-packages (10.2.0) Requirement already satisfied: pandas in /home/guilherme/.local/lib/python3.10/site-packages (2.1.3) Requirement already satisfied: scikit-learn in /home/guilherme/.local/lib/python3.10/site-packages (1.2.2) Requirement already satisfied: blobfile in /home/guilherme/.local/lib/python3.10/site-packages (3.0.0) Requirement already satisfied: chardet in /tmp/a/llama/conda/envs/llamastack-ollama/lib/python3.10/site-packages (5.2.0) Requirement already satisfied: pypdf in /home/guilherme/.local/lib/python3.10/site-packages (4.1.0) Requirement already satisfied: sentence-transformers in /tmp/a/llama/conda/envs/llamastack-ollama/lib/python3.10/site-packages (3.1.0) Requirement already satisfied: faiss-cpu in /tmp/a/llama/conda/envs/llamastack-ollama/lib/python3.10/site-packages (1.8.0.post1) Requirement already satisfied: starlette<0.39.0,>=0.37.2 in /home/guilherme/.local/lib/python3.10/site-packages (from fastapi) (0.38.5) Requirement already satisfied: pydantic!=1.8,!=1.8.1,!=2.0.0,!=2.0.1,!=2.1.0,<3.0.0,>=1.7.4 in /home/guilherme/.local/lib/python3.10/site-packages (from fastapi) (2.8.2) Requirement already satisfied: typing-extensions>=4.8.0 in /home/guilherme/.local/lib/python3.10/site-packages (from fastapi) (4.12.2) Requirement already satisfied: click>=7.0 in /home/guilherme/.local/lib/python3.10/site-packages (from uvicorn) (8.1.7) Requirement already satisfied: h11>=0.8 in /home/guilherme/.local/lib/python3.10/site-packages (from uvicorn) (0.14.0) Requirement already satisfied: httpx<0.28.0,>=0.27.0 in /home/guilherme/.local/lib/python3.10/site-packages (from ollama) (0.27.2) Requirement already satisfied: numpy>=1.17 in /home/guilherme/.local/lib/python3.10/site-packages (from accelerate) (1.26.2) Requirement already satisfied: packaging>=20.0 in /home/guilherme/.local/lib/python3.10/site-packages (from accelerate) (23.2) Requirement already satisfied: psutil in /home/guilherme/.local/lib/python3.10/site-packages (from accelerate) (5.9.6) Requirement already satisfied: pyyaml in /home/guilherme/.local/lib/python3.10/site-packages (from accelerate) (6.0.1) Requirement already satisfied: semgrep>1.68 in /tmp/a/llama/conda/envs/llamastack-ollama/lib/python3.10/site-packages (from codeshield) (1.87.0) Requirement already satisfied: filelock in /home/guilherme/.local/lib/python3.10/site-packages (from torch) (3.13.1) Requirement already satisfied: sympy in /home/guilherme/.local/lib/python3.10/site-packages (from torch) (1.12) Requirement already satisfied: networkx in /home/guilherme/.local/lib/python3.10/site-packages (from torch) (3.2.1) Requirement already satisfied: jinja2 in /home/guilherme/.local/lib/python3.10/site-packages (from torch) (3.1.2) Requirement already satisfied: fsspec in /home/guilherme/.local/lib/python3.10/site-packages (from torch) (2023.10.0) Requirement already satisfied: nvidia-cuda-nvrtc-cu12==12.1.105 in /home/guilherme/.local/lib/python3.10/site-packages (from torch) (12.1.105) Requirement already satisfied: nvidia-cuda-runtime-cu12==12.1.105 in /home/guilherme/.local/lib/python3.10/site-packages (from torch) (12.1.105) Requirement already satisfied: nvidia-cuda-cupti-cu12==12.1.105 in /home/guilherme/.local/lib/python3.10/site-packages (from torch) (12.1.105) Requirement already satisfied: nvidia-cudnn-cu12==9.1.0.70 in /home/guilherme/.local/lib/python3.10/site-packages (from torch) (9.1.0.70) Requirement already satisfied: nvidia-cublas-cu12==12.1.3.1 in /home/guilherme/.local/lib/python3.10/site-packages (from torch) (12.1.3.1) Requirement already satisfied: nvidia-cufft-cu12==11.0.2.54 in /home/guilherme/.local/lib/python3.10/site-packages (from torch) (11.0.2.54) Requirement already satisfied: nvidia-curand-cu12==10.3.2.106 in /home/guilherme/.local/lib/python3.10/site-packages (from torch) (10.3.2.106) Requirement already satisfied: nvidia-cusolver-cu12==11.4.5.107 in /home/guilherme/.local/lib/python3.10/site-packages (from torch) (11.4.5.107) Requirement already satisfied: nvidia-cusparse-cu12==12.1.0.106 in /home/guilherme/.local/lib/python3.10/site-packages (from torch) (12.1.0.106) Requirement already satisfied: nvidia-nccl-cu12==2.20.5 in /home/guilherme/.local/lib/python3.10/site-packages (from torch) (2.20.5) Requirement already satisfied: nvidia-nvtx-cu12==12.1.105 in /home/guilherme/.local/lib/python3.10/site-packages (from torch) (12.1.105) Requirement already satisfied: triton==3.0.0 in /home/guilherme/.local/lib/python3.10/site-packages (from torch) (3.0.0) Requirement already satisfied: nvidia-nvjitlink-cu12 in /home/guilherme/.local/lib/python3.10/site-packages (from nvidia-cusolver-cu12==11.4.5.107->torch) (12.3.101) Requirement already satisfied: huggingface-hub<1.0,>=0.23.2 in /home/guilherme/.local/lib/python3.10/site-packages (from transformers) (0.24.7) Requirement already satisfied: regex!=2019.12.17 in /home/guilherme/.local/lib/python3.10/site-packages (from transformers) (2023.10.3) Requirement already satisfied: requests in /home/guilherme/.local/lib/python3.10/site-packages (from transformers) (2.32.3) Requirement already satisfied: safetensors>=0.4.1 in /home/guilherme/.local/lib/python3.10/site-packages (from transformers) (0.4.2) Requirement already satisfied: tokenizers<0.20,>=0.19 in /tmp/a/llama/conda/envs/llamastack-ollama/lib/python3.10/site-packages (from transformers) (0.19.1) Requirement already satisfied: tqdm>=4.27 in /home/guilherme/.local/lib/python3.10/site-packages (from transformers) (4.66.2) Requirement already satisfied: contourpy>=1.0.1 in /tmp/a/llama/conda/envs/llamastack-ollama/lib/python3.10/site-packages (from matplotlib) (1.3.0) Requirement already satisfied: cycler>=0.10 in /tmp/a/llama/conda/envs/llamastack-ollama/lib/python3.10/site-packages (from matplotlib) (0.12.1) Requirement already satisfied: fonttools>=4.22.0 in /tmp/a/llama/conda/envs/llamastack-ollama/lib/python3.10/site-packages (from matplotlib) (4.53.1) Requirement already satisfied: kiwisolver>=1.3.1 in /tmp/a/llama/conda/envs/llamastack-ollama/lib/python3.10/site-packages (from matplotlib) (1.4.7) Requirement already satisfied: pyparsing>=2.3.1 in /tmp/a/llama/conda/envs/llamastack-ollama/lib/python3.10/site-packages (from matplotlib) (3.1.4) Requirement already satisfied: python-dateutil>=2.7 in /home/guilherme/.local/lib/python3.10/site-packages (from matplotlib) (2.8.2) Requirement already satisfied: pytz>=2020.1 in /home/guilherme/.local/lib/python3.10/site-packages (from pandas) (2024.1) Requirement already satisfied: tzdata>=2022.1 in /home/guilherme/.local/lib/python3.10/site-packages (from pandas) (2023.3) Requirement already satisfied: scipy>=1.3.2 in /tmp/a/llama/conda/envs/llamastack-ollama/lib/python3.10/site-packages (from scikit-learn) (1.14.1) Requirement already satisfied: joblib>=1.1.1 in /home/guilherme/.local/lib/python3.10/site-packages (from scikit-learn) (1.3.2) Requirement already satisfied: threadpoolctl>=2.0.0 in /home/guilherme/.local/lib/python3.10/site-packages (from scikit-learn) (3.2.0) Requirement already satisfied: pycryptodomex>=3.8 in /tmp/a/llama/conda/envs/llamastack-ollama/lib/python3.10/site-packages (from blobfile) (3.20.0) Requirement already satisfied: urllib3<3,>=1.25.3 in /home/guilherme/.local/lib/python3.10/site-packages (from blobfile) (2.2.1) Requirement already satisfied: lxml>=4.9 in /home/guilherme/.local/lib/python3.10/site-packages (from blobfile) (5.3.0) Requirement already satisfied: anyio in /home/guilherme/.local/lib/python3.10/site-packages (from httpx<0.28.0,>=0.27.0->ollama) (3.7.1) Requirement already satisfied: certifi in /tmp/a/llama/conda/envs/llamastack-ollama/lib/python3.10/site-packages (from httpx<0.28.0,>=0.27.0->ollama) (2024.8.30) Requirement already satisfied: httpcore==1.* in /home/guilherme/.local/lib/python3.10/site-packages (from httpx<0.28.0,>=0.27.0->ollama) (1.0.2) Requirement already satisfied: idna in /tmp/a/llama/conda/envs/llamastack-ollama/lib/python3.10/site-packages (from httpx<0.28.0,>=0.27.0->ollama) (3.8) Requirement already satisfied: sniffio in /home/guilherme/.local/lib/python3.10/site-packages (from httpx<0.28.0,>=0.27.0->ollama) (1.3.0) Requirement already satisfied: annotated-types>=0.4.0 in /home/guilherme/.local/lib/python3.10/site-packages (from pydantic!=1.8,!=1.8.1,!=2.0.0,!=2.0.1,!=2.1.0,<3.0.0,>=1.7.4->fastapi) (0.7.0) Requirement already satisfied: pydantic-core==2.20.1 in /home/guilherme/.local/lib/python3.10/site-packages (from pydantic!=1.8,!=1.8.1,!=2.0.0,!=2.0.1,!=2.1.0,<3.0.0,>=1.7.4->fastapi) (2.20.1) Requirement already satisfied: six>=1.5 in /tmp/a/llama/conda/envs/llamastack-ollama/lib/python3.10/site-packages (from python-dateutil>=2.7->matplotlib) (1.16.0) Requirement already satisfied: attrs>=21.3 in /home/guilherme/.local/lib/python3.10/site-packages (from semgrep>1.68->codeshield) (23.1.0) Requirement already satisfied: boltons~=21.0 in /tmp/a/llama/conda/envs/llamastack-ollama/lib/python3.10/site-packages (from semgrep>1.68->codeshield) (21.0.0) Requirement already satisfied: click-option-group~=0.5 in /tmp/a/llama/conda/envs/llamastack-ollama/lib/python3.10/site-packages (from semgrep>1.68->codeshield) (0.5.6) Requirement already satisfied: colorama~=0.4.0 in /tmp/a/llama/conda/envs/llamastack-ollama/lib/python3.10/site-packages (from semgrep>1.68->codeshield) (0.4.6) Requirement already satisfied: defusedxml~=0.7.1 in /home/guilherme/.local/lib/python3.10/site-packages (from semgrep>1.68->codeshield) (0.7.1) Requirement already satisfied: exceptiongroup~=1.2.0 in /home/guilherme/.local/lib/python3.10/site-packages (from semgrep>1.68->codeshield) (1.2.2) Requirement already satisfied: glom~=22.1 in /tmp/a/llama/conda/envs/llamastack-ollama/lib/python3.10/site-packages (from semgrep>1.68->codeshield) (22.1.0) Requirement already satisfied: jsonschema~=4.6 in /home/guilherme/.local/lib/python3.10/site-packages (from semgrep>1.68->codeshield) (4.20.0) Requirement already satisfied: opentelemetry-api~=1.25.0 in /tmp/a/llama/conda/envs/llamastack-ollama/lib/python3.10/site-packages (from semgrep>1.68->codeshield) (1.25.0) Requirement already satisfied: opentelemetry-sdk~=1.25.0 in /tmp/a/llama/conda/envs/llamastack-ollama/lib/python3.10/site-packages (from semgrep>1.68->codeshield) (1.25.0) Requirement already satisfied: opentelemetry-exporter-otlp-proto-http~=1.25.0 in /tmp/a/llama/conda/envs/llamastack-ollama/lib/python3.10/site-packages (from semgrep>1.68->codeshield) (1.25.0) Requirement already satisfied: opentelemetry-instrumentation-requests~=0.46b0 in /tmp/a/llama/conda/envs/llamastack-ollama/lib/python3.10/site-packages (from semgrep>1.68->codeshield) (0.46b0) Requirement already satisfied: peewee~=3.14 in /home/guilherme/.local/lib/python3.10/site-packages (from semgrep>1.68->codeshield) (3.17.6) Requirement already satisfied: rich~=13.5.2 in /tmp/a/llama/conda/envs/llamastack-ollama/lib/python3.10/site-packages (from semgrep>1.68->codeshield) (13.5.3) Requirement already satisfied: ruamel.yaml<0.18,>=0.16.0 in /tmp/a/llama/conda/envs/llamastack-ollama/lib/python3.10/site-packages (from semgrep>1.68->codeshield) (0.17.40) Requirement already satisfied: tomli~=2.0.1 in /home/guilherme/.local/lib/python3.10/site-packages (from semgrep>1.68->codeshield) (2.0.1) Requirement already satisfied: wcmatch~=8.3 in /tmp/a/llama/conda/envs/llamastack-ollama/lib/python3.10/site-packages (from semgrep>1.68->codeshield) (8.5.2) Requirement already satisfied: charset-normalizer<4,>=2 in /home/guilherme/.local/lib/python3.10/site-packages (from requests->transformers) (3.3.2) Requirement already satisfied: MarkupSafe>=2.0 in /home/guilherme/.local/lib/python3.10/site-packages (from jinja2->torch) (2.1.3) Requirement already satisfied: mpmath>=0.19 in /home/guilherme/.local/lib/python3.10/site-packages (from sympy->torch) (1.3.0) Requirement already satisfied: face>=20.1.0 in /tmp/a/llama/conda/envs/llamastack-ollama/lib/python3.10/site-packages (from glom~=22.1->semgrep>1.68->codeshield) (22.0.0) Requirement already satisfied: jsonschema-specifications>=2023.03.6 in /home/guilherme/.local/lib/python3.10/site-packages (from jsonschema~=4.6->semgrep>1.68->codeshield) (2023.11.1) Requirement already satisfied: referencing>=0.28.4 in /home/guilherme/.local/lib/python3.10/site-packages (from jsonschema~=4.6->semgrep>1.68->codeshield) (0.31.0) Requirement already satisfied: rpds-py>=0.7.1 in /home/guilherme/.local/lib/python3.10/site-packages (from jsonschema~=4.6->semgrep>1.68->codeshield) (0.13.0) Requirement already satisfied: deprecated>=1.2.6 in /tmp/a/llama/conda/envs/llamastack-ollama/lib/python3.10/site-packages (from opentelemetry-api~=1.25.0->semgrep>1.68->codeshield) (1.2.14) Requirement already satisfied: importlib-metadata<=7.1,>=6.0 in /tmp/a/llama/conda/envs/llamastack-ollama/lib/python3.10/site-packages (from opentelemetry-api~=1.25.0->semgrep>1.68->codeshield) (7.1.0) Requirement already satisfied: googleapis-common-protos~=1.52 in /home/guilherme/.local/lib/python3.10/site-packages (from opentelemetry-exporter-otlp-proto-http~=1.25.0->semgrep>1.68->codeshield) (1.62.0) Requirement already satisfied: opentelemetry-exporter-otlp-proto-common==1.25.0 in /tmp/a/llama/conda/envs/llamastack-ollama/lib/python3.10/site-packages (from opentelemetry-exporter-otlp-proto-http~=1.25.0->semgrep>1.68->codeshield) (1.25.0) Requirement already satisfied: opentelemetry-proto==1.25.0 in /tmp/a/llama/conda/envs/llamastack-ollama/lib/python3.10/site-packages (from opentelemetry-exporter-otlp-proto-http~=1.25.0->semgrep>1.68->codeshield) (1.25.0) Requirement already satisfied: protobuf<5.0,>=3.19 in /home/guilherme/.local/lib/python3.10/site-packages (from opentelemetry-proto==1.25.0->opentelemetry-exporter-otlp-proto-http~=1.25.0->semgrep>1.68->codeshield) (4.23.4) Requirement already satisfied: opentelemetry-instrumentation==0.46b0 in /tmp/a/llama/conda/envs/llamastack-ollama/lib/python3.10/site-packages (from opentelemetry-instrumentation-requests~=0.46b0->semgrep>1.68->codeshield) (0.46b0) Requirement already satisfied: opentelemetry-semantic-conventions==0.46b0 in /tmp/a/llama/conda/envs/llamastack-ollama/lib/python3.10/site-packages (from opentelemetry-instrumentation-requests~=0.46b0->semgrep>1.68->codeshield) (0.46b0) Requirement already satisfied: opentelemetry-util-http==0.46b0 in /tmp/a/llama/conda/envs/llamastack-ollama/lib/python3.10/site-packages (from opentelemetry-instrumentation-requests~=0.46b0->semgrep>1.68->codeshield) (0.46b0) Requirement already satisfied: setuptools>=16.0 in /tmp/a/llama/conda/envs/llamastack-ollama/lib/python3.10/site-packages (from opentelemetry-instrumentation==0.46b0->opentelemetry-instrumentation-requests~=0.46b0->semgrep>1.68->codeshield) (72.1.0) Requirement already satisfied: wrapt<2.0.0,>=1.0.0 in /tmp/a/llama/conda/envs/llamastack-ollama/lib/python3.10/site-packages (from opentelemetry-instrumentation==0.46b0->opentelemetry-instrumentation-requests~=0.46b0->semgrep>1.68->codeshield) (1.16.0) Requirement already satisfied: markdown-it-py>=2.2.0 in /home/guilherme/.local/lib/python3.10/site-packages (from rich~=13.5.2->semgrep>1.68->codeshield) (3.0.0) Requirement already satisfied: pygments<3.0.0,>=2.13.0 in /home/guilherme/.local/lib/python3.10/site-packages (from rich~=13.5.2->semgrep>1.68->codeshield) (2.17.1) Requirement already satisfied: ruamel.yaml.clib>=0.2.7 in /tmp/a/llama/conda/envs/llamastack-ollama/lib/python3.10/site-packages (from ruamel.yaml<0.18,>=0.16.0->semgrep>1.68->codeshield) (0.2.8) Requirement already satisfied: bracex>=2.1.1 in /tmp/a/llama/conda/envs/llamastack-ollama/lib/python3.10/site-packages (from wcmatch~=8.3->semgrep>1.68->codeshield) (2.5) Requirement already satisfied: zipp>=0.5 in /tmp/a/llama/conda/envs/llamastack-ollama/lib/python3.10/site-packages (from importlib-metadata<=7.1,>=6.0->opentelemetry-api~=1.25.0->semgrep>1.68->codeshield) (3.20.2) Requirement already satisfied: mdurl~=0.1 in /home/guilherme/.local/lib/python3.10/site-packages (from markdown-it-py>=2.2.0->rich~=13.5.2->semgrep>1.68->codeshield) (0.1.2) Successfully setup conda environment. Configuring build... Configuration already exists for local-ollama. Will overwrite... Configuring API: inference (remote::ollama) Enter value for url (existing: http://localhost:11434) (required):

Configuring API: safety (meta-reference) Do you want to configure llama_guard_shield? (y/n): y Entering sub-configuration for llama_guard_shield: Enter value for model (default: Llama-Guard-3-8B) (required):
Enter value for excluded_categories (default: []) (required): Enter value for disable_input_check (default: False) (required): Enter value for disable_output_check (default: False) (required): Do you want to configure prompt_guard_shield? (y/n): y Entering sub-configuration for prompt_guard_shield: Enter value for model (default: Prompt-Guard-86M) (required):

Configuring API: agentic_system (meta-reference) Enter value for brave_search_api_key (optional): Enter value for bing_search_api_key (optional): Enter value for wolfram_api_key (optional):

Configuring API: memory (meta-reference-faiss)

Configuring API: telemetry (console)

YAML configuration has been written to /home/guilherme/.llama/builds/local-ollama/conda/ollama.yaml Target ollama built with configuration at /home/guilherme/.llama/builds/local-ollama/conda/ollama.yaml Build spec configuration saved at /home/guilherme/.llama/distributions/local-ollama/conda/ollama-build.yaml (app_env2) guilherme@desktop:/tmp/a/llama/llama3.1$ llama stack run local-ollama --port 5000 --disable-ipv6 Valor de args.config: local-ollama usage: llama stack run [-h] [--port PORT] [--disable-ipv6] config llama stack run: error: File local-ollama does not exist. Did you run llama stack build?

Please, llama distribution remove llama_toolchain?

llama distribution install --spec local-ollama --name ollama

Thanks Guilherme

yanxi0830 commented 2 months ago

Thanks for raising the issue! Could you re-download the latest package via 

pip uninstall llama-toolchain
pip install llama-toolchain

Then run: 

llama stack build ./llama_toolchain/configs/distributions/conda/local-ollama-conda-example-build.yaml --name ollama
llama stack configure ./llama_toolchain/configs/distributions/conda/local-ollama-conda-example-build.yaml
llama stack run ~/.llama/builds/conda/ollama-run.yaml

We have recently updated our CLI, and the latest instructions have been updated & can be found in https://github.com/meta-llama/llama-stack-apps/blob/main/README.md