search

meta-llama / llama-stack-client-python

Python SDK for Llama Stack
Apache License 2.0
77 stars 21 forks source link

Sync SDK & CLI for eval_tasks / scoring_functions / datasets #20

Closed yanxi0830 closed 2 weeks ago

yanxi0830 commented 2 weeks ago

TL;DR

Tests

llama stack run

with following config

apis:
- inference
- telemetry
- datasetio
- eval
- scoring
providers:
  scoring:
  - provider_id: meta-reference-0
    provider_type: meta-reference
    config: {}
  datasetio:
  - provider_id: huggingface-0
    provider_type: remote::huggingface
    config: {}
  eval:
  - provider_id: meta-reference-0
    provider_type: meta-reference
    config: {}
  inference:
  - provider_id: remote::fireworks-0
    provider_type: remote::fireworks
    config:
      url: https://api.fireworks.ai/inference
      api_key: null
  telemetry:
  - provider_id: meta-reference-0
    provider_type: meta-reference
    config: {}
metadata_store: null
image