ray-project / llmperf

LLMPerf is a library for validating and benchmarking LLMs
Apache License 2.0
592 stars 93 forks source link

Add support for vertex sagemaker #1

Closed kylehh closed 11 months ago

kylehh commented 11 months ago
  1. Added LLM provider support
    • Vertex AI for PaLM models
    • SageMaker for JumpStart Llama2 models
    • Perplexity AI for Llama model
  2. Add transformer and tokenizer lib version in requirement.txt