issues
search
ray-project
/
llmperf
LLMPerf is a library for validating and benchmarking LLMs
Apache License 2.0
592
stars
93
forks
source link
Add support for vertex sagemaker
#1
Closed
kylehh
closed
11 months ago
kylehh
commented
11 months ago
Added LLM provider support
Vertex AI for PaLM models
SageMaker for JumpStart Llama2 models
Perplexity AI for Llama model
Add transformer and tokenizer lib version in requirement.txt