Open copybara-service[bot] opened 6 days ago
Create vllm TPU serving image.
This image is useful for benchmarking. It will be used for more automated testing and benchmarking in the future.
Create vllm TPU serving image.
This image is useful for benchmarking. It will be used for more automated testing and benchmarking in the future.