search

ray-project / llmperf

LLMPerf is a library for validating and benchmarking LLMs
Apache License 2.0
471 stars 70 forks source link

Fix error handling #7

Closed rickyyx closed 8 months ago

rickyyx commented 8 months ago
  1. We are missing "id" column when errors happen.
  2. Output the exceptions for better visibility.
....

Exceptions by cause:
 - 130: Invalid response object from API: '{"fault":{"faultstring":"Rate limit quota violation. Quota limit  exceeded. Identifier :"xxx", detail":{"errorcode":"policies.ratelimit.QuotaViolation"}}}' (HTTP response code was 429)
 - 20: 'str' object has no attribute 'get'