Pydantic Validation error for `EvaluationResult`

weavel-ai / Ape

Your first AI prompt engineer

https://docs.weavel.ai/sdk-reference/ape-common

MIT License

331 stars 13 forks source link

Pydantic Validation error for `EvaluationResult` #20

Closed albertlieyingadrian closed 2 weeks ago

albertlieyingadrian commented 3 weeks ago

Got an error cuz of the schema

# https://github.com/weavel-ai/Ape/blob/e77f7bf15cdedfac6e74f21923d56f559dc9fc1e/ape/types/eval_result.py
class EvaluationResult(BaseModel):
    example: Union[dict, str]
    prediction: Union[dict, str]
    score: float
    intermediate_values: Optional[Dict[str, Any]] = None

aschung01 commented 2 weeks ago

Thanks for reporting @albertlieyingadrian ! Just fixed this in PR #18