docs for `Sample`'s `target` parameter not consistent with code

UKGovernmentBEIS / inspect_ai

Inspect: A framework for large language model evaluations

https://UKGovernmentBEIS.github.io/inspect_ai/

MIT License

385 stars 41 forks source link

docs for `Sample`'s `target` parameter not consistent with code #65

Closed Lovkush-A closed 3 days ago

Lovkush-A commented 5 days ago

In docstring and in documentation page, we have target (str | list[str] | None). But using target = None when creating a Sample object gives validation error. Presumbly because in the code, None is not a possible type: target: str | list[str] = Field(default="")

jjallaire commented 4 days ago

Thanks! Will be addressed in our next sync.

jjallaire commented 3 days ago

Resolved with https://github.com/UKGovernmentBEIS/inspect_ai/commit/2d7561f02213781d603ed4ff1826f8dfe0963da4