search

UKGovernmentBEIS / inspect_ai

Inspect: A framework for large language model evaluations
https://UKGovernmentBEIS.github.io/inspect_ai/
MIT License
385 stars 41 forks source link

Support bedrock/meta.llama3-70b-instruct-v1 #35

Closed tekumara closed 3 weeks ago

tekumara commented 3 weeks ago

Currently errors with

  File "/Users/tekumara/code3/inspect_ai/src/inspect_ai/model/_providers/bedrock.py", line 66, in __init__
    raise ValueError(f"Unsupported Bedrock model: {model_name}")
ValueError: Unsupported Bedrock model: meta.llama3-70b-instruct-v1
jjallaire commented 3 weeks ago

Thanks for reporting this! Should be resolved here: https://github.com/UKGovernmentBEIS/inspect_ai/commit/aab1d693882ed7ffd2b6582d141b2e7db8621403