search

web-arena-x / webarena

Code repo for "WebArena: A Realistic Web Environment for Building Autonomous Agents"
https://webarena.dev
Apache License 2.0
676 stars 103 forks source link

Support for HF models #27

Closed karthik19967829 closed 3 months ago

karthik19967829 commented 1 year ago

Hi, do we support huggingface models? If any internal internal tests were done with llama and the insights can be shared that will be great

lihkinVerma commented 6 months ago

There is hugging face model support in the code. But I am not sure, if they tested with LLaMa or other HF models, as the paper do not share those results in any appendix. Looking forward, if authors can share some insights

frankxu2004 commented 4 months ago

one way to support this is to use vllm to set up an inference endpoint, and then serve the OSS model like LLAMA with it, and use that new OpenAI-compatible endpoint.