search

MineDojo / Voyager

An Open-Ended Embodied Agent with Large Language Models
https://voyager.minedojo.org/
MIT License
5.34k stars 491 forks source link

Implement a way test local models #149

Open bennmann opened 3 months ago

bennmann commented 3 months ago

Hello,

Wonderful work on Voyager.

Please consider added local model support (instead of openai package - using something like Python requests package to a localhost local model using openai completion elements).

I believe Voyager is a superb way to measure future Large Language models against one another using the Minecraft diamond challenge.

Please consider a collaboration with Eleuther AI on locally hosted LLM evaluation via Voyager

https://github.com/EleutherAI/lm-evaluation-harness

github-actions[bot] commented 2 months ago

This issue is stale because it has been open for 30 days with no activity.

bennmann commented 2 months ago

Please reconsider this issue in light of Llama 3 8B and 70B.

github-actions[bot] commented 1 month ago

This issue is stale because it has been open for 30 days with no activity.

Khaogamermain01 commented 1 month ago

Any updates on this?

github-actions[bot] commented 1 week ago

This issue is stale because it has been open for 30 days with no activity.