Intelligent Go-Explore

Intelligent Go-Explore (IGE) integrates the intelligence and internalized human notions of interestingness from giant pretrained foundation models into all stages of the Go-Explore algorithm, enabling foundation model agents to robustly explore in complex environments.

Intelligent Go-Explore: Standing on the Shoulders of Giant Foundation Models; Cong Lu, Shengran Hu, Jeff Clune.

View on arXiv

Setup

To install, clone the repository and run the following:

conda create -n ige python=3.11
conda activate ige
pip install -r requirements.txt

# BabyAI-Text Instructions
git clone https://github.com/flowersteam/Grounding_LLMs_with_online_RL.git
cd Grounding_LLMs_with_online_RL
pip install blosc; cd babyai-text/babyai; pip install -e .; cd ..
cd gym-minigrid; pip install -e.; cd ..
pip install -e .

# TextWorld Instructions (see https://github.com/microsoft/TextWorld for system libraries)
pip install textworld

Running Instructions

Notes

Each environment is one clean file, containing the environment, IGE, baselines, and prompts.
By default, all runs are enabled, comment out baselines that you don't want.
Ensure that OPENAI_API_KEY is set in the environment variables.
To add a new environment or domain: we recommend cloning a run.py file, ensuring the random agent baseline works without problem (no FM needed), and then moving onto IGE.

Game of 24

python3 game_of_24/run.py

BabyAI-Text

python3 babyai/run.py

TextWorld

# Run Coin Collector
python3 textworld/run_coin.py

# Run The Cooking Game
python3 textworld/run_cooking.py

# Run Treasure Hunter
python3 textworld/run_treasure.py

N.B. In order to generate the game files we used in TextWorld found in tw_games, we used the text_world/misc/make_*.py scripts.

Citation

If you find this project useful, please consider citing:

@article{lu2024IntelligentGoExplore,
title={{Intelligent Go-Explore}: Standing on the Shoulders of Giant Foundation Models},
author={Lu, Cong, and Hu, Shengran and Clune, Jeff},
journal={arXiv preprint arXiv:2405.15143},
year={2024}
}

Contact

Please contact Cong Lu for any queries.

conglu1997 / intelligent-go-explore

readme