I was trying evaluate a BC trained model/policy using the script llm_rl_scripts/car_dealer/misc/eval_car_dealer.py but I cannot find a jax_agent module. (Actually, it doesn't find algorithms. I assumed that it was a reference to the package LLM_RL/algorithms/ but that module is not there.)
This also affects other scripts as a quick grep search finds:
Notice that this had already been noted in #7 but left unresolved when closed.
By the way, that eval script follows a different pattern that the one presented in the README but it was the only I could find for the car_dealer environment. Are there other ways to evaluate the policies? And, even better, is there a way to interact with a learned seller policy (instead of the LLM buyer that is)?
I was trying evaluate a BC trained model/policy using the script
llm_rl_scripts/car_dealer/misc/eval_car_dealer.pybut I cannot find ajax_agentmodule. (Actually, it doesn't findalgorithms. I assumed that it was a reference to the packageLLM_RL/algorithms/but that module is not there.)This also affects other scripts as a quick grep search finds:
Notice that this had already been noted in #7 but left unresolved when closed.
By the way, that eval script follows a different pattern that the one presented in the README but it was the only I could find for the
car_dealerenvironment. Are there other ways to evaluate the policies? And, even better, is there a way to interact with a learned seller policy (instead of the LLM buyer that is)?