Added Omniparser integration for Navi agent (./run-local.sh --som-origin omni & ./run-local.sh --som-origin mixed-omni)
Added CUDA support when passing --gpu-enabled true to ./run-local.sh
Added QEMU controller class vm_controller.py to improve env rendering & to add a VM snapshot API
Disabled windows from entering automatic recovery when quickly launching & shutting down VMs
Tidied up desktop env & readme
If you've already built the docker image, rebuilding it once is necessary for downloading the Omniparser weights. This should be done by running cd scripts && ./build-container-image.sh --build-base-image true
Changelog
./run-local.sh --som-origin omni
&./run-local.sh --som-origin mixed-omni
)--gpu-enabled true
to./run-local.sh
vm_controller.py
to improve env rendering & to add a VM snapshot APIIf you've already built the docker image, rebuilding it once is necessary for downloading the Omniparser weights. This should be done by running
cd scripts && ./build-container-image.sh --build-base-image true