isaac-sim / IsaacLab

Unified framework for robot learning built on NVIDIA Isaac Sim
https://isaac-sim.github.io/IsaacLab
Other
2.07k stars 829 forks source link

[Bug Report] Imitation learning tutorial error #219

Closed MorningFrog closed 6 months ago

MorningFrog commented 8 months ago

If you are submitting a bug report, please fill in the following details and use the tag [bug].

Describe the bug

I am following documents, in Getting Started/Running existing scripts/Workflows/Imitation Learning section had a problem.

Steps to reproduce

When I run

./orbit.sh -p source/standalone/workflows/robomimic/collect_demonstrations.py --task Isaac-Lift-Cube-Franka-IK-Rel-v0 --num_envs 1 --num_demos 10 --device keyboard

there is an error:

[8.724s] Simulation App Startup Complete
[INFO]: Parsing configuration from: <class 'omni.isaac.orbit_tasks.manipulation.lift.config.franka.ik_rel_env_cfg.FrankaCubeLiftEnvCfg'>
2024-01-29 14:33:46 [11,945ms] [Error] [__main__] 'FrankaCubeLiftEnvCfg' object has no attribute 'control'
2024-01-29 14:33:46 [11,945ms] [Error] [__main__] Traceback (most recent call last):
  File "/path/to/Orbit/source/standalone/workflows/robomimic/collect_demonstrations.py", line 173, in <module>
    main()
  File "/path/to/Orbit/source/standalone/workflows/robomimic/collect_demonstrations.py", line 74, in main
    env_cfg.control.control_type = "inverse_kinematics"
AttributeError: 'FrankaCubeLiftEnvCfg' object has no attribute 'control'

[12.134s] Simulation App Shutting Down

System Info

Describe the characteristic of your environment:

Checklist

Mayankm96 commented 8 months ago

This seems like a duplicate of: https://github.com/NVIDIA-Omniverse/orbit/issues/228

We are working on fixing the IL workflow.

Nimingez commented 7 months ago

When do you think the bug fix will be completed?

jsmith-bdai commented 7 months ago

@Nimingez We are shooting to fix this in the next week. Sorry for delay!

Nimingez commented 7 months ago

@Nimingez We are shooting to fix this in the next week. Sorry for delay! I want to use spacemouse to collect demonstrations. Just --device spacemouse?

jsmith-bdai commented 7 months ago

Hi @Nimingez, sorry for the delay once again. We've been actively working on this but there were more API changes on the robomimic side that we are now working through.

Assuming all goes well, we should have in the coming week - I will keep you posted.

Mayankm96 commented 6 months ago

This should be fixed now. It is a bit hard-coded for the lift environment, but it can be adapted easily for your usecases.

We are working on making it more general. But that will take time from our side due to other priorities.