facebookresearch / habitat-lab

A modular high-level library to train embodied AI agents across a variety of tasks and environments.
https://aihabitat.org/
MIT License
1.95k stars 488 forks source link

Can I configure the neural network structure in habitat-lab agent? #1474

Open man469 opened 1 year ago

man469 commented 1 year ago

❓ Questions and Help

I know that habitat-lab can implement reinforcement learning using PPO algorithm. My question is can I configure the neural network structure in habitat-lab agent? I cannot find reference that explains what network structure is used in habitat-lab. Could anyone help? Thanks a lot !!

aclegg3 commented 1 year ago

Hey @man469,

The NN and training code for Habitat resides in habitat-baselines package/directory. Outside of the baselines module, there is no implicit model structure requirement (e.g. the tasks don't dictate your model). If you intend to use an external training library you can do whatever you want, if you prefer to use habitat-baselines DDPPO trainer, there are some parameters built in (See here.). We typically load an existing pre-trainined network architecture to avoid cold-starting the CNN layers.