ybgdgh / Co-NavGPT

We proposed to explore and search for the target in unknown environment based on Large Language Model for multi-robot system.
https://sites.google.com/view/co-navgpt/
57 stars 1 forks source link

Question about object category remapping(constant.py and llm_agent.py) #13

Open wukui-muc opened 3 months ago

wukui-muc commented 3 months ago

Hi, could you please explain how you use mapping constants in the constants.py? I noticed the code use coco dataset for prediction, but it also use mp_categories_mapping array to remapping the segmentation result in line 605(llm_agents.py). I am currently run the code in my own environment for different object categories, it will be help a lot if you could explain this.

ybgdgh commented 3 months ago

Hi, because we used two different semantic segmentation algorithms (RedNet and detection2), so we need to specify the categories in line 605. That is just used for RedNet, you can ignore it in your project I think.

wukui-muc commented 3 months ago

What if I want to add another category for detection(For example: dog, index 16 in coco dataset id)? I assume I only need to change the following three mapping relations, right? 2024-05-25 13-12-02 的屏幕截图 2024-05-25 13-12-53 的屏幕截图