search

GengzeZhou / NavGPT

[AAAI 2024] Official implementation of NavGPT: Explicit Reasoning in Vision-and-Language Navigation with Large Language Models
MIT License
149 stars 13 forks source link

prompt template #9

Closed 1180300611haobowen closed 4 months ago

1180300611haobowen commented 4 months ago

Do I need to modify the planner_prompt if I use llama or another large language model？

GengzeZhou commented 4 months ago

Yes, you would need to properly prompt specific language models for better performance.

Moreover, the Llama model (Llama 2 70B) performed poorly in our preliminary experiments, so it is recommended to consider finetuning the opensource models with the latest techniques (e.g. LangNav, NavCoT, NaviLLM, NavGPT-2) for VLN tasks.