search

MobileLLM / AutoDroid

Source code for the paper "Empowering LLM to use Smartphone for Intelligent Task Automation"
https://arxiv.org/abs/2308.15272
MIT License
260 stars 33 forks source link

Can't reproduce. Complete calendar task "create a event of laundry" loops forever. #12

Open leosol opened 8 months ago

leosol commented 8 months ago

After configuring openai Key and installing all the required dependencies, verything worked almost as expected, but unfortunatelly this sample task did not finish. Was it expected to complete? autodroid.log

wenh18 commented 8 months ago

Yes, The current implementation is not good at determining task completion. We mentioned it in the failure case discussion in Section 6.2 and 'Note that we do not include the completion determination step for clear comparison...' in the Task Completion Rate section.