search

MyLife-Services / mylife-maht

MyLife Member Services Repository
https://humanremembranceproject.org
MIT License
1 stars 1 forks source link

Test Diary Bot Prototype #349

Closed Mookse closed 2 months ago

Mookse commented 2 months ago

Testing Diary Bot Prototype

Access and Test the MyLife Diary Bot Prototype OpenAI GPT version. Solicit for internal and external feedback.

Vudum commented 2 months ago

https://github.com/MyLife-Services/mylife-maht/issues/348 I have partially tested the mylife-diary-bot-prototype but couldn't finish as I have reached limit for using GPTs for now. https://chatgpt.com/g/g-rSCnLVUKd-mylife-diary-bot-prototype

Following features are tested and works as expected: Keep track of journal entries, Flags, interests.

Next, I will test following key features - Entry Prompting, Entry Summary Creation, Entry Summary Updating

Vudum commented 2 months ago
  1. Entry Summary isn't created automatically after discussing a topic with prompts. The system keeps responding to questions, and when asked, it says the entry wasn't created but can be.

As a member I expect the bot will create(at least ask the member if ok to create) an entry after 5 prompts while discussing on a single topic. Functionality didn't work as expected.

  1. To save an entry, member permission is required. If confirmed, the entry is saved. Otherwise entry created doesn't mean that it saved automatically.

  2. Member Content Flagging worked well. I updated the entry with flagged content, and GPT recognized it, automatically updating the entry and reflecting changes in moods."

  3. Data Privacy & Security->Works as expected.

  4. After refreshing the page(mylife-diary-bot-prototype), entries are not remembered. Not sure, if this is an expected behavior.

Vudum commented 2 months ago

Additional testing has been completed, and here are the final issues observed:

  1. 'If a member is not prompting or prompting takes more than 2 minutes, please suggest using a dynamic greeting.' This functionality did not work as expected; GPT did not greet the member even after an extended period of silence.

  2. When switching between different GPTs or updating the GPT, previously provided entries are lost, and all input has to be re-entered."

With this, testing has been completed. I am closing this ticket. If we need a new ticket to investigate these issues if let me know @Mookse .

Mookse commented 2 months ago

That's great @Vudum -- I'll take the issues that you identified and roll them into this week's build for the series.

I think the only one you won't see in some format is the last one, that's a standard process for these bots and is intentional in their design. You would need to stay on the same conversation (MyLife is the inverse) to get remembered results. The refresh has to be the same, and honestly I've noticed inconsistencies at large, but if you click the correct conversation on the left, it will retain its "memory"