hackerai-tech / PentestGPT

AI-Powered Automated Penetration Testing Tool
https://pentestgpt.ai/
GNU General Public License v3.0
770 stars 25 forks source link

Store RAG Vector IDs and Boolean Values for AI Responses to Improve Feedback System #243

Open RostyslavManko opened 4 months ago

RostyslavManko commented 4 months ago

Description

To enhance our feedback system, we need to store RAG vector IDs (e.g., a576038e-c565-4e6b-bdf4-2244dd214e13) for each message and actual boolean values indicating whether RAG is being used or not for each AI response to the user. This information will be used to improve the feedback system by including additional fields like RAG vector IDs and whether RAG was used or not. This will help us understand how to improve specific Pinecone vectors to provide better results to users.

Assignee

@fkesheh

Objective

Our goal is to enhance the feedback system by storing RAG vector IDs and boolean values for AI responses, which will ultimately help us improve the quality of AI responses.

Actions and Considerations (ACC)

  1. Update AI Response Storage:

    • [x] Store RAG vector IDs for each message. (Pinecone Vectors Ids)
    • [x] Store boolean values indicating whether RAG was used or not for each AI response.
  2. Update Feedback System:

    • [x] Include additional fields in the feedback system to store RAG vector IDs and whether RAG was used or not.
  3. Testing and Quality Assurance:

    • [x] Conduct thorough testing to ensure that the updated feedback system works as expected and helps improve the quality of AI responses.
    • [x] Test various scenarios, including potential edge cases, to guarantee a robust and reliable solution.
    • [x] Verify that the changes work correctly both locally and on Vercel preview.

Expected Outcomes

fkesheh commented 2 months ago

PR: https://github.com/Hacker-GPT/HackerGPT-2.0/pull/500