chatcontract / public-issues

This repository is to log all the issues reported by our users.
0 stars 0 forks source link

Payment due date value incorrect by AI on AWS Contract #304

Closed rajatsharma29 closed 2 days ago

rajatsharma29 commented 6 days ago

In AWS Contract the payment Due Date is not mentioned but the AI Gives the values as "monthly"

AI Answer: Monthly Correct Answer: Not Mentioned in Agreement

AI Citation: 2,4 Correct Citation: N/A

Key Term name: Payment Due Date Question: When is payment due? (answer needed about the date as the name is due date)

Contract link: https://drive.google.com/file/d/1XAZ17NXnOyOP-xeKnbO0KenpNriULOa0/view?usp=drive_link Re Results - AWS Customer Agreement - May 2024.pdf.csv sults: Attached

samyak112 commented 3 days ago

RCA

This happened because the question was not clear it states - "When is payment due?" it does not clears how we want the answer as

samyak112 commented 3 days ago

Solution

I changed the question to 'What is the date of Payment Due" and here are the results - image

image