search

chatcontract / public-issues

This repository is to log all the issues reported by our users.
0 stars 0 forks source link

Governing Law Wrong Answer in High Radius Contract #294

Open samyak112 opened 1 week ago

samyak112 commented 1 week ago

Description

While testing the contract Highradius we got the answer for Governing Law wrong , GPT-4 stated the answer as 'Not Found'.

RCA

The reason it stated the answer as Not Found can be reasoned by reading the Chain of thought given by GPT4 which states that the agreement outlines different governing laws based on the jurisdiction of the HighRadius entity involved, and because it is not stated as which one will be followed the answer was stated as Not Found Image from Contract

Solution

In future we are going to incorporate Knowledge Graph in our app, so while we are writing information about governing law we can also state in that , "mention all the governing laws stated in the document"

samyak112 commented 6 days ago

Results

Here is the answer of governing law when i added the following instruction - "If the agreement outlines different governing laws based on the jurisdiction then mention all the governing laws with where they are applicable"

image image