HiveSight / hivesight.ai

React front-end for HiveSight.ai website
https://hivesight.ai
1 stars 1 forks source link

Tune prompt better for when Request Explanation is not checked #13

Open baogorek opened 3 months ago

baogorek commented 3 months ago

You can see that it's often just returning a one word answer, but not always:

['No.', 'No.', 'Yes, I believe a fair and reasonable income tax is necessary in North Carolina to fund essential government services and maintain a balanced budget.', 'Yes, I believe we should have an income tax in North Carolina as it helps fund essential services and government operations.', 'No.', 'No.', 'No.', 'No.', 'No.', 'No.']

And furthermore, the code is returning No Valid Responses for this output.

Another thing to consider is whether we even need a non Request Explanations option, since the explanations are so useful.

MaxGhenis commented 3 months ago

We can limit to one return token when it's not checked to reduce runtime and cost. Diverse profiles may make this more important.