ubiquibot / conversation-rewards

0 stars 10 forks source link

ChatGPT 3.5 -> 4o #30

Closed 0x4007 closed 3 weeks ago

0x4007 commented 1 month ago

Also just realized that one run of ChatGPT 4o costs the same as 10x ChatGPT 3.5. Given that we are currently doing a 10x sample of the comments using 3.5 for the relevance scoring, lets just do a single run of 4o now instead.

Originally posted by @0x4007 in https://github.com/ubiquity/ubiquibot-kernel/issues/43#issuecomment-2148880396

I expect that this will simplify our code quite a bit, and the model is significantly more intelligent which may increase the accuracy of the results.

ubiquibot[bot] commented 3 weeks ago
+ Evaluating results. Please wait...
ubiquibot[bot] commented 3 weeks ago

[ 19.8 WXDAI ]

@0x4007
Contributions Overview
ViewContributionCountReward
IssueSpecification19.2
ReviewComment210.6
Conversation Incentives
CommentFormattingRelevanceReward
> Also just realized that one run of ChatGPT `4o` cos...
9.2
code:
  count: 4
  score: "4"
  words: 6
19.2
Yeah the primary work here is to simplify the code. No more ch...
90.759
@Keyrxng I assume you tested that this works. ...
1.60.731.6

[ 100 WXDAI ]

@Keyrxng
Contributions Overview
ViewContributionCountReward
IssueTask1100