Upgrade to GPT4 model for summarization and improve long input handling

OCHA-DAP / hdx-signals

HDX Signals

https://un-ocha-centre-for-humanitarian.gitbook.io/hdx-signals/

GNU General Public License v3.0

5 stars 0 forks source link

Upgrade to GPT4 model for summarization and improve long input handling #20

Closed caldwellst closed 1 year ago

caldwellst commented 1 year ago

Upgrades the AI summarisation to use GPT4, which has the biggest benefit of handling 8x the length of inputs of the model currently being used. Have also put into utilities the summarisation function. Will move to box once all these open PRs are done.

zackarno commented 1 year ago

I have not yet dove into the {openai} package enough to understand these changes, but LGTM for merging. Perhaps we can have a call and you can help get me up to speed!