search

emmethalm / infiniteGPT

InfiniteGPT is a Python script that lets you input an unlimited size text into the OpenAI API. No more tedious copy & pasting. Long live multithreading!
751 stars 151 forks source link

Practical usage example #2

Open dcts opened 1 year ago

dcts commented 1 year ago

To me its unclear how this fixes the problem of max prompt length. Let's say I have the following prompt:

=== PROMPT-start ===
I will provide you with the full text of a unrealeased book called "my unreleased book". Please 
create a short summary of the whole book in 200 words:
Lore ipsum....
...
...
...
(full book which has 100'000 tokens) 
=== PROMPT-end ===

In that case this script will get a response from chatGPT every 1500 tokens and screw up my prompt right?

Or maybe I did not understood the benefit of this script? Can you name one practical example how to use this script?

OmarHory commented 1 year ago

I think this script can be used only for prompt independent tasks like extracting Named Entity Recognition from text, or Extracting Sentiments.

I think the title of the repo does not represent its usage (maybe I am wrong, but that what I figured from the codebase)

ghauw commented 1 year ago

@OmarHory where is the codebase?