GPT-like Detection

[kiritowu]

Compute sentence perplexity from paragraph. Benchmark the value to determine which paragraph is gpt-like. Find way to make this work in extension setup (probably py-script, or worse-come-to-worse python severless backend)

[gn07]

Perplexity — ie. the randomness of the text is — a measurement of how well a language model like ChatGPT can predict a sample text. simply put, it measures how much the computer model likes the text. your text perplexity evaluated on gpt2 (345M parameters) is 13 which is comparatively low. texts with lower perplexities are more likely to be generated by language models