PsychoinformaticsLab / pliers

Automated feature extraction in Python
https://pliers.readthedocs.io/en/latest/
BSD 3-Clause "New" or "Revised" License
293 stars 68 forks source link

implement gpt-2 forward language modeling extractor #464

Open rbroc opened 2 years ago

rbroc commented 2 years ago

It takes words w(1), w(2),..., w(n-1) from a ComplexTextStim text elements, and returns forward language modeling predicted logits for w(n). Could be used in combo w/ MetricExtractor for entropy and surprisal extraction.