search

quanteda / quanteda.textstats

Textual statistics for quanteda
GNU General Public License v3.0
14 stars 2 forks source link

Make textstat_readability to work with tokens and DFM #65

Open koheiw opened 10 months ago

koheiw commented 10 months ago

There are two ways,

  1. Improve the mechanism to save sentence counts or boundaries. For example, https://github.com/quanteda/quanteda/issues/2061
  2. Apply tokens_segment(pattern = "^[.!?]$", valuetype = "regex) when the input object is tokens