search

humlab / penelope

Pipleline for generating data used in text analytics notebooks. Used by Welfare State Analytics, INIDUN and several other research projects.
5 stars 1 forks source link

Use document_index.n_tokens if n_raw_tokens is missing #192

Closed roger-mahler closed 1 year ago

roger-mahler commented 1 year ago 
    # FIXME: Use document_index.n_tokens if n_raw_tokens is missing

https://github.com/humlab/penelope/blob/9edb53053ff67fec968a8c774c9cd82c3ab6ae19/penelope/notebook/token_counts/pipeline_gui.py#L257