Create demo notebook for Conllu files

CODAIT / text-extensions-for-pandas

Natural language processing support for Pandas dataframes.

Apache License 2.0

215 stars 34 forks source link

Create demo notebook for Conllu files #198

Closed ZachEichen closed 3 years ago

ZachEichen commented 3 years ago

Created a demo notebook that shows how the new conllu logic can be used to open and process diverse .conllu files; addresses issue #195

Shows how these can be powerfully used with pandas dataframes, and other text-extensions integrations to quickly manipulate the data and do things like displaying parse trees, and retokenizing with spaCy.

review-notebook-app[bot] commented 3 years ago

Check out this pull request on

See visual diffs & provide feedback on Jupyter Notebooks.

Powered by ReviewNB

frreiss commented 3 years ago

This is very close to ready to merge. Some minor requests:

I see some formatting issues in conll.py. Can you run that file through black?
Need an explicit conversion back to an int dtype to get rid of the unintentional float outputs to conll_u_to_dataframes -- see https://github.com/CODAIT/text-extensions-for-pandas/pull/198#discussion_r647665495.
Can you please add a precision/recall/F1 score computation after the last cell? Collection-level F1 is fine.