Visualization/Analysis: Display tokenization of input string in notebooks for inspection of predictions

ybracke / transnormer

A lexical normalizer for historical spelling variants using a transformer architecture.

GNU General Public License v3.0

6 stars 1 forks source link

Closed ybracke closed 1 year ago

ybracke commented 1 year ago

Example:

Er| brauch|te| das| Ross|.|

ybracke commented 1 year ago

Draft created on branch dev-notebook-inspect-pred in inspect_predictions_model-latest.ipynb (function separate_tokens).