Fix an issue with TOKEN_RE

tatuylonen / wikitextprocessor

Python package for WikiMedia dump processing (Wiktionary, Wikipedia etc). Wikitext parsing, template expansion, Lua module execution. For data extraction, bulk syntax checking, error detection, and offline formatting.

Other

90 stars 23 forks source link

Fix an issue with TOKEN_RE #274

Closed kristian-clausal closed 3 months ago

kristian-clausal commented 3 months ago

Should fix Wiktextract issue https://github.com/tatuylonen/wiktextract/issues/597