explosion / spaCy

💫 Industrial-strength Natural Language Processing (NLP) in Python
https://spacy.io
MIT License
29.99k stars 4.39k forks source link

Upgrades for spacy 1.x #5068

Closed chrisjbryant closed 4 years ago

chrisjbryant commented 4 years ago

I just wanted to ask if there are any plans to upgrade spacy 1 with any of the features introduced in spacy 2; e.g. improvements to the lemmatiser and custom token attributes.

I mainly use spacy for the POS tagger, but can't justify moving to spacy 2 for such small gains at such a significant cost to speed (cf. your benchmarks, which are consistent with my own experiments).

While I know spacy 2 is your focus, it would be great if there were occasional updates to spacy 1, since I'm sure some of the changes are backwards compatible.

honnibal commented 4 years ago

Hi Chris,

It's too hard to port the changes back, because there are too many differences from V1, especially with the stateful stringstore. What we'd be doing instead is porting the v1 model to work with v3: we can have a linear model that works like the v1 model, and should be similar in speed, but working with the new version.

lock[bot] commented 4 years ago

This thread has been automatically locked since there has not been any recent activity after it was closed. Please open a new issue for related bugs.