Changelog
### 2.1.6
```
🔴 Bug fixes
* Fix issue 3958: Fix order of symbols that caused tag maps to be out-of-sync.
```
### 2.1.5
```
✨ New features and improvements
* **NEW:** Base language data for [Marathi](spacy/lang/mr) and [Korean](spacy/lang/ko) (via [`mecab-ko`](https://bitbucket.org/eunjeon/mecab-ko/src/master/README.md), [`mecab-ko-dic`](https://bitbucket.org/eunjeon/mecab-ko-dic) and [`natto-py`](https://natto-py.readthedocs.io)).
* Improve language data for Lithuanian, Spanish, Kannada, French, Norwegian and Hindi.
* Add evaluation metrics per entity type.
* Add resume logic to `spacy pretrain`.
* Add optional `id` property to EntityRuler patterns.
* Better introspection and IDE automcomplete for custom extension attributes.
* Make `Doc.is_sentenced` always return `True` for single-token docs.
🔴 Bug fixes
* Fix issue 3490: Add evaluation metrics per entity type to `Scorer`.
* Fix issue 3526: Serialize `EntityRuler` settings correctly.
* Fix issue 3558: Improve `E024` error message for incorrect `GoldParse`.
* Fix issue 3611: Fix bug when setting `ngram` parameter in text classifier.
* Fix issue 3625: Improve default punctuation rules for Hindi.
* Fix issue 3707: Improve introspection of custom attributes.
* Fix issue 3737: Check if component is callable in `Language.replace_pipe`.
* Fix issue 3743: Fix documentation of `lex_id`.
* Fix issue 3749: Change vector training script to work with latest Gensim.
* Fix issue 3762, 3934: Make `Doc.is_sentenced` default to `True` for single-token `Doc`s.
* Fix issue 3802: Fix typo in docs example.
* Fix issue 3811: Fix type of `--seed` option in `spacy pretrain`.
* Fix issue 3822: Allow passing `PhraseMatcher` arguments to `EntityRuler`.
* Fix issue 3839: Ensure the `Matcher` returns correct match IDs when used with operators.
* Fix issue 3840: Improve error messages in `spacy pretrain`.
* Fix issue 3853: Rename vectors if multiple models are loaded to prevent clashes.
* Fix issue 3859: Update `pretrain` to prevent unintended overwriting of weight files.
* Fix issue 3862: Fix matcher callback example.
* Fix issue 3868: Add `"v.s."` to English tokenizer exceptions.
* Fix issue 3869: Make `Doc.count_by` work as expected.
* Fix issue 3880: Fix unflatten padding in Thinc when last element is empty.
* Fix issue 3882: Exclude `user_data` when copying doc in displaCy.
* Fix issue 3892: Update `Tokenizer` initialization docs.
* Fix issue 3912: Make text classifier raise more friendly errors.
📖 Documentation and examples
* Add documentation for [`Scorer`](https://spacy.io/api/scorer), [`Language.evaluate`](https://spacy.io/api/languageevaluate) and [`gold.docs_to_json`](https://spacy.io/api/goldparsedocs_to_json).
* Fix various typos and inconsistencies.
👥 Contributors
Thanks to BreakBB, ujwal-narayan, estr4ng7d, maknotavailable, ramananbalakrishnan, nipunsadvilkar, NirantK, munozbravo, intrafindBreno, Azagh3l, jarib, tokestermw, polm, skrcode, kabirkhan, demongolem, elbaulp, clarus, BramVanroy, rokasramas, askhogan, khellan, kognate, cedar101 and yash1994 for the pull requests and contributions.
```
### 2.1.4
```
✨ New features and improvements
* **NEW:** `util.filter_spans` helper to filter duplicates and overlaps from a list of `Span` objects.
* Improve language data for Thai, Japanese, Indonesian and Dutch.
* Add `--n-save-every` to `spacy pretrain` and rename `--nr-iter` to `--n-iter` for consistency.
* Add `--return-scores` flag to `spacy evaluate` to return a dict.
* Add `--n-early-stopping` option to `spacy train` to define maximum number of iterations without dev accuracy improvements.
🔴 Bug fixes
* Fix issue 3307: Fix symlink creation to show error on Windows.
* Fix issue 3473: Fix GPU training for text classification.
* Fix issue 3475: Change favicon.
* Fix issue 3482: Add Estonian base support to documentation.
* Fix issue 3484: Ensure lemmatization is always consistent between sessions.
* Fix issue 3521: Add variations of contractions to English stop words.
* Fix issue 3523: Make `spacy convert` correctly default to `json`.
* Fix issue 3525, 3551, 3572: Fix problem that'd cause lemmas to not be lowercase.
* Fix issue 3531: Don't make `"settings"` or `"title"` required in displaCy data.
* Fix issue 3533: Remove non-existent example from docs.
* Fix issue 3546: Make sure path in `GoldParse.__del__` is a string.
* Fix issue 3549: Ensure match pattern error isn't raised on empty errors list.
* Fix issue 3561: Fix `DependencyParser.predict` docs.
* Fix issue 3598: Allow `jupyter=False` to override Jupyter mode in `displacy`.
* Fix issue 3620: Fix bug in `.iob` converter.
* Fix issue 3628: Relax `jsonschema` pin.
* Fix issue 3667: Fix offset bug in loading pre-trained word2vec.
* Fix issue 3679: Update glossary to include missing labels in `spacy.explain`.
* Fix issue 3680: Re-add missing universe README.
* Fix issue 3681: Rewrite information extraction example to use `Doc.retokenize`.
* Fix issue 3692: Fix return value in `Language.update` docs.
* Fix issue 3694: Make `"text"` in `spacy pretrain` optional when `"tokens"` is provided.
* Fix issue 3701: Improve `Token.prob` and `Lexeme.prob` docs.
* Fix issue 3708: Fix error in regex matcher examples.
* Fix issue 3713: Call `rmtree` and `copytree` with strings in `spacy train`.
* Fix issue 3720: Add version tag to `--base-model` argument in `spacy train` docs.
📖 Documentation and examples
* Add [free interactive spaCy course](https://course.spacy.io).
* Fix various typos and inconsistencies.
* Add new projects to the [spaCy universe](https://spacy.io/universe).
👥 Contributors
Thanks to svlandeg, wannaphongcom, Bharat123rox, DuyguA, SamuelLKane, graus, HiromuHota, jeannefukumaru, ivigamberdiev, socool, yvespeirsman, lemontheme, Dobita21, w4nderlust, pierremonico, bryant1410, celikomer, xssChauhan, kowaalczyk, BreakBB, fizban99, tokestermw, bjascob, pickfire, yaph, amitness, henry860916, d5555, BramVanroy, F0rge1cE, richardpaulhudson, ldorigo, aaronkub and devforfu for the pull requests and contributions.
```
Links
- PyPI: https://pypi.org/project/spacy
- Changelog: https://pyup.io/changelogs/spacy/
- Homepage: https://spacy.io
This PR updates spacy from 2.1.3 to 2.1.6.
Changelog
### 2.1.6 ``` 🔴 Bug fixes * Fix issue 3958: Fix order of symbols that caused tag maps to be out-of-sync. ``` ### 2.1.5 ``` ✨ New features and improvements * **NEW:** Base language data for [Marathi](spacy/lang/mr) and [Korean](spacy/lang/ko) (via [`mecab-ko`](https://bitbucket.org/eunjeon/mecab-ko/src/master/README.md), [`mecab-ko-dic`](https://bitbucket.org/eunjeon/mecab-ko-dic) and [`natto-py`](https://natto-py.readthedocs.io)). * Improve language data for Lithuanian, Spanish, Kannada, French, Norwegian and Hindi. * Add evaluation metrics per entity type. * Add resume logic to `spacy pretrain`. * Add optional `id` property to EntityRuler patterns. * Better introspection and IDE automcomplete for custom extension attributes. * Make `Doc.is_sentenced` always return `True` for single-token docs. 🔴 Bug fixes * Fix issue 3490: Add evaluation metrics per entity type to `Scorer`. * Fix issue 3526: Serialize `EntityRuler` settings correctly. * Fix issue 3558: Improve `E024` error message for incorrect `GoldParse`. * Fix issue 3611: Fix bug when setting `ngram` parameter in text classifier. * Fix issue 3625: Improve default punctuation rules for Hindi. * Fix issue 3707: Improve introspection of custom attributes. * Fix issue 3737: Check if component is callable in `Language.replace_pipe`. * Fix issue 3743: Fix documentation of `lex_id`. * Fix issue 3749: Change vector training script to work with latest Gensim. * Fix issue 3762, 3934: Make `Doc.is_sentenced` default to `True` for single-token `Doc`s. * Fix issue 3802: Fix typo in docs example. * Fix issue 3811: Fix type of `--seed` option in `spacy pretrain`. * Fix issue 3822: Allow passing `PhraseMatcher` arguments to `EntityRuler`. * Fix issue 3839: Ensure the `Matcher` returns correct match IDs when used with operators. * Fix issue 3840: Improve error messages in `spacy pretrain`. * Fix issue 3853: Rename vectors if multiple models are loaded to prevent clashes. * Fix issue 3859: Update `pretrain` to prevent unintended overwriting of weight files. * Fix issue 3862: Fix matcher callback example. * Fix issue 3868: Add `"v.s."` to English tokenizer exceptions. * Fix issue 3869: Make `Doc.count_by` work as expected. * Fix issue 3880: Fix unflatten padding in Thinc when last element is empty. * Fix issue 3882: Exclude `user_data` when copying doc in displaCy. * Fix issue 3892: Update `Tokenizer` initialization docs. * Fix issue 3912: Make text classifier raise more friendly errors. 📖 Documentation and examples * Add documentation for [`Scorer`](https://spacy.io/api/scorer), [`Language.evaluate`](https://spacy.io/api/languageevaluate) and [`gold.docs_to_json`](https://spacy.io/api/goldparsedocs_to_json). * Fix various typos and inconsistencies. 👥 Contributors Thanks to BreakBB, ujwal-narayan, estr4ng7d, maknotavailable, ramananbalakrishnan, nipunsadvilkar, NirantK, munozbravo, intrafindBreno, Azagh3l, jarib, tokestermw, polm, skrcode, kabirkhan, demongolem, elbaulp, clarus, BramVanroy, rokasramas, askhogan, khellan, kognate, cedar101 and yash1994 for the pull requests and contributions. ``` ### 2.1.4 ``` ✨ New features and improvements * **NEW:** `util.filter_spans` helper to filter duplicates and overlaps from a list of `Span` objects. * Improve language data for Thai, Japanese, Indonesian and Dutch. * Add `--n-save-every` to `spacy pretrain` and rename `--nr-iter` to `--n-iter` for consistency. * Add `--return-scores` flag to `spacy evaluate` to return a dict. * Add `--n-early-stopping` option to `spacy train` to define maximum number of iterations without dev accuracy improvements. 🔴 Bug fixes * Fix issue 3307: Fix symlink creation to show error on Windows. * Fix issue 3473: Fix GPU training for text classification. * Fix issue 3475: Change favicon. * Fix issue 3482: Add Estonian base support to documentation. * Fix issue 3484: Ensure lemmatization is always consistent between sessions. * Fix issue 3521: Add variations of contractions to English stop words. * Fix issue 3523: Make `spacy convert` correctly default to `json`. * Fix issue 3525, 3551, 3572: Fix problem that'd cause lemmas to not be lowercase. * Fix issue 3531: Don't make `"settings"` or `"title"` required in displaCy data. * Fix issue 3533: Remove non-existent example from docs. * Fix issue 3546: Make sure path in `GoldParse.__del__` is a string. * Fix issue 3549: Ensure match pattern error isn't raised on empty errors list. * Fix issue 3561: Fix `DependencyParser.predict` docs. * Fix issue 3598: Allow `jupyter=False` to override Jupyter mode in `displacy`. * Fix issue 3620: Fix bug in `.iob` converter. * Fix issue 3628: Relax `jsonschema` pin. * Fix issue 3667: Fix offset bug in loading pre-trained word2vec. * Fix issue 3679: Update glossary to include missing labels in `spacy.explain`. * Fix issue 3680: Re-add missing universe README. * Fix issue 3681: Rewrite information extraction example to use `Doc.retokenize`. * Fix issue 3692: Fix return value in `Language.update` docs. * Fix issue 3694: Make `"text"` in `spacy pretrain` optional when `"tokens"` is provided. * Fix issue 3701: Improve `Token.prob` and `Lexeme.prob` docs. * Fix issue 3708: Fix error in regex matcher examples. * Fix issue 3713: Call `rmtree` and `copytree` with strings in `spacy train`. * Fix issue 3720: Add version tag to `--base-model` argument in `spacy train` docs. 📖 Documentation and examples * Add [free interactive spaCy course](https://course.spacy.io). * Fix various typos and inconsistencies. * Add new projects to the [spaCy universe](https://spacy.io/universe). 👥 Contributors Thanks to svlandeg, wannaphongcom, Bharat123rox, DuyguA, SamuelLKane, graus, HiromuHota, jeannefukumaru, ivigamberdiev, socool, yvespeirsman, lemontheme, Dobita21, w4nderlust, pierremonico, bryant1410, celikomer, xssChauhan, kowaalczyk, BreakBB, fizban99, tokestermw, bjascob, pickfire, yaph, amitness, henry860916, d5555, BramVanroy, F0rge1cE, richardpaulhudson, ldorigo, aaronkub and devforfu for the pull requests and contributions. ```Links
- PyPI: https://pypi.org/project/spacy - Changelog: https://pyup.io/changelogs/spacy/ - Homepage: https://spacy.io