search

nlpsandbox / phi-annotator-spark-nlp

An implementation of NLP Sandbox PHI Annotator API based on Spark NLP
Apache License 2.0
0 stars 1 forks source link

Bump spark-nlp from 3.1.1 to 3.3.4 in /server #51

Closed dependabot[bot] closed 2 years ago

dependabot[bot] commented 2 years ago

Bumps spark-nlp from 3.1.1 to 3.3.4.

Release notes

Sourced from spark-nlp's releases.

John Snow Labs Spark-NLP 3.3.4: Patch release

Patch release

Documentation

Installation

Python

#PyPI

pip install spark-nlp==3.3.4

Spark Packages

spark-nlp on Apache Spark 3.0.x and 3.1.x (Scala 2.12 only):

spark-shell --packages com.johnsnowlabs.nlp:spark-nlp_2.12:3.3.4

pyspark --packages com.johnsnowlabs.nlp:spark-nlp_2.12:3.3.4

GPU

spark-shell --packages com.johnsnowlabs.nlp:spark-nlp-gpu_2.12:3.3.4

pyspark --packages com.johnsnowlabs.nlp:spark-nlp-gpu_2.12:3.3.4

... (truncated)

Changelog

Sourced from spark-nlp's changelog.

3.3.4

Patch release

  • Fix "ClassCastException" error in pretrained function for DistilBertForSequenceClassification in Python

======== 3.3.3

New Features & Enhancements

  • NEW: Introducing DistilBertForSequenceClassification annotator in Spark NLP 🚀. DistilBertForSequenceClassification DistilBertForSequenceClassification can load DistilBERT Models with sequence classification/regression head on top (a linear layer on top of the pooled output) e.g. for multi-class document classification tasks. This annotator is compatible with all the models trained/fine-tuned by using DistilBertForSequenceClassification or TFDistilBertForSequenceClassification in HuggingFace 🤗
  • NEW: Introducing trainable and distributed Doc2Vec annotators based on Word2Vec in Spark ML
  • Improving BertEmbeddings for single document/sentence DataFrame per row on a single machine with a GPU device
  • Improving BertSentenceEmbeddings for single document/sentence DataFrame per row on a single machine with a GPU device
  • Add a new feature to the CoNLL() class, allowing it to read multiple CoNLL files at the same time into a single DataFrame
  • Add support for Long type in label column for ClassifierDLApproach and SentimentDLApproach

Bug Fixes

  • Improve models and pipelines resolutions in Spark NLP when wrong models/pipelines are downloaded regardless of their Apache Spark version
  • Fix MarianTransformer bug on empty sequences
  • Fix TFInvalidArgumentException in MarianTransformer for sequences longer than 512
  • Fix MarianTransformer multi-lingual models and pipelines such as opus_mt_mul_en and opus_mt_mul_en

======== 3.3.2

New Features

  • Comet.ml integration with Spark NLP
  • Introducing BertForSequenceClassification annotator

Bug Fixes

  • Fix EntityRulerApproach name from import
  • Fix missing EntityRulerModel in ResourceDownloader
  • Fix NerDLApproach logs format on Databricks
  • Fix a missing batchSize param in NerDLModel that degraded GPU performance

======== 3.3.1

... (truncated)

Commits
  • 6fe4224 Merge pull request #6514 from JohnSnowLabs/release/334-release-candidate
  • 2b1dc32 Bump conda to 3.3.4 [skip test]
  • 3bfdde1 Add DistilBertForSequenceClassificationTestSpec [skip test]
  • f34ae4e Update Scala and Python APIs
  • f5c5d6f Bump the version to 3.3.4 [run doc]
  • af03dd8 Merge pull request #6513 from JohnSnowLabs/bugfix/distilbert-sequence
  • 517f456 Fix the wrong name for DistilBertForSequenceClassification in Python
  • 1ba21d4 Merge pull request #6469 from JohnSnowLabs/fixes-new-scala
  • b4056ae Merge pull request #6508 from JohnSnowLabs/ChunkKeyPhraseExtraction_docs
  • 9dcde34 update docs
  • Additional commits viewable in compare view


Dependabot compatibility score

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.

Dependabot commands and options
You can trigger Dependabot actions by commenting on this PR: - `@dependabot rebase` will rebase this PR - `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it - `@dependabot merge` will merge this PR after your CI passes on it - `@dependabot squash and merge` will squash and merge this PR after your CI passes on it - `@dependabot cancel merge` will cancel a previously requested merge and block automerging - `@dependabot reopen` will reopen this PR if it is closed - `@dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually - `@dependabot ignore this major version` will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this minor version` will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this dependency` will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
dependabot[bot] commented 2 years ago

OK, I won't notify you again about this release, but will get in touch when a new version is available. If you'd rather skip all updates until the next major or minor version, let me know by commenting @dependabot ignore this major version or @dependabot ignore this minor version. You can also ignore all major, minor, or patch releases for a dependency by adding an ignore condition with the desired update_types to your config file.

If you change your mind, just re-open this PR and I'll resolve any conflicts on it.