Bump ai.djl.huggingface:tokenizers from 0.28.0 to 0.29.0 in /services

[dependabot[bot]]

Bumps ai.djl.huggingface:tokenizers from 0.28.0 to 0.29.0.

Release notes

Sourced from ai.djl.huggingface:tokenizers's releases.

v0.29.0

Key Changes

• Upgrades for engines

  • Upgrades PyTorch engine to 2.3.1
  • Upgrades TensorFlow engine to 2.16.1
  • Introduces Rust engine CUDA support
  • Upgrades OnnxRuntime version to 1.18.0 and added CUDA 12.4 support
  • Upgrades javacpp version to 1.5.10
  • Upgrades HuggingFace tokenizer to 0.19.1
  • Fixes several issues for LightGBM engine
  • Deprecated llamacpp engine

• Enhancements for engines and API

  • Adds Yolov8 segmentation and pose detection support
  • Adds metric type to Metic class
  • Improves drawJoints and drawMask behavior for CV model
  • Improves HuggingFace model importing and conversion tool
  • Improves HuggingFace NLP model batch inference performance
  • Adds built-in ONNX extension support
  • Adds several NDArray operators in PyTorch engine
  • Adds fp16 and bf16 support for OnnxRuntime engine
  • Adds CrossEncoder support for NLP models

Enhancements

• Adds metric type to Metic class by @​frankfliu in deepjavalibrary/djl#3244
• Improves drawJoints behavior by @​frankfliu in deepjavalibrary/djl#3305
• [api] Allows to control json pretty print with env var by @​frankfliu in deepjavalibrary/djl#3288
• [api] Avoid null dimensions for Metric by @​frankfliu in deepjavalibrary/djl#3246
• [api] Improve NDArray.toDebugString() output by @​frankfliu in deepjavalibrary/djl#3290
• [api] Loads native engine in deterministic order by @​frankfliu in deepjavalibrary/djl#3300
• [api] Refactor drawMask() for instance segmentation by @​frankfliu in deepjavalibrary/djl#3304
• [api] Refactor nms for yolo translator by @​frankfliu in deepjavalibrary/djl#3297
• add close method to all nd manager by @​lanking520 in deepjavalibrary/djl#3225
• ported tools/stats.gradle by @​elect86 in deepjavalibrary/djl#3219
• use standard GSON output by @​lanking520 in deepjavalibrary/djl#3284
• [enhancement] Optimize memory copy overhead to enhance performance. by @​ewan0x79 in deepjavalibrary/djl#3289
• Gradle Kotlin script plus other stuff by @​elect86 in deepjavalibrary/djl#3167
• Improved incremental build by @​benjie332 in deepjavalibrary/djl#3231
• Refactored Identifiers by @​congyuluo in deepjavalibrary/djl#3276
• Refactored Identifiers by @​congyuluo in deepjavalibrary/djl#3282
• [gradle] Remove unused gradle files by @​frankfliu in deepjavalibrary/djl#3280
• [jacoco] exclude spark extension since it doesnot contain test by @​frankfliu in deepjavalibrary/djl#3230
• [Lgbm] support multi classification by @​ewan0x79 in deepjavalibrary/djl#3234
• [Lgbm] support multi type prediction by @​ewan0x79 in deepjavalibrary/djl#3237
• [llamacpp] Removing llamacpp support in DJL by @​frankfliu in deepjavalibrary/djl#3312
• [mxnet-model-zoo] Adds missing translatorFactory in metadata by @​frankfliu in deepjavalibrary/djl#3279
• [onnx] Adds fp16 and bfp16 support for OnnxRuntime by @​frankfliu in deepjavalibrary/djl#3281
• [onnxruntime] Add debug message for OnnxRuntime by @​xyang16 in deepjavalibrary/djl#3217
• [onnxruntime] Adds yolov8n pose model for OnnxRuntime by @​frankfliu in deepjavalibrary/djl#3309

... (truncated)

Commits

• d073604 [docs] Updates document to use DJL 0.29.0 (#3351)
• eacd950 [docs] Fixes pytorch version in README (#3347)
• 35dd5bc [release] Bump up versions to 0.29.0 in documents to point to new url (#3344)
• 3a34351 Remove -SNAPSHOT for release v0.29.0 (#3345)
• 6b642e1 [rust] Use fused layer_norm (#3346)
• e811632 [tokenizer] Supports cross encoder for text classification model (#3338)
• d833756 [ci] Fixes pytorch JNI build (#3339)
• 2b195e6 [onnxruntime] Load onnx extenstion if available (#3333)
• 4b4d605 [rust] Change loging level to debug (#3336)
• 0a92db8 [ci] Updates dependency versions to latest (#3332)
• Additional commits viewable in compare view

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.

---

Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR: - `@dependabot rebase` will rebase this PR - `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it - `@dependabot merge` will merge this PR after your CI passes on it - `@dependabot squash and merge` will squash and merge this PR after your CI passes on it - `@dependabot cancel merge` will cancel a previously requested merge and block automerging - `@dependabot reopen` will reopen this PR if it is closed - `@dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually - `@dependabot show ignore conditions` will show all of the ignore conditions of the specified dependency - `@dependabot ignore this major version` will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this minor version` will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this dependency` will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)