search

PaddlePaddle / PaddleNLP

👑 Easy-to-use and powerful NLP and LLM library with 🤗 Awesome model zoo, supporting wide-range of NLP tasks from research to industrial applications, including 🗂Text Classification, 🔍 Neural Search, ❓ Question Answering, ℹ️ Information Extraction, 📄 Document Intelligence, 💌 Sentiment Analysis etc.
https://paddlenlp.readthedocs.io
Apache License 2.0
12.1k stars 2.94k forks source link

【三日部署直播课】UIE、BERT等NLP模型在TensorRT、OpenVINO、ONNX Runtime、RKNN、Paddle Inference、Paddle Lite部署实战。覆盖150+热门模型 #3713

Closed leiqing1 closed 1 year ago

leiqing1 commented 2 years ago

问题描述

🔥 全场景部署套件 FastDeploy：

  1. 目前支持了150+热门CV、NLP、Speech模型的部署，其中UIE模型支持tensorRT、OpenVINO、ONNX Runtime、Paddle Inference。NLP的端侧能力正在打磨中。
  2. 支持TensorRT、OpenVINO、ONNX Runtime、RKNN、Paddle Inference、Paddle lite等。
  3. 支持CPU、GPU、Jetson、ARM CPU、瑞芯微NPU、晶晨NPU、恩智浦NPU、飞腾CPU、IPU等九大类硬件，更多硬件能力完善中。
  4. 1行代码切换不同后端和硬件。

  5. GitHub地址：https://github.com/PaddlePaddle/FastDeploy

🔥 三日直播课： 【直播分享】2022.11.09 20:30～21:30，《覆盖云边端全场景，150+热门模型快速部署》。微信扫码报名 【直播分享】2022.11.10 20:30～21:30，《瑞芯微、晶晨、恩智浦等10+AI硬件部署，直达产业落地》。微信扫码报名 【直播分享】2022.11.10 19:00～20:00，《10+热门模型在RK3588、RK3568部署实战》。微信扫码报名

🔥 部分NLP模型部署能力：（更多模型部署，欢迎移步FastDeploy仓库）

github-actions[bot] commented 1 year ago

This issue is stale because it has been open for 60 days with no activity. 当前issue 60天内无活动，被标记为stale。

github-actions[bot] commented 1 year ago

This issue was closed because it has been inactive for 14 days since being marked as stale. 当前issue 被标记为stale已有14天，即将关闭。