Paddle.js
Paddle.js is a web project for Baidu PaddlePaddle, which is an open source deep learning framework running in the browser. Paddle.js can either load a pre-trained model, or transforming a model from paddle-hub with model transforming tools provided by Paddle.js. It could run in every browser with WebGL/WebGPU/WebAssembly supported. It could also run in Baidu Smartprogram and WX miniprogram.
Ecosystem
| Project | version | Description |
|---|---|---|
| paddlejs-core |  |
inference engine |
| paddlejs-backend-webgl |  |
webgl backend |
| paddlejs-backend-wasm |  |
wasm backend |
| paddlejs-backend-webgpu |  |
webgpu backend |
| paddlejsconverter |  |
convert paddlepaddle model |
| humanseg |  |
human segmentation library |
| ocr |  |
optical character recognition library |
| gesture |  |
gesture recognition library |
| mobilenet |  |
image classification library |
| ocr detection |  |
optical character detection library |
| facedetect |  |
face detection library |
Website
Key Features
Module
- paddlejs-core, the core part of the Paddle.js ecosystem, which is responsible for the operation of the inference process of the entire engine.
- paddlejsconverter, model transformation tool for Paddle.js, convert PaddlePaddle models (also known as fluid models) into a browser-friendly format.
- paddlejs-models, model projects, supply flexible low-level APIs for users to implement their AI scenario.
- paddlejs-examples, Paddle.js AI examples
- paddlejs-mediapipe, tools for live and streaming media, support webrtc camera and a lightweight opencv package
Backends
- paddlejs-backend-webgl, webgl backend, the main backend for Paddle.js, ops supported
- paddlejs-backend-webgpu, webgpu backend, an experimental backend, WebGPU draft, ops supported
- paddlejs-backend-wasm, WebAssembly backend, ops supported
- paddlejs-backend-cpu, cpu backend, ops supported
- paddlejs-backend-nodegl, nodegl backend, a backend in Node.js for Paddle.js, using the webgl backend ops. ops supported
Examples
- image classification game image classification game example in wx miniprogram
- gesture gesture recognition example online experience
- humanStream video-streaming human segmentation online experience
- humanseg human segmentation example online experience
- ocr optical character recognition example online experience
- ocr detection optical character detection example online experience
- mobilenet classify images into 1000 object categories online experience
- wine classify bottles into 7 categories online experience
- webglworker This demo help us to use Paddle.js in WebWorker.
Browser/Platforms Coverage
- PC: Chrome, Safari, Firefox
- Phone: Baidu App , Chrome , UC and QQ Browser
- Smartprogram: Baidu Smartprogram, WX miniprogram
- Platform: macOS, Windows
Load Model
-
Support load model files on the network:
- model.json (model structure and operators' attributes)
- chunk_x.dat (model params binary data)
-
Support use model obj
- modelObj.model (model structure json object)
- modelObj.params（model params Float32Array data）
If you dont' want to put model on the network, you can use method 2.
Feedback and Community Support
- Online video tutorial start video
- Questions, reports, and suggestions are welcome through Github Issues!
- Forum: Opinions and questions are welcome at our PaddlePaddle Forum！
- QQ group chat: 696965088