Paddle.js is a web project for Baidu Paddle, which is an open source deep learning framework running in the browser. Paddle.js can either load a pre-trained model, or transforming a model from paddle-hub with model transforming tools provided by Paddle.js. It could nearly run in every browser with WebGL supported.
Web project is built on Atom system which is a versatile framework to support GPGPU operation on WebGL. It is quite modular and could be used to make computation tasks faster by utilizing WebGL.
Web project could run TinyYolo model in less than 30ms on chrome. This is fast enough to run deep learning models in many realtime scenarios.
- PC: Chrome, firefox
- Mac: Chrome, Safari
- Android: Baidu App , UC, Chrome and QQ Browser
Currently Paddle.js only supports a limited set of Paddle Ops. See the full list. If your model uses unsupported ops, the Paddle.js script will fail and produce a list of the unsupported ops in your model. Please file issues to let us know what ops you need support with.
import {runner as Paddlejs} from 'paddlejs';
const paddlejs = new Paddlejs({
modelPath: 'model/mobilenetv2', // model path
fileCount: 4, // model data file count
feedShape: { // input shape
fw: 256,
fh: 256
},
fetchShape: [1, 1, 1920, 10], // output shape
fill: '#fff', // fill color when resize image
needBatch: true, // whether need to complete the shape to 4 dimension
inputType: 'image' // whether is image or video
});
// load paddlejs model and preheat
await paddlejs.loadModel();
// run model
await paddlejs.predict(img, postProcess);
function postProcee(data) {
// data is predicted result
console.log(data);
}
Please see feed documentation for details.
Please see fetch documentation for details.
The converter expects a Paddlejs SavedModel, Paddle Hub module, paddle.js JSON format for input.
The conversion script above produces 2 types of files:
- model.json (the dataflow graph and weight manifest file)
- group1-shard*of* (collection of binary weight files)
Paddle.js has some pre-converted models to Paddle.js format .There are some demos in the following URL, open a browser page with the demo.
- Online video tutorial start video
- Questions, reports, and suggestions are welcome through Github Issues!
- Forum: Opinions and questions are welcome at our PaddlePaddle Forum!
- QQ group chat: 696965088