search

microsoft / onnxruntime

ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator
https://onnxruntime.ai
MIT License
14.78k stars 2.94k forks source link

[js/webgpu] Optimize Expand #22752

Closed qjia7 closed 1 week ago

qjia7 commented 2 weeks ago

Use components = 4 if possible.

llama3.2-1B becomes 20 tokens/s from 18 tokens/s on my iGPUs.

qjia7 commented 2 weeks ago

@guschmue @fs-eire Please take a look, thanks.

guschmue commented 1 week ago

/azp run ONNX Runtime Web CI Pipeline,Windows GPU CI Pipeline,Linux Android Emulator QNN CI Pipeline

guschmue commented 1 week ago

/azp run Linux CPU CI Pipeline,Linux CPU Minimal Build E2E CI Pipeline,Linux GPU CI Pipeline,Linux GPU TensorRT CI Pipeline,Linux OpenVINO CI Pipeline,Linux QNN CI Pipeline,MacOS CI Pipeline,Windows ARM64 QNN CI Pipeline,Windows CPU CI Pipeline

guschmue commented 1 week ago

/azp run Windows GPU TensorRT CI Pipeline,onnxruntime-binary-size-checks-ci-pipeline,orttraining-linux-ci-pipeline,orttraining-linux-gpu-ci-pipeline,orttraining-ortmodule-distributed,Windows x64 QNN CI Pipeline,Big Models

azure-pipelines[bot] commented 1 week ago
Azure Pipelines successfully started running 1 pipeline(s).
azure-pipelines[bot] commented 1 week ago
Azure Pipelines could not run because the pipeline triggers exclude this branch/path.
azure-pipelines[bot] commented 1 week ago
Azure Pipelines successfully started running 1 pipeline(s).
guschmue commented 1 week ago

/azp run Windows GPU CUDA CI Pipeline,Windows GPU DML CI Pipeline,Windows GPU Doc Gen CI Pipeline

azure-pipelines[bot] commented 1 week ago
Azure Pipelines could not run because the pipeline triggers exclude this branch/path.