NVIDIA / Fuser

A Fusion Code Generator for NVIDIA GPUs (commonly known as "nvFuser")
Other
271 stars 53 forks source link

Add thunder benchmarks #3394

Open Priya2698 opened 1 week ago

Priya2698 commented 1 week ago

Adds thunder as an additional executor to the baseline benchmarks and the corresponding thunder.jit function. The following benchmarks do not have thunder benchmark:

  1. instancenorm: Unsupported operator in Thunder
  2. test_gelu_backward_reduction.py: .backward call is not supported within Thunder definitions. @IvanYashchuk has suggested using explicit backward computation for this case.

Issue #2718

Priya2698 commented 1 week ago

!build

liqiangxl commented 1 week ago

!test --pybench

liqiangxl commented 1 week ago

Can you check how does the benchmark look like? Make sure there are no unexpected results.

xwang233 commented 1 week ago

!test --pybench-full --dev

see results here when pipeline finishes