Huggingface accuracy have reached reasonable pass rate on PVC Linux on both torch.complie and eager. For windows on Client GPU, it only can support eager accuracy.
It requests to test all three benchmarks eager mode and triage the failure reason to reach a reasonable pass rate. Take LNL as an reference platform.
Some checkpoints:
Fully run huggingface benchmark e2e test result on eager.
Set up CI test task (Weekly can be workaround before CI machine ready)
Give the investigate report and fix plan within two weeks.
Fix bugs, give the fix reason and upstream the code.
🚀 The feature, motivation and pitch
Huggingface accuracy have reached reasonable pass rate on PVC Linux on both torch.complie and eager. For windows on Client GPU, it only can support eager accuracy.
It requests to test all three benchmarks eager mode and triage the failure reason to reach a reasonable pass rate. Take LNL as an reference platform.
Some checkpoints:
Alternatives
No response
Additional context
No response