search

DeepWok / mase

Machine-Learning Accelerator System Exploration Tools
Other
113 stars 52 forks source link

Hardware Regression Test #201

Open jianyicheng opened 2 months ago

jianyicheng commented 2 months ago

We are refactoring the regression tests under the fix/tests branch. On the hardware side, we observed the following errors. Due to the large number of failed test cases, it is too challenging for us to fix them in a single PR. Here we listed the observed errors below and plan progressive fixes in the future:

ERRORS:

Failed Tests:

These test cases are considered WIP and skipped in the CI at moment. We may assign group members to fix a group of these test cases and also hope users who need them can help fixing these tests and add them back to the CI (by marking it as normal). We will soon add a doc about these test categories under the test folder.

Aaron-Zhao123 commented 2 months ago

We are now transforming the test to a justfile based one; simply run just test-hw would trigger the hardware tests.

The idea is to fix commonly used modules first, and leave the ones that are barely used as dev mode.

We are testing sutff in https://github.com/DeepWok/mase/pull/203 and https://github.com/DeepWok/mase/pull/211

Activations

Dev mode (no plan to fix until we need to make use of them)

Cast

Common

Convolution_layers

Interface

Language models llmint8

Dev

Linear Layer

Dev

Memory

Normalization_layers

Scalar operators

Systolic array

Transformer_layers