openxla / stablehlo

Backward compatible ML compute opset inspired by HLO/MHLO
Apache License 2.0
415 stars 113 forks source link

Triage stablehlo/testdata #1236

Open burmako opened 1 year ago

burmako commented 1 year ago

Having 3000+ files in one directory is hard to make sense of and runs into GitHub user interface limitations. It would be good to split these files into multiple directories per some criteria that are to be developed.

GleasonK commented 1 year ago

We may also want to consider moving these files to a separate branch that is fetched on-demand or non-main-repo location. Some data on the current state of things:

Disk footprint of base compatibility suite (.mlir files): 37M Disk footprint of a version of tests (0_X_Y.bc files): 24M

Meaning our repo footprint would grow at 37M + (24M*numReleases), which is likely not desirable for users of StableHLO.

burmako commented 1 year ago

Moving to conformance suite, since we are no longer relying on testdata/ for compatibility testing.