This issue tracks the E2E op tests for the OnnxToLinalg lowering.

Failing Tests (count: 547): as on 08/04/24

Higher Priority:

Failure - incorrect numerics

[ ] "ElementwiseAtan2TensorIntModule_basic",
[ ] "ElementwiseLog10IntModule_basic",
[ ] "ElementwiseLog2IntModule_basic",
[ ] "ElementwiseSeluModule_basic",
[ ] "FlipModuleStaticShape_basic",
[ ] "FlipNegativeIndexModule_basic",
[ ] "HardsigmoidModule_basic",
[ ] "HardsigmoidRandomModule_basic",
[ ] "PixelShuffleModuleStaticRank4Float32_basic",
[ ] "SliceCopyEndGreaterThanDimSize_Module_basic",
[ ] "SliceCopyNegative_Module_basic",
[ ] "SliceCopyNonZeroDim_Module_basic",
[ ] "SliceCopy_Module_basic",
[ ] "TupleModule_basic",

Failure - incorrect shape

[ ] "ArangeStartOutDtypeModule_basic",
[ ] "ArangeStartOutViewModule_basic",
[ ] "BroadcastDynamicDimModule_basic",
[ ] "MoveDimIntNegativeIndexModule_basic",
[ ] "ViewSizeFromOtherTensor_basic",

Failure - onnx_lowering: onnx.RandomNormal

Failure - onnx_lowering: onnx.RandomNormalLike

[x] "RandnLikeDtypeModule_basic",
[ ] "RandnLikeModule_basic",

Failure - onnx_lowering: onnx.RandomUniform

[x] "RandIntLowDtypeModule_basic",
[x] "RandIntLowModule_basic",

Failure - onnx_lowering: onnx.RandomUniformLike

Failure - onnx_lowering: onnx.ReduceProd

[ ] #609
[ ] #610
[ ] "DropoutTrainStaticShapeModule_basic",
[ ] "NativeDropoutTrainModule_basic",
[ ] "NativeDropoutTrainStaticShapeModule_basic",
[ ] #592
[ ] "StdCorrectionLargeInputModule_basic",
[ ] "VarCorrectionLargeInputModule_basic",

Failure - onnx_lowering: onnx.Pad

[ ] "ReflectionPad1dModule2dInput_Right",
[ ] "ReflectionPad1dModule2dInput_basic",
[ ] "ReflectionPad1dModule3dInput_Left",
[ ] "ReflectionPad1dModule3dInput_basic",
[ ] "ReflectionPad2dModule_Bottom",
[ ] "ReflectionPad2dModule_Left",
[ ] "ReflectionPad2dModule_Right",
[ ] "ReflectionPad2dModule_Top",
[ ] "ReflectionPad2dModule_basic",
[ ] "ReplicationPad2dModule_basic",
[ ] "ReplicationPad2dModule_bottom0",
[ ] "ReplicationPad2dModule_left0",
[ ] "ReplicationPad2dModule_right0",
[ ] "ReplicationPad2dModule_top0",

Failure - onnx_lowering: onnx.ScatterND

[ ] "IndexPut1DFloatAccumulateModule_basic",
[ ] "IndexPut1DFloatNonAccumulateModule_basic",
[ ] "IndexPut1DIntAccumulateModule_basic",
[ ] "IndexPut1DIntNonAccumulateModule_basic",
[ ] "IndexPut2DFloatAccumulateModule_basic",
[ ] "IndexPut2DFloatNonAccumulateModule_basic",
[ ] "IndexPut2DIntAccumulateModule_basic",
[ ] "IndexPut2DIntNonAccumulateModule_basic",
[ ] "IndexPut3DFloatAccumulateModule_basic",
[ ] "IndexPut3DFloatNonAccumulateModule_basic",
[ ] "IndexPut3DIntAccumulateModule_basic",
[ ] "IndexPut3DIntNonAccumulateModule_basic",
[ ] "IndexPutHackedTwin1DFloatAccumulateModule_basic",
[ ] "IndexPutHackedTwin1DFloatNonAccumulateModule_basic",
[ ] "IndexPutHackedTwin1DIntAccumulateModule_basic",
[ ] "IndexPutHackedTwin1DIntNonAccumulateModule_basic",
[ ] "IndexPutHackedTwin2DFloatAccumulateModule_basic",
[ ] "IndexPutHackedTwin2DFloatNonAccumulateModule_basic",
[ ] "IndexPutHackedTwin2DIntAccumulateModule_basic",
[ ] "IndexPutHackedTwin2DIntNonAccumulateModule_basic",
[ ] "IndexPutHackedTwin3DFloatAccumulateModule_basic",
[ ] "IndexPutHackedTwin3DFloatNonAccumulateModule_basic",
[ ] "IndexPutHackedTwin3DIntAccumulateModule_basic",
[ ] "IndexPutHackedTwin3DIntNonAccumulateModule_basic",

Failure - onnx_lowering: onnx.ScatterElements

[ ] "ScatterSrcModule_basic",
[ ] "ScatterSrcStaticModule_basic",
[ ] "ScatterValueFloatModule_basic",
[ ] "ScatterValueIntModule_basic",

Failure - onnx_lowering: onnx.Squeeze

[ ] "SqueezeModule_allUnitDim",
[ ] "SqueezeModule_broadcast",
[ ] "SqueezeModule_static",

Failure - onnx_lowering: onnx.MaxPool

Failure - onnx_lowering: onnx.ReduceL1

[ ] "ReduceL1NormModule_basic",
[ ] "ReduceL1NormWithDTypeModule_basic",

Failure - onnx_lowering: onnx.Resize

[ ] "UpSampleNearest2dDynamicSize_basic",
[ ] "UpSampleNearest2dStaticSize_basic",

Failure - onnx_lowering: onnx.AveragePool

[ ] "AdaptiveAvgPool1dGeneralDynamicNoBatches_basic",
[ ] "AvgPool2dDivisorOverrideModule_basic",

Failure - onnx_lowering: onnx.SoftmaxCrossEntropyLoss

[ ] "CrossEntropyLossModule_basic",
[ ] "CrossEntropyLossNoReductionModule_basic",

Failure - onnx_lowering: onnx.Cast

[ ] #554
[ ] #555

Failure - onnx_lowering: onnx.ReduceL2

[ ] "ReduceL2NormModule_basic",

Failure - onnx_lowering: onnx.ReduceSum

[ ] "ReduceL3NormKeepDimModule_basic",

Failure - cast error

[ ] "PermuteNegativeIndexModule_basic",

Failure - incorrect dtype

[ ] "ReduceMaxAlongDimUnsignedInt_basic",

Failure - onnx_lowering: onnx.Clip

[ ] "NormalizeModule_basic",

Failure - onnx_lowering: onnx.OneHot

[ ] "OneHotModule_basic",

Failure - torch.aten.view lower

[ ] "IndexTensorDyanmicInputContiguousWithNoneModule_basic",
[ ] "IndexTensorDyanmicInputNonContiguousWithNoneModule_basic",
[ ] "IndexTensorHackedTwinMultiInputNonContiguousMultipleStaticDims_basic",
[ ] "IndexTensorMultiInputContiguousCenter_basic",
[ ] "IndexTensorMultiInputNonContiguousMultipleStaticDims_basic",
[ ] "IndexTensorMultiInputNonContiguous_basic",
[ ] "IndexTensorMultiInputOneDim_basic",
[ ] "IndexTensorMultiInputThreeIndexers_basic",
[ ] "IndexTensorMultiInput_basic",
[ ] "ViewFlattenAndExpandModule_basic",
[ ] "ViewSizeDimFollowedByCollapsedOnesModule_basic",
[ ] "ViewSizeDimFollowedByExpandedOnesModule_basic",
[ ] "ViewSizeDimLedAndFollowedByCollapsedOnesModule_basic",
[ ] "ViewSizeDimLedAndFollowedByExpandedOnesModule_basic",
[ ] "ViewSizeDimLedByCollapsedOnesModule_basic",
[ ] "ViewSizeDimLedByExpandedOnesModule_basic",

Failure - unknown

[ ] "Conv2dWithPaddingDilationStrideStaticModule_depthwise_multiplier",
[ ] "CopyWithDifferentDTypesAndSizesModule_basic",
[ ] "CopyWithDifferentDTypesModule_basic",
[ ] "CosineSimilarityStaticBroadcastModule_basic",
[ ] "CumsumInputDtypeInt32Module_basic",
[ ] "ElementwiseAcosIntModule_basic",
[ ] "ElementwiseAsinIntModule_basic",
[ ] "ElementwiseAtanTensorIntModule_basic",
[ ] "ElementwiseCosIntModule_basic",
[ ] "ElementwiseDivRoundingModeTruncModule_basic",
[ ] "ElementwiseErfIntModule_basic",
[ ] #585
[ ] "ElementwiseLogIntModule_basic",
[x] #588
[ ] "ElementwiseSigmoidIntModule_basic",
[ ] "ElementwiseSinIntModule_basic",
[ ] "ElementwiseTanIntModule_basic",
[ ] "ElementwiseUnaryIntModule_basic",
[ ] "EmbeddingModuleF16_basic",
[ ] "EmbeddingModuleI32_basic",
[ ] "EmbeddingModuleI64_basic",
[ ] "FlattenDynamicModule_basic",
[ ] "GluStaticModule_basic",
[ ] "IndexTensorHackedTwinModule3dInput_basic",
[ ] "IndexTensorHackedTwinModule_basic",
[ ] "IndexTensorModule3dInput_basic",
[ ] "IndexTensorModule_basic",
[ ] "IndexTensorMultiInputContiguousOneDimDynamic_basic",
[ ] "IndexTensorMultiInputNonContiguousDynamic_basic",
[ ] "IndexTensorMultiInputNonContiguousOneDimDynamic_basic",
[ ] "IndexTensorSelectDimModule_basic",
[ ] "MaskedFillTensorFloatValueModule_basic",
[ ] "ReduceAllDimEmpty_basic",
[ ] "ReduceAllDimFloat_basic",
[ ] "ReduceAllDimInt_basic",
[ ] "ReduceMinAlongDimUnsignedInt_basic",

Failure - onnx_import

[x] #553
[ ] "DiagonalModule_nonsquare",
[ ] "DiagonalModule_transposed",
[ ] "DiagonalModule_with_dims",
[ ] "DiagonalModule_with_dims_and_offset",
[ ] "DiagonalModule_with_negative_dims",
[ ] "DiagonalModule_with_offset",
[ ] "AtenDiagEmbedDefaultDiag_basic",
[ ] "AtenDiagEmbedDimDiag_basic",
[ ] "AtenDiagEmbedOffsetDiag_basic",
[ ] "AtenDiagEmbedRevDimDiag_basic",
[ ] "AtenDiagEmbedNegOffsetDiag_basic",
[ ] "AtenDiagEmbedNonDefault4DDiag_basic",
[ ] "ScatterReduceFloatMaxModuleIncludeSelf",
[ ] "ScatterReduceFloatMinModuleIncludeSelf",
[ ] "ScatterReduceFloatProdModuleIncludeSelf",
[ ] "ScatterReduceFloatSumModuleIncludeSelf",
[ ] "ScatterReduceIntMaxModuleIncludeSelf",
[ ] "ScatterReduceIntMinModuleIncludeSelf",
[ ] "ScatterReduceIntProdModuleIncludeSelf",
[ ] "ScatterReduceIntSumModuleIncludeSelf",
[ ] "TileBigDimsSizeModule_basic",
[ ] "TileSmallDimsSizeModule_basic",
[ ] "LinalgNormKeepDimModule_basic",
[ ] "LinalgNormModule_basic",

Failure - "RuntimeError: linalg.cross: inputs dimension 1 must have length 3. Got 1 and 1"

[ ] "AtenLinalgCrossDynamic_basic"

Crashing tests

[ ] "FakeQuantizePerTensorAffineModule_basic",
[ ] "FakeQuantizePerTensorAffineDynamicShapeModule_basic",

Lower Priority:

Failure - onnx_export

[ ] "AdaptiveAvgPool1dGeneralDynamic_basic",
[ ] "AdaptiveAvgPool1dNonUnitOutputSizeDynamicModule_basic",
[ ] "AdaptiveAvgPool1dStaticLargerOutput_basic",
[ ] "AdaptiveAvgPool2dNonUnitOutputSizeDynamicModule_basic",
[ ] "AdaptiveMaxPool2dDynamicWithIndices_basic",
[ ] "AdaptiveMaxPool2dDynamic_basic",
[ ] "AdaptiveMaxPool2dStaticWithIndices_basic",
[ ] "AdaptiveMaxPool2dStatic_basic",
[ ] "AdaptiveMaxPool3dStatic_basic",
[ ] "AdaptiveMaxPool3dStaticWithIndices_basic",
[ ] "AdaptiveMaxPool3dDynamic_basic",
[ ] "AdaptiveMaxPool3dDynamicWithIndices_basic",
[ ] "AdaptiveMaxPool3dDynamicNoBatch_basic",
[ ] "AdaptiveMaxPool2dDynamicNoBatch_basic",
[ ] "AdaptiveMaxPool1dStatic_basic",
[ ] "AdaptiveMaxPool1dDynamic_basic",
[ ] "AdaptiveMaxPool1dDynamicNoBatch_basic",
[ ] "AdaptiveAvgPool3dDynamic_basic",
[ ] "AdaptiveAvgPool3dDynamicNoBatch_basic",
[ ] "AdaptiveAvgPool2dDynamic_basic",
[ ] "AdaptiveAvgPool2dDynamicNoBatch_basic",
[ ] "AddCDivModule_basic",
[ ] "AddIntModule_basic",
[ ] "Add_Module_basic",
[ ] "AllBoolFalseModule_basic",
[ ] "AllBoolTrueModule_basic",
[ ] "AnyBoolFalseModule_basic",
[ ] "AnyBoolTrueModule_basic",
[ ] "AtenComplex64Module_basic",
[ ] "AtenComplexImagModule_basic",
[ ] "AtenComplexRealModule_basic",
[ ] "AtenComplexViewModule_basic",
[ ] "AtenEmbeddingBagStaticModule_basic",
[ ] "AtenEmbeddingBagSumExample_basic",
[ ] "AtenFloatScalarModule_basic",
[ ] "AtenIntBoolOpConstFalseModule_basic",
[ ] "AtenIntBoolOpConstTrueModule_basic",
[ ] "AtenIntBoolOpModule_basic",
[ ] "AtenIntTensorByteDtypeModule_basic",
[ ] "AtenIntTensorCharDtypeModule_basic",
[ ] "AtenItemFpOpModule_basic",
[ ] "AtenItemIntOpModule_basic",
[ ] "AtenMmQuint8_basic",
[ ] "AtenRealView128Module_basic",
[ ] "AtenRealView64Module_basic",
[ ] "AtenSubFloatModule_basic",
[ ] "AtenTopKModule_basic",
[ ] "AtenTopKSmallestModule_basic",
[ ] "Aten_EmbeddingBagExample_basic",
[ ] "AvgPool2dWithoutPadModule_basic",
[ ] "BatchMlpLayerModule_basic",
[ ] "BincountMinlengthModule_basic",
[ ] "BincountModule_basic",
[ ] "BincountStaticSizeModule_basic",
[ ] "BoolFloatConstantModule_basic",
[ ] "BoolFloatFalseModule_basic",
[ ] "BoolFloatTrueModule_basic",
[ ] "BoolIntConstantModule_basic",
[ ] "BoolIntFalseModule_basic",
[ ] "BoolIntTrueModule_basic",
[ ] "CeilFloatModule_basic",
[ ] "ChunkListUnpackDynamic_Module_basic",
[ ] "ChunkListUnpackUnevenDynamic_Module_basic",
[ ] "CollapseAllDimensionsModule_basic",
[ ] "CollapseFullDynamicModule_basic",
[ ] "CollapsePartialDynamicModule_basic",
[ ] "CollapseRank1DynamicModule_basic",
[ ] "CollapseStaticModule_basic",
[ ] "ConstantBoolParameterModule_basic",
[ ] "ContainsIntList_False",
[ ] "ContainsIntList_True",
[ ] "Conv1dModule_basic",
[ ] "Conv2dBiasNoPaddingModule_basic",
[ ] "Conv2dModule_basic",
[ ] "Conv2dNoPaddingModule_basic",
[ ] "Conv2dQInt8Module_basic",
[ ] "Conv2dWithPaddingDilationStrideModule_basic",
[ ] "Conv2dWithPaddingModule_basic",
[ ] "Conv3dModule_basic",
[ ] "ConvTbcModule_basic",
[ ] "Conv_Transpose2dModule_basic",
[ ] "Convolution2DModule_basic",
[ ] "Convolution2DStridedModule_basic",
[ ] "ConvolutionBackwardModule2DPadded_basic",
[ ] "ConvolutionBackwardModule2DStatic_basic",
[ ] "ConvolutionBackwardModule2DStrided_basic",
[ ] "ConvolutionBackwardModule2D_basic",
[ ] "ConvolutionModule2DGroups_basic",
[ ] "ConvolutionModule2DTransposeNonUnitOutputPadding_basic",
[ ] "ConvolutionModule2DTransposeStrided_basic",
[ ] "ConvolutionModule2DTranspose_basic",
[ ] "DivFloatModule_basic",
[ ] "DivIntModule_basic",
[ ] "ElementwiseAcoshIntModule_basic",
[ ] "ElementwiseAcoshModule_basic",
[ ] "ElementwiseAsinhIntModule_basic",
[ ] "ElementwiseAsinhModule_basic",
[ ] "ElementwiseAtanhIntModule_basic",
[ ] "ElementwiseAtanhModule_basic",
[ ] "ElementwiseAtenIsneginfOpModule_basic",
[ ] "ElementwiseAtenIsposinfOpModule_basic",
[ ] "ElementwiseBitwiseAndModule_basic",
[ ] "ElementwiseBitwiseAndScalarInt32Module_basic",
[ ] "ElementwiseBitwiseAndScalarInt64Module_basic",
[ ] "ElementwiseBitwiseAndScalarInt8Module_basic",
[ ] "ElementwiseBitwiseAndStaticShapeModule_basic",
[ ] "ElementwiseBitwiseLeftShiftInt32Module_basic",
[ ] "ElementwiseBitwiseLeftShiftInt64Module_basic",
[ ] "ElementwiseBitwiseLeftShiftInt8Module_basic",
[ ] "ElementwiseBitwiseNotInt32Module_basic",
[ ] "ElementwiseBitwiseNotInt64Module_basic",
[ ] "ElementwiseBitwiseOrModule_basic",
[ ] "ElementwiseBitwiseOrStaticShapeModule_basic",
[ ] "ElementwiseBitwiseRightShiftInt32Module_basic",
[ ] "ElementwiseBitwiseRightShiftInt64Module_basic",
[ ] "ElementwiseBitwiseRightShiftInt8Module_basic",
[ ] "ElementwiseBitwiseXorModule_basic",
[ ] "ElementwiseBitwiseXorStaticShapeModule_basic",
[ ] "ElementwiseCoshIntModule_basic",
[ ] "ElementwiseCoshModule_basic",
[ ] "ElementwiseDequantizePerChannelModule_basic",
[ ] "ElementwiseDequantizePerTensorModule_basic",
[ ] "ElementwiseEluNonDefaultModule_basic",
[ ] "ElementwiseExpm1IntModule_basic",
[ ] "ElementwiseExpm1Module_basic",
[ ] "ElementwiseMulTensorComplexModule_basic",
[ ] "ElementwiseOrTensorModule_basic",
[ ] "ElementwiseOrTensorStaticShapeModule_basic",
[ ] "ElementwiseQuantizePerTensorModule_basic",
[ ] "ElementwiseQuantizePerTensorUIntModule_basic",
[ ] "ElementwiseRemainderTensorModule_Int_basic",
[ ] "ElementwiseFmodTensor_Int_basic",
[ ] "EmptyStridedModule_basic",
[ ] "EmptyStridedSizeIntStrideModule_basic",
[ ] "EqIntModule_basic",
[ ] "ExponentialModule_basic",
[ ] "FloatImplicitModule_basic",
[ ] "GeFloatIntModule_basic",
[ ] "GeFloatModule_basic",
[ ] "GeIntModule_basic",
[ ] "GeluBackwardModule_basic",
[ ] "GtFloatIntModule_basic",
[ ] "GtIntModule_basic",
[ ] "HardtanhBackward_basic",
[ ] "IndexPutImpl1DFloatAccumulateModule_basic",
[ ] "IndexPutImpl1DFloatNonAccumulateModule_basic",
[ ] "IndexPutImpl1DIntAccumulateModule_basic",
[ ] "IndexPutImpl1DIntNonAccumulateModule_basic",
[ ] "IndexPutImpl2DFloatAccumulateModule_basic",
[ ] "IndexPutImpl2DFloatNonAccumulateModule_basic",
[ ] "IndexPutImpl2DIndexModule_basic",
[ ] "IndexPutImpl2DNoneIndexStaticModule_basic",
[ ] "IndexPutImpl3DFloatAccumulateModule_basic",
[ ] "IndexPutImpl3DFloatNonAccumulateModule_basic",
[ ] "IndexPutImplIndexWithNoneModule_basic",
[ ] "IntFloatModule_basic",
[ ] "IntImplicitModule_basic",
[ ] "IouOfModule_basic",
[ ] "IsFloatingPointFloat_True",
[ ] "IsFloatingPointInt_False",
[ ] "IscloseStaticModuleTrue_basic",
[ ] "IscloseStaticModule_basic",
[ ] "LeakyReluBackwardModule_basic",
[ ] "LeakyReluBackwardStaticModule_basic",
[ ] "LenStrModule_basic",
[ ] "LiftFreshCopyModule_basic",
[ ] "LogSoftmaxBackwardModule_basic",
[ ] "MaxPool2dCeilModeTrueModule_basic",
[ ] "MaxPool2dModule_basic",
[ ] "MaxPool2dWithIndicesAllOnesModule_basic",
[ ] "MaxPool2dWithIndicesBackwardDynamic3DModule_basic",
[ ] "MaxPool2dWithIndicesBackwardDynamic4DModule_basic",
[ ] "MaxPool2dWithIndicesBackwardStatic3DModule_basic",
[ ] "MaxPool2dWithIndicesBackwardStatic4DModule_basic",
[ ] "MaxPool2dWithIndicesCeilModeTrueModule_basic",
[ ] "MaxPool2dWithIndicesFullSizeKernelModule_basic",
[ ] "MaxPool2dWithIndicesModule_basic",
[ ] "MaxPool2dWithIndicesNonDefaultDilationModule_basic",
[ ] "MaxPool2dWithIndicesNonDefaultParamsModule_basic",
[ ] "MaxPool2dWithIndicesNonDefaultStrideModule_basic",
[ ] "MaxPool3dCeilModeTrueModule_basic",
[ ] "MaxPool3dLargeDatadModule_basic",
[ ] "MaxPool3dModuleRandomSimple_basic",
[ ] "MaxPool3dModule_basic",
[ ] "MeanDimEmptyDimModule_basic",
[ ] "Mlp1LayerModule_basic",
[ ] "Mlp2LayerModuleNoBias_basic",
[ ] "Mlp2LayerModule_basic",
[ ] "MulFloatModule_basic",
[ ] "MulIntModule_basic",
[ ] "NarrowHorizontalTest2_basic",
[ ] "NarrowHorizontalTest_basic",
[ ] "NarrowTensorHorizontalModule_basic",
[ ] "NarrowTensorVerticalModule_basic",
[ ] "NarrowVerticalTest2_basic",
[ ] "NarrowVerticalTest_basic",
[ ] "NativeBatchNorm1DModule_basic",
[ ] "NativeBatchNorm2DModule_basic",
[ ] "NativeBatchNorm3DModule_basic",
[ ] "NativeBatchNormNoneWeightModule_basic",
[ ] "NativeDropoutEvalFloatModule_basic",
[ ] "NativeGroupNormBackwardModule_basic",
[ ] "NativeGroupNormModule_basic",
[ ] "NativeLayerNormDynamicModule_basic",
[ ] "NeFloatIntModule_basic",
[ ] "NeIntModule_basic",
[ ] "NewEmptyStridedModuleDefaultDtype_basic",
[ ] "NllLossModuleBackward1DMeanWeight_basic",
[ ] "NllLossModuleBackward1DMean_basic",
[ ] "NllLossModuleBackward1DSumWeight_basic",
[ ] "NllLossModuleBackward1DSum_basic",
[ ] "NllLossModuleBackward1DWeight_basic",
[ ] "NllLossModuleBackward1D_basic",
[ ] "NllLossModuleBackwardMeanWeight_basic",
[ ] "NllLossModuleBackwardMean_basic",
[ ] "NllLossModuleBackwardSumWeight_basic",
[ ] "NllLossModuleBackwardSum_basic",
[ ] "NllLossModuleBackwardWeight_basic",
[ ] "NllLossModuleBackward_basic",
[ ] "NllLossModuleBackward_ignore_index",
[ ] "NllLossModule_1D_basic",
[ ] "NllLossModule_basic",
[ ] "NllLossModule_ignore_index_out_of_bounds_basic",
[ ] "NllLossModule_mean_basic",
[ ] "NllLossModule_sum_basic",
[ ] "NormScalarModule_basic",
[ ] "NormScalarOptDimKeepDimModule_basic",
[ ] "NormScalarOptDimModule_basic",
[ ] "NormalFunctionalModule_basic",
[ ] "NumToTensorFloatModule_basic",
[ ] "NumToTensorIntModule_basic",
[ ] "NumelModule_basic",
[ ] "NumelZeroRankModule_basic",
[ ] "PixelShuffleModuleFullDynamic_basic",
[ ] "PixelShuffleModuleSpatiallyDynamic_basic",
[ ] "PixelShuffleModuleSpatiallyStatic_basic",
[ ] "PixelShuffleModuleStaticRank3Int64_basic",
[ ] "PowIntFloatModule_basic",
[ ] "PrimMaxIntModule_basic",
[ ] "PrimMinIntDynamicModule_basic",
[ ] "PrimMinIntModule_basic",
[ ] "PrimsConvertElementTypeModule_basic",
[ ] "PrimsSqueezeEmptyDimensionsModule_basic",
[ ] "PrimsSqueezeModule_basic",
[ ] "PrimsViewOfModule_basic",
[ ] "PrimsViewOfZeroRankModule_basic",
[ ] "RandIntDtypeModule_basic",
[ ] "RandIntModule_basic",
[ ] "RandIntPinMemoryModule_basic",
[ ] "ReshapeAliasCollapseModule_basic",
[ ] "ReshapeAliasExpandModule_basic",
[ ] "ReshapeExpandModule_basic",
[ ] "ScalarConstantTupleModule_basic",
[ ] "ScalarImplicitFloatModule_basic",
[ ] "ScalarImplicitIntModule_basic",
[ ] "ScatterReduceFloatMaxModule",
[ ] "ScatterReduceFloatMeanModule",
[ ] "ScatterReduceFloatMeanModuleIncludeSelf",
[ ] "ScatterReduceFloatMinModule",
[ ] "ScatterReduceFloatProdModule",
[ ] "ScatterReduceFloatSumModule",
[ ] "ScatterReduceIntMaxModule",
[ ] "ScatterReduceIntMeanModule",
[ ] "ScatterReduceIntMeanModuleIncludeSelf",
[ ] "ScatterReduceIntMinModule",
[ ] "ScatterReduceIntProdModule",
[ ] "ScatterReduceIntSumModule",
[ ] "SelectScattertModule_basic",
[ ] "SelectScattertStaticModule_basic",
[ ] "SliceEndSleStartModule_basic",
[ ] "SliceOutOfUpperBoundIndexModule_basic",
[ ] "SliceScatterModule_basic",
[ ] "SliceScatterNegativeDimModule_basic",
[ ] "SliceScatterNegativeEndModule_basic",
[ ] "SliceScatterStaticModule_basic",
[ ] "SliceScatterStepVariationModule_basic",
[ ] "SliceScatterZeroDimModule_basic",
[ ] "SliceStartEqEndModule_basic",
[ ] "SoftmaxBackwardModule_basic",
[ ] "SortIntListReverse_basic",
[ ] "SortIntList_basic",
[ ] "SplitDimDynamicModule_basic",
[ ] "SplitDimStaticModule_basic",
[ ] "SqrtIntConstantModule_basic",
[ ] "SqrtIntModule_basic",
[ ] "StdCorrectionEmptyDimModule_basic",
[ ] "StdDimEmptyDimModule_basic",
[ ] "SubFloatModule_basic",
[ ] "SubIntModule_basic",
[ ] "TanhBackward_basic",
[ ] "TensorToBoolZeroRank_basic",
[ ] "TensorToBool_basic",
[ ] "TensorToFloatZeroRank_basic",
[ ] "TensorToFloat_basic",
[ ] "TensorToIntZeroRank_basic",
[ ] "TensorToInt_basic",
[ ] "TestMultipleTensorAndPrimitiveTypesReturn_basic",
[ ] "Threshold1dFloatModule_basic",
[ ] "Threshold1dIntI32Module_basic",
[ ] "Threshold1dIntModule_basic",
[ ] "Threshold2dFloatModule_basic",
[ ] "Threshold2dIntModule_basic",
[ ] "Threshold3dFloatModule_basic",
[ ] "Threshold3dIntModule_basic",
[ ] "ThresholdBackward1dFloatModule_basic",
[ ] "ThresholdBackward1dIntModule_basic",
[ ] "ThresholdBackward1dMixedModule_basic",
[ ] "ThresholdBackward2dFloatModule_basic",
[ ] "ThresholdBackward2dIntModule_basic",
[ ] "ThresholdBackward2dMixedModule_basic",
[ ] "ThresholdBackward3dFloatModule_basic",
[ ] "ThresholdBackward3dIntModule_basic",
[ ] "ThresholdBackward3dMixedModule_basic",
[ ] "ToCopyBoolDTypeStaticModule_basic",
[ ] "ToCopyModule_basic",
[ ] "ToCopyWithDTypeFalsePinMemoryModule_basic",
[ ] "ToCopyWithDTypeModule_basic",
[ ] "TorchPrimLoopForLikeModule_basic",
[ ] "TorchPrimLoopWhileLikeModule_basic",
[ ] "TraceModule_basic",
[ ] "TraceModule_empty",
[ ] "TraceModule_nonsquare",
[ ] "TraceSignedIntModule_basic",
[ ] "TraceUnsignedIntModule_basic",
[ ] "TraceUnsignedIntModule_empty",
[ ] "UniformModule_basic",
[ ] "UniformNoCorrelationModule_basic",
[ ] "UniformStaticShapeModule_basic",
[ ] "UnsafeIndexPutHackedTwin1DFloatNonAccumulateModule_basic",
[ ] "UnsafeView1DFoldModule_basic",
[ ] "UnsafeViewCollapseDynamicWithAtenSizeIntModule_basic",
[ ] "UnsafeViewCollapseModule_basic",
[ ] "UnsafeViewDynamicExpandModule_basic",
[ ] "UnsafeViewDynamicExpandWithAtenSizeIntModule_basic",
[ ] "UnsafeViewExpandModule_basic",
[ ] "UpSampleNearest2dBackwardScalesNone_basic",
[ ] "UpSampleNearest2dBackward_basic",
[ ] "UpSampleNearest2dDynamicFactor_basic",
[ ] "UpSampleNearest2dStaticFactor_basic",
[ ] "UpSampleNearest2d_basic",
[ ] "VarCorrectionEmptyDimModule_basic",
[ ] "VarDimEmptyDimModule_basic",
[ ] "ViewCollapseDynamicWithAtenSizeIntModule_basic",
[ ] "ViewCollapseModule_basic",
[ ] "ViewDynamicExpandCollapseModule_basic",
[ ] "ViewDynamicExpandCollapseWithAtenIntModule_basic",
[ ] "ViewDynamicExpandModule_basic",
[ ] "ViewDynamicExpandWithAtenSizeIntModule_basic",
[ ] "ViewExpandDynamicDimModule_basic",
[ ] "ViewNoChange1dModule_basic",
[ ] "ViewNoChange2dModule_basic",
[ ] "ViewNoChange3dModule_basic",
[ ] "_Convolution2DAllFalseModule_basic",
[ ] "_Convolution2DBenchmarkModule_basic",
[ ] "_Convolution2DCudnnModule_basic",
[ ] "_Convolution2DDeterministicModule_basic",
[ ] "_Convolution2DTF32Module_basic",
[ ] "_ConvolutionDeprecated2DAllFalseModule_basic",
[ ] "_ConvolutionDeprecated2DBenchmarkModule_basic",
[ ] "_ConvolutionDeprecated2DCudnnModule_basic",
[ ] "_ConvolutionDeprecated2DDeterministicModule_basic",
[ ] "_SoftmaxModule_basic",

Fixed:

[x] #550
[x] #551
[x] #552
[x] "AdaptiveAvgPool1dNonUnitOutputSizeStaticModule_basic",
[x] "AdaptiveAvgPool1dStaticEvenMultiple_basic",
[x] "AdaptiveAvgPool2dNonUnitOutputSizeStaticModule_basic",
[x] "AvgPool1dFloatModule_basic",
[x] "AvgPool1dIntModule_basic",
[x] "AvgPool1dStaticModule_basic",
[x] "AvgPool2dCeilModeTrueModule_basic",
[x] "AvgPool2dFloatModule_basic",
[x] "AvgPool2dIntModule_basic",
[x] "AvgPool2dStaticModule_basic",
[x] #556
[x] "EinsumStaticContractRhsModule_basic",
[x] "EinsumStaticFourDimensionModule_basic",
[x] "EinsumStaticModule_basic",
[x] "MseLossSumReductionWithDifferentElemTypeModule_basic",
[x] "ReduceL3NormAllDimsModule_basic",
[x] "ReduceSumDtypeFloatModule_basic",
[x] "ReduceSumDtypeIntModule_basic",
[x] "ReduceSumElementTypeBoolModule_basic",
[x] "ReduceSumFloatModule_basic",
[x] "ReduceSumSignedIntModule_basic",
[x] "ReduceSumUnsignedIntModule_basic",
[x] "SortTensorDescending_basic",
[x] "SortTensorInteger_basic",
[x] "SortTensorNegativeDimension_basic",
[x] "SortTensorSpecificDimension_basic",
[x] "SortTensor_basic",
[x] #590
[x] #591
[x] "BucketizeTensorStaticFloatModule_basic",
[x] "BucketizeTensorStaticModule_basic",
[x] "ElementwiseUnsqueezeNegDimsModule_basic",
[x] "GroupNormModule_basic",
[x] "TensorsStackNegativeDimModule_basic",
[x] "TensorsStackPromoteDTypeModule_basic",

nod-ai / SHARK-ModelDev

[Tracking] E2E Tests (torch->onnx->torch->linalg) #549

Higher Priority:

Failure - incorrect numerics

Failure - incorrect shape

Failure - onnx_lowering: onnx.RandomNormal

Failure - onnx_lowering: onnx.RandomNormalLike

Failure - onnx_lowering: onnx.RandomUniform

Failure - onnx_lowering: onnx.RandomUniformLike

Failure - onnx_lowering: onnx.ReduceProd

Failure - onnx_lowering: onnx.Pad

Failure - onnx_lowering: onnx.ScatterND

Failure - onnx_lowering: onnx.ScatterElements

Failure - onnx_lowering: onnx.Squeeze

Failure - onnx_lowering: onnx.MaxPool

Failure - onnx_lowering: onnx.ReduceL1

Failure - onnx_lowering: onnx.Resize

Failure - onnx_lowering: onnx.AveragePool

Failure - onnx_lowering: onnx.SoftmaxCrossEntropyLoss

Failure - onnx_lowering: onnx.Cast

Failure - onnx_lowering: onnx.ReduceL2

Failure - onnx_lowering: onnx.ReduceSum

Failure - cast error

Failure - incorrect dtype

Failure - onnx_lowering: onnx.Clip

Failure - onnx_lowering: onnx.OneHot

Failure - torch.aten.view lower

Failure - unknown

Failure - onnx_import

Failure - "RuntimeError: linalg.cross: inputs dimension 1 must have length 3. Got 1 and 1"

Crashing tests

Lower Priority:

Failure - onnx_export

Fixed: