intel / torch-xpu-ops

Apache License 2.0
30 stars 21 forks source link

Add aten::_transformer_encoder_layer_fwd operator #1069

Open yucai-intel opened 1 week ago

yucai-intel commented 1 week ago

Skipped: test_nn_xpu.py::TestNNDeviceTypeXPU::test_TransformerDecoderLayer_empty_xpu test_nn_xpu.py::TestNNDeviceTypeXPU::test_TransformerDecoderLayer_empty_xpu test_nn_xpu.py::TestNNDeviceTypeXPU::test_TransformerDecoder_empty_xpu test_nn_xpu.py::TestNNDeviceTypeXPU::test_Transformer_empty_xpu

Reason: Double and complex datatype matmul is not supported in oneDNN

yucai-intel commented 1 week ago

Passed: 2024-11-12T08:29:28.2253399Z test_modules_xpu.py::TestModuleXPU::test_factory_kwargs_nn_TransformerEncoderLayer_eval_mode_xpu_float32 PASSED [ 23%] 2024-11-12T08:29:28.2891396Z test_modules_xpu.py::TestModuleXPU::test_factory_kwargs_nn_TransformerEncoderLayer_eval_mode_xpu_float64 PASSED [ 23%] 2024-11-12T08:29:28.3590552Z test_modules_xpu.py::TestModuleXPU::test_factory_kwargs_nn_TransformerEncoderLayer_train_mode_xpu_float32 PASSED [ 23%] 2024-11-12T08:29:28.4297395Z test_modules_xpu.py::TestModuleXPU::test_factory_kwargs_nn_TransformerEncoderLayer_train_mode_xpu_float64 PASSED [ 23%] 2024-11-12T08:29:34.1619525Z test_modules_xpu.py::TestModuleXPU::test_forward_nn_TransformerEncoderLayer_eval_mode_xpu_float32 PASSED [ 30%] 2024-11-12T08:29:34.3106059Z test_modules_xpu.py::TestModuleXPU::test_forward_nn_TransformerEncoderLayer_train_mode_xpu_float32 PASSED [ 30%] 2024-11-12T08:29:45.0688168Z test_modules_xpu.py::TestModuleXPU::test_if_train_and_eval_modes_differ_nn_TransformerDecoderLayer_xpu_float32 PASSED [ 43%] 2024-11-12T08:29:45.1133936Z test_modules_xpu.py::TestModuleXPU::test_if_train_and_eval_modes_differ_nn_TransformerEncoderLayer_xpu_float32 PASSED [ 43%] 2024-11-12T08:30:09.9379150Z test_modules_xpu.py::TestModuleXPU::test_non_contiguous_tensors_nn_TransformerEncoderLayer_eval_mode_xpu_float32 PASSED [ 65%] 2024-11-12T08:30:10.6821987Z test_modules_xpu.py::TestModuleXPU::test_non_contiguous_tensors_nn_TransformerEncoderLayer_train_mode_xpu_float32 PASSED [ 65%] 2024-11-12T08:30:17.2118296Z test_modules_xpu.py::TestModuleXPU::test_repr_nn_TransformerEncoderLayer_eval_mode_xpu_float32 PASSED [ 72%] 2024-11-12T08:30:17.2307973Z test_modules_xpu.py::TestModuleXPU::test_repr_nn_TransformerEncoderLayer_eval_mode_xpu_float64 PASSED [ 72%] 2024-11-12T08:30:17.2485095Z test_modules_xpu.py::TestModuleXPU::test_repr_nn_TransformerEncoderLayer_train_mode_xpu_float32 PASSED [ 72%] 2024-11-12T08:30:17.2696355Z test_modules_xpu.py::TestModuleXPU::test_repr_nn_TransformerEncoderLayer_train_mode_xpu_float64 PASSED [ 72%] 2024-11-12T08:30:23.9521383Z test_modules_xpu.py::TestModuleXPU::test_save_load_nn_TransformerEncoderLayer_eval_mode_xpu_float32 PASSED [ 79%] 2024-11-12T08:30:24.3319295Z test_modules_xpu.py::TestModuleXPU::test_save_load_nn_TransformerEncoderLayer_train_mode_xpu_float32 PASSED [ 79%] 2024-11-12T08:30:28.2797438Z test_modules_xpu.py::TestModuleXPU::test_to_empty_nn_TransformerEncoderLayer_eval_mode_swap_False_xpu_float32 PASSED [ 86%] 2024-11-12T08:30:28.3082916Z test_modules_xpu.py::TestModuleXPU::test_to_empty_nn_TransformerEncoderLayer_eval_mode_swap_True_xpu_float32 PASSED [ 86%] 2024-11-12T08:30:28.3394529Z test_modules_xpu.py::TestModuleXPU::test_to_empty_nn_TransformerEncoderLayer_train_mode_swap_False_xpu_float32 PASSED [ 86%] 2024-11-12T08:30:28.3721485Z test_modules_xpu.py::TestModuleXPU::test_to_empty_nn_TransformerEncoderLayer_train_mode_swap_True_xpu_float32 PASSED [ 86%] 2024-11-12T08:30:31.7270981Z test_modules_xpu.py::TestModuleXPU::test_to_nn_TransformerEncoderLayer_eval_mode_swap_False_set_grad_False_xpu_float32 PASSED [ 99%] 2024-11-12T08:30:31.7678920Z test_modules_xpu.py::TestModuleXPU::test_to_nn_TransformerEncoderLayer_eval_mode_swap_False_set_grad_True_xpu_float32 PASSED [ 99%] 2024-11-12T08:30:31.8986542Z test_modules_xpu.py::TestModuleXPU::test_to_nn_TransformerEncoderLayer_eval_mode_swap_True_set_grad_False_xpu_float32 PASSED [ 99%] 2024-11-12T08:30:31.9280898Z test_modules_xpu.py::TestModuleXPU::test_to_nn_TransformerEncoderLayer_train_mode_swap_False_set_grad_False_xpu_float32 PASSED [ 99%] 2024-11-12T08:30:31.9727896Z test_modules_xpu.py::TestModuleXPU::test_to_nn_TransformerEncoderLayer_train_mode_swap_False_set_grad_True_xpu_float32 PASSED [ 99%] 2024-11-12T08:30:32.1181175Z test_modules_xpu.py::TestModuleXPU::test_to_nn_TransformerEncoderLayer_train_mode_swap_True_set_grad_False_xpu_float32 PASSED [ 99%]