ROCm / transformers

🤗Transformers: State-of-the-art Natural Language Processing for Pytorch and TensorFlow 2.0.
https://huggingface.co/transformers
Apache License 2.0
4 stars 6 forks source link

Rebase Approval for Branches #48

Closed Cemberk closed 2 months ago

Cemberk commented 2 months ago

This issue contains the test results for the upstream sync, develop PR, and release testing branches. Comment 'proceed with rebase' to approve. Close when maintenance is complete or there will be problems on the next run.

Cemberk commented 2 months ago

Unit Test Results for sync upstream_sync_test

reports/huggingface_unit_tests__run_models_gpu_generation/stats.txt

==== 102 passed, 81 skipped, 22 deselected, 94 warnings in 75.27s (0:01:15) ==== reports/huggingface_unit_testsrun_models_gpu_pipelines/stats.txt = 2 failed, 119 passed, 167 skipped, 4 deselected, 111 warnings in 131.26s (0:02:11) = reports/huggingface_unit_tests__run_models_gpu_extended/stats.txt ======== 1 failed, 2 passed, 7 skipped, 25 warnings in 94.95s (0:01:34) ======== reports/huggingface_unit_testsrun_models_gpu_sagemaker/stats.txt ======================== 7 skipped, 1 warning in 0.02s ========================= reports/huggingface_unit_testsrun_models_gpu_peft_integration/stats.txt ======================== 15 skipped, 1 warning in 0.02s ======================== reports/huggingface_unit_testsrun_models_gpu_tokenization/stats.txt ====================== 119 deselected, 1 warning in 0.70s ====================== reports/huggingface_unit_testsrun_models_gpu_bettertransformer/stats.txt ======================== 2 skipped, 1 warning in 0.01s ========================= reports/huggingface_unit_tests__run_modelsgpupycache/stats.txt ============================== 1 warning in 0.01s ============================== reports/huggingface_unit_testsrun_models_gpu_trainer/stats.txt = 4 failed, 95 passed, 51 skipped, 91 deselected, 173 warnings in 83.49s (0:01:23) = reports/huggingface_unit_testsrun_models_gpu_utils/stats.txt ===================== 467 deselected, 12 warnings in 3.82s ===================== reports/huggingface_unit_tests__run_models_gpu_agents/stats.txt ===================== 119 deselected, 11 warnings in 1.31s ===================== reports/huggingface_unit_testsrun_models_gpu_quantization/stats.txt ===== 1 failed, 16 passed, 247 skipped, 1 deselected, 11 warnings in 1.38s ===== reports/huggingface_unit_testsrun_models_gpu_optimization/stats.txt ====================== 6 deselected, 11 warnings in 0.45s ====================== reports/huggingface_unit_testsrun_models_gpu_repo_utils/stats.txt ===================== 32 deselected, 11 warnings in 0.73s ====================== reports/huggingface_unit_testsrun_models_gpu_deepspeed/stats.txt ======================= 151 skipped, 2 warnings in 1.65s ======================= reports/huggingface_unit_testsrun_models_gpu_fixtures/stats.txt ============================== 1 warning in 0.01s ============================== reports/huggingface_unit_testsrun_models_gpu_fsdp/stats.txt ============= 4 failed, 4 passed, 9 skipped, 11 warnings in 2.06s ============== reports/huggingface_unit_tests__run_models_gpu_benchmark/stats.txt ================= 13 passed, 11 skipped, 31 warnings in 5.30s ================== reports/huggingface_unit_testsrun_models_gpu_models/falcon/stats.txt ========= 72 passed, 47 skipped, 77 deselected, 21 warnings in 17.33s ========== reports/huggingface_unit_testsrun_models_gpu_models/ctrl/stats.txt ========= 58 passed, 91 skipped, 233 deselected, 17 warnings in 23.08s ========= reports/huggingface_unit_tests__run_models_gpu_models/xlm/stats.txt ======== 58 passed, 100 skipped, 234 deselected, 17 warnings in 17.95s ========= reports/huggingface_unit_testsrun_models_gpu_models/sew_d/stats.txt ========== 24 passed, 49 skipped, 78 deselected, 28 warnings in 7.99s ========== reports/huggingface_unit_testsrun_models_gpu_models/bark/stats.txt ========= 136 passed, 158 skipped, 74 deselected, 36 warnings in 7.67s ========= reports/huggingface_unit_tests__run_models_gpu_models/nougat/stats.txt ===================== 133 deselected, 11 warnings in 1.29s ===================== reports/huggingface_unit_testsrun_models_gpu_models/cpm/stats.txt ===================== 385 deselected, 12 warnings in 2.40s ===================== reports/huggingface_unit_testsrun_models_gpu_models/pop2piano/stats.txt ==== 1 failed, 73 passed, 50 skipped, 115 deselected, 18 warnings in 21.98s ==== reports/huggingface_unit_tests__run_models_gpu_models/layoutlmv2/stats.txt =============== 72 skipped, 230 deselected, 12 warnings in 2.60s =============== reports/huggingface_unit_testsrun_models_gpu_models/instructblip/stats.txt ========= 79 passed, 100 skipped, 64 deselected, 14 warnings in 10.41s ========= reports/huggingface_unit_testsrun_models_gpu_models/seamless_m4t/stats.txt ======== 69 passed, 169 skipped, 184 deselected, 30 warnings in 30.88s ========= reports/huggingface_unit_testsrun_models_gpu_models/bert/stats.txt ======== 79 passed, 139 skipped, 257 deselected, 19 warnings in 17.39s ========= reports/huggingface_unit_testsrun_models_gpu_models/markuplm/stats.txt ========= 35 passed, 35 skipped, 189 deselected, 18 warnings in 8.60s ========== reports/huggingface_unit_testsrun_models_gpu_models/visual_bert/stats.txt ========== 31 passed, 46 skipped, 77 deselected, 12 warnings in 9.08s ========== reports/huggingface_unit_testsrun_models_gpu_models/ibert/stats.txt ========= 40 passed, 45 skipped, 77 deselected, 13 warnings in 13.79s ========== reports/huggingface_unit_testsrun_models_gpu_models/megatron_bert/stats.txt ========= 39 passed, 35 skipped, 77 deselected, 15 warnings in 12.15s ========== reports/huggingface_unit_testsrun_models_gpu_models/nemotron/stats.txt ======== 145 passed, 85 skipped, 154 deselected, 28 warnings in 24.73s ========= reports/huggingface_unit_tests__run_models_gpu_models/poolformer/stats.txt ========= 18 passed, 50 skipped, 94 deselected, 12 warnings in 10.97s ========== reports/huggingface_unit_testsrun_models_gpu_models/vitdet/stats.txt ========== 24 passed, 49 skipped, 80 deselected, 12 warnings in 7.67s ========== reports/huggingface_unit_testsrun_models_gpu_models/qwen2_vl/stats.txt ========= 54 passed, 58 skipped, 41 deselected, 17 warnings in 10.90s ========== reports/huggingface_unit_testsrun_models_gpu_models/timm_backbone/stats.txt ========== 23 passed, 49 skipped, 79 deselected, 12 warnings in 8.90s ========== reports/huggingface_unit_testsrun_models_gpu_models/convbert/stats.txt ========= 34 passed, 85 skipped, 136 deselected, 12 warnings in 9.96s ========== reports/huggingface_unit_tests__run_models_gpu_models/xlm_roberta_xl/stats.txt ========= 72 passed, 49 skipped, 77 deselected, 20 warnings in 21.93s ========== reports/huggingface_unit_testsrun_models_gpu_models/vitmatte/stats.txt ========== 20 passed, 49 skipped, 94 deselected, 12 warnings in 9.35s ========== reports/huggingface_unit_testsrun_models_gpu_models/pix2struct/stats.txt === 1 failed, 64 passed, 141 skipped, 176 deselected, 14 warnings in 11.51s ==== reports/huggingface_unit_tests__run_models_gpu_models/fnet/stats.txt ========= 29 passed, 48 skipped, 179 deselected, 12 warnings in 8.61s ========== reports/huggingface_unit_testsrun_models_gpu_models/olmoe/stats.txt ========= 72 passed, 42 skipped, 77 deselected, 21 warnings in 17.31s ========== reports/huggingface_unit_testsrun_models_gpu_models/vision_text_dual_encoder/stats.txt ========== 15 passed, 39 skipped, 18 deselected, 13 warnings in 3.19s ========== reports/huggingface_unit_testsrun_models_gpu_models/swiftformer/stats.txt ========= 23 passed, 84 skipped, 136 deselected, 12 warnings in 21.02s ========= reports/huggingface_unit_testsrun_models_gpu_models/mask2former/stats.txt ========= 26 passed, 49 skipped, 105 deselected, 12 warnings in 8.58s ========== reports/huggingface_unit_testsrun_models_gpu_models/bert_generation/stats.txt ========= 65 passed, 104 skipped, 125 deselected, 17 warnings in 7.91s ========= reports/huggingface_unit_testsrun_models_gpu_models/mobilenet_v1/stats.txt ========= 23 passed, 46 skipped, 94 deselected, 13 warnings in 13.34s ========== reports/huggingface_unit_tests__run_models_gpu_models/mobilebert/stats.txt ========= 40 passed, 78 skipped, 250 deselected, 12 warnings in 13.39s ========= reports/huggingface_unit_testsrun_models_gpu_models/sew/stats.txt ========== 26 passed, 49 skipped, 78 deselected, 31 warnings in 8.29s ========== reports/huggingface_unit_testsrun_models_gpu_models/barthez/stats.txt ====================== 100 deselected, 1 warning in 0.65s ====================== reports/huggingface_unit_testsrun_models_gpu_models/big_bird/stats.txt ========= 35 passed, 81 skipped, 182 deselected, 15 warnings in 13.87s ========= reports/huggingface_unit_testsrun_models_gpu_models/deberta/stats.txt ========= 33 passed, 82 skipped, 235 deselected, 12 warnings in 9.45s ========== reports/huggingface_unit_testsrun_models_gpu_models/deit/stats.txt ========= 22 passed, 90 skipped, 153 deselected, 13 warnings in 11.40s ========= reports/huggingface_unit_testsrun_models_gpu_models/stablelm/stats.txt ========= 74 passed, 45 skipped, 77 deselected, 21 warnings in 19.02s ========== reports/huggingface_unit_tests__run_models_gpu_models/mamba/stats.txt ==== 2 failed, 49 passed, 72 skipped, 77 deselected, 16 warnings in 42.55s ===== reports/huggingface_unit_testsrun_models_gpu_models/bigbird_pegasus/stats.txt === 1 failed, 102 passed, 123 skipped, 100 deselected, 23 warnings in 29.83s === reports/huggingface_unit_testsrun_models_gpu_models/hubert/stats.txt ========= 51 passed, 186 skipped, 166 deselected, 14 warnings in 9.93s ========= reports/huggingface_unit_tests__run_models_gpu_models/rag/stats.txt =========== 18 skipped, 11 deselected, 12 warnings, 1 error in 2.58s =========== reports/huggingface_unit_testsrun_models_gpu_models/musicgen_melody/stats.txt === 2 failed, 123 passed, 155 skipped, 73 deselected, 68 warnings in 10.68s ==== reports/huggingface_unit_testsrun_models_gpu_models/distilbert/stats.txt ======== 41 passed, 105 skipped, 368 deselected, 12 warnings in 11.32s ========= reports/huggingface_unit_tests__run_models_gpu_models/bloom/stats.txt ========= 76 passed, 91 skipped, 179 deselected, 62 warnings in 24.47s ========= reports/huggingface_unit_testsrun_models_gpu_models/biogpt/stats.txt ========= 66 passed, 53 skipped, 175 deselected, 19 warnings in 11.44s ========= reports/huggingface_unit_testsrun_models_gpu_models/swinv2/stats.txt ========= 30 passed, 49 skipped, 81 deselected, 14 warnings in 15.37s ========== reports/huggingface_unit_tests__run_models_gpu_models/sam/stats.txt ========= 19 passed, 111 skipped, 145 deselected, 12 warnings in 6.43s ========= reports/huggingface_unit_testsrun_models_gpu_models/perceiver/stats.txt ========= 25 passed, 52 skipped, 179 deselected, 12 warnings in 6.73s ========== reports/huggingface_unit_testsrun_models_gpu_models/resnet/stats.txt ======== 30 passed, 116 skipped, 142 deselected, 15 warnings in 13.38s ========= reports/huggingface_unit_tests__run_models_gpu_models/convnextv2/stats.txt ========= 22 passed, 85 skipped, 135 deselected, 12 warnings in 12.22s ========= reports/huggingface_unit_testsrun_models_gpu_models/unispeech_sat/stats.txt ========= 55 passed, 98 skipped, 102 deselected, 19 warnings in 16.76s ========= reports/huggingface_unit_testsrun_models_gpu_models/zoedepth/stats.txt ========== 20 passed, 50 skipped, 96 deselected, 12 warnings in 7.13s ========== reports/huggingface_unit_tests__run_models_gpu_models/instructblipvideo/stats.txt ========= 80 passed, 99 skipped, 81 deselected, 14 warnings in 12.31s ========== reports/huggingface_unit_testsrun_models_gpu_models/imagegpt/stats.txt ==== 1 failed, 58 passed, 52 skipped, 96 deselected, 95 warnings in 16.18s ===== reports/huggingface_unit_testsrun_models_gpu_models/speech_to_text/stats.txt ======== 51 passed, 107 skipped, 294 deselected, 19 warnings in 11.75s ========= reports/huggingface_unit_tests__run_models_gpu_models/openai/stats.txt ========= 53 passed, 99 skipped, 330 deselected, 17 warnings in 8.85s ========== reports/huggingface_unit_testsrun_models_gpu_models/patchtst/stats.txt ========== 24 passed, 45 skipped, 78 deselected, 16 warnings in 7.90s ========== reports/huggingface_unit_testsrun_models_gpu_models/gpt_neox_japanese/stats.txt ========= 72 passed, 94 skipped, 121 deselected, 24 warnings in 20.08s ========= reports/huggingface_unit_tests__run_models_gpu_models/videomae/stats.txt ========== 24 passed, 46 skipped, 94 deselected, 14 warnings in 7.34s ========== reports/huggingface_unit_testsrun_models_gpu_models/mamba2/stats.txt ===== 1 failed, 36 passed, 72 skipped, 76 deselected, 14 warnings in 9.47s ===== reports/huggingface_unit_testsrun_models_gpu_models/layoutxlm/stats.txt ===================== 121 deselected, 11 warnings in 1.26s ===================== reports/huggingface_unit_tests__run_models_gpu_models/phi/stats.txt ========= 73 passed, 43 skipped, 77 deselected, 21 warnings in 19.02s ========== reports/huggingface_unit_testsrun_models_gpu_models/univnet/stats.txt ========== 15 passed, 56 skipped, 48 deselected, 10 warnings in 2.02s ========== reports/huggingface_unit_testsrun_models_gpu_models/luke/stats.txt ========= 36 passed, 44 skipped, 193 deselected, 12 warnings in 24.97s ========= reports/huggingface_unit_tests__run_models_gpu_models/udop/stats.txt ========= 46 passed, 90 skipped, 224 deselected, 15 warnings in 13.94s ========= reports/huggingface_unit_testsrun_models_gpu_models/nllb_moe/stats.txt ========= 64 passed, 53 skipped, 77 deselected, 19 warnings in 18.50s ========== reports/huggingface_unit_testsrun_models_gpu_models/upernet/stats.txt ========== 23 passed, 48 skipped, 77 deselected, 13 warnings in 7.95s ========== reports/huggingface_unit_tests__run_models_gpu_models/siglip/stats.txt ======== 72 passed, 186 skipped, 323 deselected, 13 warnings in 13.45s ========= reports/huggingface_unit_testsrun_models_gpu_models/patchtsmixer/stats.txt ========= 622 passed, 46 skipped, 78 deselected, 14 warnings in 12.02s ========= reports/huggingface_unit_testsrun_models_gpu_models/llava_onevision/stats.txt ========== 47 passed, 66 skipped, 56 deselected, 20 warnings in 8.03s ========== reports/huggingface_unit_testsrun_models_gpu_models/bert_japanese/stats.txt ====================== 227 deselected, 1 warning in 0.66s ====================== reports/huggingface_unit_testsrun_models_gpu_models/bertweet/stats.txt ====================== 97 deselected, 1 warning in 0.66s ======================= reports/huggingface_unit_tests__run_models_gpu_models/vits/stats.txt ========= 15 passed, 51 skipped, 176 deselected, 12 warnings in 7.49s ========== reports/huggingface_unit_testsrun_models_gpu_models/pycache/stats.txt ============================= 2 warnings in 0.01s ============================== reports/huggingface_unit_testsrun_models_gpu_models/speech_encoder_decoder/stats.txt ============= 18 passed, 4 skipped, 15 warnings, 1 error in 3.82s ============== reports/huggingface_unit_tests__run_models_gpu_models/audio_spectrogram_transformer/stats.txt ========= 21 passed, 41 skipped, 117 deselected, 14 warnings in 6.62s ========== reports/huggingface_unit_testsrun_models_gpu_models/camembert/stats.txt ================ 3 skipped, 100 deselected, 1 warning in 0.83s ================= reports/huggingface_unit_testsrun_models_gpu_models/fastspeech2_conformer/stats.txt ==== 2 failed, 39 passed, 98 skipped, 147 deselected, 10 warnings in 14.65s ==== reports/huggingface_unit_testsrun_models_gpu_models/nllb/stats.txt ====================== 106 deselected, 1 warning in 0.85s ====================== reports/huggingface_unit_testsrun_models_gpu_models/m2m_100/stats.txt ========= 62 passed, 52 skipped, 184 deselected, 19 warnings in 15.94s ========= reports/huggingface_unit_testsrun_models_gpu_models/blenderbot_small/stats.txt === 114 passed, 142 skipped, 258 deselected, 24 warnings, 1 error in 12.85s ==== reports/huggingface_unit_testsrun_models_gpu_models/umt5/stats.txt ==== 2 failed, 78 passed, 98 skipped, 153 deselected, 16 warnings in 32.21s ==== reports/huggingface_unit_tests__run_models_gpu_models/kosmos2/stats.txt ========= 23 passed, 45 skipped, 96 deselected, 14 warnings in 13.30s ========== reports/huggingface_unit_testsrun_models_gpu_models/pvt/stats.txt ========= 22 passed, 48 skipped, 94 deselected, 12 warnings in 12.51s ========== reports/huggingface_unit_testsrun_models_gpu_models/wav2vec2/stats.txt ======== 74 passed, 247 skipped, 316 deselected, 42 warnings in 24.67s ========= reports/huggingface_unit_tests__run_models_gpu_models/splinter/stats.txt ========== 35 passed, 41 skipped, 77 deselected, 12 warnings in 7.83s ========== reports/huggingface_unit_testsrun_models_gpu_models/recurrent_gemma/stats.txt ========== 54 passed, 59 skipped, 77 deselected, 16 warnings in 7.90s ========== reports/huggingface_unit_testsrun_models_gpu_models/granite/stats.txt ========= 69 passed, 44 skipped, 77 deselected, 21 warnings in 13.49s ========== reports/huggingface_unit_tests__run_models_gpu_models/idefics2/stats.txt ========== 86 passed, 90 skipped, 64 deselected, 16 warnings in 7.20s ========== reports/huggingface_unit_testsrun_models_gpu_models/encodec/stats.txt ========= 17 passed, 52 skipped, 99 deselected, 32 warnings in 11.40s ========== reports/huggingface_unit_testsrun_models_gpu_models/fsmt/stats.txt ================= 101 deselected, 1 warning, 1 error in 0.74s ================== reports/huggingface_unit_tests__run_models_gpu_models/vision_encoder_decoder/stats.txt =========== 22 skipped, 3 deselected, 12 warnings, 1 error in 2.62s ============ reports/huggingface_unit_testsrun_models_gpu_models/mt5/stats.txt ========= 97 passed, 95 skipped, 155 deselected, 26 warnings in 38.79s ========= reports/huggingface_unit_testsrun_models_gpu_models/prophetnet/stats.txt ======== 124 passed, 169 skipped, 236 deselected, 21 warnings in 14.44s ======== reports/huggingface_unit_tests__run_models_gpu_models/swin/stats.txt ========= 32 passed, 86 skipped, 139 deselected, 14 warnings in 13.11s ========= reports/huggingface_unit_testsrun_models_gpu_models/seamless_m4t_v2/stats.txt ========= 71 passed, 114 skipped, 48 deselected, 37 warnings in 25.92s ========= reports/huggingface_unit_testsrun_models_gpu_models/vipllava/stats.txt ========== 23 passed, 45 skipped, 23 deselected, 24 warnings in 4.98s ========== reports/huggingface_unit_tests__run_models_gpu_models/regnet/stats.txt ======== 23 passed, 116 skipped, 138 deselected, 12 warnings in 11.49s ========= reports/huggingface_unit_testsrun_models_gpu_models/deberta_v2/stats.txt ========= 34 passed, 82 skipped, 243 deselected, 12 warnings in 9.89s ========== reports/huggingface_unit_testsrun_models_gpu_models/whisper/stats.txt === 3 failed, 196 passed, 317 skipped, 340 deselected, 91 warnings in 32.30s === reports/huggingface_unit_tests__run_models_gpu_models/phi3/stats.txt ========= 67 passed, 49 skipped, 77 deselected, 19 warnings in 19.47s ========== reports/huggingface_unit_testsrun_models_gpu_models/llama/stats.txt ========= 80 passed, 91 skipped, 197 deselected, 21 warnings in 22.42s ========= reports/huggingface_unit_testsrun_models_gpu_models/dpt/stats.txt ======== 70 passed, 144 skipped, 250 deselected, 12 warnings in 10.32s ========= reports/huggingface_unit_tests__run_models_gpu_models/longt5/stats.txt ======= 170 passed, 287 skipped, 206 deselected, 152 warnings in 26.63s ======== reports/huggingface_unit_testsrun_models_gpu_models/wav2vec2_with_lm/stats.txt ===================== 20 deselected, 11 warnings in 0.91s ====================== reports/huggingface_unit_testsrun_models_gpu_models/vivit/stats.txt ========== 24 passed, 46 skipped, 96 deselected, 12 warnings in 7.21s ========== reports/huggingface_unit_tests__run_models_gpu_models/squeezebert/stats.txt ========= 32 passed, 41 skipped, 307 deselected, 12 warnings in 9.55s ========== reports/huggingface_unit_testsrun_models_gpu_models/git/stats.txt ======== 81 passed, 101 skipped, 118 deselected, 18 warnings in 11.13s ========= reports/huggingface_unit_testsrun_models_gpu_models/timesformer/stats.txt ========== 24 passed, 45 skipped, 77 deselected, 12 warnings in 9.72s ========== reports/huggingface_unit_tests__run_models_gpu_models/longformer/stats.txt ========= 40 passed, 96 skipped, 237 deselected, 12 warnings in 21.47s ========= reports/huggingface_unit_testsrun_models_gpu_models/mvp/stats.txt ================= 101 deselected, 1 warning, 1 error in 0.75s ================== reports/huggingface_unit_testsrun_models_gpu_models/funnel/stats.txt ======== 61 passed, 155 skipped, 261 deselected, 12 warnings in 15.94s ========= reports/huggingface_unit_tests__run_models_gpu_models/cpmant/stats.txt ========= 23 passed, 48 skipped, 174 deselected, 15 warnings in 4.38s ========== reports/huggingface_unit_testsrun_models_gpu_models/video_llava/stats.txt ===== 1 failed, 62 passed, 54 skipped, 44 deselected, 23 warnings in 7.75s ===== reports/huggingface_unit_testsrun_models_gpu_models/marian/stats.txt === 117 passed, 159 skipped, 263 deselected, 26 warnings, 1 error in 14.92s ==== reports/huggingface_unit_tests__run_models_gpu_models/yolos/stats.txt ========= 24 passed, 45 skipped, 107 deselected, 13 warnings in 10.55s ========= reports/huggingface_unit_testsrun_models_gpu_models/maskformer/stats.txt ========= 54 passed, 97 skipped, 186 deselected, 13 warnings in 14.59s ========= reports/huggingface_unit_testsrun_models_gpu_models/hiera/stats.txt ========= 34 passed, 45 skipped, 80 deselected, 13 warnings in 16.58s ========== reports/huggingface_unit_tests__run_models_gpu_models/dinov2/stats.txt ========= 28 passed, 79 skipped, 83 deselected, 12 warnings in 11.84s ========== reports/huggingface_unit_testsrun_models_gpu_models/flaubert/stats.txt ========= 39 passed, 79 skipped, 234 deselected, 16 warnings in 17.21s ========= reports/huggingface_unit_testsrun_models_gpu_models/mgp_str/stats.txt ========= 16 passed, 50 skipped, 181 deselected, 12 warnings in 7.89s ========== reports/huggingface_unit_testsrun_models_gpu_models/vit_mae/stats.txt ========= 21 passed, 88 skipped, 136 deselected, 14 warnings in 6.21s ========== reports/huggingface_unit_testsrun_models_gpu_models/llava_next_video/stats.txt ========== 58 passed, 56 skipped, 39 deselected, 18 warnings in 5.41s ========== reports/huggingface_unit_testsrun_models_gpu_models/gpt_bigcode/stats.txt === 2 failed, 132 passed, 114 skipped, 154 deselected, 27 warnings in 53.92s === reports/huggingface_unit_testsrun_models_gpu_models/gemma2/stats.txt === 1 failed, 125 passed, 105 skipped, 154 deselected, 26 warnings in 20.99s === reports/huggingface_unit_testsrun_models_gpu_models/bart/stats.txt ========== 53 skipped, 160 deselected, 12 warnings, 2 errors in 2.47s ========== reports/huggingface_unit_testsrun_models_gpu_models/mobilevit/stats.txt ========= 24 passed, 88 skipped, 154 deselected, 13 warnings in 20.09s ========= reports/huggingface_unit_testsrun_models_gpu_models/gpt_neox/stats.txt ========= 75 passed, 44 skipped, 77 deselected, 27 warnings in 20.56s ========== reports/huggingface_unit_testsrun_models_gpu_models/detr/stats.txt ========= 64 passed, 52 skipped, 104 deselected, 12 warnings in 13.75s ========= reports/huggingface_unit_testsrun_models_gpu_models/xlm_roberta/stats.txt =========== 1 passed, 4 skipped, 103 deselected, 1 warning in 11.23s =========== reports/huggingface_unit_testsrun_models_gpu_models/conditional_detr/stats.txt ========= 63 passed, 50 skipped, 102 deselected, 12 warnings in 19.11s ========= reports/huggingface_unit_testsrun_models_gpu_models/flava/stats.txt ======== 118 passed, 341 skipped, 229 deselected, 51 warnings in 17.93s ======== reports/huggingface_unit_testsrun_models_gpu_models/depth_anything/stats.txt ========= 21 passed, 48 skipped, 77 deselected, 12 warnings in 12.04s ========== reports/huggingface_unit_testsrun_models_gpu_models/roberta_prelayernorm/stats.txt ======== 71 passed, 130 skipped, 138 deselected, 19 warnings in 22.18s ========= reports/huggingface_unit_testsrun_models_gpu_models/dinat/stats.txt =============== 75 skipped, 80 deselected, 12 warnings in 2.44s ================ reports/huggingface_unit_tests__run_models_gpu_models/clipseg/stats.txt ======== 61 passed, 142 skipped, 141 deselected, 12 warnings in 11.11s ========= reports/huggingface_unit_testsrun_models_gpu_models/tvp/stats.txt ========= 31 passed, 40 skipped, 93 deselected, 12 warnings in 19.70s ========== reports/huggingface_unit_testsrun_models_gpu_models/owlvit/stats.txt ======== 80 passed, 191 skipped, 184 deselected, 12 warnings in 23.59s ========= reports/huggingface_unit_testsrun_models_gpu_models/chinese_clip/stats.txt ======== 70 passed, 134 skipped, 174 deselected, 13 warnings in 12.61s ========= reports/huggingface_unit_testsrun_models_gpu_models/persimmon/stats.txt ========= 75 passed, 41 skipped, 77 deselected, 20 warnings in 19.05s ========== reports/huggingface_unit_testsrun_models_gpu_models/deformable_detr/stats.txt === 65 passed, 50 skipped, 102 deselected, 16 warnings in 185.65s (0:03:05) ==== reports/huggingface_unit_testsrun_models_gpu_models/opt/stats.txt ========== 40 skipped, 59 deselected, 12 warnings, 2 errors in 2.46s =========== reports/huggingface_unit_tests__run_models_gpu_models/gemma/stats.txt ========= 72 passed, 95 skipped, 190 deselected, 21 warnings in 15.46s ========= reports/huggingface_unit_testsrun_models_gpu_models/mluke/stats.txt ====================== 115 deselected, 1 warning in 0.82s ====================== reports/huggingface_unit_testsrun_models_gpu_models/auto/stats.txt ==== 1 failed, 16 passed, 48 skipped, 74 deselected, 15 warnings in 25.36s ===== reports/huggingface_unit_tests__run_models_gpu_models/altclip/stats.txt ========= 58 passed, 125 skipped, 123 deselected, 14 warnings in 8.21s ========= reports/huggingface_unit_testsrun_models_gpu_models/unispeech/stats.txt ========= 28 passed, 48 skipped, 78 deselected, 18 warnings in 11.85s ========== reports/huggingface_unit_testsrun_models_gpu_models/ernie/stats.txt ========= 73 passed, 50 skipped, 77 deselected, 17 warnings in 11.72s ========== reports/huggingface_unit_tests__run_models_gpu_models/wavlm/stats.txt ========== 25 passed, 51 skipped, 78 deselected, 28 warnings in 8.83s ========== reports/huggingface_unit_testsrun_models_gpu_models/paligemma/stats.txt ========== 16 passed, 50 skipped, 22 deselected, 18 warnings in 3.24s ========== reports/huggingface_unit_testsrun_models_gpu_models/pvt_v2/stats.txt ========== 25 passed, 50 skipped, 81 deselected, 12 warnings in 9.56s ========== reports/huggingface_unit_testsrun_models_gpu_models/lilt/stats.txt ========= 65 passed, 47 skipped, 77 deselected, 12 warnings in 15.23s ========== reports/huggingface_unit_testsrun_models_gpu_models/qwen2_audio/stats.txt ========== 26 passed, 42 skipped, 26 deselected, 24 warnings in 5.11s ========== reports/huggingface_unit_testsrun_models_gpu_models/clip/stats.txt ======== 89 passed, 378 skipped, 408 deselected, 14 warnings in 16.05s ========= reports/huggingface_unit_testsrun_models_gpu_models/xlnet/stats.txt ======== 52 passed, 106 skipped, 239 deselected, 17 warnings in 16.06s ========= reports/huggingface_unit_tests__run_models_gpu_models/nystromformer/stats.txt ========== 33 passed, 41 skipped, 77 deselected, 12 warnings in 9.44s ========== reports/huggingface_unit_testsrun_models_gpu_models/gpt_neo/stats.txt ==== 1 failed, 71 passed, 90 skipped, 79 deselected, 25 warnings in 22.60s ===== reports/huggingface_unit_testsrun_models_gpu_models/led/stats.txt ========= 56 passed, 95 skipped, 238 deselected, 40 warnings in 16.42s ========= reports/huggingface_unit_testsrun_models_gpu_models/pegasus_x/stats.txt === 1 failed, 119 passed, 101 skipped, 100 deselected, 17 warnings in 17.27s === reports/huggingface_unit_testsrun_models_gpu_models/oneformer/stats.txt ========= 26 passed, 49 skipped, 116 deselected, 14 warnings in 9.49s ========== reports/huggingface_unit_testsrun_models_gpu_models/plbart/stats.txt ======== 114 passed, 110 skipped, 207 deselected, 27 warnings in 39.02s ======== reports/huggingface_unit_testsrun_models_gpu_models/reformer/stats.txt ======== 110 passed, 142 skipped, 202 deselected, 24 warnings in 12.24s ======== reports/huggingface_unit_tests__run_models_gpu_models/bit/stats.txt ========= 28 passed, 47 skipped, 80 deselected, 12 warnings in 10.73s ========== reports/huggingface_unit_testsrun_models_gpu_models/grounding_dino/stats.txt ========= 27 passed, 46 skipped, 122 deselected, 12 warnings in 22.91s ========= reports/huggingface_unit_testsrun_models_gpu_models/segformer/stats.txt ========= 27 passed, 83 skipped, 155 deselected, 12 warnings in 11.29s ========= reports/huggingface_unit_tests__run_models_gpu_models/cvt/stats.txt ========= 23 passed, 85 skipped, 136 deselected, 12 warnings in 15.75s ========= reports/huggingface_unit_testsrun_models_gpu_models/wav2vec2_phoneme/stats.txt ====================== 111 deselected, 1 warning in 0.69s ====================== reports/huggingface_unit_testsrun_models_gpu_models/gpt_sw3/stats.txt ====================== 102 deselected, 1 warning in 0.80s ====================== reports/huggingface_unit_testsrun_models_gpu_models/glpn/stats.txt ========= 24 passed, 45 skipped, 93 deselected, 12 warnings in 15.98s ========== reports/huggingface_unit_testsrun_models_gpu_models/vilt/stats.txt ========= 40 passed, 97 skipped, 171 deselected, 12 warnings in 18.29s ========= reports/huggingface_unit_testsrun_models_gpu_models/falcon_mamba/stats.txt ==== 2 failed, 46 passed, 69 skipped, 77 deselected, 16 warnings in 11.20s ===== reports/huggingface_unit_testsrun_models_gpu_models/qwen2/stats.txt ========= 73 passed, 43 skipped, 179 deselected, 20 warnings in 24.58s ========= reports/huggingface_unit_testsrun_models_gpu_models/donut/stats.txt ========== 26 passed, 42 skipped, 95 deselected, 13 warnings in 8.85s ========== reports/huggingface_unit_testsrun_models_gpu_models/switch_transformers/stats.txt ======== 94 passed, 102 skipped, 101 deselected, 16 warnings in 19.82s ========= reports/huggingface_unit_testsrun_models_gpu_models/tapas/stats.txt ========= 39 passed, 102 skipped, 252 deselected, 12 warnings in 9.45s ========= reports/huggingface_unit_testsrun_models_gpu_models/jamba/stats.txt ========= 56 passed, 57 skipped, 77 deselected, 18 warnings in 24.26s ========== reports/huggingface_unit_tests__run_models_gpu_models/focalnet/stats.txt ========= 30 passed, 47 skipped, 80 deselected, 12 warnings in 15.23s ========== reports/huggingface_unit_testsrun_models_gpu_models/vit_msn/stats.txt ========== 24 passed, 45 skipped, 77 deselected, 13 warnings in 9.62s ========== reports/huggingface_unit_testsrun_models_gpu_models/mpt/stats.txt ========= 66 passed, 55 skipped, 77 deselected, 18 warnings in 20.51s ========== reports/huggingface_unit_tests__run_models_gpu_models/musicgen/stats.txt === 2 failed, 125 passed, 207 skipped, 53 deselected, 72 warnings in 18.24s ==== reports/huggingface_unit_testsrun_models_gpu_models/rembert/stats.txt ========= 39 passed, 88 skipped, 236 deselected, 16 warnings in 10.19s ========= reports/huggingface_unit_testsrun_models_gpu_models/gpt2/stats.txt === 1 failed, 75 passed, 156 skipped, 247 deselected, 35 warnings in 50.50s ==== reports/huggingface_unit_tests__run_models_gpu_models/levit/stats.txt ========= 23 passed, 46 skipped, 94 deselected, 12 warnings in 17.47s ========== reports/huggingface_unit_testsrun_models_gpu_models/autoformer/stats.txt ========= 21 passed, 48 skipped, 78 deselected, 16 warnings in 15.15s ========== reports/huggingface_unit_testsrun_models_gpu_models/beit/stats.txt ========= 28 passed, 88 skipped, 103 deselected, 13 warnings in 20.98s ========= reports/huggingface_unit_tests__run_models_gpu_models/mixtral/stats.txt ========= 72 passed, 42 skipped, 77 deselected, 26 warnings in 18.94s ========== reports/huggingface_unit_testsrun_models_gpu_models/wav2vec2_conformer/stats.txt ========= 43 passed, 50 skipped, 78 deselected, 16 warnings in 16.18s ========== reports/huggingface_unit_testsrun_models_gpu_models/roberta/stats.txt === 4 failed, 70 passed, 128 skipped, 239 deselected, 20 warnings in 13.45s ==== reports/huggingface_unit_tests__run_models_gpu_models/blip/stats.txt ======== 152 passed, 587 skipped, 355 deselected, 19 warnings in 16.15s ======== reports/huggingface_unit_testsrun_models_gpu_models/dbrx/stats.txt ========= 64 passed, 45 skipped, 77 deselected, 21 warnings in 22.82s ========== reports/huggingface_unit_testsrun_models_gpu_models/yoso/stats.txt ==== 32 passed, 43 skipped, 77 deselected, 12 warnings in 150.38s (0:02:30) ==== reports/huggingface_unit_tests__run_models_gpu_models/t5/stats.txt === 1 failed, 98 passed, 273 skipped, 344 deselected, 26 warnings in 35.41s ==== reports/huggingface_unit_testsrun_models_gpu_models/clvp/stats.txt === 93 passed, 205 skipped, 193 deselected, 22 warnings in 70.93s (0:01:10) ==== reports/huggingface_unit_testsrun_models_gpu_models/seggpt/stats.txt ========= 20 passed, 51 skipped, 101 deselected, 12 warnings in 8.08s ========== reports/huggingface_unit_tests__run_models_gpu_models/trocr/stats.txt ========= 52 passed, 55 skipped, 77 deselected, 17 warnings in 11.36s ========== reports/huggingface_unit_testsrun_models_gpu_models/esm/stats.txt ======== 44 passed, 140 skipped, 219 deselected, 12 warnings in 18.31s ========= reports/huggingface_unit_testsrun_models_gpu_models/align/stats.txt ======== 53 passed, 131 skipped, 141 deselected, 13 warnings in 36.62s ========= reports/huggingface_unit_tests__run_models_gpu_models/mbart/stats.txt === 115 passed, 147 skipped, 265 deselected, 27 warnings, 1 error in 34.33s ==== reports/huggingface_unit_testsrun_models_gpu_models/mra/stats.txt = 21 failed, 7 passed, 47 skipped, 77 deselected, 12 warnings in 129.15s (0:02:09) = reports/huggingface_unit_testsrun_models_gpu_models/mbart50/stats.txt ====================== 109 deselected, 1 warning in 0.91s ====================== reports/huggingface_unit_testsrun_models_gpu_models/wav2vec2_bert/stats.txt ========= 43 passed, 51 skipped, 84 deselected, 13 warnings in 10.19s ========== reports/huggingface_unit_testsrun_models_gpu_models/fuyu/stats.txt ========== 19 passed, 46 skipped, 87 deselected, 17 warnings in 7.36s ========== reports/huggingface_unit_testsrun_models_gpu_models/roformer/stats.txt ======== 39 passed, 116 skipped, 236 deselected, 16 warnings in 11.25s ========= reports/huggingface_unit_testsrun_models_gpu_models/lxmert/stats.txt ========= 32 passed, 77 skipped, 233 deselected, 13 warnings in 7.24s ========== reports/huggingface_unit_tests__run_models_gpu_models/gptj/stats.txt ======== 72 passed, 140 skipped, 138 deselected, 20 warnings in 20.27s ========= reports/huggingface_unit_testsrun_models_gpu_models/decision_transformer/stats.txt ========== 58 passed, 47 skipped, 78 deselected, 12 warnings in 6.33s ========== reports/huggingface_unit_testsrun_models_gpu_models/herbert/stats.txt ====================== 98 deselected, 1 warning in 0.66s ======================= reports/huggingface_unit_tests__run_models_gpu_models/jetmoe/stats.txt ========= 63 passed, 47 skipped, 77 deselected, 19 warnings in 14.09s ========== reports/huggingface_unit_testsrun_models_gpu_models/layoutlm/stats.txt ========= 36 passed, 83 skipped, 234 deselected, 12 warnings in 9.93s ========== reports/huggingface_unit_testsrun_models_gpu_models/dit/stats.txt ======================= 1 skipped, 11 warnings in 0.50s ======================== reports/huggingface_unit_tests__run_models_gpu_models/mpnet/stats.txt ========= 32 passed, 81 skipped, 234 deselected, 12 warnings in 8.93s ========== reports/huggingface_unit_testsrun_models_gpu_models/rt_detr/stats.txt ========= 32 passed, 50 skipped, 103 deselected, 13 warnings in 30.47s ========= reports/huggingface_unit_testsrun_models_gpu_models/albert/stats.txt ======== 38 passed, 101 skipped, 236 deselected, 13 warnings in 11.47s ========= reports/huggingface_unit_tests__run_models_gpu_models/superpoint/stats.txt ===== 1 failed, 17 passed, 51 skipped, 42 deselected, 11 warnings in 3.47s ===== reports/huggingface_unit_testsrun_models_gpu_models/code_llama/stats.txt ====================== 112 deselected, 1 warning in 0.81s ====================== reports/huggingface_unit_testsrun_models_gpu_models/table_transformer/stats.txt ========= 66 passed, 48 skipped, 78 deselected, 12 warnings in 16.50s ========== reports/huggingface_unit_testsrun_models_gpu_models/time_series_transformer/stats.txt ========= 28 passed, 48 skipped, 78 deselected, 16 warnings in 10.65s ========== reports/huggingface_unit_testsrun_models_gpu_models/bridgetower/stats.txt ========== 18 passed, 55 skipped, 93 deselected, 13 warnings in 7.58s ========== reports/huggingface_unit_tests__run_models_gpu_models/electra/stats.txt ======== 42 passed, 112 skipped, 252 deselected, 16 warnings in 11.50s ========= reports/huggingface_unit_testsrun_models_gpu_models/bros/stats.txt ========= 31 passed, 41 skipped, 77 deselected, 31 warnings in 10.65s ========== reports/huggingface_unit_testsrun_models_gpu_models/blenderbot/stats.txt === 114 passed, 141 skipped, 164 deselected, 24 warnings, 1 error in 12.93s ==== reports/huggingface_unit_tests__run_models_gpu_models/owlv2/stats.txt ======== 80 passed, 191 skipped, 165 deselected, 12 warnings in 26.18s ========= reports/huggingface_unit_testsrun_models_gpu_models/cohere/stats.txt ========= 70 passed, 39 skipped, 179 deselected, 21 warnings in 13.82s ========= reports/huggingface_unit_testsrun_models_gpu_models/speecht5/stats.txt === 2 failed, 92 passed, 248 skipped, 314 deselected, 20 warnings in 35.24s ==== reports/huggingface_unit_tests__run_models_gpu_models/data2vec/stats.txt ======== 130 passed, 185 skipped, 291 deselected, 26 warnings in 47.25s ======== reports/huggingface_unit_testsrun_models_gpu_models/dpr/stats.txt ========= 24 passed, 87 skipped, 597 deselected, 13 warnings in 7.23s ========== reports/huggingface_unit_testsrun_models_gpu_models/mobilenet_v2/stats.txt ========= 24 passed, 47 skipped, 94 deselected, 23 warnings in 20.71s ========== reports/huggingface_unit_testsrun_models_gpu_models/qwen2_moe/stats.txt ========= 71 passed, 46 skipped, 77 deselected, 19 warnings in 35.70s ========== reports/huggingface_unit_testsrun_models_gpu_models/mobilevitv2/stats.txt ========= 23 passed, 49 skipped, 77 deselected, 13 warnings in 17.02s ========== reports/huggingface_unit_tests__run_models_gpu_models/swin2sr/stats.txt ========== 19 passed, 51 skipped, 93 deselected, 12 warnings in 5.29s ========== reports/huggingface_unit_testsrun_models_gpu_models/rwkv/stats.txt ========= 45 passed, 67 skipped, 77 deselected, 21 warnings in 40.09s ========== reports/huggingface_unit_testsrun_models_gpu_models/informer/stats.txt ===== 1 failed, 17 passed, 51 skipped, 78 deselected, 15 warnings in 6.91s ===== reports/huggingface_unit_tests__run_models_gpu_models/chameleon/stats.txt ========= 60 passed, 51 skipped, 95 deselected, 19 warnings in 12.56s ========== reports/huggingface_unit_testsrun_models_gpu_models/olmo/stats.txt ========= 71 passed, 45 skipped, 77 deselected, 22 warnings in 14.57s ========== reports/huggingface_unit_testsrun_models_gpu_models/clap/stats.txt ======== 64 passed, 145 skipped, 151 deselected, 13 warnings in 11.64s ========= reports/huggingface_unit_testsrun_models_gpu_models/blip_2/stats.txt === 1 failed, 195 passed, 305 skipped, 210 deselected, 16 warnings in 29.42s === reports/huggingface_unit_testsrun_models_gpu_models/xmod/stats.txt ========= 74 passed, 51 skipped, 77 deselected, 19 warnings in 11.32s ========== reports/huggingface_unit_testsrun_models_gpu_models/roc_bert/stats.txt ========= 41 passed, 38 skipped, 191 deselected, 16 warnings in 10.96s ========= reports/huggingface_unit_testsrun_models_gpu_models/dac/stats.txt ========== 17 passed, 55 skipped, 99 deselected, 12 warnings in 6.01s ========== reports/huggingface_unit_tests__run_models_gpu_models/vit/stats.txt ========= 26 passed, 115 skipped, 156 deselected, 13 warnings in 9.79s ========= reports/huggingface_unit_testsrun_models_gpu_models/x_clip/stats.txt ======== 62 passed, 140 skipped, 123 deselected, 13 warnings in 10.75s ========= reports/huggingface_unit_testsrun_models_gpu_models/convnext/stats.txt ========= 30 passed, 83 skipped, 155 deselected, 12 warnings in 13.81s ========= reports/huggingface_unit_tests__run_models_gpu_models/idefics/stats.txt ======== 58 passed, 286 skipped, 188 deselected, 35 warnings in 16.81s ========= reports/huggingface_unit_testsrun_models_gpu_models/megatron_gpt2/stats.txt ======================== 1 skipped, 1 warning in 0.02s ========================= reports/huggingface_unit_testsrun_models_gpu_models/llava_next/stats.txt ========== 58 passed, 56 skipped, 43 deselected, 18 warnings in 5.22s ========== reports/huggingface_unit_testsrun_models_gpu_models/pegasus/stats.txt ======== 112 passed, 176 skipped, 364 deselected, 26 warnings in 14.64s ======== reports/huggingface_unit_testsrun_models_gpu_models/mistral/stats.txt ======== 73 passed, 190 skipped, 139 deselected, 20 warnings in 17.84s ========= reports/huggingface_unit_tests__run_models_gpu_models/bartpho/stats.txt ====================== 97 deselected, 1 warning in 0.80s ======================= reports/huggingface_unit_testsrun_models_gpu_models/codegen/stats.txt ========= 70 passed, 47 skipped, 178 deselected, 20 warnings in 13.53s ========= reports/huggingface_unit_testsrun_models_gpu_models/phobert/stats.txt ====================== 97 deselected, 1 warning in 0.69s ======================= reports/huggingface_unit_tests__run_models_gpu_models/canine/stats.txt ========= 24 passed, 48 skipped, 176 deselected, 12 warnings in 10.16s ========= reports/huggingface_unit_testsrun_models_gpu_models/encoder_decoder/stats.txt =========== 45 skipped, 5 deselected, 12 warnings, 2 errors in 2.47s =========== reports/huggingface_unit_testsrun_models_gpu_models/byt5/stats.txt ====================== 103 deselected, 1 warning in 0.65s ====================== reports/huggingface_unit_tests__run_models_gpu_models/layoutlmv3/stats.txt ========= 31 passed, 82 skipped, 275 deselected, 31 warnings in 5.94s ========== reports/huggingface_unit_testsrun_models_gpu_models/xglm/stats.txt = 1 failed, 65 passed, 134 skipped, 241 deselected, 25 warnings in 86.95s (0:01:26) = reports/huggingface_unit_testsrun_models_gpu_models/llava/stats.txt ========== 24 passed, 53 skipped, 24 deselected, 24 warnings in 9.40s ========== reports/huggingface_unit_tests__run_models_gpu_models/groupvit/stats.txt ========= 63 passed, 250 skipped, 191 deselected, 13 warnings in 9.38s ========= reports/huggingface_unit_testsrun_models_gpu_models/starcoder2/stats.txt ========= 73 passed, 42 skipped, 77 deselected, 22 warnings in 17.75s ==========


### Performance Test Results for upstream_sync_test

python examples/pytorch/language-modeling/run_mlm.py --model_name_or_path bert-base-uncased --dataset_name wikitext --dataset_config_name wikitext-2-raw-v1 --do_train --do_eval --output_dir /tmp/test-mlm --per_device_train_batch_size 8 --per_device_eval_batch_size 8 --max_steps 500

Cemberk commented 2 months ago

Unit Test Results for develop tmp-develop_test-20240913

reports/huggingface_unit_tests__run_models_gpu_generation/stats.txt

==== 102 passed, 81 skipped, 22 deselected, 94 warnings in 75.27s (0:01:15) ==== reports/huggingface_unit_testsrun_models_gpu_pipelines/stats.txt = 2 failed, 119 passed, 167 skipped, 4 deselected, 111 warnings in 131.26s (0:02:11) = reports/huggingface_unit_tests__run_models_gpu_extended/stats.txt ======== 1 failed, 2 passed, 7 skipped, 25 warnings in 94.95s (0:01:34) ======== reports/huggingface_unit_testsrun_models_gpu_sagemaker/stats.txt ======================== 7 skipped, 1 warning in 0.02s ========================= reports/huggingface_unit_testsrun_models_gpu_peft_integration/stats.txt ======================== 15 skipped, 1 warning in 0.02s ======================== reports/huggingface_unit_testsrun_models_gpu_tokenization/stats.txt ====================== 119 deselected, 1 warning in 0.70s ====================== reports/huggingface_unit_testsrun_models_gpu_bettertransformer/stats.txt ======================== 2 skipped, 1 warning in 0.01s ========================= reports/huggingface_unit_tests__run_modelsgpupycache/stats.txt ============================== 1 warning in 0.01s ============================== reports/huggingface_unit_testsrun_models_gpu_trainer/stats.txt = 4 failed, 95 passed, 51 skipped, 91 deselected, 173 warnings in 83.49s (0:01:23) = reports/huggingface_unit_testsrun_models_gpu_utils/stats.txt ===================== 467 deselected, 12 warnings in 3.82s ===================== reports/huggingface_unit_tests__run_models_gpu_agents/stats.txt ===================== 119 deselected, 11 warnings in 1.31s ===================== reports/huggingface_unit_testsrun_models_gpu_quantization/stats.txt ===== 1 failed, 16 passed, 247 skipped, 1 deselected, 11 warnings in 1.38s ===== reports/huggingface_unit_testsrun_models_gpu_optimization/stats.txt ====================== 6 deselected, 11 warnings in 0.45s ====================== reports/huggingface_unit_testsrun_models_gpu_repo_utils/stats.txt ===================== 32 deselected, 11 warnings in 0.73s ====================== reports/huggingface_unit_testsrun_models_gpu_deepspeed/stats.txt ======================= 151 skipped, 2 warnings in 1.65s ======================= reports/huggingface_unit_testsrun_models_gpu_fixtures/stats.txt ============================== 1 warning in 0.01s ============================== reports/huggingface_unit_testsrun_models_gpu_fsdp/stats.txt ============= 4 failed, 4 passed, 9 skipped, 11 warnings in 2.06s ============== reports/huggingface_unit_tests__run_models_gpu_benchmark/stats.txt ================= 13 passed, 11 skipped, 31 warnings in 5.30s ================== reports/huggingface_unit_testsrun_models_gpu_models/falcon/stats.txt ========= 72 passed, 47 skipped, 77 deselected, 21 warnings in 17.33s ========== reports/huggingface_unit_testsrun_models_gpu_models/ctrl/stats.txt ========= 58 passed, 91 skipped, 233 deselected, 17 warnings in 23.08s ========= reports/huggingface_unit_tests__run_models_gpu_models/xlm/stats.txt ======== 58 passed, 100 skipped, 234 deselected, 17 warnings in 17.95s ========= reports/huggingface_unit_testsrun_models_gpu_models/sew_d/stats.txt ========== 24 passed, 49 skipped, 78 deselected, 28 warnings in 7.99s ========== reports/huggingface_unit_testsrun_models_gpu_models/bark/stats.txt ========= 136 passed, 158 skipped, 74 deselected, 36 warnings in 7.67s ========= reports/huggingface_unit_tests__run_models_gpu_models/nougat/stats.txt ===================== 133 deselected, 11 warnings in 1.29s ===================== reports/huggingface_unit_testsrun_models_gpu_models/cpm/stats.txt ===================== 385 deselected, 12 warnings in 2.40s ===================== reports/huggingface_unit_testsrun_models_gpu_models/pop2piano/stats.txt ==== 1 failed, 73 passed, 50 skipped, 115 deselected, 18 warnings in 21.98s ==== reports/huggingface_unit_tests__run_models_gpu_models/layoutlmv2/stats.txt =============== 72 skipped, 230 deselected, 12 warnings in 2.60s =============== reports/huggingface_unit_testsrun_models_gpu_models/instructblip/stats.txt ========= 79 passed, 100 skipped, 64 deselected, 14 warnings in 10.41s ========= reports/huggingface_unit_testsrun_models_gpu_models/seamless_m4t/stats.txt ======== 69 passed, 169 skipped, 184 deselected, 30 warnings in 30.88s ========= reports/huggingface_unit_testsrun_models_gpu_models/bert/stats.txt ======== 79 passed, 139 skipped, 257 deselected, 19 warnings in 17.39s ========= reports/huggingface_unit_testsrun_models_gpu_models/markuplm/stats.txt ========= 35 passed, 35 skipped, 189 deselected, 18 warnings in 8.60s ========== reports/huggingface_unit_testsrun_models_gpu_models/visual_bert/stats.txt ========== 31 passed, 46 skipped, 77 deselected, 12 warnings in 9.08s ========== reports/huggingface_unit_testsrun_models_gpu_models/ibert/stats.txt ========= 40 passed, 45 skipped, 77 deselected, 13 warnings in 13.79s ========== reports/huggingface_unit_testsrun_models_gpu_models/megatron_bert/stats.txt ========= 39 passed, 35 skipped, 77 deselected, 15 warnings in 12.15s ========== reports/huggingface_unit_testsrun_models_gpu_models/nemotron/stats.txt ======== 145 passed, 85 skipped, 154 deselected, 28 warnings in 24.73s ========= reports/huggingface_unit_tests__run_models_gpu_models/poolformer/stats.txt ========= 18 passed, 50 skipped, 94 deselected, 12 warnings in 10.97s ========== reports/huggingface_unit_testsrun_models_gpu_models/vitdet/stats.txt ========== 24 passed, 49 skipped, 80 deselected, 12 warnings in 7.67s ========== reports/huggingface_unit_testsrun_models_gpu_models/qwen2_vl/stats.txt ========= 54 passed, 58 skipped, 41 deselected, 17 warnings in 10.90s ========== reports/huggingface_unit_testsrun_models_gpu_models/timm_backbone/stats.txt ========== 23 passed, 49 skipped, 79 deselected, 12 warnings in 8.90s ========== reports/huggingface_unit_testsrun_models_gpu_models/convbert/stats.txt ========= 34 passed, 85 skipped, 136 deselected, 12 warnings in 9.96s ========== reports/huggingface_unit_tests__run_models_gpu_models/xlm_roberta_xl/stats.txt ========= 72 passed, 49 skipped, 77 deselected, 20 warnings in 21.93s ========== reports/huggingface_unit_testsrun_models_gpu_models/vitmatte/stats.txt ========== 20 passed, 49 skipped, 94 deselected, 12 warnings in 9.35s ========== reports/huggingface_unit_testsrun_models_gpu_models/pix2struct/stats.txt === 1 failed, 64 passed, 141 skipped, 176 deselected, 14 warnings in 11.51s ==== reports/huggingface_unit_tests__run_models_gpu_models/fnet/stats.txt ========= 29 passed, 48 skipped, 179 deselected, 12 warnings in 8.61s ========== reports/huggingface_unit_testsrun_models_gpu_models/olmoe/stats.txt ========= 72 passed, 42 skipped, 77 deselected, 21 warnings in 17.31s ========== reports/huggingface_unit_testsrun_models_gpu_models/vision_text_dual_encoder/stats.txt ========== 15 passed, 39 skipped, 18 deselected, 13 warnings in 3.19s ========== reports/huggingface_unit_testsrun_models_gpu_models/swiftformer/stats.txt ========= 23 passed, 84 skipped, 136 deselected, 12 warnings in 21.02s ========= reports/huggingface_unit_testsrun_models_gpu_models/mask2former/stats.txt ========= 26 passed, 49 skipped, 105 deselected, 12 warnings in 8.58s ========== reports/huggingface_unit_testsrun_models_gpu_models/bert_generation/stats.txt ========= 65 passed, 104 skipped, 125 deselected, 17 warnings in 7.91s ========= reports/huggingface_unit_testsrun_models_gpu_models/mobilenet_v1/stats.txt ========= 23 passed, 46 skipped, 94 deselected, 13 warnings in 13.34s ========== reports/huggingface_unit_tests__run_models_gpu_models/mobilebert/stats.txt ========= 40 passed, 78 skipped, 250 deselected, 12 warnings in 13.39s ========= reports/huggingface_unit_testsrun_models_gpu_models/sew/stats.txt ========== 26 passed, 49 skipped, 78 deselected, 31 warnings in 8.29s ========== reports/huggingface_unit_testsrun_models_gpu_models/barthez/stats.txt ====================== 100 deselected, 1 warning in 0.65s ====================== reports/huggingface_unit_testsrun_models_gpu_models/big_bird/stats.txt ========= 35 passed, 81 skipped, 182 deselected, 15 warnings in 13.87s ========= reports/huggingface_unit_testsrun_models_gpu_models/deberta/stats.txt ========= 33 passed, 82 skipped, 235 deselected, 12 warnings in 9.45s ========== reports/huggingface_unit_testsrun_models_gpu_models/deit/stats.txt ========= 22 passed, 90 skipped, 153 deselected, 13 warnings in 11.40s ========= reports/huggingface_unit_testsrun_models_gpu_models/stablelm/stats.txt ========= 74 passed, 45 skipped, 77 deselected, 21 warnings in 19.02s ========== reports/huggingface_unit_tests__run_models_gpu_models/mamba/stats.txt ==== 2 failed, 49 passed, 72 skipped, 77 deselected, 16 warnings in 42.55s ===== reports/huggingface_unit_testsrun_models_gpu_models/bigbird_pegasus/stats.txt === 1 failed, 102 passed, 123 skipped, 100 deselected, 23 warnings in 29.83s === reports/huggingface_unit_testsrun_models_gpu_models/hubert/stats.txt ========= 51 passed, 186 skipped, 166 deselected, 14 warnings in 9.93s ========= reports/huggingface_unit_tests__run_models_gpu_models/rag/stats.txt =========== 18 skipped, 11 deselected, 12 warnings, 1 error in 2.58s =========== reports/huggingface_unit_testsrun_models_gpu_models/musicgen_melody/stats.txt === 2 failed, 123 passed, 155 skipped, 73 deselected, 68 warnings in 10.68s ==== reports/huggingface_unit_testsrun_models_gpu_models/distilbert/stats.txt ======== 41 passed, 105 skipped, 368 deselected, 12 warnings in 11.32s ========= reports/huggingface_unit_tests__run_models_gpu_models/bloom/stats.txt ========= 76 passed, 91 skipped, 179 deselected, 62 warnings in 24.47s ========= reports/huggingface_unit_testsrun_models_gpu_models/biogpt/stats.txt ========= 66 passed, 53 skipped, 175 deselected, 19 warnings in 11.44s ========= reports/huggingface_unit_testsrun_models_gpu_models/swinv2/stats.txt ========= 30 passed, 49 skipped, 81 deselected, 14 warnings in 15.37s ========== reports/huggingface_unit_tests__run_models_gpu_models/sam/stats.txt ========= 19 passed, 111 skipped, 145 deselected, 12 warnings in 6.43s ========= reports/huggingface_unit_testsrun_models_gpu_models/perceiver/stats.txt ========= 25 passed, 52 skipped, 179 deselected, 12 warnings in 6.73s ========== reports/huggingface_unit_testsrun_models_gpu_models/resnet/stats.txt ======== 30 passed, 116 skipped, 142 deselected, 15 warnings in 13.38s ========= reports/huggingface_unit_tests__run_models_gpu_models/convnextv2/stats.txt ========= 22 passed, 85 skipped, 135 deselected, 12 warnings in 12.22s ========= reports/huggingface_unit_testsrun_models_gpu_models/unispeech_sat/stats.txt ========= 55 passed, 98 skipped, 102 deselected, 19 warnings in 16.76s ========= reports/huggingface_unit_testsrun_models_gpu_models/zoedepth/stats.txt ========== 20 passed, 50 skipped, 96 deselected, 12 warnings in 7.13s ========== reports/huggingface_unit_tests__run_models_gpu_models/instructblipvideo/stats.txt ========= 80 passed, 99 skipped, 81 deselected, 14 warnings in 12.31s ========== reports/huggingface_unit_testsrun_models_gpu_models/imagegpt/stats.txt ==== 1 failed, 58 passed, 52 skipped, 96 deselected, 95 warnings in 16.18s ===== reports/huggingface_unit_testsrun_models_gpu_models/speech_to_text/stats.txt ======== 51 passed, 107 skipped, 294 deselected, 19 warnings in 11.75s ========= reports/huggingface_unit_tests__run_models_gpu_models/openai/stats.txt ========= 53 passed, 99 skipped, 330 deselected, 17 warnings in 8.85s ========== reports/huggingface_unit_testsrun_models_gpu_models/patchtst/stats.txt ========== 24 passed, 45 skipped, 78 deselected, 16 warnings in 7.90s ========== reports/huggingface_unit_testsrun_models_gpu_models/gpt_neox_japanese/stats.txt ========= 72 passed, 94 skipped, 121 deselected, 24 warnings in 20.08s ========= reports/huggingface_unit_tests__run_models_gpu_models/videomae/stats.txt ========== 24 passed, 46 skipped, 94 deselected, 14 warnings in 7.34s ========== reports/huggingface_unit_testsrun_models_gpu_models/mamba2/stats.txt ===== 1 failed, 36 passed, 72 skipped, 76 deselected, 14 warnings in 9.47s ===== reports/huggingface_unit_testsrun_models_gpu_models/layoutxlm/stats.txt ===================== 121 deselected, 11 warnings in 1.26s ===================== reports/huggingface_unit_tests__run_models_gpu_models/phi/stats.txt ========= 73 passed, 43 skipped, 77 deselected, 21 warnings in 19.02s ========== reports/huggingface_unit_testsrun_models_gpu_models/univnet/stats.txt ========== 15 passed, 56 skipped, 48 deselected, 10 warnings in 2.02s ========== reports/huggingface_unit_testsrun_models_gpu_models/luke/stats.txt ========= 36 passed, 44 skipped, 193 deselected, 12 warnings in 24.97s ========= reports/huggingface_unit_tests__run_models_gpu_models/udop/stats.txt ========= 46 passed, 90 skipped, 224 deselected, 15 warnings in 13.94s ========= reports/huggingface_unit_testsrun_models_gpu_models/nllb_moe/stats.txt ========= 64 passed, 53 skipped, 77 deselected, 19 warnings in 18.50s ========== reports/huggingface_unit_testsrun_models_gpu_models/upernet/stats.txt ========== 23 passed, 48 skipped, 77 deselected, 13 warnings in 7.95s ========== reports/huggingface_unit_tests__run_models_gpu_models/siglip/stats.txt ======== 72 passed, 186 skipped, 323 deselected, 13 warnings in 13.45s ========= reports/huggingface_unit_testsrun_models_gpu_models/patchtsmixer/stats.txt ========= 622 passed, 46 skipped, 78 deselected, 14 warnings in 12.02s ========= reports/huggingface_unit_testsrun_models_gpu_models/llava_onevision/stats.txt ========== 47 passed, 66 skipped, 56 deselected, 20 warnings in 8.03s ========== reports/huggingface_unit_testsrun_models_gpu_models/bert_japanese/stats.txt ====================== 227 deselected, 1 warning in 0.66s ====================== reports/huggingface_unit_testsrun_models_gpu_models/bertweet/stats.txt ====================== 97 deselected, 1 warning in 0.66s ======================= reports/huggingface_unit_tests__run_models_gpu_models/vits/stats.txt ========= 15 passed, 51 skipped, 176 deselected, 12 warnings in 7.49s ========== reports/huggingface_unit_testsrun_models_gpu_models/pycache/stats.txt ============================= 2 warnings in 0.01s ============================== reports/huggingface_unit_testsrun_models_gpu_models/speech_encoder_decoder/stats.txt ============= 18 passed, 4 skipped, 15 warnings, 1 error in 3.82s ============== reports/huggingface_unit_tests__run_models_gpu_models/audio_spectrogram_transformer/stats.txt ========= 21 passed, 41 skipped, 117 deselected, 14 warnings in 6.50s ========== reports/huggingface_unit_testsrun_models_gpu_models/camembert/stats.txt ================ 3 skipped, 100 deselected, 1 warning in 0.83s ================= reports/huggingface_unit_testsrun_models_gpu_models/fastspeech2_conformer/stats.txt ==== 2 failed, 39 passed, 98 skipped, 147 deselected, 10 warnings in 14.65s ==== reports/huggingface_unit_testsrun_models_gpu_models/nllb/stats.txt ====================== 106 deselected, 1 warning in 0.85s ====================== reports/huggingface_unit_testsrun_models_gpu_models/m2m_100/stats.txt ========= 62 passed, 52 skipped, 184 deselected, 19 warnings in 15.94s ========= reports/huggingface_unit_testsrun_models_gpu_models/blenderbot_small/stats.txt === 114 passed, 142 skipped, 258 deselected, 24 warnings, 1 error in 12.85s ==== reports/huggingface_unit_testsrun_models_gpu_models/umt5/stats.txt ==== 2 failed, 78 passed, 98 skipped, 153 deselected, 16 warnings in 32.21s ==== reports/huggingface_unit_tests__run_models_gpu_models/kosmos2/stats.txt ========= 23 passed, 45 skipped, 96 deselected, 14 warnings in 13.30s ========== reports/huggingface_unit_testsrun_models_gpu_models/pvt/stats.txt ========= 22 passed, 48 skipped, 94 deselected, 12 warnings in 12.51s ========== reports/huggingface_unit_testsrun_models_gpu_models/wav2vec2/stats.txt ======== 74 passed, 247 skipped, 316 deselected, 42 warnings in 24.67s ========= reports/huggingface_unit_tests__run_models_gpu_models/splinter/stats.txt ========== 35 passed, 41 skipped, 77 deselected, 12 warnings in 7.83s ========== reports/huggingface_unit_testsrun_models_gpu_models/recurrent_gemma/stats.txt ========== 54 passed, 59 skipped, 77 deselected, 16 warnings in 7.90s ========== reports/huggingface_unit_testsrun_models_gpu_models/granite/stats.txt ========= 69 passed, 44 skipped, 77 deselected, 21 warnings in 13.49s ========== reports/huggingface_unit_tests__run_models_gpu_models/idefics2/stats.txt ========== 86 passed, 90 skipped, 64 deselected, 16 warnings in 7.20s ========== reports/huggingface_unit_testsrun_models_gpu_models/encodec/stats.txt ========= 17 passed, 52 skipped, 99 deselected, 32 warnings in 11.40s ========== reports/huggingface_unit_testsrun_models_gpu_models/fsmt/stats.txt ================= 101 deselected, 1 warning, 1 error in 0.74s ================== reports/huggingface_unit_tests__run_models_gpu_models/vision_encoder_decoder/stats.txt =========== 22 skipped, 3 deselected, 12 warnings, 1 error in 2.62s ============ reports/huggingface_unit_testsrun_models_gpu_models/mt5/stats.txt ========= 97 passed, 95 skipped, 155 deselected, 26 warnings in 38.79s ========= reports/huggingface_unit_testsrun_models_gpu_models/prophetnet/stats.txt ======== 124 passed, 169 skipped, 236 deselected, 21 warnings in 14.44s ======== reports/huggingface_unit_tests__run_models_gpu_models/swin/stats.txt ========= 32 passed, 86 skipped, 139 deselected, 14 warnings in 13.11s ========= reports/huggingface_unit_testsrun_models_gpu_models/seamless_m4t_v2/stats.txt ========= 71 passed, 114 skipped, 48 deselected, 37 warnings in 25.92s ========= reports/huggingface_unit_testsrun_models_gpu_models/vipllava/stats.txt ========== 23 passed, 45 skipped, 23 deselected, 24 warnings in 4.98s ========== reports/huggingface_unit_tests__run_models_gpu_models/regnet/stats.txt ======== 23 passed, 116 skipped, 138 deselected, 12 warnings in 11.49s ========= reports/huggingface_unit_testsrun_models_gpu_models/deberta_v2/stats.txt ========= 34 passed, 82 skipped, 243 deselected, 12 warnings in 9.89s ========== reports/huggingface_unit_testsrun_models_gpu_models/whisper/stats.txt === 3 failed, 196 passed, 317 skipped, 340 deselected, 91 warnings in 32.30s === reports/huggingface_unit_tests__run_models_gpu_models/phi3/stats.txt ========= 67 passed, 49 skipped, 77 deselected, 19 warnings in 19.47s ========== reports/huggingface_unit_testsrun_models_gpu_models/llama/stats.txt ========= 80 passed, 91 skipped, 197 deselected, 21 warnings in 22.42s ========= reports/huggingface_unit_testsrun_models_gpu_models/dpt/stats.txt ======== 70 passed, 144 skipped, 250 deselected, 12 warnings in 10.32s ========= reports/huggingface_unit_tests__run_models_gpu_models/longt5/stats.txt ======= 170 passed, 287 skipped, 206 deselected, 152 warnings in 26.63s ======== reports/huggingface_unit_testsrun_models_gpu_models/wav2vec2_with_lm/stats.txt ===================== 20 deselected, 11 warnings in 0.91s ====================== reports/huggingface_unit_testsrun_models_gpu_models/vivit/stats.txt ========== 24 passed, 46 skipped, 96 deselected, 12 warnings in 7.21s ========== reports/huggingface_unit_tests__run_models_gpu_models/squeezebert/stats.txt ========= 32 passed, 41 skipped, 307 deselected, 12 warnings in 9.55s ========== reports/huggingface_unit_testsrun_models_gpu_models/git/stats.txt ======== 81 passed, 101 skipped, 118 deselected, 18 warnings in 11.13s ========= reports/huggingface_unit_testsrun_models_gpu_models/timesformer/stats.txt ========== 24 passed, 45 skipped, 77 deselected, 12 warnings in 9.72s ========== reports/huggingface_unit_tests__run_models_gpu_models/longformer/stats.txt ========= 40 passed, 96 skipped, 237 deselected, 12 warnings in 21.47s ========= reports/huggingface_unit_testsrun_models_gpu_models/mvp/stats.txt ================= 101 deselected, 1 warning, 1 error in 0.75s ================== reports/huggingface_unit_testsrun_models_gpu_models/funnel/stats.txt ======== 61 passed, 155 skipped, 261 deselected, 12 warnings in 15.94s ========= reports/huggingface_unit_tests__run_models_gpu_models/cpmant/stats.txt ========= 23 passed, 48 skipped, 174 deselected, 15 warnings in 4.38s ========== reports/huggingface_unit_testsrun_models_gpu_models/video_llava/stats.txt ===== 1 failed, 62 passed, 54 skipped, 44 deselected, 23 warnings in 7.75s ===== reports/huggingface_unit_testsrun_models_gpu_models/marian/stats.txt === 117 passed, 159 skipped, 263 deselected, 26 warnings, 1 error in 14.92s ==== reports/huggingface_unit_tests__run_models_gpu_models/yolos/stats.txt ========= 24 passed, 45 skipped, 107 deselected, 13 warnings in 10.55s ========= reports/huggingface_unit_testsrun_models_gpu_models/maskformer/stats.txt ========= 54 passed, 97 skipped, 186 deselected, 13 warnings in 14.59s ========= reports/huggingface_unit_testsrun_models_gpu_models/hiera/stats.txt ========= 34 passed, 45 skipped, 80 deselected, 13 warnings in 16.58s ========== reports/huggingface_unit_tests__run_models_gpu_models/dinov2/stats.txt ========= 28 passed, 79 skipped, 83 deselected, 12 warnings in 11.84s ========== reports/huggingface_unit_testsrun_models_gpu_models/flaubert/stats.txt ========= 39 passed, 79 skipped, 234 deselected, 16 warnings in 17.21s ========= reports/huggingface_unit_testsrun_models_gpu_models/mgp_str/stats.txt ========= 16 passed, 50 skipped, 181 deselected, 12 warnings in 7.89s ========== reports/huggingface_unit_testsrun_models_gpu_models/vit_mae/stats.txt ========= 21 passed, 88 skipped, 136 deselected, 14 warnings in 6.21s ========== reports/huggingface_unit_testsrun_models_gpu_models/llava_next_video/stats.txt ========== 58 passed, 56 skipped, 39 deselected, 18 warnings in 5.41s ========== reports/huggingface_unit_testsrun_models_gpu_models/gpt_bigcode/stats.txt === 2 failed, 132 passed, 114 skipped, 154 deselected, 27 warnings in 53.92s === reports/huggingface_unit_testsrun_models_gpu_models/gemma2/stats.txt === 1 failed, 125 passed, 105 skipped, 154 deselected, 26 warnings in 20.99s === reports/huggingface_unit_testsrun_models_gpu_models/bart/stats.txt ========== 53 skipped, 160 deselected, 12 warnings, 2 errors in 2.47s ========== reports/huggingface_unit_testsrun_models_gpu_models/mobilevit/stats.txt ========= 24 passed, 88 skipped, 154 deselected, 13 warnings in 20.09s ========= reports/huggingface_unit_testsrun_models_gpu_models/gpt_neox/stats.txt ========= 75 passed, 44 skipped, 77 deselected, 27 warnings in 20.56s ========== reports/huggingface_unit_testsrun_models_gpu_models/detr/stats.txt ========= 64 passed, 52 skipped, 104 deselected, 12 warnings in 13.75s ========= reports/huggingface_unit_testsrun_models_gpu_models/xlm_roberta/stats.txt =========== 1 passed, 4 skipped, 103 deselected, 1 warning in 11.23s =========== reports/huggingface_unit_testsrun_models_gpu_models/conditional_detr/stats.txt ========= 63 passed, 50 skipped, 102 deselected, 12 warnings in 19.11s ========= reports/huggingface_unit_testsrun_models_gpu_models/flava/stats.txt ======== 118 passed, 341 skipped, 229 deselected, 51 warnings in 17.93s ======== reports/huggingface_unit_testsrun_models_gpu_models/depth_anything/stats.txt ========= 21 passed, 48 skipped, 77 deselected, 12 warnings in 12.04s ========== reports/huggingface_unit_testsrun_models_gpu_models/roberta_prelayernorm/stats.txt ======== 71 passed, 130 skipped, 138 deselected, 19 warnings in 22.18s ========= reports/huggingface_unit_testsrun_models_gpu_models/dinat/stats.txt =============== 75 skipped, 80 deselected, 12 warnings in 2.44s ================ reports/huggingface_unit_tests__run_models_gpu_models/clipseg/stats.txt ======== 61 passed, 142 skipped, 141 deselected, 12 warnings in 11.11s ========= reports/huggingface_unit_testsrun_models_gpu_models/tvp/stats.txt ========= 31 passed, 40 skipped, 93 deselected, 12 warnings in 19.70s ========== reports/huggingface_unit_testsrun_models_gpu_models/owlvit/stats.txt ======== 80 passed, 191 skipped, 184 deselected, 12 warnings in 23.59s ========= reports/huggingface_unit_testsrun_models_gpu_models/chinese_clip/stats.txt ======== 70 passed, 134 skipped, 174 deselected, 13 warnings in 12.61s ========= reports/huggingface_unit_testsrun_models_gpu_models/persimmon/stats.txt ========= 75 passed, 41 skipped, 77 deselected, 20 warnings in 19.05s ========== reports/huggingface_unit_testsrun_models_gpu_models/deformable_detr/stats.txt === 65 passed, 50 skipped, 102 deselected, 16 warnings in 185.65s (0:03:05) ==== reports/huggingface_unit_testsrun_models_gpu_models/opt/stats.txt ========== 40 skipped, 59 deselected, 12 warnings, 2 errors in 2.46s =========== reports/huggingface_unit_tests__run_models_gpu_models/gemma/stats.txt ========= 72 passed, 95 skipped, 190 deselected, 21 warnings in 15.46s ========= reports/huggingface_unit_testsrun_models_gpu_models/mluke/stats.txt ====================== 115 deselected, 1 warning in 0.82s ====================== reports/huggingface_unit_testsrun_models_gpu_models/auto/stats.txt ==== 1 failed, 16 passed, 48 skipped, 74 deselected, 15 warnings in 25.36s ===== reports/huggingface_unit_tests__run_models_gpu_models/altclip/stats.txt ========= 58 passed, 125 skipped, 123 deselected, 14 warnings in 7.95s ========= reports/huggingface_unit_testsrun_models_gpu_models/unispeech/stats.txt ========= 28 passed, 48 skipped, 78 deselected, 18 warnings in 11.85s ========== reports/huggingface_unit_testsrun_models_gpu_models/ernie/stats.txt ========= 73 passed, 50 skipped, 77 deselected, 17 warnings in 11.72s ========== reports/huggingface_unit_tests__run_models_gpu_models/wavlm/stats.txt ========== 25 passed, 51 skipped, 78 deselected, 28 warnings in 8.83s ========== reports/huggingface_unit_testsrun_models_gpu_models/paligemma/stats.txt ========== 16 passed, 50 skipped, 22 deselected, 18 warnings in 3.24s ========== reports/huggingface_unit_testsrun_models_gpu_models/pvt_v2/stats.txt ========== 25 passed, 50 skipped, 81 deselected, 12 warnings in 9.56s ========== reports/huggingface_unit_testsrun_models_gpu_models/lilt/stats.txt ========= 65 passed, 47 skipped, 77 deselected, 12 warnings in 15.23s ========== reports/huggingface_unit_testsrun_models_gpu_models/qwen2_audio/stats.txt ========== 26 passed, 42 skipped, 26 deselected, 24 warnings in 5.11s ========== reports/huggingface_unit_testsrun_models_gpu_models/clip/stats.txt ======== 89 passed, 378 skipped, 408 deselected, 14 warnings in 16.05s ========= reports/huggingface_unit_testsrun_models_gpu_models/xlnet/stats.txt ======== 52 passed, 106 skipped, 239 deselected, 17 warnings in 16.06s ========= reports/huggingface_unit_tests__run_models_gpu_models/nystromformer/stats.txt ========== 33 passed, 41 skipped, 77 deselected, 12 warnings in 9.44s ========== reports/huggingface_unit_testsrun_models_gpu_models/gpt_neo/stats.txt ==== 1 failed, 71 passed, 90 skipped, 79 deselected, 25 warnings in 22.60s ===== reports/huggingface_unit_testsrun_models_gpu_models/led/stats.txt ========= 56 passed, 95 skipped, 238 deselected, 40 warnings in 16.42s ========= reports/huggingface_unit_testsrun_models_gpu_models/pegasus_x/stats.txt === 1 failed, 119 passed, 101 skipped, 100 deselected, 17 warnings in 17.27s === reports/huggingface_unit_testsrun_models_gpu_models/oneformer/stats.txt ========= 26 passed, 49 skipped, 116 deselected, 14 warnings in 9.49s ========== reports/huggingface_unit_testsrun_models_gpu_models/plbart/stats.txt ======== 114 passed, 110 skipped, 207 deselected, 27 warnings in 39.02s ======== reports/huggingface_unit_testsrun_models_gpu_models/reformer/stats.txt ======== 110 passed, 142 skipped, 202 deselected, 24 warnings in 12.24s ======== reports/huggingface_unit_tests__run_models_gpu_models/bit/stats.txt ========= 28 passed, 47 skipped, 80 deselected, 12 warnings in 10.73s ========== reports/huggingface_unit_testsrun_models_gpu_models/grounding_dino/stats.txt ========= 27 passed, 46 skipped, 122 deselected, 12 warnings in 22.91s ========= reports/huggingface_unit_testsrun_models_gpu_models/segformer/stats.txt ========= 27 passed, 83 skipped, 155 deselected, 12 warnings in 11.29s ========= reports/huggingface_unit_tests__run_models_gpu_models/cvt/stats.txt ========= 23 passed, 85 skipped, 136 deselected, 12 warnings in 15.75s ========= reports/huggingface_unit_testsrun_models_gpu_models/wav2vec2_phoneme/stats.txt ====================== 111 deselected, 1 warning in 0.69s ====================== reports/huggingface_unit_testsrun_models_gpu_models/gpt_sw3/stats.txt ====================== 102 deselected, 1 warning in 0.80s ====================== reports/huggingface_unit_testsrun_models_gpu_models/glpn/stats.txt ========= 24 passed, 45 skipped, 93 deselected, 12 warnings in 15.98s ========== reports/huggingface_unit_testsrun_models_gpu_models/vilt/stats.txt ========= 40 passed, 97 skipped, 171 deselected, 12 warnings in 18.29s ========= reports/huggingface_unit_testsrun_models_gpu_models/falcon_mamba/stats.txt ==== 2 failed, 46 passed, 69 skipped, 77 deselected, 16 warnings in 11.20s ===== reports/huggingface_unit_testsrun_models_gpu_models/qwen2/stats.txt ========= 73 passed, 43 skipped, 179 deselected, 20 warnings in 24.58s ========= reports/huggingface_unit_testsrun_models_gpu_models/donut/stats.txt ========== 26 passed, 42 skipped, 95 deselected, 13 warnings in 8.85s ========== reports/huggingface_unit_testsrun_models_gpu_models/switch_transformers/stats.txt ======== 94 passed, 102 skipped, 101 deselected, 16 warnings in 19.82s ========= reports/huggingface_unit_testsrun_models_gpu_models/tapas/stats.txt ========= 39 passed, 102 skipped, 252 deselected, 12 warnings in 9.45s ========= reports/huggingface_unit_testsrun_models_gpu_models/jamba/stats.txt ========= 56 passed, 57 skipped, 77 deselected, 18 warnings in 24.26s ========== reports/huggingface_unit_tests__run_models_gpu_models/focalnet/stats.txt ========= 30 passed, 47 skipped, 80 deselected, 12 warnings in 15.23s ========== reports/huggingface_unit_testsrun_models_gpu_models/vit_msn/stats.txt ========== 24 passed, 45 skipped, 77 deselected, 13 warnings in 9.62s ========== reports/huggingface_unit_testsrun_models_gpu_models/mpt/stats.txt ========= 66 passed, 55 skipped, 77 deselected, 18 warnings in 20.51s ========== reports/huggingface_unit_tests__run_models_gpu_models/musicgen/stats.txt === 2 failed, 125 passed, 207 skipped, 53 deselected, 72 warnings in 18.24s ==== reports/huggingface_unit_testsrun_models_gpu_models/rembert/stats.txt ========= 39 passed, 88 skipped, 236 deselected, 16 warnings in 10.19s ========= reports/huggingface_unit_testsrun_models_gpu_models/gpt2/stats.txt === 1 failed, 75 passed, 156 skipped, 247 deselected, 35 warnings in 50.50s ==== reports/huggingface_unit_tests__run_models_gpu_models/levit/stats.txt ========= 23 passed, 46 skipped, 94 deselected, 12 warnings in 17.47s ========== reports/huggingface_unit_testsrun_models_gpu_models/autoformer/stats.txt ========= 21 passed, 48 skipped, 78 deselected, 16 warnings in 15.15s ========== reports/huggingface_unit_testsrun_models_gpu_models/beit/stats.txt ========= 28 passed, 88 skipped, 103 deselected, 13 warnings in 20.98s ========= reports/huggingface_unit_tests__run_models_gpu_models/mixtral/stats.txt ========= 72 passed, 42 skipped, 77 deselected, 26 warnings in 18.94s ========== reports/huggingface_unit_testsrun_models_gpu_models/wav2vec2_conformer/stats.txt ========= 43 passed, 50 skipped, 78 deselected, 16 warnings in 16.18s ========== reports/huggingface_unit_testsrun_models_gpu_models/roberta/stats.txt === 4 failed, 70 passed, 128 skipped, 239 deselected, 20 warnings in 13.45s ==== reports/huggingface_unit_tests__run_models_gpu_models/blip/stats.txt ======== 152 passed, 587 skipped, 355 deselected, 19 warnings in 16.15s ======== reports/huggingface_unit_testsrun_models_gpu_models/dbrx/stats.txt ========= 64 passed, 45 skipped, 77 deselected, 21 warnings in 22.82s ========== reports/huggingface_unit_testsrun_models_gpu_models/yoso/stats.txt ==== 32 passed, 43 skipped, 77 deselected, 12 warnings in 150.38s (0:02:30) ==== reports/huggingface_unit_tests__run_models_gpu_models/t5/stats.txt === 1 failed, 98 passed, 273 skipped, 344 deselected, 26 warnings in 35.41s ==== reports/huggingface_unit_testsrun_models_gpu_models/clvp/stats.txt === 93 passed, 205 skipped, 193 deselected, 22 warnings in 70.93s (0:01:10) ==== reports/huggingface_unit_testsrun_models_gpu_models/seggpt/stats.txt ========= 20 passed, 51 skipped, 101 deselected, 12 warnings in 8.08s ========== reports/huggingface_unit_tests__run_models_gpu_models/trocr/stats.txt ========= 52 passed, 55 skipped, 77 deselected, 17 warnings in 11.36s ========== reports/huggingface_unit_testsrun_models_gpu_models/esm/stats.txt ======== 44 passed, 140 skipped, 219 deselected, 12 warnings in 18.31s ========= reports/huggingface_unit_testsrun_models_gpu_models/align/stats.txt ======== 53 passed, 131 skipped, 141 deselected, 13 warnings in 14.33s ========= reports/huggingface_unit_tests__run_models_gpu_models/mbart/stats.txt === 115 passed, 147 skipped, 265 deselected, 27 warnings, 1 error in 34.33s ==== reports/huggingface_unit_testsrun_models_gpu_models/mra/stats.txt = 21 failed, 7 passed, 47 skipped, 77 deselected, 12 warnings in 129.15s (0:02:09) = reports/huggingface_unit_testsrun_models_gpu_models/mbart50/stats.txt ====================== 109 deselected, 1 warning in 0.91s ====================== reports/huggingface_unit_testsrun_models_gpu_models/wav2vec2_bert/stats.txt ========= 43 passed, 51 skipped, 84 deselected, 13 warnings in 10.19s ========== reports/huggingface_unit_testsrun_models_gpu_models/fuyu/stats.txt ========== 19 passed, 46 skipped, 87 deselected, 17 warnings in 7.36s ========== reports/huggingface_unit_testsrun_models_gpu_models/roformer/stats.txt ======== 39 passed, 116 skipped, 236 deselected, 16 warnings in 11.25s ========= reports/huggingface_unit_testsrun_models_gpu_models/lxmert/stats.txt ========= 32 passed, 77 skipped, 233 deselected, 13 warnings in 7.24s ========== reports/huggingface_unit_tests__run_models_gpu_models/gptj/stats.txt ======== 72 passed, 140 skipped, 138 deselected, 20 warnings in 20.27s ========= reports/huggingface_unit_testsrun_models_gpu_models/decision_transformer/stats.txt ========== 58 passed, 47 skipped, 78 deselected, 12 warnings in 6.33s ========== reports/huggingface_unit_testsrun_models_gpu_models/herbert/stats.txt ====================== 98 deselected, 1 warning in 0.66s ======================= reports/huggingface_unit_tests__run_models_gpu_models/jetmoe/stats.txt ========= 63 passed, 47 skipped, 77 deselected, 19 warnings in 14.09s ========== reports/huggingface_unit_testsrun_models_gpu_models/layoutlm/stats.txt ========= 36 passed, 83 skipped, 234 deselected, 12 warnings in 9.93s ========== reports/huggingface_unit_testsrun_models_gpu_models/dit/stats.txt ======================= 1 skipped, 11 warnings in 0.50s ======================== reports/huggingface_unit_tests__run_models_gpu_models/mpnet/stats.txt ========= 32 passed, 81 skipped, 234 deselected, 12 warnings in 8.93s ========== reports/huggingface_unit_testsrun_models_gpu_models/rt_detr/stats.txt ========= 32 passed, 50 skipped, 103 deselected, 13 warnings in 30.47s ========= reports/huggingface_unit_testsrun_models_gpu_models/albert/stats.txt ======== 38 passed, 101 skipped, 236 deselected, 13 warnings in 11.42s ========= reports/huggingface_unit_tests__run_models_gpu_models/superpoint/stats.txt ===== 1 failed, 17 passed, 51 skipped, 42 deselected, 11 warnings in 3.47s ===== reports/huggingface_unit_testsrun_models_gpu_models/code_llama/stats.txt ====================== 112 deselected, 1 warning in 0.81s ====================== reports/huggingface_unit_testsrun_models_gpu_models/table_transformer/stats.txt ========= 66 passed, 48 skipped, 78 deselected, 12 warnings in 16.50s ========== reports/huggingface_unit_testsrun_models_gpu_models/time_series_transformer/stats.txt ========= 28 passed, 48 skipped, 78 deselected, 16 warnings in 10.65s ========== reports/huggingface_unit_testsrun_models_gpu_models/bridgetower/stats.txt ========== 18 passed, 55 skipped, 93 deselected, 13 warnings in 7.58s ========== reports/huggingface_unit_tests__run_models_gpu_models/electra/stats.txt ======== 42 passed, 112 skipped, 252 deselected, 16 warnings in 11.50s ========= reports/huggingface_unit_testsrun_models_gpu_models/bros/stats.txt ========= 31 passed, 41 skipped, 77 deselected, 31 warnings in 10.65s ========== reports/huggingface_unit_testsrun_models_gpu_models/blenderbot/stats.txt === 114 passed, 141 skipped, 164 deselected, 24 warnings, 1 error in 12.93s ==== reports/huggingface_unit_tests__run_models_gpu_models/owlv2/stats.txt ======== 80 passed, 191 skipped, 165 deselected, 12 warnings in 26.18s ========= reports/huggingface_unit_testsrun_models_gpu_models/cohere/stats.txt ========= 70 passed, 39 skipped, 179 deselected, 21 warnings in 13.82s ========= reports/huggingface_unit_testsrun_models_gpu_models/speecht5/stats.txt === 2 failed, 92 passed, 248 skipped, 314 deselected, 20 warnings in 35.24s ==== reports/huggingface_unit_tests__run_models_gpu_models/data2vec/stats.txt ======== 130 passed, 185 skipped, 291 deselected, 26 warnings in 47.25s ======== reports/huggingface_unit_testsrun_models_gpu_models/dpr/stats.txt ========= 24 passed, 87 skipped, 597 deselected, 13 warnings in 7.23s ========== reports/huggingface_unit_testsrun_models_gpu_models/mobilenet_v2/stats.txt ========= 24 passed, 47 skipped, 94 deselected, 23 warnings in 20.71s ========== reports/huggingface_unit_testsrun_models_gpu_models/qwen2_moe/stats.txt ========= 71 passed, 46 skipped, 77 deselected, 19 warnings in 35.70s ========== reports/huggingface_unit_testsrun_models_gpu_models/mobilevitv2/stats.txt ========= 23 passed, 49 skipped, 77 deselected, 13 warnings in 17.02s ========== reports/huggingface_unit_tests__run_models_gpu_models/swin2sr/stats.txt ========== 19 passed, 51 skipped, 93 deselected, 12 warnings in 5.29s ========== reports/huggingface_unit_testsrun_models_gpu_models/rwkv/stats.txt ========= 45 passed, 67 skipped, 77 deselected, 21 warnings in 40.09s ========== reports/huggingface_unit_testsrun_models_gpu_models/informer/stats.txt ===== 1 failed, 17 passed, 51 skipped, 78 deselected, 15 warnings in 6.91s ===== reports/huggingface_unit_tests__run_models_gpu_models/chameleon/stats.txt ========= 60 passed, 51 skipped, 95 deselected, 19 warnings in 12.56s ========== reports/huggingface_unit_testsrun_models_gpu_models/olmo/stats.txt ========= 71 passed, 45 skipped, 77 deselected, 22 warnings in 14.57s ========== reports/huggingface_unit_testsrun_models_gpu_models/clap/stats.txt ======== 64 passed, 145 skipped, 151 deselected, 13 warnings in 11.64s ========= reports/huggingface_unit_testsrun_models_gpu_models/blip_2/stats.txt === 1 failed, 195 passed, 305 skipped, 210 deselected, 16 warnings in 29.42s === reports/huggingface_unit_testsrun_models_gpu_models/xmod/stats.txt ========= 74 passed, 51 skipped, 77 deselected, 19 warnings in 11.32s ========== reports/huggingface_unit_testsrun_models_gpu_models/roc_bert/stats.txt ========= 41 passed, 38 skipped, 191 deselected, 16 warnings in 10.96s ========= reports/huggingface_unit_testsrun_models_gpu_models/dac/stats.txt ========== 17 passed, 55 skipped, 99 deselected, 12 warnings in 6.01s ========== reports/huggingface_unit_tests__run_models_gpu_models/vit/stats.txt ========= 26 passed, 115 skipped, 156 deselected, 13 warnings in 9.79s ========= reports/huggingface_unit_testsrun_models_gpu_models/x_clip/stats.txt ======== 62 passed, 140 skipped, 123 deselected, 13 warnings in 10.75s ========= reports/huggingface_unit_testsrun_models_gpu_models/convnext/stats.txt ========= 30 passed, 83 skipped, 155 deselected, 12 warnings in 13.81s ========= reports/huggingface_unit_tests__run_models_gpu_models/idefics/stats.txt ======== 58 passed, 286 skipped, 188 deselected, 35 warnings in 16.81s ========= reports/huggingface_unit_testsrun_models_gpu_models/megatron_gpt2/stats.txt ======================== 1 skipped, 1 warning in 0.02s ========================= reports/huggingface_unit_testsrun_models_gpu_models/llava_next/stats.txt ========== 58 passed, 56 skipped, 43 deselected, 18 warnings in 5.22s ========== reports/huggingface_unit_testsrun_models_gpu_models/pegasus/stats.txt ======== 112 passed, 176 skipped, 364 deselected, 26 warnings in 14.64s ======== reports/huggingface_unit_testsrun_models_gpu_models/mistral/stats.txt ======== 73 passed, 190 skipped, 139 deselected, 20 warnings in 17.84s ========= reports/huggingface_unit_tests__run_models_gpu_models/bartpho/stats.txt ====================== 97 deselected, 1 warning in 0.80s ======================= reports/huggingface_unit_testsrun_models_gpu_models/codegen/stats.txt ========= 70 passed, 47 skipped, 178 deselected, 20 warnings in 13.53s ========= reports/huggingface_unit_testsrun_models_gpu_models/phobert/stats.txt ====================== 97 deselected, 1 warning in 0.69s ======================= reports/huggingface_unit_tests__run_models_gpu_models/canine/stats.txt ========= 24 passed, 48 skipped, 176 deselected, 12 warnings in 10.16s ========= reports/huggingface_unit_testsrun_models_gpu_models/encoder_decoder/stats.txt =========== 45 skipped, 5 deselected, 12 warnings, 2 errors in 2.47s =========== reports/huggingface_unit_testsrun_models_gpu_models/byt5/stats.txt ====================== 103 deselected, 1 warning in 0.65s ====================== reports/huggingface_unit_tests__run_models_gpu_models/layoutlmv3/stats.txt ========= 31 passed, 82 skipped, 275 deselected, 31 warnings in 5.94s ========== reports/huggingface_unit_testsrun_models_gpu_models/xglm/stats.txt = 1 failed, 65 passed, 134 skipped, 241 deselected, 25 warnings in 86.95s (0:01:26) = reports/huggingface_unit_testsrun_models_gpu_models/llava/stats.txt ========== 24 passed, 53 skipped, 24 deselected, 24 warnings in 9.40s ========== reports/huggingface_unit_tests__run_models_gpu_models/groupvit/stats.txt ========= 63 passed, 250 skipped, 191 deselected, 13 warnings in 9.38s ========= reports/huggingface_unit_testsrun_models_gpu_models/starcoder2/stats.txt ========= 73 passed, 42 skipped, 77 deselected, 22 warnings in 17.75s ==========


### Performance Test Results for tmp-develop_test-20240913

python examples/pytorch/language-modeling/run_mlm.py --model_name_or_path bert-base-uncased --dataset_name wikitext --dataset_config_name wikitext-2-raw-v1 --do_train --do_eval --output_dir /tmp/test-mlm --per_device_train_batch_size 8 --per_device_eval_batch_size 8 --max_steps 500