search

TempoHPC / codeaudit_ic

Repositório com os códigos
0 stars 1 forks source link

Rodadas de 120km do MPAS com o Scalasca #7

Open robertopsouto opened 5 months ago

robertopsouto commented 5 months ago

Rodadas de 120 km do MPAS com o Scalasca

#núcleos nós MPI OpenMP Realizado
1 1 1 1 sbatch -N1 -n1 -c1 submit_atmosphere_v8_scalasca.sh
2 1 2 1 sbatch -N1 -n2 -c1 submit_atmosphere_v8_scalasca.sh
4 1 4 1 sbatch -N1 -n4 -c1 submit_atmosphere_v8_scalasca.sh
8 1 8 1 sbatch -N1 -n8 -c1 submit_atmosphere_v8_scalasca.sh
16 1 16 1 sbatch -N1 -n16 -c1 submit_atmosphere_v8_scalasca.sh
32 1 32 1 sbatch -N1 -n32 -c1 submit_atmosphere_v8_scalasca.sh
48 1 48 1 sbatch -N1 -n48 -c1 submit_atmosphere_v8_scalasca.sh
2 1 1 2 sbatch -N1 -n1 -c2 submit_atmosphere_v8_scalasca.sh
4 1 2 2 sbatch -N1 -n2 -c2 submit_atmosphere_v8_scalasca.sh
8 1 4 2 sbatch -N1 -n4 -c2 submit_atmosphere_v8_scalasca.sh
16 1 8 2 sbatch -N1 -n8 -c2 submit_atmosphere_v8_scalasca.sh
32 1 16 2 sbatch -N1 -n16 -c2 submit_atmosphere_v8_scalasca.sh
48 1 24 2 sbatch -N1 -n24 -c2 submit_atmosphere_v8_scalasca.sh
4 1 1 4 sbatch -N1 -n1 -c4 submit_atmosphere_v8_scalasca.sh
8 1 2 4 sbatch -N1 -n2 -c4 submit_atmosphere_v8_scalasca.sh
16 1 4 4 sbatch -N1 -n4 -c4 submit_atmosphere_v8_scalasca.sh
32 1 8 4 sbatch -N1 -n8 -c4 submit_atmosphere_v8_scalasca.sh
48 1 12 4 sbatch -N1 -n12 -c4 submit_atmosphere_v8_scalasca.sh
isabeldefreitas commented 5 months ago

<!DOCTYPE html>

Rodadas de 120 km do MPAS com o Scalasca

#núcleos nós MPI OpenMP Comando Resultados
1 1 1 1 sbatch -N1 -n1 -c1 submit_atmosphere_v8_scalasca.sh -
2 1 2 1 sbatch -N1 -n2 -c1 submit_atmosphere_v8_scalasca.sh -
4 1 4 1 sbatch -N1 -n4 -c1 submit_atmosphere_v8_scalasca.sh -
8 1 8 1 sbatch -N1 -n8 -c1 submit_atmosphere_v8_scalasca.sh 970.47729
16 1 16 1 sbatch -N1 -n16 -c1 submit_atmosphere_v8_scalasca.sh 544.81769
32 1 32 1 sbatch -N1 -n32 -c1 submit_atmosphere_v8_scalasca.sh 341.83902
48 1 48 1 sbatch -N1 -n48 -c1 submit_atmosphere_v8_scalasca.sh -
2 1 1 2 sbatch -N1 -n1 -c2 submit_atmosphere_v8_scalasca.sh -
4 1 2 2 sbatch -N1 -n2 -c2 submit_atmosphere_v8_scalasca.sh -
8 1 4 2 sbatch -N1 -n4 -c2 submit_atmosphere_v8_scalasca.sh -
16 1 8 2 sbatch -N1 -n8 -c2 submit_atmosphere_v8_scalasca.sh 645.17889
32 1 16 2 sbatch -N1 -n16 -c2 submit_atmosphere_v8_scalasca.sh 383.12198
48 1 24 2 sbatch -N1 -n24 -c2 submit_atmosphere_v8_scalasca.sh -
4 1 1 4 sbatch -N1 -n1 -c4 submit_atmosphere_v8_scalasca.sh -
8 1 2 4 sbatch -N1 -n2 -c4 submit_atmosphere_v8_scalasca.sh -
16 1 4 4 sbatch -N1 -n4 -c4 submit_atmosphere_v8_scalasca.sh 854.98322
32 1 8 4 sbatch -N1 -n8 -c4 submit_atmosphere_v8_scalasca.sh 483.68765
48 1 12 4 sbatch -N1 -n12 -c4 submit_atmosphere_v8_scalasca.sh -

Obs.: ( - ) representa resultado incompleto

robertopsouto commented 5 months ago

Muito obrigado, Isabel.

isabeldefreitas commented 4 months ago

<!DOCTYPE html>

Rodadas de 120 km do MPAS com o HPCToolkit

#núcleos nós MPI OpenMP Comando Resultados
1 1 1 1 sbatch -N1 -n1 -c1 submit_atmosphere_v8_hpctoolkit.sh 215.95940
2 1 2 1 sbatch -N1 -n2 -c1 submit_atmosphere_v8_hpctoolkit.sh 119.18462
4 1 4 1 sbatch -N1 -n4 -c1 submit_atmosphere_v8_hpctoolkit.sh 74.78854
8 1 8 1 sbatch -N1 -n8 -c1 submit_atmosphere_v8_hpctoolkit.sh 39.73951
16 1 16 1 sbatch -N1 -n16 -c1 submit_atmosphere_v8_hpctoolkit.sh 25.78288
32 1 32 1 sbatch -N1 -n32 -c1 submit_atmosphere_v8_hpctoolkit.sh -
48 1 48 1 sbatch -N1 -n48 -c1 submit_atmosphere_v8_hpctoolkit.sh -
2 1 1 2 sbatch -N1 -n1 -c2 submit_atmosphere_v8_hpctoolkit.sh 570.96448
4 1 2 2 sbatch -N1 -n2 -c2 submit_atmosphere_v8_hpctoolkit.sh 310.44604
8 1 4 2 sbatch -N1 -n4 -c2 submit_atmosphere_v8_hpctoolkit.sh 195.37082
16 1 8 2 sbatch -N1 -n8 -c2 submit_atmosphere_v8_hpctoolkit.sh 105.18797
32 1 16 2 sbatch -N1 -n16 -c2 submit_atmosphere_v8_hpctoolkit.sh 56.39447
48 1 24 2 sbatch -N1 -n24 -c2 submit_atmosphere_v8_hpctoolkit.sh -
4 1 1 4 sbatch -N1 -n1 -c4 submit_atmosphere_v8_hpctoolkit.sh 572.33813
8 1 2 4 sbatch -N1 -n2 -c4 submit_atmosphere_v8_hpctoolkit.sh 312.96530
16 1 4 4 sbatch -N1 -n4 -c4 submit_atmosphere_v8_hpctoolkit.sh 198.71564
32 1 8 4 sbatch -N1 -n8 -c4 submit_atmosphere_v8_hpctoolkit.sh 97.87856
48 1 12 4 sbatch -N1 -n12 -c4 submit_atmosphere_v8_hpctoolkit.sh -

Obs.: o sinal ( - ), representa resultado com error: Batch job submission failed: Requested node configuration is not available

@ebiduardo

isabeldefreitas commented 4 months ago

<!DOCTYPE html>

Novas rodadas do MPAS com o HPCToolkit em 2h e 120km

#núcleos nós MPI OpenMP Comando Resultados
1 1 1 1 sbatch -N1 -n1 -c1 submit_atmosphere_v8_hpctoolkit.sh 223.84523
2 1 2 1 sbatch -N1 -n2 -c1 submit_atmosphere_v8_hpctoolkit.sh 120.41308
4 1 4 1 sbatch -N1 -n4 -c1 submit_atmosphere_v8_hpctoolkit.sh 76.47034
8 1 8 1 sbatch -N1 -n8 -c1 submit_atmosphere_v8_hpctoolkit.sh 40.73136
16 1 16 1 sbatch -N1 -n16 -c1 submit_atmosphere_v8_hpctoolkit.sh 28.17356
32 1 32 1 sbatch -N1 -n32 -c1 submit_atmosphere_v8_hpctoolkit.sh -
48 1 48 1 sbatch -N1 -n48 -c1 submit_atmosphere_v8_hpctoolkit.sh -
2 1 1 2 sbatch -N1 -n1 -c2 submit_atmosphere_v8_hpctoolkit.sh 218.84299
4 1 2 2 sbatch -N1 -n2 -c2 submit_atmosphere_v8_hpctoolkit.sh 122.97560
8 1 4 2 sbatch -N1 -n4 -c2 submit_atmosphere_v8_hpctoolkit.sh 80.75845
16 1 8 2 sbatch -N1 -n8 -c2 submit_atmosphere_v8_hpctoolkit.sh 42.88792
32 1 16 2 sbatch -N1 -n16 -c2 submit_atmosphere_v8_hpctoolkit.sh 23.28569
48 1 24 2 sbatch -N1 -n24 -c2 submit_atmosphere_v8_hpctoolkit.sh -
4 1 1 4 sbatch -N1 -n1 -c4 submit_atmosphere_v8_hpctoolkit.sh 216.33627
8 1 2 4 sbatch -N1 -n2 -c4 submit_atmosphere_v8_hpctoolkit.sh 127.60201
16 1 4 4 sbatch -N1 -n4 -c4 submit_atmosphere_v8_hpctoolkit.sh 76.53075
32 1 8 4 sbatch -N1 -n8 -c4 submit_atmosphere_v8_hpctoolkit.sh 44.77845
48 1 12 4 sbatch -N1 -n12 -c4 submit_atmosphere_v8_hpctoolkit.sh -

@ebiduardo @robertopsouto

isabeldefreitas commented 4 months ago

MPAS com o HPCToolkit em 24h e 120km

image image

@robertopsouto @ebiduardo

isabeldefreitas commented 3 months ago

<!DOCTYPE html>

Novos Resultados do MPAS com o HPCToolkit e Scalasca em 4h e 120km

#núcleos nós MPI OpenMP Comando Hpctoolkit Scalasca
1 1 1 1 sbatch -N1 -n1 -c1 submit_atmosphere_v8_hpctk.sh ou submit_atmosphere_v8_scalasca.sh 1128.96045
2 1 2 1 sbatch -N1 -n2 -c1 submit_atmosphere_v8_hpctk.sh ou submit_atmosphere_v8_scalasca.sh 613.42645
4 1 4 1 sbatch -N1 -n4 -c1 submit_atmosphere_v8_hpctk.sh ou submit_atmosphere_v8_scalasca.sh 314.94769
8 1 8 1 sbatch -N1 -n8 -c1 submit_atmosphere_v8_hpctk.sh ou submit_atmosphere_v8_scalasca.sh 178.34309 889.90985
16 1 16 1 sbatch -N1 -n16 -c1 submit_atmosphere_v8_hpctk.sh ou submit_atmosphere_v8_scalasca.sh 98.72994 470.33041
32 1 32 1 sbatch -N1 -n32 -c1 submit_atmosphere_v8_hpctk.sh ou submit_atmosphere_v8_scalasca.sh 63.38704 290.85623
48 1 48 1 sbatch -N1 -n48 -c1 submit_atmosphere_v8_hpctk.sh ou submit_atmosphere_v8_scalasca.sh
2 1 1 2 sbatch -N1 -n1 -c2 submit_atmosphere_v8_hpctk.sh ou submit_atmosphere_v8_scalasca.sh 626.57172
4 1 2 2 sbatch -N1 -n2 -c2 submit_atmosphere_v8_hpctk.sh ou submit_atmosphere_v8_scalasca.sh 341.86740
8 1 4 2 sbatch -N1 -n4 -c2 submit_atmosphere_v8_hpctk.sh ou submit_atmosphere_v8_scalasca.sh 174.38580 923.15503
16 1 8 2 sbatch -N1 -n8 -c2 submit_atmosphere_v8_hpctk.sh ou submit_atmosphere_v8_scalasca.sh 99.91988 531.85291
32 1 16 2 sbatch -N1 -n16 -c2 submit_atmosphere_v8_hpctk.sh ou submit_atmosphere_v8_scalasca.sh 60.74553 310.25449
48 1 24 2 sbatch -N1 -n24 -c2 submit_atmosphere_v8_hpctk.sh ou submit_atmosphere_v8_scalasca.sh
4 1 1 4 sbatch -N1 -n1 -c4 submit_atmosphere_v8_hpctk.sh ou submit_atmosphere_v8_scalasca.sh 360.83145
8 1 2 4 sbatch -N1 -n2 -c4 submit_atmosphere_v8_hpctk.sh ou submit_atmosphere_v8_scalasca.sh 198.17487 1127.06519
16 1 4 4 sbatch -N1 -n4 -c4 submit_atmosphere_v8_hpctk.sh ou submit_atmosphere_v8_scalasca.sh 100.61723 616.62720
32 1 8 4 sbatch -N1 -n8 -c4 submit_atmosphere_v8_hpctk.sh ou submit_atmosphere_v8_scalasca.sh 64.78725 373.23593
48 1 12 4 sbatch -N1 -n12 -c4 submit_atmosphere_v8_hpctk.sh ou submit_atmosphere_v8_scalasca.sh 48.17338 281.80191

@ebiduardo @robertopsouto

robertopsouto commented 3 months ago

Obrigado, Isabel. Os ganhos de desempenho com OpenMP estão coerentes e compatíveis com aqueles obtidos usando somente MPI, com o mesmo número total de núcleos computacionais alocados.

ebiduardo commented 3 months ago

bom dia. o que voces acham dos tempos com o scalasca ?

Em qui., 11 de jul. de 2024 às 17:36, Roberto Pinto Souto < @.***> escreveu:

Obrigado, Isabel. Os ganhos de desempenho com OpenMP estão coerentes e compatíveis com aqueles obtidos usando somente MPI, com o mesmo número total de núcleos computacionais alocados.

— Reply to this email directly, view it on GitHub https://github.com/TempoHPC/codeaudit_ic/issues/7#issuecomment-2223887708, or unsubscribe https://github.com/notifications/unsubscribe-auth/ADMQGIVYFQNGMBRHSTWOADDZL3UFJAVCNFSM6AAAAABINJ3CM6VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMZDEMRTHA4DONZQHA . You are receiving this because you were mentioned.Message ID: @.***>

robertopsouto commented 3 months ago

@ebiduardo , os tempos mais altos com scalasca são esperados. O custo adicional de fazer a medição das métricas de desempenho é bem alto mesmo no scalasca.

isabeldefreitas commented 3 months ago

<!DOCTYPE html>

Rodadas do MPAS sem HPCToolkit e Scalaca em 4h e 120km

#núcleos nós MPI OpenMP Comando Resultados
1 1 1 1 sbatch -N1 -n1 -c1 submit_atmosphere_v8.sh 567.95105
2 1 2 1 sbatch -N1 -n2 -c1 submit_atmosphere_v8.sh 311.47552
4 1 4 1 sbatch -N1 -n4 -c1 submit_atmosphere_v8.sh 161.63968
8 1 8 1 sbatch -N1 -n8 -c1 submit_atmosphere_v8.sh 90.48603
16 1 16 1 sbatch -N1 -n16 -c1 submit_atmosphere_v8.sh 47.94639
32 1 32 1 sbatch -N1 -n32 -c1 submit_atmosphere_v8.sh 27.47388
2 1 1 2 sbatch -N1 -n1 -c2 submit_atmosphere_v8.sh 322.74997
4 1 2 2 sbatch -N1 -n2 -c2 submit_atmosphere_v8.sh 181.14856
8 1 4 2 sbatch -N1 -n4 -c2 submit_atmosphere_v8.sh 90.33562
16 1 8 2 sbatch -N1 -n8 -c2 submit_atmosphere_v8.sh 50.81199
32 1 16 2 sbatch -N1 -n16 -c2 submit_atmosphere_v8.sh 29.61199
4 1 1 4 sbatch -N1 -n1 -c4 submit_atmosphere_v8.sh 194.06419
8 1 2 4 sbatch -N1 -n2 -c4 submit_atmosphere_v8.sh 104.62843
16 1 4 4 sbatch -N1 -n4 -c4 submit_atmosphere_v8.sh 53.70099
32 1 8 4 sbatch -N1 -n8 -c4 submit_atmosphere_v8.sh 32.34010
48 1 12 4 sbatch -N1 -n12 -c4 submit_atmosphere_v8.sh 24.27359

@ebiduardo