Closed erikzenker closed 9 years ago
There are some unfixed warnings in the pulled GrayBat subtree, I think.
In file included from /home/eckert62/haseongpu/src/calc_phi_ase_graybat.cc:35:0:
/home/eckert62/haseongpu/include/graybat/communicationPolicy/BMPI.hpp: In constructor ‘graybat::communicationPolicy::BMPI::Event::Event(boost::mpi::request)’:
/home/eckert62/haseongpu/include/graybat/communicationPolicy/BMPI.hpp:160:16: warning: ‘graybat::communicationPolicy::BMPI::Event::request’ will be initialized after [-Wreorder]
mpi::request request;
^
/home/eckert62/haseongpu/include/graybat/communicationPolicy/BMPI.hpp:159:28: warning: ‘const bool graybat::communicationPolicy::BMPI::Event::async’ [-Wreorder]
const bool async;
^
/home/eckert62/haseongpu/include/graybat/communicationPolicy/BMPI.hpp:108:3: warning: when initialized here [-Wreorder]
Event(mpi::request request) : request(request), async(true){
^
/home/eckert62/haseongpu/include/graybat/communicationPolicy/BMPI.hpp: In constructor ‘graybat::communicationPolicy::BMPI::Event::Event(boost::mpi::status)’:
/home/eckert62/haseongpu/include/graybat/communicationPolicy/BMPI.hpp:161:30: warning: ‘graybat::communicationPolicy::BMPI::Event::status’ will be initialized after [-Wreorder]
mpi::status status;
^
/home/eckert62/haseongpu/include/graybat/communicationPolicy/BMPI.hpp:159:28: warning: ‘const bool graybat::communicationPolicy::BMPI::Event::async’ [-Wreorder]
const bool async;
^
/home/eckert62/haseongpu/include/graybat/communicationPolicy/BMPI.hpp:112:17: warning: when initialized here [-Wreorder]
Event(mpi::status status) : status(status), async(false){
^
Okay, this was caused by unordered members in the Event class. Fixed it quick and clean.
First results are here :smiley_cat:
Very similar to https://github.com/ComputationalRadiationPhysics/haseongpu/pull/58#issuecomment-114260746 . Only difference: this time, 8 nodes were used to speed up the computation a bit.
1.5684e-04
.1.3170e-04
.Timestep | parallel_mode = 'graybat' (8 Nodes) | parallel_mode = 'graybat' (2 Nodes) |
---|---|---|
0 | 0.79924105727549743516391345110605470836162567138672 | 0.79924105727549743516391345110605470836162567138672 |
1 | 0.82967902324631426225209906988311558961868286132812 | 0.82967902324631426225209906988311558961868286132812 |
2 | 0.86065464598197138901269909183611162006855010986328 | 0.86065462812079707166645903271273709833621978759766 |
3 | 0.89211764631769296940433378040324896574020385742188 | 0.89211842815342379253706894814968109130859375000000 |
4 | 0.92401582024966666395471293071750551462173461914062 | 0.92401682806554297222589866578346118330955505371094 |
5 | 0.95629181903938598185987984834355302155017852783203 | 0.95629263173937595343687689819489605724811553955078 |
6 | 0.98888623154559951444753096438944339752197265625000 | 0.98888712306753245862012136058183386921882629394531 |
7 | 1.02173751319121119962574084638617932796478271484375 | 1.02173843526310159646186548343393951654434204101562 |
8 | 1.05478157067889788400805173296248540282249450683594 | 1.05478245359802325076259421621216461062431335449219 |
9 | 1.08795325652327523613394077983684837818145751953125 | 1.08795395273589790008372801821678876876831054687500 |
10 | 1.12118674243655158662136273051146417856216430664062 | 1.12118816782543184729092899942770600318908691406250 |
11 | 1.15441523081499419767226299882167950272560119628906 | 1.15441670163264520354573505755979567766189575195312 |
12 | 1.18757161866819327400435213348828256130218505859375 | 1.18757508930889632559058100014226511120796203613281 |
13 | 1.22059289196651521436365328554529696702957153320312 | 1.22059425925333542295447841752320528030395507812500 |
14 | 1.25340950145959162398412445327267050743103027343750 | 1.25340957286649690161084436113014817237854003906250 |
15 | 1.28596778825772051213505164923844859004020690917969 | 1.28596268964107940391272677516099065542221069335938 |
16 | 1.31819861680314831531291019928175956010818481445312 | 1.31819285752118720012049379874952137470245361328125 |
17 | 1.35004952558666801998299433762440457940101623535156 | 1.35004790878892411143397112027741968631744384765625 |
18 | 1.38145974878399324659028479800326749682426452636719 | 1.38145493697656029929987653304124251008033752441406 |
19 | 1.41238535494249095592067533289082348346710205078125 | 1.41237555863802777267324017884675413370132446289062 |
20 | 1.44277517907330432578305590141098946332931518554688 | 1.44276118787210050342650902166496962308883666992188 |
21 | 1.47258200461405808212589363392908126115798950195312 | 1.47255132020237633483361605613026767969131469726562 |
22 | 1.50175083870338177405301394173875451087951660156250 | 1.50173649074519044432918235543183982372283935546875 |
23 | 1.53025602012058525858151369902770966291427612304688 | 1.53023848774189463739503480610437691211700439453125 |
24 | 1.55805021973011426084099184663500636816024780273438 | 1.55804882163697255847978340170811861753463745117188 |
25 | 1.58513674721803443645740117062814533710479736328125 | 1.58513561645443479264372399484273046255111694335938 |
26 | 1.61147404996065501947555276274215430021286010742188 | 1.61145552707751482657272390497382730245590209960938 |
27 | 1.63703934055330391217353280808310955762863159179688 | 1.63700597924142199346420056826900690793991088867188 |
28 | 1.66180996211737985746026424749288707971572875976562 | 1.66178656194134188872624235955299809575080871582031 |
29 | 1.68575068457618315598267599852988496422767639160156 | 1.68575734438228863609765539877116680145263671875000 |
30 | 1.70887230650595167702476828708313405513763427734375 | 1.70894384879774108298988721799105405807495117187500 |
31 | 1.73119771562435142975289181777043268084526062011719 | 1.73124053506014141667890271492069587111473083496094 |
32 | 1.75269251998407171733163067983696237206459045410156 | 1.75273472832178667246694203640799969434738159179688 |
33 | 1.77333864341145552856460199109278619289398193359375 | 1.77336005392800299951261422393145039677619934082031 |
34 | 1.79320318088342567364179558353498578071594238281250 | 1.79321438817702971668666123150615021586418151855469 |
35 | 1.81222746390682676320693644811399281024932861328125 | 1.81223211489575275479069205175619572401046752929688 |
36 | 1.83048487470327070347764220059616491198539733886719 | 1.83050871241112700360531562182586640119552612304688 |
37 | 1.84796500955362663631831310340203344821929931640625 | 1.84798353747037924499352357088355347514152526855469 |
38 | 1.86470416174254149943578795500798150897026062011719 | 1.86469159278159879455927239177981391549110412597656 |
39 | 1.88065568658344695052164752269163727760314941406250 | 1.88061391547066913965124967944575473666191101074219 |
40 | 1.89588211026164188410803035367280244827270507812500 | 1.89580139551908488648734874004730954766273498535156 |
41 | 1.91040803002414394384800289117265492677688598632812 | 1.91030465448633712810533324955031275749206542968750 |
42 | 1.92418668207478971154955615929793566465377807617188 | 1.92412076805760623443575241253711283206939697265625 |
43 | 1.93731384377214377323639382666442543268203735351562 | 1.93725063663261698465589688566979020833969116210938 |
44 | 1.94979128929440648221316223498433828353881835937500 | 1.94975568983534230937948450446128845214843750000000 |
45 | 1.96163568911663110938548015838023275136947631835938 | 1.96160848551465516464986649225465953350067138671875 |
46 | 1.97288172909390091547265910776332020759582519531250 | 1.97287086343232909158018628659192472696304321289062 |
47 | 1.98351988407477475284679258038522675633430480957031 | 1.98354697826470971477874627453275024890899658203125 |
48 | 1.99357169503742515104249832802452147006988525390625 | 1.99364445798763245676354927127249538898468017578125 |
49 | 2.00317622832205932681404192408081144094467163085938 | 2.00322164084043929932477112743072211742401123046875 |
50 | 2.01223664315384054290802851028274744749069213867188 | 2.01230938852370266900493334105703979730606079101562 |
51 | 1.95018394316558474343992202193476259708404541015625 | 1.95021993846931129823474293516483157873153686523438 |
52 | 1.89318910258728934081773331854492425918579101562500 | 1.89323544811712496382938297756481915712356567382812 |
53 | 1.84068780664882636344259481120388954877853393554688 | 1.84073957907868712702281754900468513369560241699219 |
54 | 1.79214044783855275255746164475567638874053955078125 | 1.79221312385755426888067631807643920183181762695312 |
55 | 1.74722172735053238312730172765441238880157470703125 | 1.74725309348977475565334316343069076538085937500000 |
56 | 1.70550227819825117592245078412815928459167480468750 | 1.70548917746601080835944230784662067890167236328125 |
57 | 1.66667764281204355825138918589800596237182617187500 | 1.66662040349931439564556967525277286767959594726562 |
58 | 1.63039145550484265712043452367652207612991333007812 | 1.63038805027152400306533763796323910355567932128906 |
59 | 1.59650790050154722798936290928395465016365051269531 | 1.59647594404052206584765372099354863166809082031250 |
60 | 1.56470386595774035853878558555152267217636108398438 | 1.56470070839759101133381591353099793195724487304688 |
61 | 1.53483314058098763155157939763739705085754394531250 | 1.53484332728497685494062352518085390329360961914062 |
62 | 1.50671883030010933524067695543635636568069458007812 | 1.50677018622325631369562870531808584928512573242188 |
63 | 1.48024918388678683456305407162290066480636596679688 | 1.48031004637851237859536013274919241666793823242188 |
64 | 1.45526638690099963113766534661408513784408569335938 | 1.45533750323464472486989507160615175962448120117188 |
65 | 1.43165249590941434654212116583948954939842224121094 | 1.43169871744296561821840896300273016095161437988281 |
66 | 1.40929459755204522508620357257314026355743408203125 | 1.40934152704175597037306033598724752664566040039062 |
67 | 1.38809723863382927788734377827495336532592773437500 | 1.38814374774575899351702901185490190982818603515625 |
68 | 1.36798262076889542981916747521609067916870117187500 | 1.36803243713483846377698682772461324930191040039062 |
69 | 1.34886700051521324361658571433508768677711486816406 | 1.34892008949273956019965226005297154188156127929688 |
70 | 1.33069577550302087232125813898164778947830200195312 | 1.33073839427816298375262249464867636561393737792969 |
71 | 1.31339131364773820109803637024015188217163085937500 | 1.31342206595436405969223869760753586888313293457031 |
72 | 1.29689512482056379383266175864264369010925292968750 | 1.29692744006829707714700816723052412271499633789062 |
73 | 1.28115715576978650425132855161791667342185974121094 | 1.28119025004819597768346284283325076103210449218750 |
74 | 1.26612817449438219696844498685095459222793579101562 | 1.26615794051214836102303706866223365068435668945312 |
75 | 1.25176251935713311880249420937616378068923950195312 | 1.25179724582636131557933367730583995580673217773438 |
76 | 1.23802046259382936277404496649978682398796081542969 | 1.23805653064118281747596483910456299781799316406250 |
77 | 1.22486460450795231480469738016836345195770263671875 | 1.22489875043123985776105655531864613294601440429688 |
78 | 1.21226204040743779088984410918783396482467651367188 | 1.21229159920425622054551695327972993254661560058594 |
79 | 1.20017323120257346502626205619890242815017700195312 | 1.20020467671594444070137797098141163587570190429688 |
80 | 1.18857712053595299117603190097725018858909606933594 | 1.18860912048194755641361552989110350608825683593750 |
81 | 1.17744427067537360542814894870389252901077270507812 | 1.17747445359833546874028797901701182126998901367188 |
82 | 1.16674776621888742766941504669375717639923095703125 | 1.16677789933801379085309690708527341485023498535156 |
83 | 1.15646424465430763817153092531953006982803344726562 | 1.15649438579182683994872604671400040388107299804688 |
84 | 1.14657627617212765080978442711057141423225402832031 | 1.14660126156137831543446736759506165981292724609375 |
85 | 1.13705824499840990604582202649908140301704406738281 | 1.13708168925274111238366003817645832896232604980469 |
86 | 1.12789142416562082615882900427095592021942138671875 | 1.12791279101886865454673625208670273423194885253906 |
87 | 1.11905918646281987705037863634061068296432495117188 | 1.11907904604401364778709648817311972379684448242188 |
88 | 1.11054346479937171565666176320519298315048217773438 | 1.11056292437275128115459210675908252596855163574219 |
89 | 1.10233033840870398023525922326371073722839355468750 | 1.10234855498391848271921844570897519588470458984375 |
90 | 1.09440397649277709746229447773657739162445068359375 | 1.09442179494997393618405112647451460361480712890625 |
91 | 1.08675218778618565274030061118537560105323791503906 | 1.08676993418013467795901760837296023964881896972656 |
92 | 1.07936059484478974468402157071977853775024414062500 | 1.07937809653759630990066398226190358400344848632812 |
93 | 1.07221906565965330315748360590077936649322509765625 | 1.07223542147674733016060599766205996274948120117188 |
94 | 1.06531521070014068008902086148736998438835144042969 | 1.06533133595106010993447398504940792918205261230469 |
95 | 1.05863840661769947892878462880617007613182067871094 | 1.05865377365728097203145807725377380847930908203125 |
96 | 1.05217887025763423558544218394672498106956481933594 | 1.05219314747922521036116449977271258831024169921875 |
97 | 1.04592663307590361121413025102810934185981750488281 | 1.04594095369748152357658455002820119261741638183594 |
98 | 1.03987342943126126471042880439199507236480712890625 | 1.03988748320252244461414647958008572459220886230469 |
99 | 1.03401078390834277875853786099469289183616638183594 | 1.03402379135532718201773150212829932570457458496094 |
100 | 1.02833016373117813735404979524901136755943298339844 | 1.02834264847993295255434986756881698966026306152344 |
101 | 1.02282448490799904305958989425562322139739990234375 | 1.02283648881535604857617727247998118400573730468750 |
102 | 1.01748626130377162191109619016060605645179748535156 | 1.01749795913597962382368677936028689146041870117188 |
103 | 1.01230886187067015136165082367369905114173889160156 | 1.01232025698318950368559399066725745797157287597656 |
104 | 1.00728624255222354300087772571714594960212707519531 | 1.00729716948704495216304621862946078181266784667969 |
105 | 1.00241226034057762106499467336107045412063598632812 | 1.00242258351871993404813565575750544667243957519531 |
106 | 0.99768076790134840869939125695964321494102478027344 | 0.99769082055188507140996989619452506303787231445312 |
107 | 0.99308644609382046297696433612145483493804931640625 | 0.99309624250998462802186850240104831755161285400391 |
108 | 0.98862407146092601273323907662415876984596252441406 | 0.98863367584973582680163417535368353128433227539062 |
109 | 0.98428880010365116248749473015777766704559326171875 | 0.98429824221312611776113499217899516224861145019531 |
110 | 0.98007594612372961329072040825849398970603942871094 | 0.98008506529439709531459357094718143343925476074219 |
111 | 0.97598101546387816540573112433776259422302246093750 | 0.97598959539850305144881303931470029056072235107422 |
112 | 0.97199970816129066530919544675271026790142059326172 | 0.97200791184127321997721082880161702632904052734375 |
113 | 0.96812768863179654577066912679583765566349029541016 | 0.96813594608255271189989343838533386588096618652344 |
114 | 0.96436155250989630260960439045447856187820434570312 | 0.96436947993695332215224880201276391744613647460938 |
115 | 0.96069707314523844488007853215094655752182006835938 | 0.96070496191256404827640835719648748636245727539062 |
116 | 0.95713120518139127579360092568094842135906219482422 | 0.95713898103221084490144221490481868386268615722656 |
117 | 0.95366004773104462444166529166977852582931518554688 | 0.95366789600286039352283751213690266013145446777344 |
118 | 0.95028083968622367727618893695762380957603454589844 | 0.95028870179130553452750973519869148731231689453125 |
119 | 0.94699047393009827544574363855645060539245605468750 | 0.94699798263331924630392677499912679195404052734375 |
120 | 0.94378581739776779002681905694771558046340942382812 | 0.94379300949230882089580063620815053582191467285156 |
121 | 0.94066383588623980749332531559048220515251159667969 | 0.94067086097235841357644403615267947316169738769531 |
122 | 0.93762211473113321602568248636089265346527099609375 | 0.93762871718067486437320212644408456981182098388672 |
123 | 0.93465800681812805095205476391129195690155029296875 | 0.93466440829337971152313002676237374544143676757812 |
124 | 0.93176916906692008879531385900918394327163696289062 | 0.93177486234713935431273057474754750728607177734375 |
125 | 0.92895293620670205125833263082313351333141326904297 | 0.92895839734549212618475166891585104167461395263672 |
126 | 0.92620687029267712020441649656277149915695190429688 | 0.92621261326743753450330132181989029049873352050781 |
127 | 0.92352908853477955197774917905917391180992126464844 | 0.92353443653637556920443785202223807573318481445312 |
128 | 0.92091729206519046257994887128006666898727416992188 | 0.92092238671251025472486162470886483788490295410156 |
129 | 0.91836969854787242617533138400176540017127990722656 | 0.91837437384528053385679413622710853815078735351562 |
130 | 0.91588414485016977906184365565422922372817993164062 | 0.91588811720972496122072925572865642607212066650391 |
131 | 0.91345834531663261390832531105843372642993927001953 | 0.91346246584431323167763139281305484473705291748047 |
132 | 0.91109119856288134364774577989010140299797058105469 | 0.91109523808806869293874797222088091075420379638672 |
133 | 0.90878033675643354882822677609510719776153564453125 | 0.90878484360072953052167576970532536506652832031250 |
134 | 0.90652518886124355823596943082520738244056701660156 | 0.90652946154296132341698921663919463753700256347656 |
135 | 0.90432336887987396778498805360868573188781738281250 | 0.90432721464549281620293186279013752937316894531250 |
136 | 0.90217308161716625036774530599359422922134399414062 | 0.90217703428488627004355748795205727219581604003906 |
137 | 0.90007335451173298146443357836687937378883361816406 | 0.90007740706758887494487453295732848346233367919922 |
138 | 0.89802289739336449425621822229004465043544769287109 | 0.89802690756556990958614505871082656085491180419922 |
139 | 0.89601973267369250386593648727284744381904602050781 | 0.89602365907103842523895309568615630269050598144531 |
Looks even a bit faster than the MPI code! Cool stuff!
Introduced GrayBat recv from any adjacent vertex, such that the first vertex that sends a msg will be served first.