-
Notifications
You must be signed in to change notification settings - Fork 0
Expand file tree
/
Copy pathcontainer_full.txt
More file actions
978 lines (938 loc) · 41.9 KB
/
container_full.txt
File metadata and controls
978 lines (938 loc) · 41.9 KB
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460
461
462
463
464
465
466
467
468
469
470
471
472
473
474
475
476
477
478
479
480
481
482
483
484
485
486
487
488
489
490
491
492
493
494
495
496
497
498
499
500
501
502
503
504
505
506
507
508
509
510
511
512
513
514
515
516
517
518
519
520
521
522
523
524
525
526
527
528
529
530
531
532
533
534
535
536
537
538
539
540
541
542
543
544
545
546
547
548
549
550
551
552
553
554
555
556
557
558
559
560
561
562
563
564
565
566
567
568
569
570
571
572
573
574
575
576
577
578
579
580
581
582
583
584
585
586
587
588
589
590
591
592
593
594
595
596
597
598
599
600
601
602
603
604
605
606
607
608
609
610
611
612
613
614
615
616
617
618
619
620
621
622
623
624
625
626
627
628
629
630
631
632
633
634
635
636
637
638
639
640
641
642
643
644
645
646
647
648
649
650
651
652
653
654
655
656
657
658
659
660
661
662
663
664
665
666
667
668
669
670
671
672
673
674
675
676
677
678
679
680
681
682
683
684
685
686
687
688
689
690
691
692
693
694
695
696
697
698
699
700
701
702
703
704
705
706
707
708
709
710
711
712
713
714
715
716
717
718
719
720
721
722
723
724
725
726
727
728
729
730
731
732
733
734
735
736
737
738
739
740
741
742
743
744
745
746
747
748
749
750
751
752
753
754
755
756
757
758
759
760
761
762
763
764
765
766
767
768
769
770
771
772
773
774
775
776
777
778
779
780
781
782
783
784
785
786
787
788
789
790
791
792
793
794
795
796
797
798
799
800
801
802
803
804
805
806
807
808
809
810
811
812
813
814
815
816
817
818
819
820
821
822
823
824
825
826
827
828
829
830
831
832
833
834
835
836
837
838
839
840
841
842
843
844
845
846
847
848
849
850
851
852
853
854
855
856
857
858
859
860
861
862
863
864
865
866
867
868
869
870
871
872
873
874
875
876
877
878
879
880
881
882
883
884
885
886
887
888
889
890
891
892
893
894
895
896
897
898
899
900
901
902
903
904
905
906
907
908
909
910
911
912
913
914
915
916
917
918
919
920
921
922
923
924
925
926
927
928
929
930
931
932
933
934
935
936
937
938
939
940
941
942
943
944
945
946
947
948
949
950
951
952
953
954
955
956
957
958
959
960
961
962
963
964
965
966
967
968
969
970
971
972
973
974
975
976
977
978
CONTAINER
92f58a51$for FILE in */**; do mpirun -np 2 $FILE; done
# OSU MPI Allgather Latency Test v5.9
# Size Avg Latency(us)
1 0.85
2 0.89
4 0.86
8 0.89
16 0.90
32 0.90
64 0.89
128 0.90
256 0.92
512 1.22
1024 1.23
2048 1.30
4096 2.59
8192 2.94
16384 3.65
32768 4.70
65536 7.80
131072 20.01
262144 46.75
524288 96.72
1048576 190.98
# OSU MPI Allgatherv Latency Test v5.9
# Size Avg Latency(us)
1 0.88
2 0.91
4 0.89
8 0.90
16 0.91
32 0.91
64 0.95
128 0.92
256 0.95
512 1.24
1024 1.26
2048 1.33
4096 2.68
8192 3.01
16384 3.74
32768 4.62
65536 7.73
131072 19.35
262144 44.48
524288 93.49
1048576 187.29
# OSU MPI Allreduce Latency Test v5.9
# Size Avg Latency(us)
4 0.96
8 0.97
16 0.97
32 1.00
64 1.02
128 1.01
256 1.11
512 1.43
1024 1.52
2048 1.76
4096 3.74
8192 4.90
16384 7.46
32768 11.03
65536 18.11
131072 34.68
262144 103.39
524288 226.50
1048576 444.57
# OSU MPI All-to-All Personalized Exchange Latency Test v5.9
# Size Avg Latency(us)
1 0.85
2 0.88
4 0.83
8 0.88
16 0.85
32 0.89
64 0.89
128 0.90
256 0.92
512 1.25
1024 1.21
2048 1.33
4096 2.59
8192 2.97
16384 3.46
32768 4.57
65536 8.62
131072 22.42
262144 50.07
524288 97.04
1048576 193.96
# OSU MPI All-to-Allv Personalized Exchange Latency Test v5.9
# Size Avg Latency(us)
1 0.90
2 0.94
4 0.90
8 0.94
16 0.93
32 0.95
64 0.94
128 0.94
256 0.96
512 1.27
1024 1.28
2048 1.36
4096 2.65
8192 3.10
16384 3.64
32768 5.17
65536 9.15
131072 22.27
262144 49.10
524288 98.43
1048576 189.31
# OSU MPI Barrier Latency Test v5.9
# Avg Latency(us)
0.85
# OSU MPI Broadcast Latency Test v5.9
# Size Avg Latency(us)
1 0.71
2 0.70
4 0.68
8 0.70
16 0.71
32 0.72
64 0.71
128 0.75
256 0.76
512 1.03
1024 1.04
2048 1.59
4096 2.24
8192 4.51
16384 7.03
32768 12.10
65536 22.37
131072 42.95
262144 89.27
524288 60.40
1048576 120.70
# OSU MPI Gather Latency Test v5.9
# Size Avg Latency(us)
1 0.66
2 0.69
4 0.67
8 0.66
16 0.71
32 0.69
64 0.70
128 0.69
256 0.71
512 1.02
1024 1.00
2048 1.09
4096 2.17
8192 3.35
16384 3.99
32768 5.40
65536 9.22
131072 23.99
262144 45.86
524288 92.63
1048576 177.15
# OSU MPI Gatherv Latency Test v5.9
# Size Avg Latency(us)
1 0.65
2 0.67
4 0.65
8 0.65
16 0.69
32 0.69
64 0.70
128 0.69
256 0.71
512 1.02
1024 1.00
2048 1.08
4096 2.15
8192 2.53
16384 3.18
32768 5.13
65536 9.04
131072 20.42
262144 42.82
524288 88.10
1048576 172.44
# OSU MPI Non-blocking Allgather Latency Test v5.9
# Overall = Coll. Init + Compute + MPI_Test + MPI_Wait
# Size Overall(us) Compute(us) Pure Comm.(us) Overlap(%)
1 7.64 4.31 1.25 0.00
2 7.77 4.41 1.22 0.00
4 7.75 4.39 1.24 0.00
8 7.77 4.41 1.23 0.00
16 7.70 4.34 1.29 0.00
32 7.72 4.32 1.29 0.00
64 7.72 4.35 1.28 0.00
128 7.72 4.34 1.28 0.00
256 7.68 4.28 1.29 0.00
512 8.09 4.28 1.64 0.00
1024 8.14 4.30 1.63 0.00
2048 8.27 4.33 1.70 0.00
4096 9.86 4.36 3.21 0.00
8192 13.88 7.93 3.71 0.00
16384 14.78 7.97 4.49 0.00
32768 16.69 8.17 6.41 0.00
65536 28.61 15.67 10.89 0.00
131072 53.45 27.87 23.41 0.00
262144 124.43 64.37 54.86 0.00
524288 254.49 131.56 114.37 0.00
1048576 500.17 262.71 231.73 0.00
# OSU MPI Non-blocking Allgatherv Latency Test v5.9
# Overall = Coll. Init + Compute + MPI_Test + MPI_Wait
# Size Overall(us) Compute(us) Pure Comm.(us) Overlap(%)
1 7.62 4.26 1.24 0.00
2 7.78 4.25 1.26 0.00
4 7.68 4.25 1.26 0.00
8 7.72 4.29 1.26 0.00
16 7.77 4.33 1.31 0.00
32 7.78 4.33 1.32 0.00
64 7.82 4.37 1.32 0.00
128 7.88 4.40 1.34 0.00
256 7.86 4.34 1.36 0.00
512 8.44 4.37 1.66 0.00
1024 8.42 4.37 1.63 0.00
2048 8.46 4.34 1.75 0.00
4096 10.06 4.38 3.31 0.00
8192 14.29 7.98 3.82 0.00
16384 15.14 8.08 4.50 0.00
32768 18.26 9.05 6.66 0.00
65536 28.75 15.57 10.41 0.00
131072 56.91 30.63 24.49 0.00
262144 125.54 65.43 56.59 0.00
524288 256.14 132.69 115.28 0.00
1048576 499.49 261.88 230.26 0.00
# OSU MPI Non-blocking Allreduce Latency Test v5.9
# Overall = Coll. Init + Compute + MPI_Test + MPI_Wait
# Size Overall(us) Compute(us) Pure Comm.(us) Overlap(%)
4 8.30 4.30 1.70 0.00
8 8.19 4.27 1.73 0.00
16 8.23 4.27 1.78 0.00
32 8.38 4.30 1.88 0.00
64 8.35 4.29 1.84 0.00
128 8.33 4.31 1.85 0.00
256 8.34 4.30 1.89 0.00
512 8.71 4.27 2.31 0.00
1024 8.76 4.27 2.40 0.00
2048 9.01 4.27 2.66 0.00
4096 15.63 8.15 5.26 0.00
8192 16.60 8.18 6.18 0.00
16384 22.36 11.87 8.32 0.00
32768 30.98 15.86 12.18 0.00
65536 49.53 26.86 20.65 0.00
131072 94.33 49.55 42.33 0.00
262144 187.37 98.30 85.03 0.00
524288 361.53 189.40 166.75 0.00
1048576 714.43 375.51 332.44 0.00
# OSU MPI Non-blocking All-to-All Latency Test v5.9
# Overall = Coll. Init + Compute + MPI_Test + MPI_Wait
# Size Overall(us) Compute(us) Pure Comm.(us) Overlap(%)
1 7.67 4.28 1.31 0.00
2 7.69 4.25 1.31 0.00
4 7.75 4.29 1.32 0.00
8 7.84 4.36 1.34 0.00
16 7.87 4.38 1.36 0.00
32 7.87 4.37 1.36 0.00
64 7.86 4.36 1.36 0.00
128 7.90 4.32 1.37 0.00
256 7.75 4.32 1.35 0.00
512 8.21 4.32 1.67 0.00
1024 8.19 4.31 1.70 0.00
2048 8.32 4.31 1.76 0.00
4096 9.84 4.42 3.07 0.00
8192 13.04 7.06 3.44 0.00
16384 14.68 8.34 4.21 0.00
32768 17.15 8.69 6.09 0.00
65536 27.65 14.76 10.44 0.00
131072 57.89 30.84 24.82 0.00
262144 119.11 61.93 53.48 0.00
524288 222.31 115.35 100.54 0.00
1048576 418.28 219.10 192.96 0.00
# OSU MPI Non-blocking All-to-Allv Personalized Exchange Latency Test v5.9
# Overall = Coll. Init + Compute + MPI_Test + MPI_Wait
# Size Overall(us) Compute(us) Pure Comm.(us) Overlap(%)
1 7.81 4.31 1.32 0.00
2 7.74 4.25 1.33 0.00
4 7.78 4.30 1.33 0.00
8 7.70 4.23 1.33 0.00
16 7.74 4.24 1.35 0.00
32 7.74 4.25 1.35 0.00
64 7.77 4.25 1.36 0.00
128 7.80 4.26 1.38 0.00
256 7.82 4.28 1.40 0.00
512 8.22 4.25 1.69 0.00
1024 8.24 4.24 1.70 0.00
2048 8.29 4.25 1.80 0.00
4096 9.71 4.27 3.10 0.00
8192 14.07 7.85 3.45 0.00
16384 14.50 8.05 4.15 0.00
32768 15.70 8.10 5.31 0.00
65536 24.65 12.24 9.81 0.00
131072 54.00 28.20 23.37 0.00
262144 117.71 61.16 52.14 0.00
524288 219.21 113.87 98.88 0.00
1048576 416.69 218.04 191.18 0.00
# OSU MPI Non-blocking All-to-Allw Personalized Exchange Latency Test v5.9
# Overall = Coll. Init + Compute + MPI_Test + MPI_Wait
# Size Overall(us) Compute(us) Pure Comm.(us) Overlap(%)
1 7.71 4.27 1.40 0.00
2 7.73 4.29 1.34 0.00
4 7.82 4.35 1.33 0.00
8 8.07 4.59 1.36 0.00
16 7.94 4.43 1.38 0.00
32 7.85 4.36 1.38 0.00
64 7.90 4.39 1.35 0.00
128 7.82 4.32 1.38 0.00
256 7.85 4.31 1.42 0.00
512 8.28 4.33 1.72 0.00
1024 8.34 4.36 1.75 0.00
2048 8.46 4.34 1.86 0.00
4096 9.86 4.35 3.15 0.00
8192 13.75 7.92 3.50 0.00
16384 14.32 7.95 4.11 0.00
32768 15.85 8.09 5.83 0.00
65536 25.59 12.39 10.05 0.00
131072 52.57 27.62 23.26 0.00
262144 114.22 59.80 51.06 0.00
524288 216.40 112.88 97.77 0.00
1048576 414.80 219.30 192.31 0.00
# OSU MPI Non-blocking Barrier Latency Test v5.9
# Overall = Coll. Init + Compute + MPI_Test + MPI_Wait
Overall(us) Compute(us) Pure Comm.(us) Overlap(%)
8.03 4.69 1.25 0.00
# OSU MPI Non-Blocking Broadcast Latency Test v5.9
# Overall = Coll. Init + Compute + MPI_Test + MPI_Wait
# Size Overall(us) Compute(us) Pure Comm.(us) Overlap(%)
1 7.45 4.27 1.05 0.00
2 7.44 4.28 1.03 0.00
4 7.36 4.25 1.04 0.00
8 7.45 4.30 1.02 0.00
16 7.53 4.35 1.05 0.00
32 7.41 4.27 1.05 0.00
64 7.45 4.30 1.05 0.00
128 7.46 4.29 1.07 0.00
256 7.49 4.31 1.07 0.00
512 7.58 4.25 1.33 0.00
1024 7.80 4.49 1.32 0.00
2048 7.81 4.47 1.39 0.00
4096 8.60 4.27 2.36 0.00
8192 8.87 4.40 2.55 0.00
16384 9.22 4.27 3.00 0.00
32768 13.57 7.95 3.72 0.00
65536 15.44 8.08 5.33 0.00
131072 23.80 11.99 9.84 0.00
262144 60.77 31.51 26.71 0.00
524288 122.49 64.84 56.12 0.00
1048576 241.33 128.29 111.79 0.00
# OSU MPI Non-blocking Gather Latency Test v5.9
# Overall = Coll. Init + Compute + MPI_Test + MPI_Wait
# Size Overall(us) Compute(us) Pure Comm.(us) Overlap(%)
1 7.49 4.30 1.04 0.00
2 7.39 4.23 1.03 0.00
4 7.51 4.39 1.02 0.00
8 7.44 4.29 1.02 0.00
16 7.44 4.28 1.04 0.00
32 7.46 4.32 1.02 0.00
64 7.46 4.30 1.03 0.00
128 7.44 4.29 1.05 0.00
256 7.47 4.30 1.06 0.00
512 7.85 4.36 1.36 0.00
1024 7.83 4.28 1.35 0.00
2048 7.92 4.33 1.42 0.00
4096 9.15 4.39 2.58 0.00
8192 9.55 4.36 2.94 0.00
16384 13.71 7.35 3.74 0.00
32768 15.51 8.09 4.95 0.00
65536 24.08 12.39 9.87 0.00
131072 50.66 26.91 22.05 0.00
262144 105.07 56.03 47.82 0.00
524288 196.96 102.89 90.00 0.00
1048576 387.82 206.19 181.25 0.00
# OSU MPI Non-blocking Gatherv Latency Test v5.9
# Overall = Coll. Init + Compute + MPI_Test + MPI_Wait
# Size Overall(us) Compute(us) Pure Comm.(us) Overlap(%)
1 7.42 4.28 1.09 0.00
2 7.47 4.35 1.06 0.00
4 7.49 4.34 1.05 0.00
8 7.40 4.28 1.05 0.00
16 7.41 4.30 1.06 0.00
32 7.48 4.33 1.05 0.00
64 7.42 4.28 1.05 0.00
128 7.51 4.34 1.06 0.00
256 7.54 4.37 1.07 0.00
512 7.88 4.41 1.37 0.00
1024 7.86 4.38 1.40 0.00
2048 7.92 4.33 1.43 0.00
4096 9.12 4.33 2.60 0.00
8192 9.47 4.37 2.97 0.00
16384 13.52 7.51 3.68 0.00
32768 15.45 7.96 5.01 0.00
65536 23.57 11.81 9.13 0.00
131072 51.31 26.77 21.60 0.00
262144 103.91 53.83 46.43 0.00
524288 197.35 103.90 90.41 0.00
1048576 387.28 204.06 180.66 0.00
# OSU MPI Non-blocking Reduce Latency Test v5.9
# Overall = Coll. Init + Compute + MPI_Test + MPI_Wait
# Size Overall(us) Compute(us) Pure Comm.(us) Overlap(%)
4 7.78 4.46 1.20 0.00
8 7.68 4.36 1.24 0.00
16 7.70 4.40 1.19 0.00
32 7.67 4.37 1.21 0.00
64 7.63 4.28 1.25 0.00
128 7.67 4.32 1.24 0.00
256 7.70 4.33 1.27 0.00
512 8.07 4.33 1.55 0.00
1024 8.07 4.31 1.61 0.00
2048 8.15 4.29 1.75 0.00
4096 12.75 5.94 3.06 0.00
8192 13.43 6.10 3.64 0.00
16384 14.87 6.33 4.58 0.00
32768 20.14 9.94 6.35 0.00
65536 58.57 30.64 25.57 0.00
131072 127.72 66.47 57.36 0.00
262144 247.95 130.29 113.87 0.00
524288 481.78 253.82 223.66 0.00
1048576 947.11 497.16 440.48 0.00
# OSU MPI Non-blocking Scatter Latency Test v5.9
# Overall = Coll. Init + Compute + MPI_Test + MPI_Wait
# Size Overall(us) Compute(us) Pure Comm.(us) Overlap(%)
1 7.53 4.33 1.14 0.00
2 7.57 4.41 1.13 0.00
4 7.60 4.39 1.13 0.00
8 7.46 4.27 1.13 0.00
16 7.43 4.25 1.15 0.00
32 7.44 4.23 1.16 0.00
64 7.51 4.31 1.16 0.00
128 7.50 4.28 1.17 0.00
256 7.58 4.38 1.19 0.00
512 7.60 4.23 1.44 0.00
1024 7.64 4.29 1.44 0.00
2048 7.63 4.24 1.51 0.00
4096 8.63 4.26 2.55 0.00
8192 8.84 4.26 2.77 0.00
16384 11.05 6.41 3.47 0.00
32768 13.75 8.07 4.58 0.00
65536 19.65 11.86 7.19 0.00
131072 31.39 19.41 15.07 20.48
262144 75.36 47.62 40.24 31.08
524288 151.35 100.69 87.18 41.90
1048576 285.95 191.18 168.25 43.67
# OSU MPI Non-blocking Scatterv Latency Test v5.9
# Overall = Coll. Init + Compute + MPI_Test + MPI_Wait
# Size Overall(us) Compute(us) Pure Comm.(us) Overlap(%)
1 7.64 4.39 1.16 0.00
2 7.60 4.37 1.16 0.00
4 7.77 4.52 1.15 0.00
8 7.61 4.38 1.15 0.00
16 7.63 4.37 1.17 0.00
32 7.63 4.36 1.18 0.00
64 7.62 4.39 1.17 0.00
128 7.62 4.34 1.19 0.00
256 7.72 4.43 1.20 0.00
512 7.99 4.46 1.49 0.00
1024 7.87 4.35 1.49 0.00
2048 7.90 4.34 1.56 0.00
4096 8.95 4.33 2.62 0.00
8192 9.20 4.36 2.84 0.00
16384 11.05 6.35 3.47 0.00
32768 14.08 7.96 4.67 0.00
65536 19.61 11.75 7.08 0.00
131072 32.29 19.44 15.78 18.59
262144 73.70 47.32 40.18 34.36
524288 148.60 98.03 85.62 40.94
1048576 291.44 194.30 170.78 43.12
# OSU MPI Reduce Latency Test v5.9
# Size Avg Latency(us)
4 0.70
8 0.71
16 0.71
32 0.71
64 0.78
128 0.75
256 0.77
512 1.11
1024 1.14
2048 1.26
4096 2.51
8192 2.98
16384 3.95
32768 5.67
65536 13.00
131072 25.34
262144 57.00
524288 117.46
1048576 238.22
# OSU MPI Reduce_scatter Latency Test v5.9
# Size Avg Latency(us)
4 1.13
8 1.33
16 1.31
32 1.31
64 1.34
128 1.40
256 1.42
512 1.48
1024 1.82
2048 1.90
4096 2.20
8192 4.22
16384 5.34
32768 7.70
65536 13.02
131072 73.99
262144 157.20
524288 312.37
1048576 674.32
# OSU MPI Scatter Latency Test v5.9
# Size Avg Latency(us)
1 0.71
2 0.71
4 0.71
8 0.71
16 0.74
32 0.74
64 0.73
128 0.76
256 0.76
512 1.06
1024 1.07
2048 1.14
4096 2.17
8192 2.40
16384 3.14
32768 4.08
65536 6.46
131072 16.54
262144 37.04
524288 85.17
1048576 168.49
# OSU MPI Scatterv Latency Test v5.9
# Size Avg Latency(us)
1 0.70
2 0.71
4 0.71
8 0.71
16 0.74
32 0.74
64 0.74
128 0.75
256 0.76
512 1.07
1024 1.08
2048 1.14
4096 2.17
8192 2.39
16384 3.30
32768 4.50
65536 7.37
131072 14.65
262144 40.45
524288 89.38
1048576 170.43
# OSU MPI_Accumulate latency Test v5.9
# Window creation: MPI_Win_allocate
# Synchronization: MPI_Win_flush
# Size Latency (us)
1 0.06
2 0.06
4 0.06
8 0.06
16 0.07
32 0.08
64 0.09
128 0.13
256 0.18
512 0.30
1024 0.53
2048 0.99
4096 1.93
8192 3.79
16384 7.55
32768 15.17
65536 30.23
131072 60.47
262144 120.86
524288 241.35
1048576 482.37
2097152 964.93
4194304 1930.26
# OSU MPI_Compare_and_swap latency Test v5.9
# Window creation: MPI_Win_allocate
# Synchronization: MPI_Win_flush
# Size Latency (us)
8 0.07
# OSU MPI_Fetch_and_op latency Test v5.9
# Window creation: MPI_Win_allocate
# Synchronization: MPI_Win_flush
# Size Latency (us)
8 0.07
# OSU MPI_Get_accumulate latency Test v5.9
# Window creation: MPI_Win_create
# Synchronization: MPI_Win_lock/unlock
# Size Latency (us)
1 3.02
2 3.03
4 3.04
8 3.04
16 3.05
32 3.10
64 3.09
128 3.14
256 3.25
512 3.45
1024 3.72
2048 4.30
4096 8.83
8192 11.70
16384 17.92
32768 31.17
65536 57.00
131072 135.95
262144 276.70
524288 532.44
1048576 1019.63
2097152 2026.29
4194304 3574.44
# OSU MPI_Get Bandwidth Test v5.9
# Window creation: MPI_Win_allocate
# Synchronization: MPI_Win_flush
# Size Bandwidth (MB/s)
1 31.58
2 61.86
4 119.31
8 254.50
16 523.52
32 984.70
64 1930.62
128 3600.26
256 6286.02
512 10587.26
1024 18639.73
2048 21662.25
4096 16971.83
8192 14121.81
16384 13877.12
32768 13733.76
65536 12676.02
131072 11976.28
262144 10725.89
524288 8301.74
1048576 8428.13
2097152 8612.81
4194304 8615.79
# OSU MPI_Get latency Test v5.9
# Window creation: MPI_Win_allocate
# Synchronization: MPI_Win_flush
# Size Latency (us)
1 0.07
2 0.07
4 0.07
8 0.06
16 0.06
32 0.07
64 0.07
128 0.07
256 0.07
512 0.08
1024 0.09
2048 0.09
4096 0.11
8192 0.16
16384 0.29
32768 0.73
65536 1.42
131072 4.29
262144 13.04
524288 39.20
1048576 75.22
2097152 153.79
4194304 305.93
# OSU MPI_Put Bi-directional Bandwidth Test v5.9
# Window creation: MPI_Win_allocate
# Synchronization: MPI_Win_post/start/complete/wait
# Size Bandwidth (MB/s)
1 44.63
2 69.15
4 159.45
8 312.69
16 687.87
32 1349.89
64 2658.78
128 5084.44
256 8112.66
512 14967.51
1024 27698.95
2048 38303.31
4096 29666.68
8192 25846.98
16384 24110.17
32768 24287.81
65536 23369.40
131072 16067.83
262144 11256.72
524288 11286.11
1048576 11310.97
2097152 11434.54
4194304 11441.22
# OSU MPI_Put Bandwidth Test v5.9
# Window creation: MPI_Win_allocate
# Synchronization: MPI_Win_flush
# Size Bandwidth (MB/s)
1 31.25
2 61.88
4 112.70
8 261.10
16 515.31
32 1008.61
64 1913.63
128 3599.31
256 6199.27
512 9665.53
1024 16777.56
2048 24161.49
4096 18168.60
8192 15981.09
16384 15191.22
32768 14259.56
65536 13448.71
131072 12565.83
262144 10274.71
524288 8456.06
1048576 8495.20
2097152 8577.68
4194304 8653.55
# OSU MPI_Put Latency Test v5.9
# Window creation: MPI_Win_allocate
# Synchronization: MPI_Win_flush
# Size Latency (us)
1 0.06
2 0.07
4 0.07
8 0.06
16 0.06
32 0.06
64 0.07
128 0.07
256 0.07
512 0.09
1024 0.09
2048 0.10
4096 0.12
8192 0.16
16384 0.38
32768 0.82
65536 1.57
131072 3.11
262144 13.06
524288 41.69
1048576 82.35
2097152 152.14
4194304 285.40
# OSU MPI Bi-Directional Bandwidth Test v5.9
# Size Bandwidth (MB/s)
1 7.66
2 15.04
4 29.94
8 60.17
16 110.21
32 235.33
64 385.67
128 559.99
256 957.53
512 1939.40
1024 3636.87
2048 6416.02
4096 4699.57
8192 8107.50
16384 13120.28
32768 20290.24
65536 27509.40
131072 27147.77
262144 21069.85
524288 20141.00
1048576 20429.99
2097152 21281.65
4194304 21134.58
# OSU MPI Bandwidth Test v5.9
# Size Bandwidth (MB/s)
1 6.30
2 12.84
4 25.24
8 51.69
16 100.93
32 201.56
64 337.32
128 483.17
256 822.49
512 1997.60
1024 4030.79
2048 6911.14
4096 3309.91
8192 5822.72
16384 8612.83
32768 12631.88
65536 16261.53
131072 15877.11
262144 11657.78
524288 11171.33
1048576 11400.95
2097152 11624.47
4194304 11708.48
# OSU MPI Latency Test v5.9
# Size Latency (us)
0 0.50
1 0.54
2 0.55
4 0.55
8 0.55
16 0.58
32 0.58
64 0.59
128 0.59
256 0.60
512 0.73
1024 0.72
2048 0.79
4096 1.83
8192 2.03
16384 2.52
32768 3.28
65536 4.79
131072 10.03
262144 23.66
524288 48.56
1048576 95.52
2097152 187.80
4194304 364.34
# Number of forked processes in sender: 2
# Number of forked processes in receiver: 2
# OSU MPI Multi-process Latency Test v5.9
# Size Latency (us)
0 0.57
1 0.61
2 0.61
4 0.61
8 0.61
16 0.64
32 0.64
64 0.65
128 0.65
256 0.65
512 0.73
1024 0.72
2048 0.79
4096 1.86
8192 2.06
16384 2.52
32768 3.27
65536 5.15
131072 9.99
262144 23.52
524288 48.85
1048576 94.15
2097152 183.16
4194304 363.24
# Number of Sender threads: 1
# Number of Receiver threads: 2
# OSU MPI Multi-threaded Latency Test v5.9
# Size Latency (us)
0 4.27
1 4.26
2 4.25
4 4.26
8 4.26
16 4.27
32 4.29
64 4.29
128 4.29
256 4.32
512 5.29
1024 5.49
2048 5.17
4096 9.42
8192 9.34
16384 11.44
32768 15.34
65536 19.03
131072 22.59
262144 35.27
524288 60.03
1048576 107.57
2097152 198.92
4194304 395.47
# OSU MPI Multiple Bandwidth / Message Rate Test v5.9
[r35c2t6n1:1626978] *** Process received signal ***
[r35c2t6n1:1626978] Signal: Segmentation fault (11)
[r35c2t6n1:1626978] Signal code: Address not mapped (1)
[r35c2t6n1:1626978] Failing at address: 0
Unable to print stack trace!
[r35c2t6n1:1626978] *** End of error message ***
--------------------------------------------------------------------------
Primary job terminated normally, but 1 process returned
a non-zero exit code. Per user-direction, the job has been aborted.
--------------------------------------------------------------------------
--------------------------------------------------------------------------
mpirun noticed that process rank 0 with PID 0 on node r35c2t6n1 exited on signal 11 (Segmentation fault).
--------------------------------------------------------------------------
# OSU MPI Multi Latency Test v5.9
# Size Latency (us)
0 0.57
1 0.61
2 0.61
4 0.62
8 0.61
16 0.65
32 0.65
64 0.65
128 0.66
256 0.66
512 0.72
1024 0.72
2048 0.78
4096 1.81
8192 1.99
16384 2.46
32768 3.19
65536 4.67
131072 9.29
262144 23.45
524288 48.12
1048576 94.70
2097152 188.20
4194304 359.89
# OSU MPI Hello World Test v5.9
This is a test with 2 processes
# OSU MPI Init Test v5.9
nprocs: 2, min: 102 ms, max: 102 ms, avg: 102 ms