MPI-FM on Myrinet Performance
Bandwidth
Latency
MPI-FM on Giganet Performance
Bandwidth
Latency
MPI-FM on Shared Memory Performance
Bandwidth
Latency
MPI-FM on Myrinet Performance (Tables)
Latency and Bandwidth
| Message
Size (bytes) |
Bandwidth (MB/s) |
Latency (usec) |
| 4 |
0.129 |
12.43 |
| 8 |
0.252 |
12.415 |
| 16 |
0.517 |
12.841 |
| 32 |
1.001 |
12.919 |
| 64 |
2.074 |
13.792 |
| 128 |
4.042 |
15.279 |
| 256 |
7.761 |
19.538 |
| 512 |
14.246 |
27.828 |
| 1024 |
24.008 |
43.968 |
| 2048 |
52.358 |
77.166 |
| 2176 |
54.788 |
78.044 |
| 2304 |
57.997 |
79.295 |
| 2432 |
61.292 |
80.037 |
| 2560 |
64.331 |
81.214 |
| 2688 |
67.576 |
82.831 |
| 2816 |
71.764 |
83.542 |
| 2944 |
74.558 |
84.434 |
| 3072 |
76.225 |
85.698 |
| 3200 |
45.949 |
86.858 |
| 3328 |
45.604 |
87.508 |
| 3456 |
46.9 |
88.07 |
| 3584 |
47.968 |
89.298 |
| 3712 |
48.282 |
90.454 |
| 3840 |
49.023 |
91.394 |
| 3968 |
49.548 |
92.683 |
| 4096 |
69.111 |
96.07 |
| 4224 |
71.111 |
97.25 |
| 4352 |
73.166 |
98.278 |
| 4480 |
75.262 |
99.956 |
| 4608 |
77.316 |
101.438 |
| 4736 |
79.067 |
102.9 |
| 4864 |
67.078 |
103.984 |
| 4992 |
68.839 |
105.495 |
| 5120 |
67.621 |
106.433 |
| 5248 |
67.972 |
107.42 |
| 5376 |
66.46 |
108.132 |
| 5504 |
68.152 |
109.789 |
| 5632 |
69.6 |
111.551 |
| 5760 |
68.618 |
112.82 |
| 5888 |
69.19 |
113.285 |
| 6016 |
68.997 |
115.381 |
| 6144 |
77.454 |
122.227 |
| 6272 |
72.682 |
123.314 |
| 6400 |
74.829 |
124.592 |
| 6528 |
75.122 |
125.528 |
| 6656 |
71.102 |
127.436 |
| 6784 |
74.689 |
127.47 |
| 6912 |
71.092 |
128.722 |
| 7040 |
70.275 |
129.598 |
| 7168 |
70.721 |
130.869 |
| 7296 |
71.551 |
131.643 |
| 7424 |
71.715 |
133.013 |
| 7552 |
71.666 |
133.609 |
| 7680 |
73.365 |
134.886 |
| 7808 |
73.679 |
135.45 |
| 7936 |
73.824 |
136.561 |
| 8064 |
74.026 |
137.395 |
| 8192 |
78.477 |
144.179 |
| 8320 |
75.362 |
145.569 |
| 8448 |
77.797 |
146.315 |
| 8576 |
74.026 |
147.385 |
| 8704 |
75.838 |
148.956 |
| 8832 |
75.925 |
149.991 |
| 8960 |
76.907 |
150.765 |
| 9088 |
76.113 |
152.143 |
| 9216 |
77.877 |
153.04 |
| 9344 |
77.173 |
154.515 |
| 9472 |
77.842 |
154.647 |
| 9600 |
76.624 |
156.506 |
| 9728 |
78.291 |
158.299 |
| 9856 |
78.285 |
159.867 |
| 9984 |
76.609 |
161.124 |
| 10112 |
77.899 |
162.555 |
| 10240 |
76.373 |
161.975 |
| 10368 |
76.401 |
162.295 |
| 10496 |
77.29 |
163.469 |
| 10624 |
78.66 |
164.27 |
| 10752 |
77.76 |
165.589 |
| 10880 |
79.151 |
166.536 |
| 11008 |
78.637 |
168.162 |
| 11136 |
79.148 |
167.78 |
| 11264 |
79.384 |
170.049 |
| 11392 |
79.231 |
169.032 |
| 11520 |
80.449 |
169.737 |
| 11648 |
80.027 |
170.686 |
| 11776 |
79.336 |
172 |
| 11904 |
80.293 |
172.906 |
| 12032 |
78.848 |
173.565 |
| 12160 |
79.888 |
174.941 |
| 12288 |
81.26 |
181.555 |
| 12416 |
80.085 |
182.191 |
| 12544 |
80.586 |
183.184 |
| 12672 |
80.896 |
184.308 |
| 12800 |
81.354 |
185.38 |
| 12928 |
81.195 |
186.412 |
| 13056 |
81.3 |
187.915 |
| 13184 |
82.075 |
190.667 |
| 13312 |
81.23 |
191.829 |
| 13440 |
81.136 |
192.854 |
| 13568 |
81.833 |
194.382 |
| 13696 |
81.748 |
195.483 |
| 13824 |
82.451 |
195.864 |
| 13952 |
82.183 |
197.123 |
| 14080 |
81.857 |
197.419 |
| 14208 |
82.591 |
199.659 |
| 14336 |
82.987 |
205.202 |
| 14464 |
85.691 |
206.274 |
| 14592 |
83.196 |
207.259 |
| 14720 |
82.117 |
208.736 |
| 14848 |
82.811 |
208.324 |
| 14976 |
83.24 |
208.531 |
| 15104 |
82.958 |
210.468 |
| 15232 |
82.527 |
211.467 |
| 15360 |
82.516 |
213.715 |
| 15488 |
83.026 |
214.53 |
| 15616 |
83.494 |
214.658 |
| 15744 |
82.872 |
216.969 |
| 15872 |
84.252 |
218.258 |
| 16000 |
84.15 |
216.175 |
| 16128 |
84.087 |
216.974 |
| 16256 |
83.868 |
217.967 |
| 16384 |
84.012 |
221.268 |
MPI-FM on Giganet Performance (Tables)
Latency and Bandwidth
| Message
Size (bytes) |
Bandwidth (MB/s) |
Latency (usec) |
| 4 |
0.596 |
18.161 |
| 8 |
1.244 |
18.142 |
| 16 |
2.445 |
18.276 |
| 32 |
5.002 |
18.402 |
| 64 |
8.887 |
18.868 |
| 128 |
17.062 |
20.914 |
| 256 |
28.973 |
23.75 |
| 512 |
38.109 |
30.441 |
| 1024 |
61.455 |
42.796 |
| 2048 |
66.704 |
71.353 |
| 2176 |
66.93 |
73.205 |
| 2304 |
69.199 |
73.874 |
| 2432 |
67.792 |
75.772 |
| 2560 |
68.147 |
76.312 |
| 2688 |
69.881 |
77.82 |
| 2816 |
71.305 |
78.952 |
| 2944 |
72.169 |
80.546 |
| 3072 |
72.194 |
81.79 |
| 3200 |
71.768 |
83.513 |
| 3328 |
73.5 |
85.294 |
| 3456 |
74.184 |
86.453 |
| 3584 |
75.089 |
88.295 |
| 3712 |
76.453 |
89.337 |
| 3840 |
78.403 |
91.303 |
| 3968 |
77.02 |
92.049 |
| 4096 |
71.026 |
97.748 |
| 4224 |
71.485 |
99.138 |
| 4352 |
73.196 |
100.27 |
| 4480 |
72.675 |
101.487 |
| 4608 |
73.648 |
103.348 |
| 4736 |
74.197 |
104.6 |
| 4864 |
74.756 |
104.614 |
| 4992 |
74.763 |
107.873 |
| 5120 |
76.194 |
108.983 |
| 5248 |
75.278 |
110.473 |
| 5376 |
76.172 |
112.373 |
| 5504 |
76.594 |
112.926 |
| 5632 |
76.907 |
114.375 |
| 5760 |
77.28 |
115.485 |
| 5888 |
78.259 |
117.557 |
| 6016 |
77.584 |
118.922 |
| 6144 |
74.291 |
129.102 |
| 6272 |
74.848 |
129.889 |
| 6400 |
74.78 |
131.041 |
| 6528 |
74.306 |
132.428 |
| 6656 |
75.213 |
134.447 |
| 6784 |
74.746 |
130.77 |
| 6912 |
75.505 |
137.051 |
| 7040 |
75.8 |
138.826 |
| 7168 |
76.109 |
140.223 |
| 7296 |
76.629 |
141.252 |
| 7424 |
76.653 |
142.045 |
| 7552 |
77.451 |
143.324 |
| 7680 |
77.342 |
144.809 |
| 7808 |
77.49 |
147.357 |
| 7936 |
77.794 |
148.397 |
| 8064 |
77.506 |
148.909 |
| 8192 |
75.243 |
152.096 |
| 8320 |
74.721 |
150.946 |
| 8448 |
74.9 |
153.862 |
| 8576 |
74.575 |
154.321 |
| 8704 |
75.268 |
154.277 |
| 8832 |
75.863 |
156.095 |
| 8960 |
75.866 |
157.701 |
| 9088 |
75.776 |
160.668 |
| 9216 |
75.694 |
159.11 |
| 9344 |
75.845 |
163.537 |
| 9472 |
75.79 |
164.118 |
| 9600 |
76.787 |
165.607 |
| 9728 |
75.447 |
165.954 |
| 9856 |
76.288 |
170.919 |
| 9984 |
76.827 |
171.846 |
| 10112 |
76.384 |
170.124 |
| 10240 |
74.319 |
177.031 |
| 10368 |
75.138 |
179.045 |
| 10496 |
73.48 |
180.161 |
| 10624 |
74.927 |
183.932 |
| 10752 |
75.254 |
185.675 |
| 10880 |
75.334 |
186.023 |
| 11008 |
75.569 |
186.518 |
| 11136 |
74.799 |
189.346 |
| 11264 |
75.648 |
187.988 |
| 11392 |
75.447 |
188.829 |
| 11520 |
75.144 |
188.341 |
| 11648 |
76.289 |
187.489 |
| 11776 |
77.38 |
189.945 |
| 11904 |
75.791 |
194.506 |
| 12032 |
75.666 |
193.067 |
| 12160 |
75.571 |
197.721 |
| 12288 |
74.547 |
204.079 |
| 12416 |
74.308 |
205.768 |
| 12544 |
73.698 |
208.575 |
| 12672 |
73.805 |
209.353 |
| 12800 |
75.019 |
210.816 |
| 12928 |
73.877 |
212.453 |
| 13056 |
74.352 |
214.164 |
| 13184 |
74.507 |
215.714 |
| 13312 |
74.547 |
216.517 |
| 13440 |
75.319 |
218.662 |
| 13568 |
75.355 |
219.146 |
| 13696 |
75.781 |
220.52 |
| 13824 |
76.796 |
221.93 |
| 13952 |
75.604 |
223.255 |
| 14080 |
76.363 |
224.44 |
| 14208 |
75.252 |
225.234 |
| 14336 |
74.108 |
230.924 |
| 14464 |
74.533 |
232.818 |
| 14592 |
75.376 |
232.997 |
| 14720 |
77.83 |
234.533 |
| 14848 |
76.109 |
236.234 |
| 14976 |
76.424 |
237.342 |
| 15104 |
75.827 |
238.842 |
| 15232 |
75.918 |
239.475 |
| 15360 |
74.825 |
241.418 |
| 15488 |
76.217 |
243.135 |
| 15616 |
76.39 |
244.196 |
| 15744 |
76.189 |
244.802 |
| 15872 |
77.035 |
247.59 |
| 16000 |
77.448 |
247.792 |
| 16128 |
76.137 |
249.682 |
| 16256 |
77.411 |
251.223 |
| 16384 |
76.621 |
255.658 |
MPI-FM on Shared Memory Performance (Tables)
Latency and Bandwidth
| Message
Size (bytes) |
Bandwidth (MB/s) |
Latency (usec) |
| 4 |
0.927 |
5.757 |
| 8 |
1.999 |
5.213 |
| 16 |
3.727 |
5.596 |
| 32 |
7.369 |
5.886 |
| 64 |
13.92 |
6.047 |
| 128 |
22.874 |
7.559 |
| 256 |
35.104 |
9.08 |
| 512 |
56.911 |
11.879 |
| 1024 |
62.429 |
18.291 |
| 2048 |
76.057 |
34.534 |
| 2176 |
74.378 |
35.641 |
| 2304 |
80.821 |
37.506 |
| 2432 |
80.266 |
38.379 |
| 2560 |
78.523 |
40.546 |
| 2688 |
80.819 |
40.184 |
| 2816 |
79.467 |
42.388 |
| 2944 |
79.017 |
44.37 |
| 3072 |
79.338 |
45.99 |
| 3200 |
78.78 |
45.367 |
| 3328 |
81.198 |
47.736 |
| 3456 |
82.941 |
48.248 |
| 3584 |
80.216 |
50.552 |
| 3712 |
83.89 |
50.779 |
| 3840 |
80.317 |
53.042 |
| 3968 |
85.506 |
54.362 |
| 4096 |
80.661 |
56.542 |
| 4224 |
76.14 |
59.164 |
| 4352 |
79.979 |
59.722 |
| 4480 |
81.651 |
61.39 |
| 4608 |
83.541 |
62.568 |
| 4736 |
81.142 |
63.923 |
| 4864 |
78.386 |
65.25 |
| 4992 |
82.452 |
66.846 |
| 5120 |
82.022 |
67.471 |
| 5248 |
82.162 |
68.913 |
| 5376 |
81.624 |
71.982 |
| 5504 |
84.265 |
73.237 |
| 5632 |
80.428 |
73.795 |
| 5760 |
85.311 |
74.005 |
| 5888 |
83.487 |
76.484 |
| 6016 |
83.227 |
77.714 |
| 6144 |
80.534 |
81.704 |
| 6272 |
85.298 |
82.672 |
| 6400 |
83.064 |
83.325 |
| 6528 |
82.831 |
85.305 |
| 6656 |
82.274 |
87.437 |
| 6784 |
81.728 |
87.172 |
| 6912 |
82.724 |
88.799 |
| 7040 |
82.062 |
90.866 |
| 7168 |
82.324 |
91.773 |
| 7296 |
82.909 |
94.035 |
| 7424 |
83.812 |
95.873 |
| 7552 |
83.217 |
97.614 |
| 7680 |
82.723 |
98.503 |
| 7808 |
84.548 |
98.558 |
| 7936 |
84.333 |
99.671 |
| 8064 |
83.897 |
101.535 |
| 8192 |
82.707 |
105.367 |
| 8320 |
82.699 |
103.555 |
| 8448 |
81.205 |
107.287 |
| 8576 |
82.534 |
108.186 |
| 8704 |
83.34 |
109.455 |
| 8832 |
82.111 |
111.316 |
| 8960 |
83.068 |
113.171 |
| 9088 |
82.583 |
114.095 |
| 9216 |
82.551 |
113.609 |
| 9344 |
83.424 |
115.856 |
| 9472 |
82.93 |
117.447 |
| 9600 |
83.625 |
117.629 |
| 9728 |
83.75 |
119.753 |
| 9856 |
83.558 |
122.18 |
| 9984 |
84.547 |
122.28 |
| 10112 |
84.113 |
124.259 |
| 10240 |
84.301 |
126.142 |
| 10368 |
83.704 |
130.292 |
| 10496 |
81.868 |
128.75 |
| 10624 |
82.771 |
130.766 |
| 10752 |
83.978 |
131.626 |
| 10880 |
84.3 |
132.993 |
| 11008 |
81.581 |
135.136 |
| 11136 |
82.086 |
134.094 |
| 11264 |
82.128 |
135.961 |
| 11392 |
85.021 |
137.811 |
| 11520 |
84.889 |
139.026 |
| 11648 |
84.403 |
140.116 |
| 11776 |
83.67 |
142.039 |
| 11904 |
83.71 |
142.456 |
| 12032 |
84.57 |
143.514 |
| 12160 |
84.951 |
144.685 |
| 12288 |
82.764 |
147.801 |
| 12416 |
82.632 |
146.996 |
| 12544 |
84.732 |
148.179 |
| 12672 |
84.777 |
151.073 |
| 12800 |
83.8 |
151.181 |
| 12928 |
84.756 |
153.775 |
| 13056 |
84.749 |
155.559 |
| 13184 |
83.853 |
157.443 |
| 13312 |
85.17 |
157.051 |
| 13440 |
84.141 |
159.379 |
| 13568 |
83.424 |
161.366 |
| 13696 |
85.026 |
163.635 |
| 13824 |
83.602 |
163.116 |
| 13952 |
84.511 |
163.642 |
| 14080 |
85.076 |
165.317 |
| 14208 |
83.962 |
168.924 |
| 14336 |
82.816 |
171.084 |
| 14464 |
84.708 |
169.537 |
| 14592 |
83.333 |
172.913 |
| 14720 |
84.551 |
172.543 |
| 14848 |
84.695 |
173.855 |
| 14976 |
85.299 |
175.303 |
| 15104 |
83.839 |
178.469 |
| 15232 |
85.186 |
179.165 |
| 15360 |
83.893 |
181.306 |
| 15488 |
83.708 |
180.856 |
| 15616 |
83.612 |
182.979 |
| 15744 |
85.516 |
182.012 |
| 15872 |
85.513 |
184.719 |
| 16000 |
84.448 |
187.63 |
| 16128 |
84.03 |
188.543 |
| 16256 |
84.56 |
189.138 |
| 16384 |
83.087 |
194.618 |