Mercurial > hg > Members > masakoha > masa

comparison Cerium_IO/IO_result.txt @ 97:26c484b68084

Find changesets by keywords (author, files, the commit message), revision number or hash, or revset expression.
add statistics.txt
author Masataka Kohagura <kohagura@cr.ie.u-ryukyu.ac.jp>
date Sat, 10 May 2014 12:06:03 +0900
parents 14/Cerium_IO/IO_result.txt@735feeaf7279
children 3dbef6fda385
comparison
equal deleted inserted replaced
96:735feeaf7279 97:26c484b68084
1 --------------------------------------------------------------
2 2014/05/09 (Thu)
3 [result]
4 firefly にて
5 GPU での計測
6
7 ./word_count -file 1gb.txt -g -gpu -division 16 -block 48 -m
8 + cuda ver +
9
10 in cache : 94.474161 94.466858 94.496025
11 ave : 94.4790146666667
12 [mmap]
13 104.112721 104.842246 103.481724 104.756570 103.966992
14 ave : 104.2320506
15
16
17
18
19 --------------------------------------------------------------
20 2014/05/08 (Thu)
21 [result]
22 firefly にて
23
24 firefly を再起動してリフレッシュした後の計測
25 実験 CPU 数は全て 12
26
27
28 bread size = division_size * block_num
29 block num は 48 固定
30 division size を変化させてみた
31
32 division_size ->| 4k | 8k | 16k | 32k | 64k | 128k | 256k |
33 --------------------------------------------------------------------------------
34 mmap | 11.867 | 10.570 | 11.803 | 14.915 | 16.626 | 16.923 | 18.474 |
35 read | 12.020 | 11.585 | 11.729 | 11.661 | 12.497 | 11.347 | 11.658 |
36 bread & SPE_ANY | 11.508 | 15.932 | 11.407 | 12.816 | 12.454 | 12.891 | 11.962 |
37 bread & IO_0 | 11.342 | 12.242 | 11.636 | 12.331 | 10.870 | 11.295 | 11.723 |
38 --------------------------------------------------------------------------------
39
40 [考察]
41 mmap の遅くなる境目は 16k*48 = 768k と 32k * 48 = 1,536k の間
42 2^9 < bread size < 2^11
43
44 read, bread & IO_0 は安定(まぁ一気に読み込んでるわけだし。)
45 mmap は、一度に読み込む範囲が狭いほうが速度は出る。
46 -> ランダムアクセス
47
48 ###########################################
49 ./word_count -file 1gb.txt -cpu 12 -division 4 -block 48 -m
50
51 division size を 4k に変更
52 Blocked Read size 4k * 48
53
54 [mmap]
55 13.955924 10.593330 10.076561 13.343254 11.368239
56 ave : 11.8674616
57
58 [read]
59 10.874073 11.181728 12.574511 12.639683 12.830423
60 ave : 12.0200836
61
62 [blocked Read & SPE_ANY]
63 10.139217 10.343027 10.868068 15.226670 10.960942
64 ave : 11.5075848
65
66 [blocked Read & IO_0]
67 10.071492 12.267685 11.409233 10.417327 12.542598
68 ave : 11.341667
69
70 ###########################################
71 ./word_count -file 1gb.txt -cpu 12 -division 8 -block 48 -m
72
73 division size を 8k に変更
74 Blocked Read size 8k * 48
75
76 [mmap]
77 10.019870 10.182644 10.865943 11.464948 10.316064
78 ave : 10.5698938
79
80 [read]
81 10.929073 10.494944 13.320447 11.696959 11.485670
82 ave : 11.5854186
83
84 [blocked Read & SPE_ANY]
85 10.524184 16.851492 18.499222 17.166419 16.617646
86 ave : 15.9317926
87
88 [blocked Read & IO_0]
89 12.594326 10.974664 9.791322 14.108371 13.741705
90 ave : 12.2420776
91
92
93 ###########################################
94 ./word_count -file 1gb.txt -cpu 12 -division 16 -block 48 -m
95
96 division size を 16k に変更
97 Blocked Read size 16k * 48
98
99 [mmap]
100 10.169057 10.540739 15.449075 10.957382 11.899007
101 ave : 11.803052
102
103 [read]
104 11.462661 12.633221 11.207322 10.525345 12.815037
105 ave : 11.7287172
106
107 [blocked Read & SPE_ANY]
108 11.794426 11.285127 10.987724 11.539787 11.426118
109 ave : 11.4066364
110
111 [blocked Read & IO_0]
112 9.902556 12.431267 11.206498 10.889500 13.748140
113 ave : 11.6355922
114
115
116 ###########################################
117 ./word_count -file 1gb.txt -cpu 12 -division 32 -block 48 -m
118
119 division size を 32k に変更
120 Blocked Read size 32k * 48
121
122 [mmap]
123 15.069456 15.122584 14.922003 14.683691 14.777088
124 ave : 14.9149644
125
126 [read]
127 11.028623 11.035131 11.373129 12.821938 12.046853
128 ave : 11.6611348
129
130 [blocked Read & SPE_ANY]
131 11.919220 12.329987 12.332933 14.418972 13.078229
132 ave : 12.8158682
133
134 [blocked Read & IO_0]
135 10.530808 10.747448 13.123480 10.487363 16.765442
136 ave : 12.3309082
137
138 ###########################################
139 ./word_count -file 1gb.txt -cpu 12 -division 64 -block 48 -m
140
141 division size を 64k に変更
142 Blocked Read size 64k * 48
143
144 [mmap]
145 16.111595 16.025707 17.268757 15.955856 17.766358
146 ave : 16.6256546
147
148 [read]
149 11.808742 12.239779 12.924552 13.963415 11.550749
150 ave : 12.4974474
151
152 [blocked Read & SPE_ANY]
153 11.352159 13.369793 12.610295 12.669730 12.267202
154 ave : 12.4538358
155
156 [blocked Read & IO_0]
157 10.797157 10.301865 11.943482 10.176760 11.135116
158 ave : 10.870876
159
160 ###########################################
161 ./word_count -file 1gb.txt -cpu 12 -division 128 -block 48 -m
162
163 division size を 128k に変更
164 Blocked Read size 128k * 48
165
166 [mmap]
167 16.034226 16.560303 16.890796 19.045418 16.082843
168 ave : 16.9227172
169
170 [read]
171 10.536881 10.504687 11.637468 12.857552 11.196838
172 ave : 11.3466852
173
174 [blocked Read & SPE_ANY]
175 12.481490 13.197780 12.647181 13.424816 12.707132
176 ave : 12.8916798
177
178 [blocked Read & IO_0]
179 10.342932 10.488933 12.881027 11.114004 11.648817
180 ave : 11.2951426
181
182 ###########################################
183 ./word_count -file 1gb.txt -cpu 12 -division 256 -block 48 -m
184
185 division size を 256k に変更
186 Blocked Read size 256k * 48
187
188 [mmap]
189 16.861397 16.332805 21.959199 19.286259 17.929253
190 ave : 18.4737826
191
192 [read]
193 11.290773 10.484917 12.768376 11.330529 12.415259
194 ave : 11.6579708
195
196 [blocked Read & SPE_ANY]
197 11.277959 11.902750 12.208483 11.148553 13.273579
198 ave : 11.9622648
199
200 [blocked Read & IO_0]
201 10.603377 10.891932 11.916977 12.061559 13.142021
202 ave : 11.7231732
203
204 ###########################################
205 リフレッシュ後はここまで
206 #############################################
207
208 ###########################################
209 ./word_count -file 1gb.txt -cpu 12 -division 32 -block 48 -m
210
211 mmap only で Blocked Read の様々な大きさを試してみる
212
213 Blocked Read size 16k * 48
214 11.225793 11.516904 13.259233 12.324640 10.343828
215 ave : 11.7340796
216
217 ###########################################
218 ./word_count -file 1gb.txt -cpu 12 -division 32 -block 48 -m
219
220 division size を 32k に変更
221 Blocked Read size 256k * 48
222
223 [mmap]
224 16.648177 20.314135 22.318274 20.390665 21.174707
225 ave : 20.1691916
226
227 [read]
228 12.048092 13.031264 15.055066 13.631955 14.629920
229 ave : 13.6792594
230
231 [blocked Read & SPE_ANY]
232 11.673849 14.027035 13.938218 14.581857 15.435502
233 ave : 13.9312922
234
235 [blocked Read & IO_0]
236 15.310970 12.431799 13.015167 12.111157 13.268908
237 ave : 13.2276002
238
239 ###########################################
240 ./word_count -file 1gb.txt -cpu 12 -division 256 -block 48 -m
241
242 division size を 256k に変更
243 Blocked Read size 256k * 48
244
245 [mmap]
246 16.533852 22.421299 23.928809 20.837954 21.757904
247 ave : 21.0959636
248
249 [read]
250 11.522632 15.494991 14.413933 15.421523 14.346096
251 ave : 14.239835
252
253 [blocked Read & SPE_ANY]
254 11.645137 14.220895 13.072463 13.235456 13.830988
255 ave : 13.2009878
256
257 [blocked Read & IO_0]
258 13.405995 13.243454 12.777046 13.805675 13.137011
259 ave : 13.2738362
260
261 ###########################################
262 ./word_count -file 1gb.txt -cpu 12 -division 64 -block 48 -m
263
264 division size を 64k に変更
265 Blocked Read size 64k * 48
266
267 [mmap]
268 16.563569 20.158053 21.448670 21.293077 20.550916
269 ave : 20.002857
270
271 [read]
272 11.368613 14.068283 13.444215 15.334056 14.554330
273 ave : 13.7538994
274
275 [blocked Read & SPE_ANY]
276 11.169437 14.419505 15.024782 17.806684 17.591594
277 ave : 15.2024004
278
279 [blocked Read & IO_0]
280 11.116777 14.260367 13.418558 13.119003 13.319392
281 ave : 13.0468194
282
283
284 --------------------------------------------------------------
285 2014/05/07 (Wed)
286 [result]
287 nkmr 研サーバにて
288
289 ###########################################
290 (2014/05/01 の結果)
291 cpu 8 other division_size = 16k block_num = 48
292 cache 0.840
293 [mmap]
294 include I/O 7.886 7.919 7.604 7.412 7.443 7.631
295 ave 7.649
296
297 [read]
298 include I/O 7.541 7.553 7.963 7.501 7.477
299 ave 7.607
300
301 [blocked Read & SPE_ANY]
302 include I/O 14.887 14.486 14.453 14.608 15.279
303 ave 14.723
304
305 [blocked Read & IO_0]
306 include I/O 6.719 6.835 6.819 6.663 6.738
307 ave 6.755
308
309 以下 2014/05/07 に計測
310
311 ###########################################
312 cpu 4 other division_size = 16k block_num = 48
313 cache 1.088943
314 [mmap]
315 11.394516 12.045339 13.763432 13.429961 11.886197
316 12.503889
317
318 [read]
319 7.900163 8.210646 8.174739 8.221865 8.257309
320 8.1529444
321
322 [blocked Read & SPE_ANY]
323 11.583224 13.696717 11.232450 10.875663 11.609224
324 11.7994556
325
326 [blocked Read & IO_0]
327 6.862518 7.163325 7.196333 6.887726 6.972422
328 7.0164648
329
330 ###########################################
331 cpu 3 other division_size = 16k block_num = 48
332 cache 2.049192
333 [mmap]
334 7.210944 7.754113 7.971077 7.704215 7.520623
335 7.6321944
336
337 [read]
338 8.232689 8.645796 8.895464 8.685775 8.873369
339 8.6666186
340
341 [blocked Read & SPE_ANY]
342 12.253558 13.401002 13.410819 12.614162 13.296896
343 12.9952874
344
345 [blocked Read & IO_0]
346 6.753707 7.472933 7.339476 7.597705 7.389503
347 7.3106648
348
349 ###########################################
350 cpu 2 other division_size = 16k block_num = 48
351 cache 2.049192
352 [mmap]
353 6.702701 6.761172 6.753862 6.736276 6.869777
354 6.7647576
355
356 [read]
357 8.690265 8.691177 8.712588 8.695770 8.706455
358 8.699251
359
360 [blocked Read & SPE_ANY]
361 10.189692 10.972406 10.679654 10.344061 10.843843
362 10.6059312
363
364 [blocked Read & IO_0]
365 6.688520 6.831342 6.813723 6.787828 6.881037
366 6.80049
367
368 ###########################################
369 cpu 1 other division_size = 16k block_num = 48
370 cache 3.956206
371 [mmap]
372 6.894841 6.736401 6.896121 7.003213 6.729732
373 6.8520616
374
375 [read]
376 10.526449 10.556775 10.552578 10.569887 10.518269
377 10.5447916
378
379 [blocked Read & SPE_ANY]
380 8.655361 8.710293 8.661651 8.634304 8.768228
381 8.6859674
382
383 [blocked Read & IO_0]
384 6.724043 6.680827 6.790831 6.724226 6.756765 6.831216
385 6.751318
386
387
388 2014/05/01 (Thu)
389 [result]
390 nkmr 研 namako 鯖
391 OS : CentOS 6.5
392 CPU : Intel(R) Core(TM) i7-3770 CPU @ 3.40GHz
393 memory : 16 GB
394 HDD : ST2000DM001-1CH1 2TB 7200 rpm 64MB Cache SATA 6.0 Gbps
395
396 kono 研 firefly
397 HDD : WD1001FALS-41Y6A1 1TB 7200 rpm 32MB Cache SATA 3.0 Gbps
398
399
400 ###########################################
401 cpu 8 other division_size = 16k block_num = 48
402 cache 0.840
403 [mmap]
404 include I/O 7.886 7.919 7.604 7.412 7.443 7.631
405 ave 7.649
406
407 [read]
408 include I/O 7.541 7.553 7.963 7.501 7.477
409 ave 7.607
410
411 [blocked Read & SPE_ANY]
412 include I/O 14.887 14.486 14.453 14.608 15.279
413 ave 14.723
414
415 [blocked Read & IO_0]
416 include I/O 6.719 6.835 6.819 6.663 6.738
417 ave 6.755
418
419 ###########################################
420 cpu 8 division_size = 128k block_num = 48
421
422 cache 0.698
423 [mmap]
424 include I/O 18.380 19.356 19.033 19.007 19.641
425 ave 19.083
426
427 [read]
428 include I/O 7.389 7.419 7.480 7.409 7.455
429 ave 7.430
430
431 [blocked Read & SPE_ANY]
432 include I/O 10.488 10.254 10.833 10.513 10.937
433 ave 10.605
434
435 [blocked Read & IO_0]
436 include I/O 6.722 6.822 6.747 7.339 6.790
437 ave 6.884
438
439
440 ###########################################
441 cpu 8 division_size = 16k block_num = 96
442
443 cache 0.698
444 [mmap]
445 include I/O 7.578 7.385 7.560 7.538 7.479
446
447 [read]
448 include I/O 7.615 7.480 7.494 7.444 7.470
449
450 [blocked Read & SPE_ANY]
451 include I/O 14.989 14.505 14.341 14.759 14.086
452
453 [blocked Read & IO_0]
454 include I/O 6.719 6.786 6.728 6.735 6.869
455
456 ###########################################
457 cpu 8 division_size = 128k block_num = 96
458
459 cache 0.701
460 [mmap]
461 include I/O 18.461 18.330 18.530 18.186 18.286
462
463 [read]
464 include I/O 7.369 7.444 7.493 7.393 7.478 7.539
465
466 [blocked Read & SPE_ANY]
467 include I/O 9.301 9.453 9.362 9.426 9.272
468
469 [blocked Read & IO_0]
470 include I/O 6.784 6.741 6.737 6.801 6.743
471
472
473 -------------------------------------------------------------
474
475 2014/04/18 (Fri)
476 [memo]
477 word count の再計測
478
479 kono 研 firefly
480 HDD : WD1001FALS-41Y6A1 1TB 7200 rpm 32MB Cache SATA 3.0 Gbps
481
482 ./word_count -file 1gb.txt -cpu 12 -division 128 -block 48 -m
483 (CPU num = 12)
484 < mmap > 22.713 0.878
485 < read > 12.520 1.469
486 < bread & IO_0 > 10.295 0.886
487 < bread & SPE_ANY > 14.028 0.882
488
489 (CPU num = 8)
490 < mmap > 22.789 0.952
491 < read > 14.785 1.571
492 < bread & IO_0 > 14.774 0.857
493 < bread & SPE_ANY > 15.287 1.009
494
495 (CPU num = 4)
496 < mmap > 22.861 1.739
497 < read > 15.737 2.303
498 < bread & IO_0 > 14.634 1.565
499 < bread & SPE_ANY > 15.646 1.941
500
501 (CPU num = 1)
502 < mmap > 20.179 6.521
503 < read > 21.351 6.832
504 < bread & IO_0 > 13.930 6.009
505 < bread & IO_0 > 18.531 6.775
506
507
508
509 ./word_count -file X gb.txt -cpu 12 -division 128 -block 48 -m
510 (file size 2GB)
511 < mmap > 34.072
512 < read > 24.755
513 < bread & IO_0 > 21.396
514 < bread & SPE_ANY > 23.909
515
516 (file size 3GB)
517 < mmap > 52.819
518 < read > 33.398
519 < bread & IO_0 > 32.798
520 < bread & SPE_ANY > 37.140
521
522 (file size 4GB)
523 < mmap > 68.951
524 < read > 43.578
525 < bread & IO_0 > 42.491
526 < bread & SPE_ANY > 48.078
527
528
529
530
531 ./word_count -file 1gb.txt -cpu 12 -division 16 -block 48 -m
532 < mmap > 11.137 0.854
533 < read > 11.437 1.487
534 < bread & IO_0 > 11.412 0.847
535 < bread & SPE_ANY > 11.146 0.866
536
537 ./word_count -file 1gb.txt -cpu 1 -division 16 -block 48 -m
538 < mmap > 15.353
539 < read > 16.846
540 < bread & IO_0 > 11.503 6.992
541 < bread & SPE_ANY > 13.297
542
543 ./word_count -file 1gb.txt -cpu 8 -division 16 -block 48 -m
544 < mmap > 11.707
545 < read > 11.487
546 < bread & IO_0 > 11.365
547 < bread & SPE_ANY > 10.887
548
549
550
551 ./word_count -file 1gb.txt -cpu 1 -division 128 -block 48 -br
552 14.210562 15.025856 13.118798 14.155912 13.137139 13.930
553
554 ./word_count -file 1gb.txt -cpu 1 -division 128 -block 48 -br spe_any
555 21.347 18.110 15.926 18.128 19.143 18.531
556
557 ./word_count -file 1gb.txt -cpu 1 -division 128 -block 48 -r
558 19.669 19.612 22.830 22.116 22.528 21.351
559
560 ./word_count -file 1gb.txt -cpu 1 -division 128 -block 48 -m
561 18.604 22.576 15.844 22.019 21.852 20.179
562
563 ./word_count -file 1gb.txt -cpu 4 -division 128 -block 48 -m
564 20.963 24.989 19.770 20.893 27.692 22.861
565
566 ./word_count -file 1gb.txt -cpu 4 -division 128 -block 48 -r
567 14.331 14.403 16.493 15.652 17.808 15.737
568
569 ./word_count -file 1gb.txt -cpu 4 -division 128 -block 48 -br spe_any
570 14.369 13.818 17.198 15.796 17.051 15.646
571
572 ./word_count -file 1gb.txt -cpu 4 -division 128 -block 48 -br IO_0
573 12.898 14.056 15.115 15.839 15.263 14.634
574
575 ./word_count -file 1gb.txt -cpu 4 -division 128 -block 48 -br IO_0
576 12.898 14.056 15.115 15.839 15.263 14.634
577
578 ./word_count -file 1gb.txt -cpu 8 -division 128 -block 48 -br spe_any
579 14.995 13.622 15.332 16.686 15.802 A 15.287
580
581 ./word_count -file 1gb.txt -cpu 8 -division 128 -block 48 -br IO_0
582 12.351 15.303 17.811 14.310 14.094 14.774
583
584 ./word_count -file 1gb.txt -cpu 8 -division 128 -block 48 -m
585 20.071 20.652 27.683 23.919 22.070 22.789
586
587 ./word_count -file 1gb.txt -cpu 8 -division 128 -block 48 -r
588 15.542 14.062 14.255 14.541 15.524 14.785
589
590 ./word_count -file 1gb.txt -cpu 12 -division 128 -block 48 -m
591 20.415 23.049 27.368 20.539 22.195 22.713
592
593 ./word_count -file 2gb.txt -cpu 12 -division 128 -block 48 -m
594 40.646 41.631 34.220 36.335 38.208
595
596 ./word_count -file 2gb.txt -cpu 12 -division 128 -block 48 -br
597 27.800 30.437 26.995 28.411
598
599 ./word_count -file 2gb.txt -cpu 12 -division 128 -block 48 -br io_0
600 21.977 23.126 28.174 25.038 22.688 24.201
601
602 ./word_count -file 3gb.txt -cpu 12 -division 128 -block 48 -m
603 51.671 61.249 59.457 56.704 63.490 58.514
604
605 ./word_count -file 4gb.txt -cpu 12 -division 128 -block 48 -m
606 65.671 73.202 77.090 76.386 76.017 73.767
607
608 ./word_count -file 4gb.txt -cpu 12 -division 128 -block 48 -br io_0
609 43.864 51.867 49.750 49.981 44.271 47.967
610
611 ./word_count -file 3gb.txt -cpu 12 -division 128 -block 48 -br io_0
612 29.918 35.544 36.423 39.121 41.158 36.397
613
614 ./word_count -file 4gb.txt -cpu 12 -division 128 -block 48 -br SPE_ANY
615 50.935 57.769 54.234 54.155 52.010 53.813
616
617 ./word_count -file 3gb.txt -cpu 12 -division 128 -block 48 -br SPE_ANY
618 45.513 40.117 42.841 38.430 41.798 41.740
619
620 ./word_count -file 2gb.txt -cpu 12 -division 128 -block 48 -br SPE_ANY
621 23.304 24.006 22.301 23.292 25.107 23.602
622
623 -------------------------------------------------------------
624