Mercurial > hg > Members > masakoha > masa

annotate 2014/February/memo/MMAPvsDivideRead.txt @ 44:fe3ef7f6a23f

Find changesets by keywords (author, files, the commit message), revision number or hash, or revset expression.
add result
author Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
date Tue, 11 Feb 2014 15:56:23 +0900
parents 2e3a08465f8c
children
Ignore whitespace changes - Everywhere: Within whitespace: At end of lines:
rev   line source
38
85f3125dd461 add result but imcomplete
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents: 37
diff changeset
1 [program]
44
fe3ef7f6a23f add result
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents: 42
diff changeset
2
fe3ef7f6a23f add result
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents: 42
diff changeset
3 mmap だと ramdam access なので DB だと使用されない -> read を使用している。
fe3ef7f6a23f add result
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents: 42
diff changeset
4
fe3ef7f6a23f add result
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents: 42
diff changeset
5 実験環境をいろいろ変えてみよう
fe3ef7f6a23f add result
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents: 42
diff changeset
6 OSを変更してみる。(Linux など)
fe3ef7f6a23f add result
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents: 42
diff changeset
7 mmap の flag をかえてみる
fe3ef7f6a23f add result
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents: 42
diff changeset
8 priority 下げてみる??
fe3ef7f6a23f add result
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents: 42
diff changeset
9 様々なことをやってみよう
fe3ef7f6a23f add result
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents: 42
diff changeset
10
38
85f3125dd461 add result but imcomplete
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents: 37
diff changeset
11 [実験環境]
85f3125dd461 add result but imcomplete
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents: 37
diff changeset
12 firefly で計測
44
fe3ef7f6a23f add result
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents: 42
diff changeset
13 mac os X 10.9.1
38
85f3125dd461 add result but imcomplete
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents: 37
diff changeset
14 2*2.66 GHz, HHD 1TB, memory 16GB
85f3125dd461 add result but imcomplete
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents: 37
diff changeset
15 読み込んだ file size : 10740996168 Byte (10GB)
85f3125dd461 add result but imcomplete
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents: 37
diff changeset
16
85f3125dd461 add result but imcomplete
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents: 37
diff changeset
17 読み込んでから Task が終了するまでの時間を測定
85f3125dd461 add result but imcomplete
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents: 37
diff changeset
18
44
fe3ef7f6a23f add result
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents: 42
diff changeset
19 % ./regex -file 10gb.txt -sw doing -division 128 -block 48 -cpu 12 -br
41
069bd7447975 add result
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents: 40
diff changeset
20 [結果]
40
2b55530913a2 add result (interim)
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents: 39
diff changeset
21 bm_search one task size 128k
41
069bd7447975 add result
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents: 40
diff changeset
22 task blocks 48
44
fe3ef7f6a23f add result
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents: 42
diff changeset
23 CPUNUM
40
2b55530913a2 add result (interim)
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents: 39
diff changeset
24 1
2b55530913a2 add result (interim)
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents: 39
diff changeset
25 MMAP
2b55530913a2 add result (interim)
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents: 39
diff changeset
26 second 35.713130
2b55530913a2 add result (interim)
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents: 39
diff changeset
27 IO BRead
2b55530913a2 add result (interim)
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents: 39
diff changeset
28 2
41
069bd7447975 add result
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents: 40
diff changeset
29 MMAP 94.298429 94.268424 96.484658
40
2b55530913a2 add result (interim)
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents: 39
diff changeset
30 second 17.186720
41
069bd7447975 add result
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents: 40
diff changeset
31 IO BRead 100.222430 100.458053 94.847105
40
2b55530913a2 add result (interim)
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents: 39
diff changeset
32 3
41
069bd7447975 add result
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents: 40
diff changeset
33 MMAP 129.450665 108.940161 106.512558
40
2b55530913a2 add result (interim)
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents: 39
diff changeset
34 second 12.161487
41
069bd7447975 add result
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents: 40
diff changeset
35 SPE BRead 107.156623
069bd7447975 add result
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents: 40
diff changeset
36 IO BRead 96.690044 98.422669 95.189016
40
2b55530913a2 add result (interim)
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents: 39
diff changeset
37 4
44
fe3ef7f6a23f add result
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents: 42
diff changeset
38 MMAP 135.155317 142.751540 148.916697 137.110170 147.350221
40
2b55530913a2 add result (interim)
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents: 39
diff changeset
39 second 12.102094
41
069bd7447975 add result
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents: 40
diff changeset
40 SPE BRead 96.664415
44
fe3ef7f6a23f add result
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents: 42
diff changeset
41 IO BRead 109.181394 97.955774 94.676133 94.508641 97.399619
40
2b55530913a2 add result (interim)
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents: 39
diff changeset
42 8
2b55530913a2 add result (interim)
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents: 39
diff changeset
43 MMAP 174.250825 146.720434 147.433098
2b55530913a2 add result (interim)
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents: 39
diff changeset
44 second 6.942862
2b55530913a2 add result (interim)
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents: 39
diff changeset
45 IO BRead 90.398165 91.338648 101.322919
2b55530913a2 add result (interim)
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents: 39
diff changeset
46 12
2b55530913a2 add result (interim)
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents: 39
diff changeset
47 MMAP 181.776079 148.274648 148.439857 147.485801 147.036413
2b55530913a2 add result (interim)
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents: 39
diff changeset
48 second 6.929711
41
069bd7447975 add result
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents: 40
diff changeset
49 SPE BRead 111.674880 94.806148 106.796695 106.796695 95.730738
40
2b55530913a2 add result (interim)
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents: 39
diff changeset
50 IO BRead 95.656162 117.457584 96.305392 91.637826 94.680580
41
069bd7447975 add result
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents: 40
diff changeset
51
069bd7447975 add result
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents: 40
diff changeset
52 bm_search one task size 64k
069bd7447975 add result
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents: 40
diff changeset
53 task blocks 48
069bd7447975 add result
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents: 40
diff changeset
54 12
069bd7447975 add result
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents: 40
diff changeset
55 MMAP 128.752630 130.268836
069bd7447975 add result
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents: 40
diff changeset
56 IO BRead 97.779679 109.356311
069bd7447975 add result
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents: 40
diff changeset
57
069bd7447975 add result
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents: 40
diff changeset
58 bm_search one task size 256k
069bd7447975 add result
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents: 40
diff changeset
59 task blocks 48
069bd7447975 add result
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents: 40
diff changeset
60 12
069bd7447975 add result
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents: 40
diff changeset
61 MMAP 166.577149 148.437492
069bd7447975 add result
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents: 40
diff changeset
62 IO BRead 107.571059 99.907239
069bd7447975 add result
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents: 40
diff changeset
63
069bd7447975 add result
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents: 40
diff changeset
64 bm_search one task size 512k
069bd7447975 add result
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents: 40
diff changeset
65 task blocks 48
069bd7447975 add result
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents: 40
diff changeset
66 12
069bd7447975 add result
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents: 40
diff changeset
67 MMAP 149.994577 138.402043
069bd7447975 add result
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents: 40
diff changeset
68 IO BRead 94.069890 101.792784
069bd7447975 add result
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents: 40
diff changeset
69
069bd7447975 add result
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents: 40
diff changeset
70 bm_search one task size 128k
069bd7447975 add result
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents: 40
diff changeset
71 task blocks 24
069bd7447975 add result
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents: 40
diff changeset
72 12
069bd7447975 add result
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents: 40
diff changeset
73 MMAP 153.115449
069bd7447975 add result
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents: 40
diff changeset
74 IO BRead 98.620145
42
2e3a08465f8c add result
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents: 41
diff changeset
75
2e3a08465f8c add result
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents: 41
diff changeset
76 bm_search one task size 128k
2e3a08465f8c add result
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents: 41
diff changeset
77 task blocks 64
2e3a08465f8c add result
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents: 41
diff changeset
78 12
2e3a08465f8c add result
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents: 41
diff changeset
79 MMAP 153.186823
2e3a08465f8c add result
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents: 41
diff changeset
80 IO BRead 95.646812
2e3a08465f8c add result
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents: 41
diff changeset
81
2e3a08465f8c add result
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents: 41
diff changeset
82 bm_search one task size 256k
2e3a08465f8c add result
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents: 41
diff changeset
83 task blocks 64
2e3a08465f8c add result
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents: 41
diff changeset
84 12
2e3a08465f8c add result
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents: 41
diff changeset
85 MMAP 147.430725
2e3a08465f8c add result
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents: 41
diff changeset
86 IO BRead 94.544596
2e3a08465f8c add result
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents: 41
diff changeset
87
2e3a08465f8c add result
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents: 41
diff changeset
88 bm_search one task size 256k
2e3a08465f8c add result
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents: 41
diff changeset
89 task blocks 256
2e3a08465f8c add result
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents: 41
diff changeset
90 12
2e3a08465f8c add result
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents: 41
diff changeset
91 MMAP 150.335210
2e3a08465f8c add result
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents: 41
diff changeset
92 IO BRead 111.773256
2e3a08465f8c add result
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents: 41
diff changeset
93
44
fe3ef7f6a23f add result
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents: 42
diff changeset
94 fileread
fe3ef7f6a23f add result
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents: 42
diff changeset
95 file read one task size
fe3ef7f6a23f add result
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents: 42
diff changeset
96 1024 * 128 * 48 cpu 1 93.605574 95.171400
fe3ef7f6a23f add result
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents: 42
diff changeset
97 1024 * 128 * 48 cpu 4 97.775177 97.714276
fe3ef7f6a23f add result
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents: 42
diff changeset
98 1024 * 256 * 256 cpu 4 98.261143 95.614298