Mercurial > hg > Members > masakoha > masa

comparison 2014/February/memo/MMAPvsDivideRead.txt @ 44:fe3ef7f6a23f

Find changesets by keywords (author, files, the commit message), revision number or hash, or revset expression.
add result
author Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
date Tue, 11 Feb 2014 15:56:23 +0900
parents 2e3a08465f8c
children
comparison
equal deleted inserted replaced
43:d8479839bee8 44:fe3ef7f6a23f
1 [program] 1 [program]
2
3 mmap だと ramdam access なので DB だと使用されない -> read を使用している。
4
5 実験環境をいろいろ変えてみよう
6 OSを変更してみる。(Linux など)
7 mmap の flag をかえてみる
8 priority 下げてみる??
9 様々なことをやってみよう
10
2 [実験環境] 11 [実験環境]
3 firefly で計測 12 firefly で計測
13 mac os X 10.9.1
4 2*2.66 GHz, HHD 1TB, memory 16GB 14 2*2.66 GHz, HHD 1TB, memory 16GB
5 読み込んだ file size : 10740996168 Byte (10GB) 15 読み込んだ file size : 10740996168 Byte (10GB)
6 16
7 読み込んでから Task が終了するまでの時間を測定 17 読み込んでから Task が終了するまでの時間を測定
8 18
9 divide read で一度に読み込む量 : 4*4096*1024 Byte 19 % ./regex -file 10gb.txt -sw doing -division 128 -block 48 -cpu 12 -br
10
11
12 % ./fileread -file ../regex_mas/10gb.txt -cpu 12 -dr
13
14 bm_search one task size 16k
15 [結果]
16 | -SPE_ANY-|--IO_0---|
17 CPUNUM| MMAP BRead| DRead|
18 2 95.865063
19 3
20 4 104.667434
21 8 114.974203
22 12 111.810354 147.010479
23 24 99.040944
24
25 12 MMAP 111.810354 63.559829 77.970525
26 IO_0 BRead 79.868357 115.067654 107.77211 96.924706
27 SPE_NUM BRead 102.420338 120.658969 102.126428 118.725368
28
29 11 MMAP
30 IO_0 BRead 99.384507 116.714300 134.678377 97.970632
31
32 4
33 IO_0 BRead 102.480095
34
35 filesize 15GB
36 12
37 mmap 160.332098 224.448694
38 IO_0 BRead 276.518567 205.553947
39
40
41 [結果] 20 [結果]
42 bm_search one task size 128k 21 bm_search one task size 128k
43 task blocks 48 22 task blocks 48
44 | |-SPE_ANY-|--IO_0---| 23 CPUNUM
45 CPUNUM| MMAP | BRead | BRead |
46 1 24 1
47 MMAP 25 MMAP
48 second 35.713130 26 second 35.713130
49 IO BRead 27 IO BRead
50 2 28 2
55 MMAP 129.450665 108.940161 106.512558 33 MMAP 129.450665 108.940161 106.512558
56 second 12.161487 34 second 12.161487
57 SPE BRead 107.156623 35 SPE BRead 107.156623
58 IO BRead 96.690044 98.422669 95.189016 36 IO BRead 96.690044 98.422669 95.189016
59 4 37 4
60 MMAP 135.155317 142.751540 148.916697 38 MMAP 135.155317 142.751540 148.916697 137.110170 147.350221
61 second 12.102094 39 second 12.102094
62 SPE BRead 96.664415 40 SPE BRead 96.664415
63 IO BRead 109.181394 97.955774 94.676133 41 IO BRead 109.181394 97.955774 94.676133 94.508641 97.399619
64 8 42 8
65 MMAP 174.250825 146.720434 147.433098 43 MMAP 174.250825 146.720434 147.433098
66 second 6.942862 44 second 6.942862
67 IO BRead 90.398165 91.338648 101.322919 45 IO BRead 90.398165 91.338648 101.322919
68 12 46 12
111 task blocks 256 89 task blocks 256
112 12 90 12
113 MMAP 150.335210 91 MMAP 150.335210
114 IO BRead 111.773256 92 IO BRead 111.773256
115 93
94 fileread
95 file read one task size
96 1024 * 128 * 48 cpu 1 93.605574 95.171400
97 1024 * 128 * 48 cpu 4 97.775177 97.714276
98 1024 * 256 * 256 cpu 4 98.261143 95.614298