Mercurial > hg > Members > masakoha > masa

diff 2014/February/memo/MMAPvsDivideRead.txt @ 44:fe3ef7f6a23f

Find changesets by keywords (author, files, the commit message), revision number or hash, or revset expression.
add result
author Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
date Tue, 11 Feb 2014 15:56:23 +0900
parents 2e3a08465f8c
children
line wrap: on
line diff
--- a/2014/February/memo/MMAPvsDivideRead.txt	Mon Feb 10 16:09:09 2014 +0900
+++ b/2014/February/memo/MMAPvsDivideRead.txt	Tue Feb 11 15:56:23 2014 +0900
@@ -1,48 +1,26 @@
 [program]
+
+    mmap だと ramdam access なので DB だと使用されない -> read を使用している。
+
+    実験環境をいろいろ変えてみよう
+    OSを変更してみる。(Linux など)
+    mmap の flag をかえてみる
+    priority 下げてみる??
+    様々なことをやってみよう
+
     [実験環境]
         firefly で計測
+        mac os X 10.9.1
         2*2.66 GHz, HHD 1TB, memory 16GB
         読み込んだ file size : 10740996168 Byte (10GB)
 
         読み込んでから Task が終了するまでの時間を測定
 
-        divide read で一度に読み込む量 : 4*4096*1024 Byte
-
-
-    % ./fileread -file ../regex_mas/10gb.txt -cpu 12 -dr
-
-    bm_search one task size 16k
-    [結果]
-          |          -SPE_ANY-|--IO_0---|
-    CPUNUM|    MMAP      BRead|   DRead|
-        2                      95.865063
-        3
-        4                      104.667434
-        8                      114.974203
-       12  111.810354          147.010479
-       24                      99.040944
-
-       12 MMAP 111.810354 63.559829 77.970525
-    IO_0 BRead  79.868357 115.067654 107.77211 96.924706
- SPE_NUM BRead  102.420338 120.658969 102.126428 118.725368
-
-       11 MMAP 
-    IO_0 BRead 99.384507 116.714300 134.678377 97.970632
-
-        4
-    IO_0 BRead 102.480095 
-
-        filesize 15GB
-        12
-    mmap        160.332098 224.448694
-    IO_0 BRead     276.518567  205.553947
-
-
+    % ./regex -file 10gb.txt -sw doing -division 128 -block 48 -cpu 12 -br
     [結果]
     bm_search one task size 128k
     task blocks 48
-          |         |-SPE_ANY-|--IO_0---|
-    CPUNUM|    MMAP |  BRead  |  BRead  |
+    CPUNUM
         1                      
            MMAP     
            second    35.713130
@@ -57,10 +35,10 @@
            SPE BRead 107.156623
            IO BRead 96.690044  98.422669 95.189016
         4                      
-           MMAP     135.155317 142.751540 148.916697
+           MMAP     135.155317 142.751540 148.916697 137.110170 147.350221
            second   12.102094
            SPE BRead 96.664415
-           IO BRead  109.181394 97.955774  94.676133
+           IO BRead  109.181394 97.955774  94.676133 94.508641 97.399619
         8                      
            MMAP     174.250825 146.720434 147.433098
            second     6.942862   
@@ -113,3 +91,8 @@
            MMAP     150.335210
            IO BRead 111.773256
 
+    fileread
+    file read one task size
+    1024 * 128 *  48  cpu 1 93.605574 95.171400
+    1024 * 128 *  48  cpu 4 97.775177 97.714276
+    1024 * 256 * 256  cpu 4 98.261143 95.614298