view 2014/February/memo/MMAPvsDivideRead.txt @ 44:fe3ef7f6a23f

add result
author Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
date Tue, 11 Feb 2014 15:56:23 +0900
parents 2e3a08465f8c
children
line wrap: on
line source

[program]

    mmap だと ramdam access なので DB だと使用されない -> read を使用している。

    実験環境をいろいろ変えてみよう
    OSを変更してみる。(Linux など)
    mmap の flag をかえてみる
    priority 下げてみる??
    様々なことをやってみよう

    [実験環境]
        firefly で計測
        mac os X 10.9.1
        2*2.66 GHz, HHD 1TB, memory 16GB
        読み込んだ file size : 10740996168 Byte (10GB)

        読み込んでから Task が終了するまでの時間を測定

    % ./regex -file 10gb.txt -sw doing -division 128 -block 48 -cpu 12 -br
    [結果]
    bm_search one task size 128k
    task blocks 48
    CPUNUM
        1                      
           MMAP     
           second    35.713130
           IO BRead 
        2                      
           MMAP       94.298429 94.268424 96.484658
           second    17.186720 
           IO BRead  100.222430 100.458053 94.847105
        3
           MMAP    129.450665  108.940161 106.512558
           second    12.161487
           SPE BRead 107.156623
           IO BRead 96.690044  98.422669 95.189016
        4                      
           MMAP     135.155317 142.751540 148.916697 137.110170 147.350221
           second   12.102094
           SPE BRead 96.664415
           IO BRead  109.181394 97.955774  94.676133 94.508641 97.399619
        8                      
           MMAP     174.250825 146.720434 147.433098
           second     6.942862   
           IO BRead  90.398165  91.338648 101.322919
       12
           MMAP     181.776079  148.274648   148.439857  147.485801 147.036413 
           second     6.929711   
          SPE BRead 111.674880 94.806148 106.796695 106.796695 95.730738 
           IO BRead  95.656162  117.457584    96.305392   91.637826  94.680580

    bm_search one task size 64k
    task blocks 48
       12
           MMAP     128.752630 130.268836
           IO BRead  97.779679 109.356311

    bm_search one task size 256k
    task blocks 48
       12
           MMAP     166.577149 148.437492
           IO BRead 107.571059 99.907239

    bm_search one task size 512k
    task blocks 48
       12
           MMAP     149.994577 138.402043
           IO BRead 94.069890 101.792784

    bm_search one task size 128k
    task blocks 24
       12
           MMAP     153.115449
           IO BRead 98.620145

    bm_search one task size 128k
    task blocks 64
       12
           MMAP     153.186823
           IO BRead  95.646812

    bm_search one task size 256k
    task blocks 64
       12
           MMAP     147.430725
           IO BRead  94.544596

    bm_search one task size 256k
    task blocks 256
       12
           MMAP     150.335210
           IO BRead 111.773256

    fileread
    file read one task size
    1024 * 128 *  48  cpu 1 93.605574 95.171400
    1024 * 128 *  48  cpu 4 97.775177 97.714276
    1024 * 256 * 256  cpu 4 98.261143 95.614298