view benchmark_gfs2.txt @ 15:88d663a7bad5

add file for gnuplot
author taiki
date Tue, 13 Jan 2015 15:22:27 +0900
parents 07347ccf01e0
children 170f04992ccb
line wrap: on
line source

GFS2 use FileBench benchmark on Fedora 20  kernel-3.16 

* 2015 1/1 GFS2 / fileserver / 60 seconds / VM to GFS2 only bldsv09 access / VM image on FC
statfile1            16217ops      270ops/s   0.0mb/s      0.2ms/op     2155us/op-cpu [0ms - 428ms]
deletefile1          16221ops      270ops/s   0.0mb/s      8.4ms/op     6842us/op-cpu [0ms - 2911ms]
closefile3           16223ops      270ops/s   0.0mb/s      0.0ms/op     2132us/op-cpu [0ms - 19ms]
readfile1            16225ops      270ops/s  34.2mb/s     23.8ms/op     4463us/op-cpu [0ms - 5577ms]
openfile2            16237ops      271ops/s   0.0mb/s      0.3ms/op     2175us/op-cpu [0ms - 428ms]
closefile2           16243ops      271ops/s   0.0mb/s      0.0ms/op     2114us/op-cpu [0ms - 5ms]
appendfilerand1      16245ops      271ops/s   2.1mb/s     49.7ms/op     8875us/op-cpu [0ms - 5643ms]
openfile1            16257ops      271ops/s   0.0mb/s      0.3ms/op     2158us/op-cpu [0ms - 425ms]
closefile1           16258ops      271ops/s   0.0mb/s      0.0ms/op     2133us/op-cpu [0ms - 9ms]
wrtfile1             16262ops      271ops/s  33.9mb/s      1.5ms/op     2783us/op-cpu [0ms - 1806ms]
createfile1          16267ops      271ops/s   0.0mb/s      0.9ms/op     2445us/op-cpu [0ms - 428ms]
 1093: 127.732: IO Summary: 178655 ops, 2976.451 ops/s, (270/542 r/w),  70.2mb/s,    457us cpu/op,  28.4ms latency


* 2015 1/1 GFS2 / fileserver / 60 seconds / only bldsv09 access / FC
statfile1            19419ops      324ops/s   0.0mb/s      0.4ms/op     1967us/op-cpu [0ms - 230ms]
deletefile1          19419ops      324ops/s   0.0mb/s      8.5ms/op     6421us/op-cpu [0ms - 8915ms]
closefile3           19429ops      324ops/s   0.0mb/s      0.0ms/op     1396us/op-cpu [0ms - 0ms]
readfile1            19429ops      324ops/s  41.9mb/s      2.9ms/op     6144us/op-cpu [0ms - 8908ms]
openfile2            19431ops      324ops/s   0.0mb/s      1.1ms/op     2121us/op-cpu [0ms - 8906ms]
closefile2           19432ops      324ops/s   0.0mb/s      0.0ms/op     1438us/op-cpu [0ms - 0ms]
appendfilerand1      19432ops      324ops/s   2.5mb/s      8.8ms/op     7417us/op-cpu [0ms - 8912ms]
openfile1            19435ops      324ops/s   0.0mb/s      3.1ms/op     2399us/op-cpu [0ms - 8907ms]
closefile1           19436ops      324ops/s   0.0mb/s      0.0ms/op     1338us/op-cpu [0ms - 0ms]
wrtfile1             19436ops      324ops/s  39.8mb/s     96.0ms/op   120915us/op-cpu [0ms - 9012ms]
createfile1          19464ops      324ops/s   0.0mb/s      9.7ms/op    13736us/op-cpu [0ms - 7886ms]
22867: 99.839: IO Summary: 213762 ops, 3562.315 ops/s, (324/648 r/w),  84.3mb/s,   1117us cpu/op,  43.5ms latency


* 2015 1/1 GFS2 / fileserver / 60 seconds / docker to only bldsv09 access / FC

    -v option で /media/fcs へ接続

statfile1            27399ops      457ops/s   0.0mb/s      0.7ms/op     1869us/op-cpu [0ms - 13179ms]
deletefile1          27381ops      456ops/s   0.0mb/s      3.6ms/op     6066us/op-cpu [0ms - 13194ms]
closefile3           27400ops      457ops/s   0.0mb/s      0.0ms/op     1378us/op-cpu [0ms - 0ms]
readfile1            27400ops      457ops/s  59.2mb/s      1.5ms/op     6065us/op-cpu [0ms - 209ms]
openfile2            27400ops      457ops/s   0.0mb/s      0.3ms/op     2014us/op-cpu [0ms - 99ms]
closefile2           27400ops      457ops/s   0.0mb/s      0.0ms/op     1400us/op-cpu [0ms - 0ms]
appendfilerand1      27400ops      457ops/s   3.6mb/s      4.4ms/op     9155us/op-cpu [0ms - 13193ms]
openfile1            27400ops      457ops/s   0.0mb/s      0.4ms/op     2048us/op-cpu [0ms - 81ms]
closefile1           27400ops      457ops/s   0.0mb/s      0.0ms/op     1341us/op-cpu [0ms - 1ms]
wrtfile1             27400ops      457ops/s  56.1mb/s     81.9ms/op   130988us/op-cpu [0ms - 13500ms]
createfile1          27439ops      457ops/s   0.0mb/s      6.9ms/op    14198us/op-cpu [0ms - 13186ms]
   43: 92.660: IO Summary: 301419 ops, 5023.193 ops/s, (457/913 r/w), 118.9mb/s,   1187us cpu/op,  33.2ms latency


* 2015 1/1 GFS2 / fileserver / 60 seconds / bldsv09 access / FC
statfile1            26112ops      435ops/s   0.0mb/s      0.2ms/op     1669us/op-cpu [0ms - 291ms]
deletefile1          26111ops      435ops/s   0.0mb/s      4.4ms/op     5851us/op-cpu [0ms - 14536ms]
closefile3           26114ops      435ops/s   0.0mb/s      0.0ms/op     1187us/op-cpu [0ms - 0ms]
readfile1            26114ops      435ops/s  56.1mb/s      5.0ms/op     4831us/op-cpu [0ms - 14540ms]
openfile2            26114ops      435ops/s   0.0mb/s      1.4ms/op     1825us/op-cpu [0ms - 14518ms]
closefile2           26114ops      435ops/s   0.0mb/s      0.0ms/op     1212us/op-cpu [0ms - 0ms]
appendfilerand1      26114ops      435ops/s   3.4mb/s      7.2ms/op     8338us/op-cpu [0ms - 14540ms]
openfile1            26115ops      435ops/s   0.0mb/s      1.7ms/op     1891us/op-cpu [0ms - 14519ms]
closefile1           26115ops      435ops/s   0.0mb/s      0.0ms/op     1206us/op-cpu [0ms - 0ms]
wrtfile1             26115ops      435ops/s  54.1mb/s     76.3ms/op   126556us/op-cpu [0ms - 14636ms]
createfile1          26160ops      436ops/s   0.0mb/s      8.7ms/op    13211us/op-cpu [0ms - 14537ms]
18999: 86.335: IO Summary: 287298 ops, 4787.839 ops/s, (435/870 r/w), 113.5mb/s,   1127us cpu/op,  35.0ms latency


* 2015 1/6 GFS2 / fileserver / 60 seconds / bldsv10 access / FC
statfile1            23738ops      396ops/s   0.0mb/s      1.4ms/op     2917us/op-cpu [0ms - 13948ms]
deletefile1          23718ops      395ops/s   0.0mb/s      8.4ms/op     6633us/op-cpu [0ms - 13969ms]
closefile3           23739ops      396ops/s   0.0mb/s      0.0ms/op     2433us/op-cpu [0ms - 0ms]
readfile1            23739ops      396ops/s  50.9mb/s      5.4ms/op    10531us/op-cpu [0ms - 14041ms]
openfile2            23739ops      396ops/s   0.0mb/s      3.8ms/op     2983us/op-cpu [0ms - 13955ms]
closefile2           23739ops      396ops/s   0.0mb/s      0.0ms/op     2398us/op-cpu [0ms - 0ms]
appendfilerand1      23740ops      396ops/s   3.1mb/s      7.0ms/op     9821us/op-cpu [0ms - 13969ms]
openfile1            23742ops      396ops/s   0.0mb/s      1.1ms/op     3156us/op-cpu [0ms - 13949ms]
closefile1           23742ops      396ops/s   0.0mb/s      0.0ms/op     2358us/op-cpu [0ms - 0ms]
wrtfile1             23743ops      396ops/s  49.2mb/s     56.8ms/op   114702us/op-cpu [0ms - 14031ms]
createfile1          23785ops      396ops/s   0.0mb/s     25.1ms/op    16142us/op-cpu [0ms - 13969ms]
 5359: 68.172: IO Summary: 261164 ops, 4352.327 ops/s, (396/791 r/w), 103.2mb/s,   1243us cpu/op,  36.3ms latency


* 2015 1/6 GFS2 / fileserver / 60 seconds / bldsv10 and bldsv09 access / FC
ansible を使った 2 node (bldsv09、bldsv10) から GFS2 上の別ディレクトリへの読み書き
同じディレクトリへは filebench の性質上できなかった

ansible -s -i hosts all -a 'filebench -f /home/taira/hg/benchmarks/fileserver.f' --sudo --ask-sudo-pass

    bldsv09.cr.ie.u-ryukyu.ac.jp
    /media/fcs/bldsv09

statfile1            2832ops       47ops/s   0.0mb/s     15.2ms/op     5290us/op-cpu [0ms - 5189ms]
deletefile1          2830ops       47ops/s   0.0mb/s     40.4ms/op     7021us/op-cpu [0ms - 17584ms]
closefile3           2839ops       47ops/s   0.0mb/s      0.0ms/op     1828us/op-cpu [0ms - 0ms]
readfile1            2839ops       47ops/s   6.0mb/s      4.8ms/op     2853us/op-cpu [0ms - 1642ms]
openfile2            2847ops       47ops/s   0.0mb/s    120.9ms/op     7457us/op-cpu [0ms - 19056ms]
closefile2           2852ops       48ops/s   0.0mb/s      0.0ms/op     2002us/op-cpu [0ms - 0ms]
appendfilerand1      2852ops       48ops/s   0.4mb/s     40.8ms/op    14246us/op-cpu [0ms - 9765ms]
openfile1            2866ops       48ops/s   0.0mb/s    239.1ms/op    12955us/op-cpu [0ms - 19058ms]
closefile1           2867ops       48ops/s   0.0mb/s      0.0ms/op     2065us/op-cpu [0ms - 0ms]
wrtfile1             2867ops       48ops/s   5.9mb/s     31.5ms/op    12675us/op-cpu [0ms - 5644ms]
createfile1          2879ops       48ops/s   0.0mb/s    452.5ms/op    76766us/op-cpu [0ms - 28904ms]
 4400: 65.803: IO Summary: 31370 ops, 522.771 ops/s, (47/95 r/w),  12.2mb/s,   1526us cpu/op, 316.6ms latency

    bldsv10.cr.ie.u-ryukyu.ac.jp
    /media/fcs/bldsv10

 statfile1            4912ops       82ops/s   0.0mb/s     11.9ms/op     2079us/op-cpu [0ms - 4671ms]
 deletefile1          4891ops       82ops/s   0.0mb/s     71.6ms/op    12556us/op-cpu [0ms - 13723ms]
 closefile3           4919ops       82ops/s   0.0mb/s      0.0ms/op     1386us/op-cpu [0ms - 0ms]
 readfile1            4919ops       82ops/s  10.3mb/s      3.1ms/op     2007us/op-cpu [0ms - 6064ms]
 openfile2            4922ops       82ops/s   0.0mb/s     16.0ms/op     2292us/op-cpu [0ms - 4709ms]
 closefile2           4926ops       82ops/s   0.0mb/s      0.0ms/op     1303us/op-cpu [0ms - 0ms]
 appendfilerand1      4926ops       82ops/s   0.6mb/s     28.7ms/op    11045us/op-cpu [0ms - 7014ms]
 openfile1            4933ops       82ops/s   0.0mb/s     93.4ms/op     2783us/op-cpu [0ms - 15341ms]
 closefile1           4936ops       82ops/s   0.0mb/s      0.0ms/op     1264us/op-cpu [0ms - 0ms]
 wrtfile1             4936ops       82ops/s  10.2mb/s     99.5ms/op    75415us/op-cpu [0ms - 10896ms]
 createfile1          4938ops       82ops/s   0.0mb/s    220.4ms/op    37436us/op-cpu [0ms - 16501ms]
 18603: 65.666: IO Summary: 54158 ops, 902.538 ops/s, (82/164 r/w),  21.1mb/s,   1473us cpu/op, 181.6ms latency


* 2015 1/12 GFS2 / fileserver / 60 seconds / bldsv10 access / FC
http://jpetazzo.github.io/2014/01/29/docker-device-mapper-resize/ を参考に、devicemapper が作る pool を FC 上に変更

1. Stop the Docker daemon.
2. Wipe out /var/lib/docker. (That should sound familiar, right?)
3. Create the storage directory: mkdir -p /var/lib/docker/devicemapper/devicemapper.
4. Create a data symbolic link in that directory, pointing to the device: ln -s /dev/sdb /var/lib/docker/devicemapper/devicemapper/data.
5. Restart Docker.
6. Check with docker info that the Data Space Total value is correct.

 docker run --privileged -it fedora:20 /bin/bash で docker を実行し filebench を install

statfile1            41866ops      698ops/s   0.0mb/s      0.0ms/op     6235us/op-cpu [0ms - 1ms]
deletefile1          41869ops      698ops/s   0.0mb/s      0.2ms/op     6971us/op-cpu [0ms - 218ms]
closefile3           41874ops      698ops/s   0.0mb/s      0.0ms/op     6054us/op-cpu [0ms - 2ms]
readfile1            41881ops      698ops/s  91.0mb/s      8.8ms/op    29662us/op-cpu [0ms - 266ms]
openfile2            41886ops      698ops/s   0.0mb/s      0.1ms/op     6587us/op-cpu [0ms - 13ms]
closefile2           41890ops      698ops/s   0.0mb/s      0.0ms/op     6085us/op-cpu [0ms - 2ms]
appendfilerand1      41895ops      698ops/s   5.4mb/s      2.5ms/op    12903us/op-cpu [0ms - 14ms]
openfile1            41900ops      698ops/s   0.0mb/s      0.1ms/op     6640us/op-cpu [0ms - 9ms]
closefile1           41904ops      698ops/s   0.0mb/s      0.0ms/op     6122us/op-cpu [0ms - 2ms]
wrtfile1             41910ops      698ops/s  86.5mb/s      8.5ms/op    28960us/op-cpu [0ms - 272ms]
createfile1          41914ops      699ops/s   0.0mb/s      0.2ms/op     7029us/op-cpu [0ms - 15ms]
35: 76.024: IO Summary: 460789 ops, 7679.141 ops/s, (698/1397 r/w), 182.9mb/s,   1022us cpu/op,   6.8ms latency


* 2015 1/13 GFS2 / fileserver / 60 seconds / docker on bldsv09 / FC
docker run --privileged -it --name counttime -v /media/fcs:/media/fcs:rw fedora:20 /bin/bash
statfile1            41954ops      699ops/s   0.0mb/s      0.0ms/op     6522us/op-cpu [0ms - 1ms]
deletefile1          41955ops      699ops/s   0.0mb/s      2.5ms/op     8750us/op-cpu [0ms - 1846ms]
closefile3           41962ops      699ops/s   0.0mb/s      0.0ms/op     6413us/op-cpu [0ms - 2ms]
readfile1            41972ops      699ops/s  90.8mb/s      7.7ms/op    26537us/op-cpu [0ms - 1897ms]
openfile2            41974ops      700ops/s   0.0mb/s      0.1ms/op     6851us/op-cpu [0ms - 8ms]
closefile2           41976ops      700ops/s   0.0mb/s      0.0ms/op     6366us/op-cpu [0ms - 1ms]
appendfilerand1      41979ops      700ops/s   5.4mb/s      2.4ms/op    12301us/op-cpu [0ms - 1838ms]
openfile1            41985ops      700ops/s   0.0mb/s      0.1ms/op     6887us/op-cpu [0ms - 9ms]
closefile1           41991ops      700ops/s   0.0mb/s      0.0ms/op     6422us/op-cpu [0ms - 1ms]
wrtfile1             41998ops      700ops/s  86.9mb/s      7.4ms/op    26438us/op-cpu [0ms - 623ms]
createfile1          42002ops      700ops/s   0.0mb/s      0.3ms/op     7455us/op-cpu [0ms - 622ms]
   38: 77.904: IO Summary: 461748 ops, 7695.120 ops/s, (699/1399 r/w), 183.2mb/s,   1022us cpu/op,   6.8ms latency

* 2015 1/13 GFS2 / fileserver / 60 seconds / only bldsv09 / FC
statfile1            43169ops      719ops/s   0.0mb/s      0.0ms/op     6043us/op-cpu [0ms - 1ms]
deletefile1          43172ops      719ops/s   0.0mb/s      1.9ms/op    10613us/op-cpu [0ms - 1977ms]
closefile3           43190ops      720ops/s   0.0mb/s      0.0ms/op     5934us/op-cpu [0ms - 1ms]
readfile1            43195ops      720ops/s  93.5mb/s      8.8ms/op    29020us/op-cpu [0ms - 221ms]
openfile2            43195ops      720ops/s   0.0mb/s      0.0ms/op     6188us/op-cpu [0ms - 6ms]
closefile2           43195ops      720ops/s   0.0mb/s      0.0ms/op     5931us/op-cpu [0ms - 0ms]
appendfilerand1      43195ops      720ops/s   5.6mb/s      2.2ms/op    11659us/op-cpu [0ms - 27ms]
openfile1            43197ops      720ops/s   0.0mb/s      0.1ms/op     6234us/op-cpu [0ms - 6ms]
closefile1           43197ops      720ops/s   0.0mb/s      0.0ms/op     5982us/op-cpu [0ms - 2ms]
wrtfile1             43197ops      720ops/s  88.9mb/s      8.3ms/op    27852us/op-cpu [0ms - 216ms]
createfile1          43202ops      720ops/s   0.0mb/s      0.1ms/op     6510us/op-cpu [0ms - 41ms]
 4656: 82.259: IO Summary: 475104 ops, 7917.701 ops/s, (720/1440 r/w), 188.1mb/s,    972us cpu/op,   7.2ms latency

* 2015 1/13 GFS2 / fileserver / 60 seconds / VM bldsv09 / FC
statfile1            15754ops      261ops/s   0.0mb/s      0.1ms/op     2210us/op-cpu [0ms - 84ms]
deletefile1          15754ops      261ops/s   0.0mb/s      4.6ms/op     5418us/op-cpu [0ms - 618ms]
closefile3           15768ops      261ops/s   0.0mb/s      0.0ms/op     2173us/op-cpu [0ms - 12ms]
readfile1            15768ops      261ops/s  33.5mb/s     21.4ms/op     4264us/op-cpu [0ms - 7800ms]
openfile2            15769ops      261ops/s   0.0mb/s      0.2ms/op     2254us/op-cpu [0ms - 278ms]
closefile2           15799ops      261ops/s   0.0mb/s      0.0ms/op     2206us/op-cpu [0ms - 5ms]
appendfilerand1      15801ops      261ops/s   2.0mb/s     48.0ms/op     7072us/op-cpu [0ms - 7807ms]
openfile1            15802ops      261ops/s   0.0mb/s      0.2ms/op     2226us/op-cpu [0ms - 657ms]
closefile1           15803ops      261ops/s   0.0mb/s      0.0ms/op     2063us/op-cpu [0ms - 12ms]
wrtfile1             15804ops      261ops/s  32.4mb/s      1.2ms/op     2588us/op-cpu [0ms - 3553ms]
createfile1          15804ops      261ops/s   0.0mb/s      7.3ms/op     2513us/op-cpu [0ms - 4053ms]
  1061: 106.272: IO Summary: 173626 ops, 2872.431 ops/s, (261/523 r/w),  68.0mb/s,    433us cpu/op,  27.7ms latency

statfile1            16795ops      280ops/s   0.0mb/s      1.0ms/op     2230us/op-cpu [0ms - 1654ms]
deletefile1          16802ops      280ops/s   0.0mb/s      3.9ms/op     4517us/op-cpu [0ms - 2071ms]
closefile3           16807ops      280ops/s   0.0mb/s      0.0ms/op     2285us/op-cpu [0ms - 8ms]
readfile1            16812ops      280ops/s  36.0mb/s     22.5ms/op     4705us/op-cpu [0ms - 4024ms]
openfile2            16820ops      280ops/s   0.0mb/s      0.5ms/op     2262us/op-cpu [0ms - 1650ms]
closefile2           16821ops      280ops/s   0.0mb/s      0.0ms/op     2288us/op-cpu [0ms - 4ms]
appendfilerand1      16822ops      280ops/s   2.2mb/s     37.7ms/op     6868us/op-cpu [0ms - 4030ms]
openfile1            16826ops      280ops/s   0.0mb/s      0.7ms/op     2329us/op-cpu [0ms - 1653ms]
closefile1           16830ops      280ops/s   0.0mb/s      0.0ms/op     2258us/op-cpu [0ms - 12ms]
wrtfile1             16832ops      280ops/s  34.5mb/s      1.3ms/op     2731us/op-cpu [0ms - 386ms]
createfile1          16840ops      281ops/s   0.0mb/s      3.7ms/op     2748us/op-cpu [0ms - 1741ms]
   1039: 90.588: IO Summary: 185007 ops, 3082.561 ops/s, (280/561 r/w),  72.7mb/s,    439us cpu/op,  23.8ms latency