annotate Cerium_IO/Cerium_IO_memo.txt @ 97:26c484b68084

add statistics.txt
author Masataka Kohagura <kohagura@cr.ie.u-ryukyu.ac.jp>
date Sat, 10 May 2014 12:06:03 +0900
parents 14/Cerium_IO/Cerium_IO_memo.txt@5fb2d057b5d9
children b41e121acc0b
Ignore whitespace changes - Everywhere: Within whitespace: At end of lines:
rev   line source
95
5fb2d057b5d9 add synth memo
Masataka Kohagura <kohagura@cr.ie.u-ryukyu.ac.jp>
parents: 92
diff changeset
1 2014/05/08 (Thu)
5fb2d057b5d9 add synth memo
Masataka Kohagura <kohagura@cr.ie.u-ryukyu.ac.jp>
parents: 92
diff changeset
2 [memo]
5fb2d057b5d9 add synth memo
Masataka Kohagura <kohagura@cr.ie.u-ryukyu.ac.jp>
parents: 92
diff changeset
3 IO についての具体的な論文を出したい
5fb2d057b5d9 add synth memo
Masataka Kohagura <kohagura@cr.ie.u-ryukyu.ac.jp>
parents: 92
diff changeset
4 こういうアプリケーションは mmap がいい。fread がいい etc...
5fb2d057b5d9 add synth memo
Masataka Kohagura <kohagura@cr.ie.u-ryukyu.ac.jp>
parents: 92
diff changeset
5 Task の負荷が大きい例題があるといいよね
5fb2d057b5d9 add synth memo
Masataka Kohagura <kohagura@cr.ie.u-ryukyu.ac.jp>
parents: 92
diff changeset
6
5fb2d057b5d9 add synth memo
Masataka Kohagura <kohagura@cr.ie.u-ryukyu.ac.jp>
parents: 92
diff changeset
7 GPU で word count を走らせた時も計測してみよう
5fb2d057b5d9 add synth memo
Masataka Kohagura <kohagura@cr.ie.u-ryukyu.ac.jp>
parents: 92
diff changeset
8 pread を fread で書き換えたり、Blocked mmap もやってみて、様々な読み込み方法を試してみよう
5fb2d057b5d9 add synth memo
Masataka Kohagura <kohagura@cr.ie.u-ryukyu.ac.jp>
parents: 92
diff changeset
9
5fb2d057b5d9 add synth memo
Masataka Kohagura <kohagura@cr.ie.u-ryukyu.ac.jp>
parents: 92
diff changeset
10
91
40ea07afb5b7 separate memo
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents:
diff changeset
11 2014/05/01 (Thu)
40ea07afb5b7 separate memo
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents:
diff changeset
12 [memo]
40ea07afb5b7 separate memo
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents:
diff changeset
13 Linux のメモリキャッシュをクリアする
40ea07afb5b7 separate memo
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents:
diff changeset
14 http://futuremix.org/2009/09/clear-linux-memory-cach
40ea07afb5b7 separate memo
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents:
diff changeset
15 % sysctl -w vm.drop_caches=3
40ea07afb5b7 separate memo
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents:
diff changeset
16
40ea07afb5b7 separate memo
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents:
diff changeset
17 vm.drop_caches=index
40ea07afb5b7 separate memo
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents:
diff changeset
18 index : 内容
40ea07afb5b7 separate memo
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents:
diff changeset
19 1 : ページキャッシュ解放
40ea07afb5b7 separate memo
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents:
diff changeset
20 2 : ダーティキャッシュ、inode 解放
40ea07afb5b7 separate memo
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents:
diff changeset
21 3 : 1 かつ 2
40ea07afb5b7 separate memo
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents:
diff changeset
22
40ea07afb5b7 separate memo
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents:
diff changeset
23 sysctl について
40ea07afb5b7 separate memo
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents:
diff changeset
24
40ea07afb5b7 separate memo
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents:
diff changeset
25 ページキャッシュとは??
40ea07afb5b7 separate memo
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents:
diff changeset
26 ダーティキャッシュとは??
40ea07afb5b7 separate memo
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents:
diff changeset
27
40ea07afb5b7 separate memo
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents:
diff changeset
28 Linux PC でのスペックの確認方法
40ea07afb5b7 separate memo
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents:
diff changeset
29 http://www.asterisk-works.jp/wiki/index.php/Linux_PC%E3%81%A7%E3%81%AE%E3%82%B9%E3%83%9A%E3%83%83%E3%82%AF%E7%A2%BA%E8%AA%8D%E6%96%B9%E6%B3%95
40ea07afb5b7 separate memo
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents:
diff changeset
30
40ea07afb5b7 separate memo
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents:
diff changeset
31 OS の確認方法
40ea07afb5b7 separate memo
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents:
diff changeset
32 cat /etc/redhat-release redhat 系
40ea07afb5b7 separate memo
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents:
diff changeset
33 cat /etc/debian_version Debian 系
40ea07afb5b7 separate memo
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents:
diff changeset
34 cat /etc/lsb-release Ubuntu
40ea07afb5b7 separate memo
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents:
diff changeset
35
40ea07afb5b7 separate memo
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents:
diff changeset
36 様々なハードウェア情報
40ea07afb5b7 separate memo
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents:
diff changeset
37 cat /proc/cpuinfo
40ea07afb5b7 separate memo
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents:
diff changeset
38 cat /proc/meminfo
92
4db3a0797aa7 measure WordCount time in namako
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents: 91
diff changeset
39
4db3a0797aa7 measure WordCount time in namako
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents: 91
diff changeset
40 計測を Block num division size いろいろ試してみよう
4db3a0797aa7 measure WordCount time in namako
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents: 91
diff changeset
41 Solaris でも測ってみたいよね -> mmap がはやいらしい
4db3a0797aa7 measure WordCount time in namako
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents: 91
diff changeset
42
4db3a0797aa7 measure WordCount time in namako
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents: 91
diff changeset
43 read size を自動チューニングしたい
4db3a0797aa7 measure WordCount time in namako
Masataka Kohagura <e085726@ie.u-ryukyu.ac.jp>
parents: 91
diff changeset
44 どうにかできないかな??
95
5fb2d057b5d9 add synth memo
Masataka Kohagura <kohagura@cr.ie.u-ryukyu.ac.jp>
parents: 92
diff changeset
45
5fb2d057b5d9 add synth memo
Masataka Kohagura <kohagura@cr.ie.u-ryukyu.ac.jp>
parents: 92
diff changeset
46