annotate paper/chapter4.tex @ 46:c63aaa629330

Added dat files
author Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
date Fri, 31 Jan 2014 05:38:58 +0900
parents 618adf0a9b2b
children faa708c2958b
Ignore whitespace changes - Everywhere: Within whitespace: At end of lines:
rev   line source
39
63eca978482f Writed description of experiment
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 30
diff changeset
1 \chapter{分散木構造データーベース Jungle の評価}
63eca978482f Writed description of experiment
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 30
diff changeset
2 前章では Jungle における分散データベースの詳細な実装について述べた.
63eca978482f Writed description of experiment
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 30
diff changeset
3 本章では実装を行った Jungle に対して Cassandra との性能比較を行い評価をする.
63eca978482f Writed description of experiment
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 30
diff changeset
4 性能比較の為に簡易な掲示板プログラムを Jungle と Cassandra それぞれに作成した.
63eca978482f Writed description of experiment
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 30
diff changeset
5 複数のノードに繋がっている状態においても性能を測りたいため, 学科提供する
63eca978482f Writed description of experiment
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 30
diff changeset
6 VMWare の並列環境を利用する. また, 我々の研究室が利用しているブレードサーバ
63eca978482f Writed description of experiment
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 30
diff changeset
7 上で動いている KVM もノードとして利用する.
24
5316b4791570 Added master_paper.pdf
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 4
diff changeset
8
4
d42d2acf5d1d Added some tex files
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents:
diff changeset
9 \section{実験方法}
39
63eca978482f Writed description of experiment
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 30
diff changeset
10 実験は同じ機能を提供している簡易掲示板プログラムを Jungle と Cassandra それぞれで
63eca978482f Writed description of experiment
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 30
diff changeset
11 動かし, HTTPリクエストにより負荷をかけて行う.
63eca978482f Writed description of experiment
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 30
diff changeset
12 レスポンスが帰ってくるまでの時間をはかる.
24
5316b4791570 Added master_paper.pdf
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 4
diff changeset
13
39
63eca978482f Writed description of experiment
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 30
diff changeset
14 また, 実験は2つ行う.
63eca978482f Writed description of experiment
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 30
diff changeset
15 まず行う実験は, 複数のノードで起動してるうちの1つのノードに負荷をかける方法である.
63eca978482f Writed description of experiment
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 30
diff changeset
16 これはノードの数に比例してレスポンスが遅くなっていないか確かめるためである.
63eca978482f Writed description of experiment
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 30
diff changeset
17 \begin{figure}[htpb]
63eca978482f Writed description of experiment
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 30
diff changeset
18 \begin{center}
63eca978482f Writed description of experiment
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 30
diff changeset
19 \includegraphics[scale=0.70]{figures/jungle_experiment.pdf}
63eca978482f Writed description of experiment
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 30
diff changeset
20 \caption{複数起動中のJungle の1ノードへの負荷}
63eca978482f Writed description of experiment
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 30
diff changeset
21 \label{fig:jungle_exp}
63eca978482f Writed description of experiment
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 30
diff changeset
22 \end{center}
63eca978482f Writed description of experiment
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 30
diff changeset
23 \end{figure}
63eca978482f Writed description of experiment
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 30
diff changeset
24
63eca978482f Writed description of experiment
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 30
diff changeset
25 \begin{figure}[htpb]
63eca978482f Writed description of experiment
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 30
diff changeset
26 \begin{center}
63eca978482f Writed description of experiment
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 30
diff changeset
27 \includegraphics[scale=0.70]{figures/cas_experiment.pdf}
63eca978482f Writed description of experiment
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 30
diff changeset
28 \caption{複数起動中のCassandra の1ノードへの負荷}
63eca978482f Writed description of experiment
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 30
diff changeset
29 \label{fig:cas_exp}
63eca978482f Writed description of experiment
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 30
diff changeset
30 \end{center}
63eca978482f Writed description of experiment
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 30
diff changeset
31 \end{figure}
63eca978482f Writed description of experiment
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 30
diff changeset
32
63eca978482f Writed description of experiment
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 30
diff changeset
33 次に行う実験は複数のノードに対し複数のクライアントから負荷をかける方法である.
63eca978482f Writed description of experiment
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 30
diff changeset
34 それぞれ大量のHTTPリクエストをだし, 全てのリクエストの処理にかかる時間を測定する.
63eca978482f Writed description of experiment
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 30
diff changeset
35
63eca978482f Writed description of experiment
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 30
diff changeset
36 クライアントの数に比例してノードを増やすことでレスポンスを維持できるか
63eca978482f Writed description of experiment
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 30
diff changeset
37 スケーラビリティを調べるためである.
63eca978482f Writed description of experiment
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 30
diff changeset
38 \begin{figure}[htpb]
63eca978482f Writed description of experiment
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 30
diff changeset
39 \begin{center}
63eca978482f Writed description of experiment
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 30
diff changeset
40 \includegraphics[scale=0.70]{figures/clients_request_servers.pdf}
63eca978482f Writed description of experiment
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 30
diff changeset
41 \caption{複数のクライアントから複数のノードへの負荷}
63eca978482f Writed description of experiment
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 30
diff changeset
42 \label{fig:clients_servers}
63eca978482f Writed description of experiment
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 30
diff changeset
43 \end{center}
63eca978482f Writed description of experiment
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 30
diff changeset
44 \end{figure}
63eca978482f Writed description of experiment
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 30
diff changeset
45
46
c63aaa629330 Added dat files
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 44
diff changeset
46 \subsection{Torque Resource Manager}
c63aaa629330 Added dat files
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 44
diff changeset
47
39
63eca978482f Writed description of experiment
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 30
diff changeset
48 \subsection{weighttp}
63eca978482f Writed description of experiment
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 30
diff changeset
49 最初の実験で1つのノードに負荷をかけるプログラムはウェブサーバの測定ツールであるweighttpを使用する.
44
618adf0a9b2b Added some figures
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 42
diff changeset
50 weighttpは総リクエスト数, 同時接続数, ネイティブスレッド数をオプションとして指定することができるC言語
618adf0a9b2b Added some figures
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 42
diff changeset
51 でかかれたプログラムである.
39
63eca978482f Writed description of experiment
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 30
diff changeset
52
63eca978482f Writed description of experiment
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 30
diff changeset
53
63eca978482f Writed description of experiment
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 30
diff changeset
54 \subsection{掲示板プログラム}
63eca978482f Writed description of experiment
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 30
diff changeset
55 今回使用する掲示板プログラムは組み込み用ウェブサーバであるJettyをフロントエンドとして利用し, バックエンド
63eca978482f Writed description of experiment
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 30
diff changeset
56 に Jungle と Cassandra を利用している.
63eca978482f Writed description of experiment
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 30
diff changeset
57
46
c63aaa629330 Added dat files
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 44
diff changeset
58 \begin{table}[!htbp]
c63aaa629330 Added dat files
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 44
diff changeset
59 \caption{簡易掲示板システムで利用したJettyとCassandraのバージョン}
c63aaa629330 Added dat files
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 44
diff changeset
60 \label{tab:bulletinboard_components}
c63aaa629330 Added dat files
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 44
diff changeset
61 \begin{center}
c63aaa629330 Added dat files
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 44
diff changeset
62 \begin{tabular}{|c||c|} \hline
c63aaa629330 Added dat files
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 44
diff changeset
63 名前 & バージョン \\ \hline \hline
c63aaa629330 Added dat files
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 44
diff changeset
64 Jetty & 6.1.26 \\ \hline
c63aaa629330 Added dat files
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 44
diff changeset
65 Cassandra & 2.0.4 \\ \hline
c63aaa629330 Added dat files
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 44
diff changeset
66 \end{tabular}
c63aaa629330 Added dat files
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 44
diff changeset
67 \end{center}
c63aaa629330 Added dat files
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 44
diff changeset
68 \end{table}
c63aaa629330 Added dat files
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 44
diff changeset
69
c63aaa629330 Added dat files
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 44
diff changeset
70
39
63eca978482f Writed description of experiment
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 30
diff changeset
71
63eca978482f Writed description of experiment
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 30
diff changeset
72 \subsection{実験環境}
63eca978482f Writed description of experiment
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 30
diff changeset
73
63eca978482f Writed description of experiment
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 30
diff changeset
74 \subsubsection{ノードを実行させるサーバの仕様}
63eca978482f Writed description of experiment
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 30
diff changeset
75 使用するVMWareとKVMのクラスタの使用を以下に示す.
63eca978482f Writed description of experiment
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 30
diff changeset
76 クラスタは仕様を表\ref{tab:cluster_spec_vmware}と表\ref{tab:cluster_spec_kvm}に示す.
63eca978482f Writed description of experiment
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 30
diff changeset
77
63eca978482f Writed description of experiment
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 30
diff changeset
78 \begin{table}[!htbp]
63eca978482f Writed description of experiment
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 30
diff changeset
79 \caption{ノードを実行させるVMWareクラスタの仕様}
63eca978482f Writed description of experiment
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 30
diff changeset
80 \label{tab:cluster_spec_vmware}
63eca978482f Writed description of experiment
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 30
diff changeset
81 \begin{center}
63eca978482f Writed description of experiment
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 30
diff changeset
82 \begin{tabular}{|c||c|} \hline
63eca978482f Writed description of experiment
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 30
diff changeset
83 名前 & 概要 \\ \hline \hline
63eca978482f Writed description of experiment
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 30
diff changeset
84 CPU & Intel(R) Xeon(R) CPU X5650@2.67GHz \\ \hline
63eca978482f Writed description of experiment
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 30
diff changeset
85 Memory & 8GB \\ \hline
63eca978482f Writed description of experiment
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 30
diff changeset
86 OS & CentOS 5.8 \\ \hline
63eca978482f Writed description of experiment
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 30
diff changeset
87 HyperVisor & VMWare ESXi \\ \hline
44
618adf0a9b2b Added some figures
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 42
diff changeset
88 JavaVM & Java(TM) SE Runtime Environment (build 1.7.0-b147) \\ \hline
39
63eca978482f Writed description of experiment
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 30
diff changeset
89 \end{tabular}
63eca978482f Writed description of experiment
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 30
diff changeset
90 \end{center}
63eca978482f Writed description of experiment
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 30
diff changeset
91 \end{table}
63eca978482f Writed description of experiment
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 30
diff changeset
92
63eca978482f Writed description of experiment
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 30
diff changeset
93 \begin{table}[!htbp]
63eca978482f Writed description of experiment
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 30
diff changeset
94 \caption{ノードを実行させるKVMクラスタの仕様}
63eca978482f Writed description of experiment
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 30
diff changeset
95 \label{tab:cluster_spec_kvm}
63eca978482f Writed description of experiment
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 30
diff changeset
96 \begin{center}
63eca978482f Writed description of experiment
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 30
diff changeset
97 \begin{tabular}{|c||c|} \hline
63eca978482f Writed description of experiment
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 30
diff changeset
98 名前 & 概要 \\ \hline \hline
63eca978482f Writed description of experiment
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 30
diff changeset
99 CPU & Intel(R) Xeon(R) CPU X5650@2.67GHz \\ \hline
63eca978482f Writed description of experiment
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 30
diff changeset
100 Memory & 8GB \\ \hline
63eca978482f Writed description of experiment
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 30
diff changeset
101 OS & CentOS 5.8 \\ \hline
63eca978482f Writed description of experiment
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 30
diff changeset
102 HyperVisor & KVM \\ \hline
44
618adf0a9b2b Added some figures
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 42
diff changeset
103 JavaVM & Java(TM) SE Runtime Environment (build 1.7.0-b147) \\ \hline
39
63eca978482f Writed description of experiment
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 30
diff changeset
104 \end{tabular}
63eca978482f Writed description of experiment
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 30
diff changeset
105 \end{center}
63eca978482f Writed description of experiment
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 30
diff changeset
106 \end{table}
63eca978482f Writed description of experiment
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 30
diff changeset
107
63eca978482f Writed description of experiment
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 30
diff changeset
108 \subsubsection{1台に負荷をかけるブレードサーバの仕様}
63eca978482f Writed description of experiment
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 30
diff changeset
109 最初の実験で負荷をかける側としてブレードサーバを使用する.
63eca978482f Writed description of experiment
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 30
diff changeset
110 ブレードサーバの仕様を表\ref{tab:server_spec_1}に示す
63eca978482f Writed description of experiment
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 30
diff changeset
111
63eca978482f Writed description of experiment
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 30
diff changeset
112 \begin{table}[!htbp]
63eca978482f Writed description of experiment
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 30
diff changeset
113 \caption{}
63eca978482f Writed description of experiment
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 30
diff changeset
114 \label{tab:server_spec_1}
63eca978482f Writed description of experiment
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 30
diff changeset
115 \begin{center}
63eca978482f Writed description of experiment
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 30
diff changeset
116 \begin{tabular}{|c||c|} \hline
63eca978482f Writed description of experiment
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 30
diff changeset
117 名前 & 概要 \\ \hline \hline
63eca978482f Writed description of experiment
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 30
diff changeset
118 CPU & Intel(R) Xeon(R) CPU X5650@2.67GHz \\ \hline
63eca978482f Writed description of experiment
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 30
diff changeset
119 物理コア数 & 12 \\ \hline
63eca978482f Writed description of experiment
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 30
diff changeset
120 論理コア数 & 24 \\ \hline
63eca978482f Writed description of experiment
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 30
diff changeset
121 Memory & 132GB \\ \hline
63eca978482f Writed description of experiment
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 30
diff changeset
122 OS & Fedora 16 \\ \hline
63eca978482f Writed description of experiment
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 30
diff changeset
123 \end{tabular}
63eca978482f Writed description of experiment
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 30
diff changeset
124 \end{center}
63eca978482f Writed description of experiment
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 30
diff changeset
125 \end{table}
63eca978482f Writed description of experiment
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 30
diff changeset
126
63eca978482f Writed description of experiment
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 30
diff changeset
127
63eca978482f Writed description of experiment
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 30
diff changeset
128
63eca978482f Writed description of experiment
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 30
diff changeset
129 \subsubsection{サーバの環境}
63eca978482f Writed description of experiment
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 30
diff changeset
130 HTTPによりノードに負荷を掛ける場合気をつけることがある.
40
8ea1a684bfbe Added benchmark dat file
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 39
diff changeset
131 それはサーバの設定により最大コネクション数や開くことのできるファイル記述子の数に制限がかかっていることである.
39
63eca978482f Writed description of experiment
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 30
diff changeset
132 この2つの値はデフォルトでは小さなものとなっており, そのままではカーネル
63eca978482f Writed description of experiment
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 30
diff changeset
133 の設定がネックとなったベンチマーク結果がでる可能性がある.
63eca978482f Writed description of experiment
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 30
diff changeset
134 そこで次のようにコマンドを実行することでコネクション数の制限を増やすことができる.
63eca978482f Writed description of experiment
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 30
diff changeset
135 \begin{lstlisting}[frame=lrbt,label=src:maxconn_up,caption=コネクション数を増やす,numbers=left]
63eca978482f Writed description of experiment
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 30
diff changeset
136 % sudo sysctl -w net.core.somaxconn=10000
63eca978482f Writed description of experiment
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 30
diff changeset
137 \end{lstlisting}
63eca978482f Writed description of experiment
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 30
diff changeset
138 ファイル記述子の制限を増やす場合は次のコマンドを実行する
63eca978482f Writed description of experiment
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 30
diff changeset
139 \begin{lstlisting}[frame=lrbt,label=src:max_up_filedisc,caption=ファイル記述子の制限を増やす,numbers=left]
63eca978482f Writed description of experiment
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 30
diff changeset
140 % ulimit -n 10000
63eca978482f Writed description of experiment
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 30
diff changeset
141 \end{lstlisting}
63eca978482f Writed description of experiment
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 30
diff changeset
142
40
8ea1a684bfbe Added benchmark dat file
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 39
diff changeset
143 \section{実験結果1}
41
a59ede6b5a5a Writed chapter4
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 40
diff changeset
144 サーバノード数は10台から50台まで10台単位でweighttpにより負荷をかけ測定した.
a59ede6b5a5a Writed chapter4
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 40
diff changeset
145 weighttpに付けたオプションは以下のとおりである
a59ede6b5a5a Writed chapter4
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 40
diff changeset
146 \begin{lstlisting}[frame=lrbt,label=src:weighttp_op,caption=weighttpのオプション,numbers=left]
a59ede6b5a5a Writed chapter4
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 40
diff changeset
147 weighttp -n 1000000 -c 1000 -t 10 -k "http://url"
a59ede6b5a5a Writed chapter4
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 40
diff changeset
148 \end{lstlisting}
a59ede6b5a5a Writed chapter4
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 40
diff changeset
149 ネイティブスレッドを10個生成し, 同時接続は1000までで, 百万リクエストを送るオプションとなっている.
24
5316b4791570 Added master_paper.pdf
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 4
diff changeset
150
41
a59ede6b5a5a Writed chapter4
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 40
diff changeset
151 実験の結果を示す.
a59ede6b5a5a Writed chapter4
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 40
diff changeset
152 縦軸は全てのリクエストに対してレスポンスが返ってくるのにかかった時間(秒), 横軸は
a59ede6b5a5a Writed chapter4
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 40
diff changeset
153 サーバノード数を表す.
a59ede6b5a5a Writed chapter4
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 40
diff changeset
154 Jungle と, Cassandra のコンシステンシー・レベルをQUORUM, ONEと両方の結果を測定した.
a59ede6b5a5a Writed chapter4
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 40
diff changeset
155 Cassandraのレプリケーションは5である.
24
5316b4791570 Added master_paper.pdf
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 4
diff changeset
156
30
92bc4faa9a37 Added benchmark images
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 25
diff changeset
157 \begin{figure}[htpb]
92bc4faa9a37 Added benchmark images
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 25
diff changeset
158 \begin{center}
92bc4faa9a37 Added benchmark images
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 25
diff changeset
159 \includegraphics[scale=1.0]{figures/read_bench.pdf}
92bc4faa9a37 Added benchmark images
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 25
diff changeset
160 \caption{読み込みベンチマーク結果}
92bc4faa9a37 Added benchmark images
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 25
diff changeset
161 \label{fig:read_cassandra}
92bc4faa9a37 Added benchmark images
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 25
diff changeset
162 \end{center}
92bc4faa9a37 Added benchmark images
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 25
diff changeset
163 \end{figure}
92bc4faa9a37 Added benchmark images
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 25
diff changeset
164
92bc4faa9a37 Added benchmark images
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 25
diff changeset
165 \begin{figure}[htpb]
92bc4faa9a37 Added benchmark images
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 25
diff changeset
166 \begin{center}
92bc4faa9a37 Added benchmark images
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 25
diff changeset
167 \includegraphics[scale=1.0]{figures/write_bench.pdf}
92bc4faa9a37 Added benchmark images
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 25
diff changeset
168 \caption{書き込みベンチマーク結果}
92bc4faa9a37 Added benchmark images
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 25
diff changeset
169 \label{fig:write_cassandra}
92bc4faa9a37 Added benchmark images
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 25
diff changeset
170 \end{center}
92bc4faa9a37 Added benchmark images
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 25
diff changeset
171 \end{figure}
40
8ea1a684bfbe Added benchmark dat file
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 39
diff changeset
172
42
585196deaace Added figures
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 41
diff changeset
173 読み込み, 書き込み, どちらともJungleが3倍以上早くレスポンスを返していることが確認できる.
585196deaace Added figures
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 41
diff changeset
174 また, CassandraもJungleもノードの数が増えてもレスポンスを返す時間が遅くならないことも分かる.
41
a59ede6b5a5a Writed chapter4
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 40
diff changeset
175
a59ede6b5a5a Writed chapter4
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 40
diff changeset
176
a59ede6b5a5a Writed chapter4
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 40
diff changeset
177
44
618adf0a9b2b Added some figures
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 42
diff changeset
178
40
8ea1a684bfbe Added benchmark dat file
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 39
diff changeset
179 \section{実験結果2}
44
618adf0a9b2b Added some figures
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 42
diff changeset
180 学科の並列環境クラスタを用いて分散環境下での実験を行う
618adf0a9b2b Added some figures
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 42
diff changeset
181 学科の提供するVMは48台だが, ブレードサーバ上で動くKVMから12台を利用し, 合計60台を使用する.
618adf0a9b2b Added some figures
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 42
diff changeset
182 JungleとCassandraをそれぞれサーバノード10台, 20台, 30台で動かし, クライアントも10台, 20台, 30台
618adf0a9b2b Added some figures
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 42
diff changeset
183 と増やして負荷をかける.
618adf0a9b2b Added some figures
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 42
diff changeset
184 KVM側はクライアント側だけに利用する.
618adf0a9b2b Added some figures
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 42
diff changeset
185 weighttpに付けたオプションを以下の通りである.
618adf0a9b2b Added some figures
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 42
diff changeset
186 \begin{lstlisting}[frame=lrbt,label=src:distributed_weighttp_op,caption=weighttpのオプション(実験2),numbers=left]
618adf0a9b2b Added some figures
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 42
diff changeset
187 weighttp -n 50000 -c 200 -t 2 -k "http://url"
618adf0a9b2b Added some figures
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 42
diff changeset
188 \end{lstlisting}
618adf0a9b2b Added some figures
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 42
diff changeset
189 クライアント1台からはそれぞれ5万のHTTPリクエストが送られる.
618adf0a9b2b Added some figures
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 42
diff changeset
190 実験1に比べ同時接続数とネイティブスレッド数が少ないのはVMの環境に合わせてあるからである.
618adf0a9b2b Added some figures
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 42
diff changeset
191
618adf0a9b2b Added some figures
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 42
diff changeset
192 測定は読み込みと書き込みの両方を行う.
618adf0a9b2b Added some figures
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 42
diff changeset
193 測定の結果をグラフにしたのを図\ref{fig:distributed_read_bench}, \ref{fig:distributed_write_bench}に示す.
618adf0a9b2b Added some figures
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 42
diff changeset
194
618adf0a9b2b Added some figures
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 42
diff changeset
195 \begin{figure}[htpb]
618adf0a9b2b Added some figures
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 42
diff changeset
196 \begin{center}
618adf0a9b2b Added some figures
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 42
diff changeset
197 \includegraphics[scale=1.0]{figures/distributed_read_bench.pdf}
618adf0a9b2b Added some figures
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 42
diff changeset
198 \caption{分散環境下における読み込みベンチマーク結果}
618adf0a9b2b Added some figures
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 42
diff changeset
199 \label{fig:distributed_read_bench}
618adf0a9b2b Added some figures
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 42
diff changeset
200 \end{center}
618adf0a9b2b Added some figures
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 42
diff changeset
201 \end{figure}
618adf0a9b2b Added some figures
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 42
diff changeset
202
618adf0a9b2b Added some figures
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 42
diff changeset
203 \begin{figure}[htpb]
618adf0a9b2b Added some figures
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 42
diff changeset
204 \begin{center}
618adf0a9b2b Added some figures
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 42
diff changeset
205 \includegraphics[scale=1.0]{figures/distributed_write_bench.pdf}
618adf0a9b2b Added some figures
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 42
diff changeset
206 \caption{分散環境下における書き込みベンチマーク結果}
618adf0a9b2b Added some figures
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 42
diff changeset
207 \label{fig:distributed_write_bench}
618adf0a9b2b Added some figures
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 42
diff changeset
208 \end{center}
618adf0a9b2b Added some figures
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 42
diff changeset
209 \end{figure}
40
8ea1a684bfbe Added benchmark dat file
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 39
diff changeset
210
8ea1a684bfbe Added benchmark dat file
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 39
diff changeset
211
8ea1a684bfbe Added benchmark dat file
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 39
diff changeset
212
44
618adf0a9b2b Added some figures
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 42
diff changeset
213
618adf0a9b2b Added some figures
Nobuyasu Oshiro <dimolto@cr.ie.u-ryukyu.ac.jp>
parents: 42
diff changeset
214