annotate slide.md @ 3:623da64aac7a default tip

Internship_presentation
author shivanidubey
date Mon, 24 Jun 2019 13:05:55 +0900
parents 54dd75a92d04
children
Ignore whitespace changes - Everywhere: Within whitespace: At end of lines:
rev   line source
2
54dd75a92d04 fix slies
shivanidubey
parents: 1
diff changeset
1 title: Studying Operating System Using Docker Platform
0
845dadcd3a85 slide.html
shivanidubey
parents:
diff changeset
2 author: Shivani Dubey
3
623da64aac7a Internship_presentation
shivanidubey
parents: 2
diff changeset
3 profile: Madan Mohan Malaviya University of Technology, Gorakhpur
2
54dd75a92d04 fix slies
shivanidubey
parents: 1
diff changeset
4
3
623da64aac7a Internship_presentation
shivanidubey
parents: 2
diff changeset
5 ## Why do we study Operating System?
2
54dd75a92d04 fix slies
shivanidubey
parents: 1
diff changeset
6
3
623da64aac7a Internship_presentation
shivanidubey
parents: 2
diff changeset
7 - Every computer system has an operating system, which manages the resources of the computer.
2
54dd75a92d04 fix slies
shivanidubey
parents: 1
diff changeset
8
3
623da64aac7a Internship_presentation
shivanidubey
parents: 2
diff changeset
9 - IoT or IT Services can't work well without resource managements.
2
54dd75a92d04 fix slies
shivanidubey
parents: 1
diff changeset
10
3
623da64aac7a Internship_presentation
shivanidubey
parents: 2
diff changeset
11 - To handle it, we have to understand the API of OS.
2
54dd75a92d04 fix slies
shivanidubey
parents: 1
diff changeset
12
3
623da64aac7a Internship_presentation
shivanidubey
parents: 2
diff changeset
13 - To understand the API, it is better to see the implementations.
2
54dd75a92d04 fix slies
shivanidubey
parents: 1
diff changeset
14
3
623da64aac7a Internship_presentation
shivanidubey
parents: 2
diff changeset
15 - For example, API for tuning priorities of the processes.
2
54dd75a92d04 fix slies
shivanidubey
parents: 1
diff changeset
16
54dd75a92d04 fix slies
shivanidubey
parents: 1
diff changeset
17 ## Xv6 Operating System as an educational tool
54dd75a92d04 fix slies
shivanidubey
parents: 1
diff changeset
18
3
623da64aac7a Internship_presentation
shivanidubey
parents: 2
diff changeset
19 - A Unix-like operating system developed in MIT, based on V6 kernel
2
54dd75a92d04 fix slies
shivanidubey
parents: 1
diff changeset
20
3
623da64aac7a Internship_presentation
shivanidubey
parents: 2
diff changeset
21 - xv6 is written in ANSI C ( not in C++ )
2
54dd75a92d04 fix slies
shivanidubey
parents: 1
diff changeset
22
54dd75a92d04 fix slies
shivanidubey
parents: 1
diff changeset
23 - xv6 is small and simple (9628 lines of codes)
54dd75a92d04 fix slies
shivanidubey
parents: 1
diff changeset
24
3
623da64aac7a Internship_presentation
shivanidubey
parents: 2
diff changeset
25 - It can run on Raspberry Pi ( Small PC board )
2
54dd75a92d04 fix slies
shivanidubey
parents: 1
diff changeset
26
54dd75a92d04 fix slies
shivanidubey
parents: 1
diff changeset
27 - Or on ARM emulator such as QEMU
0
845dadcd3a85 slide.html
shivanidubey
parents:
diff changeset
28
3
623da64aac7a Internship_presentation
shivanidubey
parents: 2
diff changeset
29 ## Xv6 development environment with QEMU
2
54dd75a92d04 fix slies
shivanidubey
parents: 1
diff changeset
30
54dd75a92d04 fix slies
shivanidubey
parents: 1
diff changeset
31 - QEMU emulates ARM CPU with virtual memory
54dd75a92d04 fix slies
shivanidubey
parents: 1
diff changeset
32
54dd75a92d04 fix slies
shivanidubey
parents: 1
diff changeset
33 - Xv6 operating sytem itself is running on QEMU
54dd75a92d04 fix slies
shivanidubey
parents: 1
diff changeset
34
54dd75a92d04 fix slies
shivanidubey
parents: 1
diff changeset
35 - gdb debugger can be attached to the emulated program (both in user space and system space)
54dd75a92d04 fix slies
shivanidubey
parents: 1
diff changeset
36
3
623da64aac7a Internship_presentation
shivanidubey
parents: 2
diff changeset
37 - We can step and trace inside xv6 kernel
2
54dd75a92d04 fix slies
shivanidubey
parents: 1
diff changeset
38
3
623da64aac7a Internship_presentation
shivanidubey
parents: 2
diff changeset
39 ... but it requires complex development environments setup
2
54dd75a92d04 fix slies
shivanidubey
parents: 1
diff changeset
40 ... very time consuming
54dd75a92d04 fix slies
shivanidubey
parents: 1
diff changeset
41
3
623da64aac7a Internship_presentation
shivanidubey
parents: 2
diff changeset
42 ## Our development environments
2
54dd75a92d04 fix slies
shivanidubey
parents: 1
diff changeset
43
54dd75a92d04 fix slies
shivanidubey
parents: 1
diff changeset
44
54dd75a92d04 fix slies
shivanidubey
parents: 1
diff changeset
45 - homebrew (it simplifies installation of software in macOS)
54dd75a92d04 fix slies
shivanidubey
parents: 1
diff changeset
46
54dd75a92d04 fix slies
shivanidubey
parents: 1
diff changeset
47 - Mercurial repository of the lab where we saved everything using ssh
54dd75a92d04 fix slies
shivanidubey
parents: 1
diff changeset
48
54dd75a92d04 fix slies
shivanidubey
parents: 1
diff changeset
49 - Cross Compilers
54dd75a92d04 fix slies
shivanidubey
parents: 1
diff changeset
50
54dd75a92d04 fix slies
shivanidubey
parents: 1
diff changeset
51 - ARM libraries for C language
54dd75a92d04 fix slies
shivanidubey
parents: 1
diff changeset
52
54dd75a92d04 fix slies
shivanidubey
parents: 1
diff changeset
53 - QEMU (ARM Emulator)
0
845dadcd3a85 slide.html
shivanidubey
parents:
diff changeset
54
2
54dd75a92d04 fix slies
shivanidubey
parents: 1
diff changeset
55 ## Introducing Docker
0
845dadcd3a85 slide.html
shivanidubey
parents:
diff changeset
56
2
54dd75a92d04 fix slies
shivanidubey
parents: 1
diff changeset
57 - What is Docker? It is a container.
54dd75a92d04 fix slies
shivanidubey
parents: 1
diff changeset
58
3
623da64aac7a Internship_presentation
shivanidubey
parents: 2
diff changeset
59 - What is Container? An isolated envirornment such as file system.
2
54dd75a92d04 fix slies
shivanidubey
parents: 1
diff changeset
60
3
623da64aac7a Internship_presentation
shivanidubey
parents: 2
diff changeset
61 - It has DockerFile, which describes how to setup the envrionment in the container.
2
54dd75a92d04 fix slies
shivanidubey
parents: 1
diff changeset
62
3
623da64aac7a Internship_presentation
shivanidubey
parents: 2
diff changeset
63 - Docker can run on any computer using an emulator such as QEMU.
2
54dd75a92d04 fix slies
shivanidubey
parents: 1
diff changeset
64
3
623da64aac7a Internship_presentation
shivanidubey
parents: 2
diff changeset
65 - Complex development environment can be build using DockerFile and docker built command.
2
54dd75a92d04 fix slies
shivanidubey
parents: 1
diff changeset
66
54dd75a92d04 fix slies
shivanidubey
parents: 1
diff changeset
67 # The DockerFile
54dd75a92d04 fix slies
shivanidubey
parents: 1
diff changeset
68
54dd75a92d04 fix slies
shivanidubey
parents: 1
diff changeset
69 ```
54dd75a92d04 fix slies
shivanidubey
parents: 1
diff changeset
70 FROM phitek/qemu-arm
54dd75a92d04 fix slies
shivanidubey
parents: 1
diff changeset
71 RUN apt-get update -y
54dd75a92d04 fix slies
shivanidubey
parents: 1
diff changeset
72 RUN apt-get remove gdb -y
54dd75a92d04 fix slies
shivanidubey
parents: 1
diff changeset
73 RUN apt-get install gcc-arm-none-eabi gdb-arm-none-eabi qemu-system-arm -y
54dd75a92d04 fix slies
shivanidubey
parents: 1
diff changeset
74 WORKDIR /code
54dd75a92d04 fix slies
shivanidubey
parents: 1
diff changeset
75 COPY ["src", "."]
54dd75a92d04 fix slies
shivanidubey
parents: 1
diff changeset
76 RUN make
54dd75a92d04 fix slies
shivanidubey
parents: 1
diff changeset
77 CMD /bin/bash
54dd75a92d04 fix slies
shivanidubey
parents: 1
diff changeset
78 ```
54dd75a92d04 fix slies
shivanidubey
parents: 1
diff changeset
79
3
623da64aac7a Internship_presentation
shivanidubey
parents: 2
diff changeset
80 - FROM line specifies the shared image in Docker repository.
2
54dd75a92d04 fix slies
shivanidubey
parents: 1
diff changeset
81
3
623da64aac7a Internship_presentation
shivanidubey
parents: 2
diff changeset
82 - apt-get installs Linux cross compiling tools.
0
845dadcd3a85 slide.html
shivanidubey
parents:
diff changeset
83
3
623da64aac7a Internship_presentation
shivanidubey
parents: 2
diff changeset
84 - Then it creates working directory, copies our sources to it, and executes make.
2
54dd75a92d04 fix slies
shivanidubey
parents: 1
diff changeset
85
3
623da64aac7a Internship_presentation
shivanidubey
parents: 2
diff changeset
86 ## Docker commands
2
54dd75a92d04 fix slies
shivanidubey
parents: 1
diff changeset
87
3
623da64aac7a Internship_presentation
shivanidubey
parents: 2
diff changeset
88 - Create docker image and environment, and build xv6 kernel
2
54dd75a92d04 fix slies
shivanidubey
parents: 1
diff changeset
89
3
623da64aac7a Internship_presentation
shivanidubey
parents: 2
diff changeset
90 docker build --tag xv6-docker
2
54dd75a92d04 fix slies
shivanidubey
parents: 1
diff changeset
91
3
623da64aac7a Internship_presentation
shivanidubey
parents: 2
diff changeset
92 - Run xv6 kernel on QEMU in the container
2
54dd75a92d04 fix slies
shivanidubey
parents: 1
diff changeset
93
54dd75a92d04 fix slies
shivanidubey
parents: 1
diff changeset
94 docker run --rm --privileged -it xv6-docker ./run-debug.sh
54dd75a92d04 fix slies
shivanidubey
parents: 1
diff changeset
95
3
623da64aac7a Internship_presentation
shivanidubey
parents: 2
diff changeset
96 - Run gdb to connect the xv6 kernel running in the QEMU
2
54dd75a92d04 fix slies
shivanidubey
parents: 1
diff changeset
97
54dd75a92d04 fix slies
shivanidubey
parents: 1
diff changeset
98 docker exec -it xv6-docker ./debug.sh
54dd75a92d04 fix slies
shivanidubey
parents: 1
diff changeset
99
54dd75a92d04 fix slies
shivanidubey
parents: 1
diff changeset
100
0
845dadcd3a85 slide.html
shivanidubey
parents:
diff changeset
101
1
be770be61183 Updated
shivanidubey
parents: 0
diff changeset
102
3
623da64aac7a Internship_presentation
shivanidubey
parents: 2
diff changeset
103
623da64aac7a Internship_presentation
shivanidubey
parents: 2
diff changeset
104 # Exercise : Adding priorities to the xv6 scheduler
1
be770be61183 Updated
shivanidubey
parents: 0
diff changeset
105
2
54dd75a92d04 fix slies
shivanidubey
parents: 1
diff changeset
106 - Added getpriority() and setpriority()
54dd75a92d04 fix slies
shivanidubey
parents: 1
diff changeset
107
54dd75a92d04 fix slies
shivanidubey
parents: 1
diff changeset
108 - get_highest_priority() functions in proc.c file of xv6
0
845dadcd3a85 slide.html
shivanidubey
parents:
diff changeset
109
3
623da64aac7a Internship_presentation
shivanidubey
parents: 2
diff changeset
110 - Implemented it in schelduler()
0
845dadcd3a85 slide.html
shivanidubey
parents:
diff changeset
111
2
54dd75a92d04 fix slies
shivanidubey
parents: 1
diff changeset
112 - Added a test function testpriority() in usertests.c file of xv6 to implement our algorithm
0
845dadcd3a85 slide.html
shivanidubey
parents:
diff changeset
113
3
623da64aac7a Internship_presentation
shivanidubey
parents: 2
diff changeset
114 ## Function used in our exercise to find highest priority process
1
be770be61183 Updated
shivanidubey
parents: 0
diff changeset
115 ```c
be770be61183 Updated
shivanidubey
parents: 0
diff changeset
116 int get_highest_priority_proc(void)
be770be61183 Updated
shivanidubey
parents: 0
diff changeset
117 {
be770be61183 Updated
shivanidubey
parents: 0
diff changeset
118 int highest_priority;
be770be61183 Updated
shivanidubey
parents: 0
diff changeset
119 int pid = 0;
be770be61183 Updated
shivanidubey
parents: 0
diff changeset
120 int hpid = -1;
be770be61183 Updated
shivanidubey
parents: 0
diff changeset
121 int rpid = 0;
be770be61183 Updated
shivanidubey
parents: 0
diff changeset
122 highest_priority=100;
3
623da64aac7a Internship_presentation
shivanidubey
parents: 2
diff changeset
123
623da64aac7a Internship_presentation
shivanidubey
parents: 2
diff changeset
124 struct proc *p;
1
be770be61183 Updated
shivanidubey
parents: 0
diff changeset
125 for(p = ptable.proc; p < &ptable.proc[NPROC]; p++, pid++){
be770be61183 Updated
shivanidubey
parents: 0
diff changeset
126 if(p->state != RUNNABLE) {
3
623da64aac7a Internship_presentation
shivanidubey
parents: 2
diff changeset
127 continue; }
1
be770be61183 Updated
shivanidubey
parents: 0
diff changeset
128 rpid = pid;
be770be61183 Updated
shivanidubey
parents: 0
diff changeset
129 if (highest_priority > p->priority) {
be770be61183 Updated
shivanidubey
parents: 0
diff changeset
130 highest_priority=p->priority;
3
623da64aac7a Internship_presentation
shivanidubey
parents: 2
diff changeset
131 hpid = pid; } }
1
be770be61183 Updated
shivanidubey
parents: 0
diff changeset
132 return hpid > 0?hpid:rpid;
be770be61183 Updated
shivanidubey
parents: 0
diff changeset
133 }
be770be61183 Updated
shivanidubey
parents: 0
diff changeset
134 ```
3
623da64aac7a Internship_presentation
shivanidubey
parents: 2
diff changeset
135 - It assumes at least one process to be RUNNABLE.
1
be770be61183 Updated
shivanidubey
parents: 0
diff changeset
136
2
54dd75a92d04 fix slies
shivanidubey
parents: 1
diff changeset
137 - It may allow no highest priority process.
54dd75a92d04 fix slies
shivanidubey
parents: 1
diff changeset
138
54dd75a92d04 fix slies
shivanidubey
parents: 1
diff changeset
139 - The correctness of the function is *important*.
54dd75a92d04 fix slies
shivanidubey
parents: 1
diff changeset
140
54dd75a92d04 fix slies
shivanidubey
parents: 1
diff changeset
141 ## Docker Limitation
54dd75a92d04 fix slies
shivanidubey
parents: 1
diff changeset
142
54dd75a92d04 fix slies
shivanidubey
parents: 1
diff changeset
143
3
623da64aac7a Internship_presentation
shivanidubey
parents: 2
diff changeset
144 - If repository breaks, Docker poses a problem (a cloud problem).
623da64aac7a Internship_presentation
shivanidubey
parents: 2
diff changeset
145
623da64aac7a Internship_presentation
shivanidubey
parents: 2
diff changeset
146 - Cloud may be used conveniently but we must not rely on it.
2
54dd75a92d04 fix slies
shivanidubey
parents: 1
diff changeset
147
54dd75a92d04 fix slies
shivanidubey
parents: 1
diff changeset
148 - We can use a direct environment without Docker, since we have a Linux server.
54dd75a92d04 fix slies
shivanidubey
parents: 1
diff changeset
149
3
623da64aac7a Internship_presentation
shivanidubey
parents: 2
diff changeset
150 - Docker images can easily eat up our disk spaces.
1
be770be61183 Updated
shivanidubey
parents: 0
diff changeset
151
2
54dd75a92d04 fix slies
shivanidubey
parents: 1
diff changeset
152 in ~/.zsh_history
1
be770be61183 Updated
shivanidubey
parents: 0
diff changeset
153
2
54dd75a92d04 fix slies
shivanidubey
parents: 1
diff changeset
154 ```c
54dd75a92d04 fix slies
shivanidubey
parents: 1
diff changeset
155 : 1561014922:0;docker system prune
54dd75a92d04 fix slies
shivanidubey
parents: 1
diff changeset
156 : 1561014973:0;docker container prune
54dd75a92d04 fix slies
shivanidubey
parents: 1
diff changeset
157 : 1561015350:0;docker image prune
54dd75a92d04 fix slies
shivanidubey
parents: 1
diff changeset
158 : 1561015362:0;docker volume prune
54dd75a92d04 fix slies
shivanidubey
parents: 1
diff changeset
159 ```
54dd75a92d04 fix slies
shivanidubey
parents: 1
diff changeset
160 # Conclusion
54dd75a92d04 fix slies
shivanidubey
parents: 1
diff changeset
161
3
623da64aac7a Internship_presentation
shivanidubey
parents: 2
diff changeset
162
623da64aac7a Internship_presentation
shivanidubey
parents: 2
diff changeset
163 - Docker environment poses some problems, some of which are difficult to comprehend.
2
54dd75a92d04 fix slies
shivanidubey
parents: 1
diff changeset
164
3
623da64aac7a Internship_presentation
shivanidubey
parents: 2
diff changeset
165
2
54dd75a92d04 fix slies
shivanidubey
parents: 1
diff changeset
166
3
623da64aac7a Internship_presentation
shivanidubey
parents: 2
diff changeset
167 - Yet, it gives a good insight of the underlying important concepts of operating system because it is well documented, fast and uses less resources.