DevOps

Tutorial
venkyh1r9chinna@[Link]
2XQDNKMJC8

This file is meant for personal use by venkyh1r9chinna@[Link] only.

Sharing or publishing the contents in part or full is liable for legal action.
©Great Learning. All Rights Reserved. Unauthorized use or distribution prohibited
 Module 1:
venkyh1r9chinna@[Link]

DevOps Overview
2XQDNKMJC8

This file is meant for personal use by venkyh1r9chinna@[Link] only.

Sharing or publishing the contents in part or full is liable for legal action.
©Great Learning. All Rights Reserved. Unauthorized use or distribution prohibited
venkyh1r9chinna@[Link]
2XQDNKMJC8

Why DevOps?
This file is meant for personal use by venkyh1r9chinna@[Link] only.
Sharing or publishing the contents in part or full is liable for legal action.
©Great Learning. All Rights Reserved. Unauthorized use or distribution prohibited
 Waterfall Model

Requirements In the early year of software

development when it was just
Designing coming up, waterfall model was
used.
Implementation
venkyh1r9chinna@[Link] Waterfall model is a very standard
2XQDNKMJC8
model used in many different fields,
Testing not just software development.

It was very useful when the

Deployment
requirements were concrete and the
development cycles were long.
Maintenance
This file is meant for personal use by venkyh1r9chinna@[Link] only.
Sharing or publishing the contents in part or full is liable for legal action.
©Great Learning. All Rights Reserved. Unauthorized use or distribution prohibited
 New Methodologies

Extreme Programming
venkyh1r9chinna@[Link]
2XQDNKMJC8 Agile Spiral Model

Develop an Build a Plan by Design by Build by

overall model feature list feature feature feature

Feature Driven Development

Lean Methodology
This file is meant for personal use by venkyh1r9chinna@[Link] only.
Sharing or publishing the contents in part or full is liable for legal action.
©Great Learning. All Rights Reserved. Unauthorized use or distribution prohibited
venkyh1r9chinna@[Link]
2XQDNKMJC8

What is DevOps?
This file is meant for personal use by venkyh1r9chinna@[Link] only.
Sharing or publishing the contents in part or full is liable for legal action.
©Great Learning. All Rights Reserved. Unauthorized use or distribution prohibited
 What is DevOps?

venkyh1r9chinna@[Link]
2XQDNKMJC8

Way of software Values & Principle Methodologies Tools

development

This file is meant for personal use by venkyh1r9chinna@[Link] only.

Sharing or publishing the contents in part or full is liable for legal action.
©Great Learning. All Rights Reserved. Unauthorized use or distribution prohibited
 What is DevOps?

The name DevOps comes from Developer and Operations. DevOps bridges
the communication gap between the software developers and the It operation
teams.

venkyh1r9chinna@[Link]
2XQDNKMJC8

DevOps

DevelopersThis file is meant for personal use by venkyh1r9chinna@[Link] [Link]

Sharing or publishing the contents in part or full is liable for legal action.
©Great Learning. All Rights Reserved. Unauthorized use or distribution prohibited
 What is DevOps?

“DevOps is a set of practices that combines software development (Dev)

and IT operations (Ops). It aims to shorten the systems development life
cycle and provide continuous delivery with high software quality. DevOps is
complementary with Agile software development; several DevOps aspects
came from Agile methodology.”
venkyh1r9chinna@[Link]
2XQDNKMJC8

This file is meant for personal use by venkyh1r9chinna@[Link] only.

Sharing or publishing the contents in part or full is liable for legal action.
©Great Learning. All Rights Reserved. Unauthorized use or distribution prohibited
 Benefits of DevOps

venkyh1r9chinna@[Link]
2XQDNKMJC8

Productivity Returns

Excellence
This file is meant for personal use by venkyh1r9chinna@[Link] only.
Sharing or publishing the contents in part or full is liable for legal action.
©Great Learning. All Rights Reserved. Unauthorized use or distribution prohibited
venkyh1r9chinna@[Link]
2XQDNKMJC8

DevOps Phases
This file is meant for personal use by venkyh1r9chinna@[Link] only.
Sharing or publishing the contents in part or full is liable for legal action.
©Great Learning. All Rights Reserved. Unauthorized use or distribution prohibited
 DevOps Phases

Continuous Continuous Continuous Continuous Continuous

Development Testing Integration Deployment Monitoring
venkyh1r9chinna@[Link]
2XQDNKMJC8

This file is meant for personal use by venkyh1r9chinna@[Link] only.

Sharing or publishing the contents in part or full is liable for legal action.
©Great Learning. All Rights Reserved. Unauthorized use or distribution prohibited
venkyh1r9chinna@[Link]
2XQDNKMJC8

Who is a DevOps Engineer?

This file is meant for personal use by venkyh1r9chinna@[Link] only.
Sharing or publishing the contents in part or full is liable for legal action.
©Great Learning. All Rights Reserved. Unauthorized use or distribution prohibited
 DevOps Engineer

- Basically a DevOps engineer is responsible for designing, maintaining the

software development pipeline. He also makes sure that a software is
deployed properly without any issues. A DevOps engineer knows how to
automate processes and writing automation scripts. He also knows how to
keep the whole infrastructure secure and robust.
venkyh1r9chinna@[Link]
2XQDNKMJC8
- A DevOps engineer has excellent communication skills that help him to
convey ideas and exchange information between different teams.

- On daily level, a DevOps engineer is responsible for makes sure scaling

needs of cloud are fulfilled, optimisation, managing permissions,
documentations.

This file is meant for personal use by venkyh1r9chinna@[Link] only.

Sharing or publishing the contents in part or full is liable for legal action.
©Great Learning. All Rights Reserved. Unauthorized use or distribution prohibited
 DevOps Engineer
A DevOps engineer has a wealth of knowledge such as:

• Knowledge of Linux, Windows Operating Systems

• Database Tech
• Server Tech
venkyh1r9chinna@[Link] • Orchestration
2XQDNKMJC8
• Cloud tech
• Source Control
• Continuous integration & Deployment
• Automation
• Scripting
• Networking
• Excellent Communication
This file is meant for personal use by venkyh1r9chinna@[Link] only.
Sharing or publishing the contents in part or full is liable for legal action.
©Great Learning. All Rights Reserved. Unauthorized use or distribution prohibited
venkyh1r9chinna@[Link]
2XQDNKMJC8

Version Control - GIT

This file is meant for personal use by venkyh1r9chinna@[Link] only.
Sharing or publishing the contents in part or full is liable for legal action.
venkyh1r9chinna@[Link]
2XQDNKMJC8

What is Version Control?

This file is meant for personal use by venkyh1r9chinna@[Link] only.
Sharing or publishing the contents in part or full is liable for legal action.
 What is Version Control?
These days when software is developed, It is not developed with the mind-set
that there will only be one piece of code that will be deployed and that’s it.
These days smaller snippets of code are deployed in regular successions with
regular feedbacks. This leads to many different versions of the code.

And that creates a need to organise the code and all of its different version of
it. This is where Version Control comes in. It is a practice of managing and
venkyh1r9chinna@[Link]
2XQDNKMJC8
storing different version of a source code.

This is especially the case with Larger companies that have multiple projects
and multiple teams working within it.

A1, A2, A3 B1, B2, B3 C1,C2,C3

This file is meant for personal use by venkyh1r9chinna@[Link] only.
Sharing or publishing the contents in part or full is liable for legal action.
©Great Learning. All Rights Reserved. Unauthorized use or distribution prohibited
venkyh1r9chinna@[Link]
2XQDNKMJC8

What is Git
This file is meant for personal use by venkyh1r9chinna@[Link] only.
Sharing or publishing the contents in part or full is liable for legal action.
 What is Git?
Git is an open source version control system that allows the user to keep track
of all the changes that have been made to the source code of the software.

venkyh1r9chinna@[Link]
2XQDNKMJC8

Developer 1

GitHub

Developer 2
This file is meant for personal use by venkyh1r9chinna@[Link] only.
Sharing or publishing the contents in part or full is liable for legal action.
©Great Learning. All Rights Reserved. Unauthorized use or distribution prohibited
 What is Git?
The lifecycle of the code within Git.

venkyh1r9chinna@[Link]
2XQDNKMJC8

Working Directory Initialization Staging Local Storage GitHub

This file is meant for personal use by venkyh1r9chinna@[Link] only.

Sharing or publishing the contents in part or full is liable for legal action.
©Great Learning. All Rights Reserved. Unauthorized use or distribution prohibited
venkyh1r9chinna@[Link]
2XQDNKMJC8

Getting started with GitHub

This file is meant for personal use by venkyh1r9chinna@[Link] only.
Sharing or publishing the contents in part or full is liable for legal action.
venkyh1r9chinna@[Link]
2XQDNKMJC8

Installing & Configuring Git

This file is meant for personal use by venkyh1r9chinna@[Link] only.
Sharing or publishing the contents in part or full is liable for legal action.
 Git Installation & Setup

Linux Windows MAC

venkyh1r9chinna@[Link]
2XQDNKMJC8

This file is meant for personal use by venkyh1r9chinna@[Link] only.

Sharing or publishing the contents in part or full is liable for legal action.
venkyh1r9chinna@[Link]
2XQDNKMJC8

Git Common Commands

This file is meant for personal use by venkyh1r9chinna@[Link] only.
Sharing or publishing the contents in part or full is liable for legal action.
venkyh1r9chinna@[Link]
2XQDNKMJC8

Branches
This file is meant for personal use by venkyh1r9chinna@[Link] only.
Sharing or publishing the contents in part or full is liable for legal action.
venkyh1r9chinna@[Link]
2XQDNKMJC8

Microsystems & Containerization

– Docker This file is meant for personal use by venkyh1r9chinna@[Link] only.
Sharing or publishing the contents in part or full is liable for legal action.
venkyh1r9chinna@[Link]
2XQDNKMJC8

Issues we faced before Containerization

This file is meant for personal use by venkyh1r9chinna@[Link] only.
Sharing or publishing the contents in part or full is liable for legal action.
 Issues we faced before Containerization

venkyh1r9chinna@[Link]
2XQDNKMJC8

Developer Tester

Standard Delivery Pipeline

This file is meant for personal use by venkyh1r9chinna@[Link] only.
Sharing or publishing the contents in part or full is liable for legal action.
 Issues we faced before Containerization

Operating Pytest 5.4.3 Pycharm IDE

venkyh1r9chinna@[Link]
System
2XQDNKMJC8

Backend Code Dependencies

Backend Developer

Developer’s Environment
This file is meant for personal use by venkyh1r9chinna@[Link] only.
Sharing or publishing the contents in part or full is liable for legal action.
 Issues we faced before Containerization

Operating Pytest 5.3.0 Spyder IDE

venkyh1r9chinna@[Link] System
2XQDNKMJC8

Backend Code Dependencies

Tester

Tester’s Environment
This file is meant for personal use by venkyh1r9chinna@[Link] only.
Sharing or publishing the contents in part or full is liable for legal action.
 Issues we faced before Containerization

Developer Tester

venkyh1r9chinna@[Link]
2XQDNKMJC8

- This Code runs fine on my computer - This Code does not run on my system
This file is meant for personal use by venkyh1r9chinna@[Link] only.
Sharing or publishing the contents in part or full is liable for legal action.
 Issues we faced before Containerization

Developer Tester

venkyh1r9chinna@[Link]
Operating
2XQDNKMJC8
Pytest 5.4.3 Pycharm IDE Operating Pytest 5.3.0 Spyder IDE
System System

Backend Code Dependencies Backend Code Dependencies

This file is meant for personal use by venkyh1r9chinna@[Link] only.

Sharing or publishing the contents in part or full is liable for legal action.
 Issues we faced before Containerization

venkyh1r9chinna@[Link]
2XQDNKMJC8 - Now Let’s see what happens
when we introduce Containers.

This file is meant for personal use by venkyh1r9chinna@[Link] only.

Sharing or publishing the contents in part or full is liable for legal action.
 Issues we faced before Containerization

- This Code runs fine on my computer

- This Code runs fine on my computer

venkyh1r9chinna@[Link]
2XQDNKMJC8

Developer Tester Prod

Similar Delivery
This file is meant Pipeline
for personal but with containers
use by venkyh1r9chinna@[Link] only.
Sharing or publishing the contents in part or full is liable for legal action.
venkyh1r9chinna@[Link]
2XQDNKMJC8

What is a Container?
This file is meant for personal use by venkyh1r9chinna@[Link] only.
Sharing or publishing the contents in part or full is liable for legal action.
 What is a Container?

Containers are software that wrap up all the parts of a code and all its
dependencies into a single deployable unit that can be used on
different systems and servers.

venkyh1r9chinna@[Link]
2XQDNKMJC8

Code Libraries

Container Systems & Servers

This file is meant for personal use by venkyh1r9chinna@[Link] only.
Sharing or publishing the contents in part or full is liable for legal action.
venkyh1r9chinna@[Link]
2XQDNKMJC8

What is Docker?
This file is meant for personal use by venkyh1r9chinna@[Link] only.
Sharing or publishing the contents in part or full is liable for legal action.
 What is Docker?

Docker is a tool that helps in developing, building, deploying and executing software in
isolation. It does so by creating containers that completely wrap a software.

venkyh1r9chinna@[Link]
2XQDNKMJC8

The Isolation provided by container gives a layer of security to the

containers.
This file is meant for personal use by venkyh1r9chinna@[Link] only.
Sharing or publishing the contents in part or full is liable for legal action.
 Why Docker?

Simple Fast Easy Collaboration

venkyh1r9chinna@[Link]
2XQDNKMJC8

Built for Developers, by

Docker Community
Developers
This file is meant for personal use by venkyh1r9chinna@[Link] only.
Sharing or publishing the contents in part or full is liable for legal action.
venkyh1r9chinna@[Link]
2XQDNKMJC8

Docker Installation & Setup

This file is meant for personal use by venkyh1r9chinna@[Link] only.
Sharing or publishing the contents in part or full is liable for legal action.
 Docker Installation & Setup

Linux Windows MAC

venkyh1r9chinna@[Link]
2XQDNKMJC8

This file is meant for personal use by venkyh1r9chinna@[Link] only.

Sharing or publishing the contents in part or full is liable for legal action.
venkyh1r9chinna@[Link]
2XQDNKMJC8

Docker Environment
This file is meant for personal use by venkyh1r9chinna@[Link] only.
Sharing or publishing the contents in part or full is liable for legal action.
 Docker Environment

Docker Engine Docker Objects Docker Registry

venkyh1r9chinna@[Link]
2XQDNKMJC8

Docker Compose Docker Swarm

This file is meant for personal use by venkyh1r9chinna@[Link] only.
Sharing or publishing the contents in part or full is liable for legal action.
venkyh1r9chinna@[Link]
2XQDNKMJC8

Docker Engine
This file is meant for personal use by venkyh1r9chinna@[Link] only.
Sharing or publishing the contents in part or full is liable for legal action.
 Docker Engine

Docker engine is as the name suggests, its technology that allows for
the creation and management of all the Docker Processes. It has three
major parts to it.

venkyh1r9chinna@[Link]
2XQDNKMJC8

Docker CLI Docker API Docker Daemon

This file is meant for personal use by venkyh1r9chinna@[Link] only.

Sharing or publishing the contents in part or full is liable for legal action.
venkyh1r9chinna@[Link]
2XQDNKMJC8

Docker Objects
This file is meant for personal use by venkyh1r9chinna@[Link] only.
Sharing or publishing the contents in part or full is liable for legal action.
 Docker Objects

Docker Images Docker Containers Docker Volumes

venkyh1r9chinna@[Link]
2XQDNKMJC8

Docker Swarm Nodes &

Docker Networks
Services
This file is meant for personal use by venkyh1r9chinna@[Link] only.
Sharing or publishing the contents in part or full is liable for legal action.
 Docker Objects - Images

Docker images are sets of instructions that are used to create

containers and execute code inside it.

venkyh1r9chinna@[Link]
2XQDNKMJC8

This file is meant for personal use by venkyh1r9chinna@[Link] only.

Sharing or publishing the contents in part or full is liable for legal action.
 Docker Objects - Images

venkyh1r9chinna@[Link]
2XQDNKMJC8 Let’s pull an image and work with
it.

This file is meant for personal use by venkyh1r9chinna@[Link] only.

Sharing or publishing the contents in part or full is liable for legal action.
venkyh1r9chinna@[Link]
2XQDNKMJC8

Docker Common Commands

This file is meant for personal use by venkyh1r9chinna@[Link] only.
Sharing or publishing the contents in part or full is liable for legal action.
venkyh1r9chinna@[Link]
2XQDNKMJC8

Continuous Integration - Jenkins

This file is meant for personal use by venkyh1r9chinna@[Link] only.
Sharing or publishing the contents in part or full is liable for legal action.
©Great Learning. All Rights Reserved. Unauthorized use or distribution prohibited
 Agenda

1. Why Continuous integration?

2. What is Jenkins?
venkyh1r9chinna@[Link]
2XQDNKMJC8 3. What are Jenkins Features?
4. Jenkins architecture
5. Jenkins installation & setup
6. Setting up a CI/CD pipeline

This file is meant for personal use by venkyh1r9chinna@[Link] only.

Sharing or publishing the contents in part or full is liable for legal action.
©Great Learning. All Rights Reserved. Unauthorized use or distribution prohibited
venkyh1r9chinna@[Link]
2XQDNKMJC8

Why continuous integration?

This file is meant for personal use by venkyh1r9chinna@[Link] only.
Sharing or publishing the contents in part or full is liable for legal action.
©Great Learning. All Rights Reserved. Unauthorized use or distribution prohibited
 Why continuous integration?

venkyh1r9chinna@[Link]
2XQDNKMJC8

Code
Source Code Deployment
Manager Tester

Standard Delivery Pipeline

This file is meant for personal use by venkyh1r9chinna@[Link] only.
Sharing or publishing the contents in part or full is liable for legal action.
©Great Learning. All Rights Reserved. Unauthorized use or distribution prohibited
venkyh1r9chinna@[Link]
2XQDNKMJC8

What is Jenkins?
This file is meant for personal use by venkyh1r9chinna@[Link] only.
Sharing or publishing the contents in part or full is liable for legal action.
©Great Learning. All Rights Reserved. Unauthorized use or distribution prohibited
 What is Jenkins?
Jenkins is an Open Source continuous integration tool written in java
that allows us to automate the software development process, making
sure that there is minimum involvement from us. It also integrates all
the different parts of the development.
venkyh1r9chinna@[Link]
2XQDNKMJC8

This file is meant for personal use by venkyh1r9chinna@[Link] only.

Sharing or publishing the contents in part or full is liable for legal action.
©Great Learning. All Rights Reserved. Unauthorized use or distribution prohibited
 What is Jenkins?

venkyh1r9chinna@[Link]
2XQDNKMJC8
Code
Source Code Deployment
Manager Jenkins

Tester
This file is meant for personal use by venkyh1r9chinna@[Link] only.
Sharing or publishing the contents in part or full is liable for legal action.
©Great Learning. All Rights Reserved. Unauthorized use or distribution prohibited
 Benefits of Jenkins
- Jenkins is a community tool – Its open source and has a very very
large community that contributes to it regularly.

- It’s free, so you don’t have to accrue anymore subscription costs.

venkyh1r9chinna@[Link]
2XQDNKMJC8

- It is highly modifiable and adaptable and has a support for a very

large number of plugins.

- It can run on any major platform without any compatibility issues.

This file is meant for personal use by venkyh1r9chinna@[Link] only.

Sharing or publishing the contents in part or full is liable for legal action.
©Great Learning. All Rights Reserved. Unauthorized use or distribution prohibited
 Jenkins Pipeline

feedback

Staging
Code
venkyh1r9chinna@[Link] building
2XQDNKMJC8

Testing
Jenkins

Source Code
Manager
Production

This file is meant for personal use by venkyh1r9chinna@[Link] only.

Sharing or publishing the contents in part or full is liable for legal action.
©Great Learning. All Rights Reserved. Unauthorized use or distribution prohibited
venkyh1r9chinna@[Link]
2XQDNKMJC8

Jenkins Installation & Setup

This file is meant for personal use by venkyh1r9chinna@[Link] only.
Sharing or publishing the contents in part or full is liable for legal action.
©Great Learning. All Rights Reserved. Unauthorized use or distribution prohibited
venkyh1r9chinna@[Link]
2XQDNKMJC8

Continuous Monitoring – ELK &

Prometheus & grafana
This file is meant for personal use by venkyh1r9chinna@[Link] only.
Sharing or publishing the contents in part or full is liable for legal action.
©Great Learning. All Rights Reserved. Unauthorized use or distribution prohibited
venkyh1r9chinna@[Link]
2XQDNKMJC8

Why Continuous Monitoring?

This file is meant for personal use by venkyh1r9chinna@[Link] only.
Sharing or publishing the contents in part or full is liable for legal action.
©Great Learning. All Rights Reserved. Unauthorized use or distribution prohibited
 Why Continuous Monitoring?
Continuous Monitoring is an important part of Software Development. It
is something we take up as measure to maintain the health of a
software and to improve the quality of the software, and this is based
on the feed back we get from the insights gained from monitoring.
venkyh1r9chinna@[Link]
2XQDNKMJC8

This file is meant for personal use by venkyh1r9chinna@[Link] only.

Sharing or publishing the contents in part or full is liable for legal action.
©Great Learning. All Rights Reserved. Unauthorized use or distribution prohibited
 Why Continuous Monitoring?
Continuous Monitoring is an important part of Software Development. It
is something we take up as measure to maintain the health of a
software and to improve the quality of the software, and this is based
on the feed back we get from the insights gained from monitoring.
venkyh1r9chinna@[Link]
2XQDNKMJC8

This file is meant for personal use by venkyh1r9chinna@[Link] only.

Sharing or publishing the contents in part or full is liable for legal action.
©Great Learning. All Rights Reserved. Unauthorized use or distribution prohibited
 Why Continuous Monitoring?
Continuous Monitoring is an important part of Software Development. It
is something we take up as measure to maintain the health of a
software and to improve the quality of the software, and this is based
on the feed back we get from the insights gained from monitoring.
venkyh1r9chinna@[Link]
2XQDNKMJC8

This file is meant for personal use by venkyh1r9chinna@[Link] only.

Sharing or publishing the contents in part or full is liable for legal action.
©Great Learning. All Rights Reserved. Unauthorized use or distribution prohibited
 Why Continuous Monitoring?
Continuous Monitoring is an important part of Software Development. It
is something we take up as measure to maintain the health of a
software and to improve the quality of the software, and this is based
on the feed back we get from the insights gained from monitoring.
venkyh1r9chinna@[Link]
2XQDNKMJC8

This file is meant for personal use by venkyh1r9chinna@[Link] only.

Sharing or publishing the contents in part or full is liable for legal action.
©Great Learning. All Rights Reserved. Unauthorized use or distribution prohibited
venkyh1r9chinna@[Link]
2XQDNKMJC8

What is ELK stack?

This file is meant for personal use by venkyh1r9chinna@[Link] only.
Sharing or publishing the contents in part or full is liable for legal action.
©Great Learning. All Rights Reserved. Unauthorized use or distribution prohibited
 What is ELK stack?
ELK stack is a set of open-source tools that allow us to monitor, collect, process
analyze & visualize data, this data can be of different types and formats and
from almost any source. It was developed by Elastic co. iteratively. They started
with Elastic search and kept on adding more tools to the stack. The primary
purpose of ELK stack is log management.
venkyh1r9chinna@[Link]
2XQDNKMJC8

This file is meant for personal use by venkyh1r9chinna@[Link] only.

Sharing or publishing the contents in part or full is liable for legal action.
©Great Learning. All Rights Reserved. Unauthorized use or distribution prohibited
 ELK features

System & Application Stack Security &

Logging
Performance
venkyh1r9chinna@[Link] Alerting
2XQDNKMJC8

Scalability and Dashboards &

Resiliency Visualisations
This file is meant for personal use by venkyh1r9chinna@[Link] only.
Sharing or publishing the contents in part or full is liable for legal action.
©Great Learning. All Rights Reserved. Unauthorized use or distribution prohibited
 ELK Stack
Logstash

Elastic search Kibana X-Pack

venkyh1r9chinna@[Link]
Filebeat
2XQDNKMJC8

Security Reporting

Alerting ML

Elastic Cloud / Infrastructure

This file is meant for personal use by venkyh1r9chinna@[Link] only.
Sharing or publishing the contents in part or full is liable for legal action.
©Great Learning. All Rights Reserved. Unauthorized use or distribution prohibited
venkyh1r9chinna@[Link]
2XQDNKMJC8

This file is meant for personal use by venkyh1r9chinna@[Link] only.

Sharing or publishing the contents in part or full is liable for legal action.
©Great Learning. All Rights Reserved. Unauthorized use or distribution prohibited