CCS335 CLOUD COMPUTING
UNIT 1
Prepared by
[Link],
AP/CSE
COURSE OUTCOMES:
CO1: Describe the design challenges in cloud architecture. [Understanding]
CO2: Optimize the hardware utilization by employing virtualization
techniques. [Applying]
CO3: Implement virtualization infrastructures using Docker. [Applying]
CO4: Develop and deploy cloud services in the cloud environment.
[Analyzing]
CO5: Analyze security challenges in the cloud security system. [Analyzing]
Lab:
CO6: Execute virtualization applications using Cloudsim
CO7: Deploy Cloud services using Docker
Take a system and enhance your understanding of
1. Centralized Computing
2. Distributed Computing
3. Cloud computing
Aspect Centralized Computing Distributed Computing Cloud Computing
Definition All processing and data storage are Processing and data storage are shared Computing resources are
handled by a single central system among multiple interconnected delivered as services over the
systems Internet
Infrastructure Owned and managed by a single Owned by one or more organizations Owned and managed by cloud
Ownership organization service providers
Control Fully controlled by a central node Control is distributed across nodes Control is shared between
provider and user
Scalability Limited scalability High scalability by adding nodes Elastic scalability (on-demand
resources)
Fault Single point of failure High fault tolerance Very high fault tolerance using
Tolerance data replication & regions
Resource Manual and rigid Coordinated among nodes Automated and dynamic
Management
Cost Model High upfront cost Moderate infrastructure cost Pay-as-you-go model
Access Local or private network Network-based Internet-based access
Method
Examples Mainframe systems, single server Distributed databases, Hadoop, AWS, Microsoft Azure, Google
Self Learning
Data-Intensive computing
High Performance Computing
High Throughput Computing
Parallel computing (Massively Parallel Computing)
Service Oriented Architechture
Think–Pair–Share Activity
Topic: Understanding Distributed Computing
Time: 15–20 minutes
Questions:
What is distributed computing in your own words?
Why can’t a single computer handle such systems efficiently?
List two characteristics you believe a distributed system must have.
Why to study cloud computing?
• Amazon Web Services (AWS), Azure Cloud, and Google Cloud
Platform (GCP) are dominating the cloud market.
• If you are one of the many users of Google free offerings like Gmail,
Sheets, Photos, Google Docs, you are already using their cloud.
• All major streaming services like Netflix, Amazon Prime relies on
cloud-computing services to run its its video-streaming service and its
other business systems, too.
• Companies like Salesforce, Workday, Hubspot, all use cloud to serve
their customers.
Why do you want to learn cloud computing?
Some reasons for you to get on to the cloud
• Cloud computing is one of the most in-demand skills you can have on
your resume.
• Flexibility for Developers
• Six Figure Salary
• More Jobs
• Challenging Field
• Build your own startup
What are the benefits of Cloud Computing?
• Reduced Costs
• Increased Flexibility
• Increased Productivity
• Increased Security
• Increased Agility
• Reduced Carbon Footprint
• Faster Innovation
Cloud Computing
• Simply put, cloud computing is the delivery of computing
services—including servers, storage, databases, networking, software,
analytics, and intelligence—over the Internet (“the cloud”) to offer
faster innovation, flexible resources, and economies of scale. (Microsoft)
• Cloud Computing means storing and accessing the data and programs
on remote servers that are hosted on the internet instead of the
computer’s hard drive or local server. (Geeks for Geeks)
• In simple terms, cloud computing allows you to rent instead of buy
your IT. (Oracle)
Cloud Architecture
• Cloud architecture is a key element of building in the cloud. It refers to
the layout and connects all the necessary components and technologies
required for cloud computing.
Cloud architecture components include:
• A frontend platform
• A backend platform
• A cloud-based delivery model
• A network (internet, intranet, or intercloud)
Distributed Computing
• Distributed computing is the method of making multiple computers work
together to solve a common problem.
• It makes a computer network appear as a powerful single computer that
provides large-scale resources to deal with complex challenges.
Advantages:
• Scalability
• Availability
• Consistency
• Transparency
• Efficiency
System Models for Distributed and Cloud
Computing
• Distributed and cloud computing systems are built over a large number
of autonomous computer nodes.
• These node machines are interconnected by SANs, LANs, or WANs in
a hierarchical manner.
Massive systems are classified into four groups:
• Clusters
• P2P Networks
• Computing Grids
• Internet clouds
Cluster
• A distributed systems cluster is a group of machines that are virtually
separated and that work together to provide the same service or
application to clients.
• It is possible that many of the services you run in your network today
are part of a distributed system.
Single System Image (SSI):
• Ideal Cluster should merge multiple system images into a Single
System Images
H/W, S/W and Middleware Support:
Major Cluster Design Issues:
• Cluster-wide OS for complete resource sharing is not available yet.
• Middleware and OS extensions were developed at the user space.
• The S/W environments and applications must rely on the M/W to
achieve high performance
P2P Networks
• Every node acts as both a client and a server, providing part of the
system resources.
• Peer machines are simply client computers connected to the Internet.
• All client machines act autonomously to join or leave the system
freely.
• No central coordination or central database is needed. The system is
self-organizing with distributed control.
Computing Grids
• Grid computing is a computing platform that uses multiple networked
computers to work together as a virtual supercomputer to perform
large tasks.
• The unused resources on each computer are pooled together to
complete a single task.
• Grid computing can be used to solve complex problems that are
difficult to do on a single computer, such as analyzing large sets of
data, Weather modeling, Protein folding, Financial modeling,
Earthquake simulation, and Climate modeling.
Internet clouds
• The idea is to move desktop computing to a service-oriented platform
using server clusters and huge databases at data centers.
• Cloud computing leverages its low cost and simplicity to benefit both
users and providers. Machine virtualization has enabled such
cost-effectiveness.
• Cloud computing intends to satisfy many user Virtualized resources
from data centers to form an Internet cloud, provisioned with
hardware, software, storage, network, and services for paid users to
run their applications.
Difference between Cloud Computing and
Distributed computing
CLOUD COMPUTING DISTRIBUTED COMPUTING
Cloud computing refers to providing on demand IT Distributed computing refers to solve a problem
resources/services like server, storage, database, over distributed autonomous computers and they
networking, analytics, software etc. over internet. communicate between them over a network.
It is classified into 3 different types such as
It is classified into 4 different types such as Public
Distributed Computing Systems, Distributed
Cloud, Private Cloud, Community Cloud and
Information Systems and Distributed Pervasive
Hybrid Cloud.
Systems.
The goal of cloud computing is to provide on The goal of distributed computing is to distribute a
demand computing services over internet on pay single task among multiple computers and to solve it
per use model. quickly
NIST Cloud Computing Reference Architecture
1. The National Institute of Standards and Technology (NIST)
2. The goal is to accelerate the federal government‟s adoption of
secure and effective cloud computing to reduce costs and improve
services.
3. The NIST strategy is to build a USG Cloud Computing Technology
Roadmap which focuses on the highest priority USG cloud
computing security, interoperability and portability requirements.
4. NIST Cloud Computing reference architecture defines five major
performers
Cloud Stakeholders
1. Cloud Provider
2. Cloud Carrier
3. Cloud Broker
4. Cloud Auditor
5. Cloud Consumer
Each performer is an object (a person or an organization) that
contributes to a transaction or method and/or performs tasks in Cloud
computing.
Cloud Service Providers
1. A group or object that delivers cloud services to cloud consumers or
end-users. It offers various components of cloud computing.
2. Cloud computing consumers purchase a growing variety of cloud services
from cloud service providers.
3. IaaS Providers: In this model, the cloud service providers offer
infrastructure components that would exist in an on-premises data
center.
4. SaaS Providers: In Software as a Service (SaaS), vendors provide a wide
sequence of business technologies, such as Human resources
management (HRM) software, customer relationship management (CRM)
software
5. PaaS Providers: In Platform as a Service (PaaS), vendors offer cloud
infrastructure and services that can access to perform many functions.
PaaS providers provide operating system and middleware along with
application stack, to the underlying infrastructure.
Cloud Carrier:
• The mediator who provides offers connectivity and transport of cloud
services within cloud service providers and cloud consumers.
• It allows access to the services of the cloud through Internet networks,
telecommunication, and other access devices.
• Network and telecom carriers or a transport agent can provide
distribution.
• Carrier may be required to offer dedicated and encrypted connections.
Cloud Broker:
• An organization or a unit that manages the performance, use, and
delivery of cloud services by enhancing specific capability and offers
value-added services to cloud consumers. It combines and integrates
various services into one or more new services.
There are major three services offered by a cloud broker:
● Service Intermediation (involving adding value ).
● Service Aggregation (combining services).
● Service Arbitrage( dynamically choosing services for optimization).
Cloud Auditor:
An entity that can conduct independent assessment of cloud services, security,
performance, and information system operations of the cloud implementations.
The services that are provided by Cloud Service Providers (CSP) can be evaluated
by service auditors in terms of privacy impact, security control, and performance,
etc.
Cloud Auditor can make an assessment of the security controls in the information
system to determine the extent to which the controls are implemented correctly,
operating as planned and constructing the desired outcome with respect to meeting
the security necessities for the system.
There are three major roles of Cloud Auditor which are mentioned
below:
● Security Audit.
● Privacy Impact Audit.
● Performance Audit.
Cloud Consumer:
• A cloud consumer is the end-user who browses or utilizes the
services provided by Cloud Service Providers (CSP), sets up service
contracts with the cloud provider.
• The cloud consumer pays per use of the service provisioned.
Measured services utilized by the consumer.
• Cloud consumers use Service-Level Agreement (SLAs) to specify
the technical performance requirements to be fulfilled by a cloud
provider.
Cloud Deployment Model
• Cloud Deployment Model functions as a virtual computing
environment with a deployment architecture that varies depending on
the amount of data you want to store and who has access to the
infrastructure.
• The cloud deployment model identifies the specific type of cloud
environment based on ownership, scale, and access, as well as the
cloud’s nature and purpose.
• It specifies how your cloud infrastructure will look, what you can
change, and whether you will be given services or will have to create
everything yourself.
Types of Cloud Computing Deployment Models
● Public Cloud
● Private Cloud
● Hybrid Cloud
● Community Cloud
● Multi-Cloud
Public Cloud
• The public cloud makes it possible for anybody to access systems and
services.
• It is a type of cloud hosting that allows customers and users to easily
access systems and services. This form of cloud computing is an excellent
example of cloud hosting, in which service providers supply services to a
variety of customers.
• In this arrangement, storage backup and retrieval services are given for
free, as a subscription, or on a per-user basis. For example, Google App
Engine etc.
Advantages of the Public Cloud Model
Minimal Investment:
Infrastructure Management is not required:
Dynamic Scalability:
Disadvantages of the Public Cloud Model
Less secure:
Low customization:
Private Cloud
It’s a one-on-one environment for a single user (customer). There is no
need to share your hardware with anyone else.
It is also called the “internal cloud” & it refers to the ability to access
systems and services within a given border or organization.
The cloud platform is implemented in a cloud-based secure environment
that is protected by powerful firewalls and under the supervision of an
organization’s IT department.
Advantages of the Private Cloud Model
Better Control:
Data Security and Privacy:
Customization:
Disadvantages of the Private Cloud Model
Less scalable:
Costly:
Hybrid Cloud
By bridging the public and private worlds with a layer of proprietary
software, hybrid cloud computing gives the best of both worlds.
With a hybrid solution, you may host the app in a safe environment while
taking advantage of the public cloud’s cost savings.
Advantages:
Flexibility and control
Cost
Security
Disadvantages:
Difficult to manage:
Slow data transmission:
Community Cloud
• Community clouds are distributed systems created by integrating
the services of different clouds to address the specific needs of an
industry, a community, or a business sector.
• In the community cloud, the infrastructure is shared between
organizations that have shared concerns or tasks. An organization or
a third party may manage the cloud.
• Ex: CloudSigma, Nextcloud, Synology C2, OwnCloud, Stratoscale
Community Cloud
Advantages
• community clouds are cost-effective
• community cloud is adaptable and scalable
• more secure than private cloud
Disadvantages
• Not all businesses should choose community cloud
• It’s challenging for corporations to share duties.
Multicloud
• Multicloud is the use of multiple cloud computing services from
different providers, which allows organizations to use the
best-suited services for their specific needs and avoid vendor
lock-in.
• This allows organizations to take advantage of the different features
and capabilities offered by different cloud providers.
• Examples: Cloud Foundry, Kubernetes, Apache Mesos, Red Hat
OpenShift, Docker Swarm
Multicloud
Advantages:
Flexibility
Cost-effectiveness
Improved performance
Increased security
Disadvantages:
Complexity
Increased costs
Compatibility issues
Limited interoperability
Architectural Design of Compute and Storage
Clouds
1. A Generic Cloud Architecture Design
1.1 Cloud Platform Design Goal
1.2 Enabling Technologies for cloud
1.3 A Generic Cloud Architecture
2. Layered Cloud Architecture Development
2.1 Market Oriented Cloud Architecture
2.2 Quality of Service Factors
3. Virtualization Support and Disaster Recovery
3.1 Hardware Virtualization
3.2 Virtualization Support in Public Cloud
3.3 Storage Virtualization for Green Data Centers
3.4 Virtualization for Iaas
3.5 VM Cloning for Disaster Recovery
Cloud platform design goals
4 major design goals or objective:
● Scalability
● Virtualization
● Efficiency
● Reliability
❏ Cloud management receives request from user, find the correct
resources, and then calls the provisioning services which invokes the
resources.
❏ Security in shared resources and access is another design challenge.
❏ The H/W and S/W are combined to make it easy and efficient to
operate.
❏ The scale of the cloud architecture can be easily expanded by adding
more servers and enlarging the network connectivity
Enabling Technologies for Clouds
The key driving force behind cloud computing are Broadband and
wireless networking, falling storage cost, and progressive improvements
in the internet computing software.
Clouds are enabled by the progress in hardware, software and
networking technologies.
1. Fast platform deployment
2. Virtual cluster on demand
3. Multi Tenant Techniques
4. Massive data processing
5. Web scale communication
6. Distributed storage
7. Licensing and billing services
Layered Cloud Architectural Development
Market Oriented Cloud Architecture
• Supply and demand of cloud resources at market equilibrium.
• The users or brokers acting on user behalf submit service request from
anywhere in the world to the data center.
• When a service request is first submitted the service provider interpret the
submitted request for QoS requirements before determining whether to
accept or reject the request.
• The request examiner ensures that there is no overloading of resources
whereby many cannot be fulfilled successfully due to limited resources
• VMM keep monitoring availability of VM’s availability.
• Service Request Monitor Mechanism keep tracks of progress of service
request.
Market Oriented Cloud Architecture
QoS Factors
• The DC comprises multiple computing servers that provide resources
to meet service demands.
• The critical QoS parameters to consider in a service request, such as
time, cost, reliability and Trust/Security.
• Qos requirements cannot be static and may change over time due to
continuing changes in business operations and operating
environments.
• Commercial cloud offerings must be able to support customer driven
service management based on customer profile and requested service
requirement.
Virtualization Support and Disaster Recovery
• Work together to improve data protection and reduce the down time
in the event of disaster.
• The infrastructure needed to virtualize the servers in a data center for
implementing specific cloud applications shows in the next diagram.
Cloud Platform Architecture over virtualized data centers
Hardware Virtualization
• Virtualization S/W is used to virtualize the H/W.
• This S/W simulates the execution of Hardware and runs even unmodified
OS.
• Virtual Machine Monitor (VMM) / Hypervisor and Types.
Virtualization Support in public clouds
• Three public clouds in the context of virtualization support. AWS,
Microsoft Azure and GAE.
• VMware tool, Xen Architecture. [Virtual Infrastructure]
• Virtualization Leads to HA(High Availability)
• Disaster Recovery, Dynamic Load Leveling and Rich provisioning
Support.
Storage Virtualization for Green Data Centers
IT Power Consumption.
Actively implementing new corporate energy policies.
Virtualization and Server consolidation supports reduced power
consumption.
Architectural Design Challenges
Challenge 1 - Service Availability and Data Lock-in Problem
Challenge 2 - Data Privacy and Security Concerns
Challenge 3 - Unpredictable Performance and Bottlenecks
Challenge 4 - Distributed Storage and Widespread Software Bugs
Challenge 5 - Cloud Scalability, Interoperability, and Standardization
Challenge 6 - Software Licensing and Reputation Sharing