UNIT-II

Cloud Services and Platforms

• Cloud provides different types of services like compute, storage, database, application,
content delivery, analytics, deployment and management and identity and access
management.

• Infrastructure as a Service(IaaS)- provides virtualized dynamically scalable

resources using a virtualized infrastructure.

• Platform as a Service (PaaS)- simplifies application development by providing

development tools and APIs.

• Software as a Service (SaaS)- provides multi-tenant applications hosted in the cloud.

Cloud Services and Platforms

Fig : Cloud Reference model

 Compute Services
• Compute services provide dynamically scalable compute capacity in the cloud .

• Compute resources can be provisioned on-demand in the form of virtual machines.

Features :
• Scalable: Compute services allow rapidly provisioning as many virtual machine
instances as required.
• Flexible: compute services give a wide range of options for virtual machines with
multiple instance types, operating systems, zones/regions etc.
• Secure: It provides various security features that control the access to the virtual
machine instances such as security groups, access control lists, network firewalls
etc.
• Cost effective: CSP offer various billing options such as on-demand,reserved ,spot
instances.
 Compute Services
1. Amazon Elastic Compute Cloud (Amazon EC2 ):
• Amazon EC2 is a compute service provided by amazon.
• By Click on the launch instance button we create a new instances with the user
choice.
• When you launch the instance you can specify the instance type with the number
of instances to launch based on the selected AMI and availability zones for the
instance.
• At the time launch instance the user selects a key-pair from existing key pairs or
create new one to provide secure connection after it launch.
• Security groups are used to open or block a specific network port for the launched
instances.
• By using public DNS connect to the instances using SSH.
Cloud Services Examples

Fig : Amazon EC2 Dashboard

 Compute Services
2. Google Compute Engine
• It is a compute service provided by Google.

• GCE allows the user to create and manage compute instances.

• To create a new instance the user selects an instance machine type, zone, machine
image and name of instance, instance tags and meta-data.
• Depending on instance type it creates two disk resources like scratch disk space and
persistent disk space.
• By default, traffic between instances in the same network, over any port and any
protocol and incoming SSH connections from anywhere are enabled.
 Cloud Services Examples

Fig : Google Compute Engine Dashboard

 Compute Services

3. Windows Azure Virtual Machines

• It is the compute service from Microsoft.

• To create a new instance, you select the instance type and the machine image.

• You can either provide a user name and password or upload a certificate file for
securely connecting to the instance.
• Any changes made to the VM are persistently stored and new VMs can be created
from the previously stored machine images.
 Cloud Services Examples

Fig : Windows Azure VM dashboard

 Storage Services
• Cloud storage services allow storage and retrieval of any amount of data, at any where
on the web.
• Data in cloud storage services is organized into buckets or containers.
Features :
• Scalability : Cloud storage services provide high capacity and scalability.
• Objects up to several tera-bytes in size can be uploaded and multiple
buckets or containers can be created on cloud storage.
• Replication : When an object is uploaded it is replicated at multiple facilities on multiple
devices within each facility.
• Access Policies : It provide Access Control Lists and Bucket/container level policies to
provide security.
• Encryption : It provide Server side encryption option to encrypt all data stored in cloud
storage.
• Consistency: Strong data consistency is provided for all uploaded and delete operations.
 Storage Services
Amazon Simple Storage Service : (S3)
• Amazon simple storage service(S3) is an online cloud based data storage
infrastructure for storing and retrieving any amount of data.
• S3 provides highly reliable, scalable, fast, fully redundant and affordable storage
infrastructure.
• Data stored on S3 is organized in the form of buckets.

• It is necessary to create a bucket before you can store data on S3.

• You can upload any kind of file to S3.

• While uploading a file, you can specify the redundancy and encryption options and
access permissions.
Storage Services

Fig : Amazon S3 Console

 Storage Services
Google Cloud Storage
• Objects in GCS are organized into buckets.
• ACLs are used to control access to objects and buckets.
• ACLs can be configured to share objects and buckets with the entire world, a google group, a
google-hosted domain or specific google account holders.
 Storage Services
Windows Azure Storage
• It is a cloud storage service from Microsoft.
• Windows Azure Storage provides various storage service such as blob storage
service, table service and queue service.
• The blob storage service allows strong unstructured binary data or binary large
objects.
• Blobs are organized into containers.
• There are two kinds of blobs can be stored – block and page blobs.
• A block blob can be subdivided into some number of blocks.
• If a failure occurs while transferring a block blob, retransmission can resume with
the most recent block rather than sending the entire blob again.
• Page blobs are divided into number of pages and are designed for random access.
• Applications can read and write individual pages at random in a page blob.
 Storage Services

Fig : Windows azure Storage Console

 Database Services
• Cloud database services allow you to set-up and operate relational or non-relational
data bases in the cloud.
• The benefit of using cloud database services is that it relieves the application
developers from the time consuming database administration tasks.
• Relational databases provides by cloud services are like MySql, Oracle, SQL
Serve etc.
• The non relational data bases provided by cloud service providers are mostly
proprietary solutions, No-SQL databases are usually fully-managed and deliver
seamless throughput and scalability.
Features :
• Scalability : Cloud data base services allow provisioning as much compute and
storage resources as required to meet the application workload levels.
• Provisioned capacity can be scaled-up or down.

• For Heavy work loads, read-replicas can be created.

• Reliability : Cloud database services are reliable and provide automated backup
and snapshot options.

• Performance : Cloud database services provide guaranteed performance with

options such as guaranteed input/output operations per second (IOPS) which
can be provisioned upfront.

• Security : Cloud database services provide several security features to restrict

the access to the database instances and stored data, such as network firewalls
and authentication mechanisms.
 Database Services
Amazon Relational Data Store:
•Amazon relational database service(RDS) is a web service that makes it easy to
setup, operate and scale a relational database in the cloud.
•It provides cost-efficient and resizable capacity while managing time-
consuming database administration tasks, freeing you up to focus on your
applications and business.
•The console provides an instance launch wizard that allows you to select the
type of database to create, database instance size, allocated storage, DB instance
identifier, DB username and Password.
•After creating the instance it create an end point, using this end point you can
connect instance securely.
• Click get started now
 Amazon DynamoDBDatabase
: Services
• Amazon DynamoDB is a fast and flexible NoSQL database service for all applications that
need consistent, single-digit millisecond latency at any scale.
• Its flexible data model and reliable performance make it a great fit for mobile, web, gaming,
ad-tech, IoT, and many other applications.
• Amazon Dynamo DB is the non-relational database service from Amazon.
• This model includes include table, attributes and items.
• A table is a collection of items and each item is a collection of attributes.
• To store data you need to create one or more tables and specify the required throughput
capacity you want to provision and reserve for read and writes.
• It is a fully managed service that automatically spreads the stored tables to number of servers
to meet the throughput requirements specified by the user.
• All the stored data is automatically replicated across multiple availability zones to provide
data durability.
• Click create table
 Database Services
 Google Cloud SQL:
• It is a relational database from Google.

• Cloud SQL is a fully-managed database service that makes it easy to set up,
maintain, manage, and administer your relational PostgreSQL BETA
and MySQL
databases in the cloud.
• Cloud SQL offers high performance, scalability, and convenience.
• Hosted on Google Cloud Platform

• Cloud SQL provides a database infrastructure for applications running

anywhere.
Google Cloud Data store:

• It is a fully managed non-relational database from google.

• cloud Datastore is a highly-scalable NoSQL database for your applications.
• Cloud Datastore offers ACID transactions and high availability of reads and
writes.
• Each entity has one or more properties (Key-value pairs) .
• Each entity has a kind and key.
• The entity kind is used for categorizing the entity for the purpose of queries and
the entity key uniquely identifies the entity.
• Easy to Use Query Language
• Fast & Highly Scalable
 Database Services

 Windows Azure SQL Databases

• Windows azure SQL database is the relational database service from the Microsoft.

• Azure SQL Database is based on the SQL server.

• It does not give each customer a separate instance of SQL server.

• Instead the Database is a multi-tenant service, with a logical SQL database server

for each customer.

Windows Azure Table Services

• It is a non-relational(No-SQL) database service from Microsoft.

• It consists of tables having multiple entities.

• Tables are divided into some number of partitions, each of which can be
stored on a separate machine.
• Each partition in a table holds a specified number of entities, each
containing as many as 255 properties.
• Each property can be one of the several supported data types such as
integers and strings.
  Application Services
• There are different types of cloud application services like application runtime and
frameworks, queuing services, email services, notification services and media
services.

1. Application Runtime and Frameworks:

• It allows the developers to develop and host applications in the cloud.

• Application runtime provide support for programming languages and

automatically allocate resources for applications without the need to run and
maintain the server.

 Google App Engine

• It is a PaaS from google and it includes both an application and web frameworks.
Features :
• Runtimes: App Engine supports applications developed in java, python and PHP
programming languages and it provides runtime environment for those languages.
 Application Services
• Sandbox : Applications run in a secure sandbox environment isolated from other
applications.
• Web Frameworks: App engine provides a simple python web application
framework called webapp2.
• Data store: App Engine provides a no-SQL data storage services.

• Authentication: App Engine applications can be integrated with google accounts

for user authentication.
• URL Fetch Service: URL Fetch service allows applications to access resources on
the internet like web services.
• Email Services: Email service allows applications to send email messages.

• Image Manipulation service: Image manipulation service allows applications to

resize, crop, rotate, flip and enhance Images.
 Application Services
• Task Queues: Task queues allow applications to do work in the background by breaking up
work into small, discrete units called tasks which are enqueued in task queues.
• Scheduled Tasks Service: App Engine provides a Cron service for scheduled tasks that
trigger events at specified times and regular intervals.

 Windows Azure Web Sites:

• It is a PaaS service from Microsoft.
• It allows you to host web applications in the azure cloud.
• Azure web sites provide shared and standard options.
• In the shared option, It run on a set of virtual machines that may contain multiple websites
created by multiple users.
• In the standard option, Azure web sites run on virtual machines that belongs to an individual
user.
• It support web applications developed in [Link],PHP,[Link] and python languages.
 Application Services
2. Queuing Services :
• Cloud-based queuing services allow de-coupling application components.

• The de-coupled components communicate via messaging queues.

• Queues are useful for asynchronous processing.

• Queuing services from various cloud service providers allow short messages of a few

kilo-bytes in size.

• Messages can be enqueued and read from the queues simultaneously.

 Amazon Simple Queue Service(SQS):

• It is a queuing service from Amazon.

• SQS is a distributed queue that supports messages of up to 256 KB.

• SQS supports multiple writers and readers and locks messages while they are being

processed.

• To ensure high availability for delivering messages, SQS service trade-offs on the first

in first out capacity and does not guarantee that messages will be delivered in FIFO

order.
 Application Services
 Google Task Queue Service
• It is a queuing service from google and it is part of the Google App Engine
platform.
• Task queue allow applications to execute in background.

• Task is unit of work to be performed by an application.

• Task objects consists of application-specific URL with a request handler for the
task, and an optional data payload that parameterizes the task.
• There two configurations for Task Queues 1. Push Queue [Link] Queue.

• Push queue is default queue that processes tasks based on the processing rate
configured in the queue definition.
• Pull queues allow task consumers to lease a specific number of tasks for a specific
definition.
 Application Services
 Windows Azure Queue Service

• It is a queuing service from Microsoft.

• Azure queue service allows storing large numbers of messages that can be accessed

from anywhere in the world via authenticate calls using HTTP and HTTPS.

• The size of single message can be up to 64KB.

 Application Services
3. Email Services
• Cloud based email services allow applications hosted in the cloud to send emails.

 Amazon Simple Email Services(SES)

• It is a bulk and transactional email-sending service from Amazon.

• SES is an outbound- only email sending service that allows applications hosted in
the Amazon cloud to send emails such as marketing, transactional and other types
of correspondence emails.
• SES uses content filtering technologies to scan the outgoing email messages.

• SES used from the SES console, SMTP interface or SES API.
 Application
 Google Email Services Services
• It is part of the Google App Engine platform that allows App Engine applications to
send email messages on behalf of the app’s administrator and on behalf of users with
Google Accounts.

• App engine Apps can also receive emails.

• Apps send messages using the mail service and receive messages in the form of HTTP
requests initiated by App Engine and posted to the app.
4. Notification Services
• Cloud-based notification services or push messaging service allow applications to push
messages to internet connected smart devices such as smart phones, tablets etc.

• It works based on publish- subscribe model in which consumers subscribe to various

topics provided by a publisher.

• When ever new content is available on one of those topics , the notification service
pushes that information out to the consumer.
 Application Services
 Amazon Simple Notification Services(SNS):
• It is a push messaging service from Amazon.
• It has two types of clients like publishers and subscribers.
• Publishers communicate asynchronously with subscribers by producing and
sending messages to topics.
• A topic is a logical access point or a communication channel.
• SNS can deliver notifications as SMS, email, or to SQS queues, or any HTTP
endpoint.
 Google Cloud Messaging
• GCM for android provides push messaging for android devices.

• GCM allows applications to send data from the application servers to their users,
Android devices and also to receive messages from devices on the same connection.
• GCM provides a send to sync message capability that can be used to inform an
application to sync data from the server.
 Application Services
 Windows Azure Notification Hubs
• It is a push notification service from Microsoft that provides a common interface to
send notifications to all major mobile platforms including windows store/windows
phone8,Ios and Android.
• Platform specific infrastructures called Platform Notifications System(PNS) are
used to deliver notification Messages.
• Devices register their PNS handles with the notification Hub.

• Each notification hub contains credentials for each supported PNS.

• These credentials are used to connect to the PNSs and send push notifications to the
applications.
 Application Services
5. Media Services
• Cloud service providers provide various media services for manipulating and
transforming media such as images, videos and audio.
 Amazon Elastic Transcoder
• It is a cloud based video transcoding service from Amazon.

• It is used to convert video files from their source format into various other formats
that can be played on devices such as desktops, mobiles, tablets etc.
• It works with the Amazon S3 for input and output video files are stored.
 Application Services
 Google Images Manipulation Services
• It is a part of the Google App Engine platform.

• Image Manipulation service provides the capability to resize, crop, rotate, flip and
enhance images.
• It accepts the image data directly from the App Engine apps, from Goolge Blobstore
or Google Cloud Storage.
 Windows Azure Media Services
• It provides the various media services such as encoding and format conversion,
content protection and on-demand and live streaming capabilities.
• It provides applications the capability to build media workflows for uploading,
storing, encoding, format conversion, content protection and media delivery.
 Content Delivery Services
• Cloud based content delivery service include content delivery networks(CDNs).

• A CDN is a distributed system of servers located across multiple geographic

locations to serve content to end users with high availability and high performance.
• CDNs are useful for serving static content like text, images, scripts etc.. and
streaming media.
• CDNs have a number of edge locations deployed in multiple locations.

• Request for a static or streaming media content that is served by a CDN are directed
to the nearest edge location.
• CDN catch the popular content on the edge servers which helps in reducing
bandwidth costs and improve response times.
 Content Delivery Services
 Amazon Cloud Front
• It is a content delivery from Amazon.

• It is used to deliver dynamic, static and streaming content using a global network of
edge locations.
• The content in the cloudfront is organized into distributions.

• Each distribution specifies the original location of the content to be delivered which
can be an Amazon S3 bucket, an Amazon EC2 instance, or an Elastic Load
balancer, or your own origin server.
• Distributions can be accessed by their domain names.

• CloudFront helps in improving the performance of websites by:

1. Catching the static content like javascript,CSS and Images etc. at edge locations.

2. Proxing requests for dynamic or interactive content back to the origin running in the
AWS cloud.
 Content Delivery Services
 Windows Azure Content Delivery Network
• It is the Content Delivery Service from the Microsoft.

• Azure CDN caches windows Azure blobs and static content at the edge locations to
improve the performance of the websites.

• Azure CDN can be Enabled on a windows Azure storage accoun t.

 Analytics Services
• It allow analyzing massive data sets stored in the cloud either in clod storage or in
cloud database using programming models such as Map Reduce.
• Using cloud analytics services applications can perform data-intensive tasks such as
data mining, log file analysis, machine learning, web indexing etc.

 Amazon Elastic Map Reduce

• It is the Map Reduce service from Amazon based the Hadoop framework running
on Amazon EC2 and Amazon S3.
• It supports different job types like :

1. Custom JAR : Custom JAR job flow runs a java program that you have uploaded
to Amazon S3.

2. Hive Program: Hive is a data warehouse system for Hadoop. You can use Hive to
process data using the SQL-like language, called Hive-QL. You can create a hive
 Analytics Services
3. Streaming Job: Streaming job flow runs a single Hadoop job consisting of map and
reduce functions implemented in a script or binary that you have uploaded to Amazon S3.
• You can write map and reduce scripts in ruby,perl,python,php,R,bash or C++.

4. Pig programs: Apache pig is a platform for analyzing large data sets that consists of a
high-level language(Pig Latin) for expressing data analysis programs, coupled with
infrastructure for evaluating these programs.
• You can create a Pig job flow with EMR which can either be an interactive pig job or pig
script.

5. Hbase: Hbases is a distributed, scalable, No-Sql database built on top of Hadoop.

• EMR allows you to launch an Hbase cluster. Hbase can be use for various purposes such
as referencing data for Hadoop analytics, real-time long ingestion and batch log analytics.
 Analytics Services
 Google Map Reduce Services
• It is a part of the map engine platform.

• App Engine Map Reduce is optimized for App Engine Environment and provides
capabilities such as automatic sharding for faster execution, standard data input
readers for iterating over blob and data store data, Standard output writers etc.
• The MapReduce service can be accesses using the google MapReduce API.

• To Execute a MapReduce job a MapReduce pipeline object is instantiated within

the app engine application.
• Map Reduce pipeline specifies the mapper, reducer, data input reader and output
writer.
 Analytics Services
 Google BigQuery
• It is service for querying massive datasets.
• Big query allows querying datasets using SQL-like queries.
• The BigQuery queries are run against append-only tables and use the processing
power of goolge’s infrastructure for speeding up queries.
• To query data, it is first loaded into BigQuery using the BigQuery console or
BigQuery commandline tool or BigQuery API.
• Data can be either in CSV or JSON format.
• The uploaded data can be queried using BigQuery’s dialect.
 Windows Azure HDInsight

• Windows Azure HDInsight is an analytic service from Microsoft.

• HDInsight deploys and provisions Hadoop clusters in the Azure cloud and makes
Hadoop available as a service.
• HDInsight service uses Windows Azure Blob Storage as the default file [Link]
provides interactive consoles for both JS and Hive.
 Deployment and Management Services
• It allow you to easily deploy and manage applications in the cloud.

• These Services automatically handle deployment tasks such as capacity

provisioning, load balancing, auto-scaling and application health monitoring.
 Amazon Elastic Beanstalk
• Amazon provides a deployment service called Elastic Beanstalk that allows you to
quickly deploy and manage applications in the AWS cloud.
• Elastic Bean Stalk supports Java, PHP, .NET, [Link], Python and Ruby
applications.
• In Elastic Bean Stalk you just need to upload the application and specify
configuration settings in a simple wizard and the service automatically handles
instance provisioning, server configuration, load balancing and monitoring.
 Deployment and Management Services
 Amazon Cloud Formation
• Amazon Cloud Formation is a deployment management service from Amazon.

• With cloud Front you can create deployments from a collection of AWS resources
such as Amazon Elastic Compute Cloud, Amazon Elastic Block Store, Amazon
Simple Notification Service, Elastic Load Balancing and Auto Scaling.
• A collection of AWS resources that you want to manage together are organized into
a stack.
• Cloud Formation Stacks are created from cloud formation templates.

• It allows to create your own templates or use the predefined templates.

 Identity and Access Management Services
• IDAM services allow managing the authentication and authorization of users to
provide secure access to cloud resources.
• These are useful for organizations which have multiple users who access the cloud
resources.
• By using IDAM services you can manage user identifiers, user permissions,
security credentials and access keys.
 Amazon Identity and Access Management
• AWS IDAM allows you to manage users and user permissions for an AWS account.

• With IDAM you can manage users, security creadentials such as access key and
permissions that control wich AWS resources users can access.
• Using IDAM you can control what data users can access and what resources users
can create.
• It allows creation, rotation and revocation of user credentials.
 Identity and Access Management Services
 Windows Azure Active Directory
• It is an IDAM service from Microsoft.

• It provides a cloud based identity provider that easily integrates with your on-
premises active directory deployments and also provides support for third party
identity providers.
• With Azure Active directory you can control access to your applications in
Windows Azure.
 Open Source Private Cloud Software
1. Cloud Stack
• Apache CloudStack is an opensource cloud software that can be used for creating private
cloud offerings.
• CloudStack manages the network, storage and compute nodes that make up a cloud
infrastructure.
• A Cloud Stack installation consists of a Management Server and the cloud infrastructure
that it manages.
• The cloud infrastructure can be as simple as one host running the hypervisor or a large
cluster of hundreds of hosts.
• The management server allows you to configure and manage the cloud resources.
• The Management server manages one or more zones where each zone is typically a single
datacenter.

• Each zone has one or more pods. A pod i s a rack of hardware comprising of a
 Open Source Private Cloud Software
• A cluster consists of one or more hosts and a primary storage.
• A host is a compute node that runs guest virtual machines.
• The Primary storage of a cluster stores the disk volumes for all the virtual
machines running on the hosts in that cluster.
• Each zone has a secondary storage that stores templates, ISO images and disk
volume snapshots.
• A region is a specific geographical location where you can run your resources.
Open Source Private Cloud Software

Fig : Cloud Stack Architecture

 Open Source Private Cloud Software
2. Eucalyptus
• Eucalyptus is an open source private cloud software for building private and
hybrid clouds that are compatible with Amazon Web Services(AWS) APIs.
• The Node controller hosts the virtual machine instances and manages the virtual
network endpoints.
• The cluster level consists of three components like cluster controller(CC), Storage
Controller(SC) and VMWare Broker.
• The CC manages the Virtual machines and is the front end for a cluster.
• The SC manages the Eucalyptus block volumes and snapshots to the instances
within its specific cluster.
• SC is similar to AWS Elastic Block Store(EBS).
• VMWare broker is an optional component that provides an AWS – compatible
interface for VMWare environments.
 Open Source Private Cloud Software
• At the cloud level there are two components like Cloud Controller (CLC) and
Walrus.
• CLC provides an administrative interface for management and performs high level
resource scheduling, system accounting, authentication and quota management.
• Walrus is equal to Amazon S3 and serves as a persistent storage to all of the virtual
machines in the Eucalyptus cloud.
Open Source Private Cloud Software

Fig: Eucalyptus Architecture

 Open Source Private Cloud Software
3. OpenStack
• OpenStack is a cloud operating system comprising of interactive services that
control computing, storage and networking resources.
• The OpenStack compute service (nova-compute) manages networks of virtual
machines running on nodes, providing virtual servers on demand.
• The network service(nova-networking) provides connectivity between the
interfaces of other OpenStack services.
• The volume service (Cinder) manages storage volumes for virtual machines.
• The object storage service (swift) allows users to store and retrieve files.
• The identity service (Keystone) provides authentication and authorization for other
services.
• The image registry(glance) acts as a catalog and repository for virtual machine
images.
 Open Source Private Cloud Software
• The open stack scheduler (nova –scheduler ) maps the nova-API calls to the
appropriate OpenStack components.
• The scheduler takes the virtual machine requests from the queue and determines
where they should run.
• The messaging service(rabbit-mq) acts as a central node for message passing
between daemons.
• Orchestration activities such as running an instance are performed by the nova-api
which accepts and responds to end user compute API calls.
• The OpenStack dashboard(called horizon) provides web-based interface for
managing OpenStack service.
Open Source Private Cloud Software

Fig : OpenStack Architecture