0% found this document useful (0 votes)
2 views20 pages

Module3_5

The document outlines AWS Database Services, focusing on Amazon EMR (Elastic MapReduce) and its capabilities for processing big data using frameworks like Apache Hadoop and Spark. It details use cases for EMR, including machine learning, ETL, and real-time analytics, as well as deployment options on various AWS services. Additionally, it discusses AWS disaster recovery strategies, emphasizing tools and services for effective data recovery and minimizing downtime.

Uploaded by

ennaennasoldran
Copyright
© All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
0% found this document useful (0 votes)
2 views20 pages

Module3_5

The document outlines AWS Database Services, focusing on Amazon EMR (Elastic MapReduce) and its capabilities for processing big data using frameworks like Apache Hadoop and Spark. It details use cases for EMR, including machine learning, ETL, and real-time analytics, as well as deployment options on various AWS services. Additionally, it discusses AWS disaster recovery strategies, emphasizing tools and services for effective data recovery and minimizing downtime.

Uploaded by

ennaennasoldran
Copyright
© All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd

AWS for Cloud Computing

1
Module 3: AWS Database Services
• AWS Lambda
• Amazon Dynamo DB
• Amazon ECS (Elastic Container Service) & Amazon S3 Glacier
• Amazon Kinesis, Amazon Redshift
• Amazon EMR (Elastic MapReduce), AWS Disaster Recovery and
Backup.

2
Amazon EMR (Elastic MapReduce)
• Amazon EMR (Elastic MapReduce) is a managed service on
AWS
• It makes it easy to run big data tools like Apache Hadoop and
Apache Spark.
• It helps you process and analyze large amounts of data for
analytics and business intelligence.
• With Amazon EMR, you can also move and transform data
between other AWS services like Amazon S3 and Amazon
DynamoDB.

3
Apache Hadoop and Apache Spark
Apache Hadoop:
• A framework that stores and processes very large datasets using many
computers working together.
• It breaks big data into smaller chunks, stores them across multiple machines, and
processes them in parallel.
Apache Spark:
• A faster data processing engine that can handle big data in memory (RAM)
instead of only reading from disk like Hadoop.
• It’s widely used for real-time data processing, analytics, and machine learning.
In short:
• Hadoop = good for storing and batch-processing very large data.
• Spark = good for fast, real-time, and complex big data analytics.

4
Amazon EMR Use Cases
• Machine learning: EMR can run ML algorithms (like decision trees, random
forests, SVM, logistic regression) using Hadoop to help with decision-
making.
• ETL (Extract, Transform, Load): EMR can move data between storage
systems and transform it (e.g., sorting, combining, or summarizing data).
• Real-time streaming: With Spark Streaming and Flink, EMR can analyze
data as it arrives, making real-time pipelines possible.
• Interactive analytics: EMR Notebooks (based on Jupyter) let data scientists
write and run live code, prepare data, and create visualizations in a secure,
scalable environment.
• Genomics: EMR can process large genomic datasets, helping industries like
medicine and telecom scale their data analysis.

6
Spark Streaming and Flink
• Spark Streaming is a real-time data processing framework built on top of Apache
Spark.
• It allows processing of live data streams from sources like Kafka, Flume, Twitter,
or TCP sockets.
• Apache Flink is a stream-first framework for stateful stream processing.
• It can handle both streaming and batch data.
• A stream-first framework is a software system or platform designed primarily to
process data as it arrives, rather than in large batches. In other words, it treats
streaming (real-time) data as the main focus instead of batch data.
• Genomics is the branch of biology that focuses on the study of an organism’s
complete set of DNA, including all of its genes. It goes beyond individual genes to
look at the entire genome and how genes interact with each other and the
environment.

7
Amazon EMR deployment options
Amazon EMR on Amazon EC2.
• Amazon EMR can quickly process large amounts of data using
Amazon EC2.
• Users can configure Amazon EMR to take advantage of On-Demand,
Reserved and Spot Instances.

8
Amazon EMR deployment options
Amazon EMR on Amazon Elastic Kubernetes Service (EKS).
• The Amazon EMR console enables users to run Apache Spark
applications with other applications on the same EKS cluster.
• Organizations can share compute and memory resources
across all applications and
• Use a Kubernetes tool to monitor and manage the
infrastructure.

9
Amazon Elastic Kubernetes Service
(Amazon EKS)
• It is a fully managed Kubernetes service provided by
AWS.
• It makes it easy to run Kubernetes clusters on the
AWS cloud or on-premises.
• Kubernetes is an open-source platform for
automating deployment, scaling, and management
of containerized applications.

10
Amazon EMR deployment options
Amazon EMR on AWS Outposts.
• AWS Outposts enables organizations to run EMR in
their own data centers.
• This makes it easier to set up, deploy, manage and
scale EMR in on-premises environments.

11
Advantages of Amazon EMR
[Link]: EMR allows users to easily scale up or down the number of instances
in a cluster to handle varying amounts of data processing and analysis tasks.
[Link] Effectiveness: EMR allows users to pay for the resources they need, when
they need them, making it a cost-effective solution for big data processing.
[Link] With Other AWS Services: EMR can be easily integrated with other
AWS services such as Amazon S3, Amazon DynamoDB, and Amazon Redshift for
data storage and analysis.
[Link]: EMR supports a wide range of open-source big data frameworks,
including Hadoop, Spark, and Hive, giving users the flexibility to choose the tools
that best fit their needs.
[Link] To Use: EMR provides an easy-to-use web interface that allows users to
launch and manage clusters, as well as monitor and troubleshoot performance
issues.

12
AWS Disaster Recovery and Backup
Disaster recovery involves the process of restoring
and recovering an organization’s critical systems,
infrastructure, and data after a disruptive event.
It aims to minimize downtime, recover lost data,
and resume normal operations as quickly as
possible.
AWS (Amazon Web Services) offers a full range of
tools and services to assist organizations in
establishing effective disaster recovery
strategies. Services like Amazon S3 for secure and
reliable object storage, Amazon EC2 for adaptable
and scalable computing instances, and AWS
Backup for automatic backup and recovery
procedures are all provided by AWS. AWS also
offers options like cross-region replication which
lets companies duplicate data. Also, organizations
can improve their capacity to respond to disasters
by using AWS for DR.
13
AWS Disaster Recovery and Backup
• Disaster recovery involves the process of restoring
and recovering an organization’s critical systems,
infrastructure, and data after a disruptive event.
• It aims to minimize downtime, recover lost data,
and resume normal operations as quickly as
possible.
• AWS (Amazon Web Services) offers a full range of
tools and services to assist organizations in
establishing effective disaster recovery strategies.
14
AWS Disaster Recovery and Backup
AWS (Amazon Web Services) provides tools to help with
disaster recovery, such as:
• Amazon S3: Secure and reliable storage for data.
• Amazon EC2: Flexible and scalable computing resources.
• AWS Backup: Automated backup and recovery.
• Cross-region replication: Copy data to another region for
extra safety.
• Using AWS helps organizations recover faster and
respond better to disasters.
15
16
AWS Services for Disaster Recovery
• Amazon S3 (Simple Storage Service): It is perfect for safely storing backup
data and making it possible for quick retrieval during the recovery stage.
• Amazon EC2 (Elastic Compute Cloud): Organizations can build a failover
architecture by replicating their on-premises virtual machine (VM)
environments.
• High availability and seamless failover are made possible by EC2’s Auto
Scaling and Load Balancing features.
• AWS Database Services: Database services from AWS include Amazon RDS
(Relational Database Service), Amazon DynamoDB, and Amazon Aurora.
• The automated backups, point-in-time recovery, and cross-region replication
provided by these services ensure data durability and availability.

17
Strategies

18
RPO (Recovery Point Objective)
• The maximum amount of data loss that an
organization can tolerate after a disaster.
• Measured in: Hours or minutes.
• Example:
• If RPO = 4 hours, backups must be taken at least every 4
hours.
• In a disaster, you might lose up to 4 hours of data, but no
more.
19
RTO (Recovery Time Objective)
• The maximum time allowed to restore systems
and resume operations after a disaster.
• Measured in: Hours or minutes.
• Example:
• If RTO = 2 hours, systems must be back online
within 2 hours of failure.

20
Steps to Set Up AWS Disaster Recovery
[Link] Recovery Objectives:
[Link] DR Architecture:
[Link] Data and Applications:
[Link] Up Automation:
[Link] Monitoring and Alerting:
[Link] and Validate:
[Link] the DR Plan:

•Recovery time objective (RTO): The maximum


acceptable delay between the interruption of service and
restoration of service. This determines an acceptable
length of time for service downtime.
•Recovery point objective (RPO): The maximum
acceptable amount of time since the last data recovery
point. This determines what is considered an acceptable
loss of data. 21

You might also like