MODULE 11 LOCAL REPLICATION
EMC Proven Professional
EMC Proven Professional. Copyright 2012 EMC Corporation. All Rights Reserved.
Module 11: Local Replication
Module 11: Local Replication
Upon completion of this module, you should be able to: Describe various uses of local replica Describe how consistency is ensured in file system and database replication Describe host-based, array-based, and network-based local replication technologies Explain restore and restart considerations Describe local replication in a virtualized environment
EMC Proven Professional
EMC Proven Professional. Copyright 2012 EMC Corporation. All Rights Reserved.
Module 11: Local Replication
Module 11: Local Replication
Lesson 1: Local Replication Overview
During this lesson the following topics are covered: Uses of local replica File system and database consistency
EMC Proven Professional
EMC Proven Professional. Copyright 2012 EMC Corporation. All Rights Reserved.
Module 11: Local Replication
What is Replication?
Replication
It is a process of creating an exact copy (replica) of data.
Replication can be classified as
Local replication Replicating data within the same array or data center
Remote replication Replicating data at remote site
REPLICATION
EMC Proven Professional Source Replica (Target)
EMC Proven Professional. Copyright 2012 EMC Corporation. All Rights Reserved.
Module 11: Local Replication
Uses of Local Replica
Alternate source for backup Fast recovery Decision support activities Testing platform Data Migration
EMC Proven Professional
EMC Proven Professional. Copyright 2012 EMC Corporation. All Rights Reserved.
Module 11: Local Replication
Replica Characteristics
Recoverability/Restartability
Replica should be able to restore data on the source device Restart business operation from replica
Consistency
Replica must be consistent with the source
Choice of replica type ties back theto RPO
Point-in-Time (PIT) Non-zero RPO
Continuous Near-zero RPO
EMC Proven Professional
EMC Proven Professional. Copyright 2012 EMC Corporation. All Rights Reserved.
Module 11: Local Replication
Understanding Consistency
Consistency ensures the usability of replica Consistency can be achieved in various ways for file system and
database
Offline Online
File System
Unmount file system
Flushing host buffers a) Using dependent write I/O principle Holding I/Os to source before creating replica
Database
Shutdown database
EMC Proven Professional
EMC Proven Professional. Copyright 2012 EMC Corporation. All Rights Reserved.
Module 11: Local Replication
File System Consistency: Flushing Host Buffer
Application File System Data
Flush Buffer
Memory Buffers Logical Volume Manager Physical Disk Driver
EMC Proven Professional
Source
Replica
EMC Proven Professional. Copyright 2012 EMC Corporation. All Rights Reserved.
Module 11: Local Replication
Database Consistency: Dependent Write I/O Principle
Source Replica Source Replica 1 1 1
EMC Proven Professional
C C
Consistent
Inconsistent
EMC Proven Professional. Copyright 2012 EMC Corporation. All Rights Reserved.
Module 11: Local Replication
10
Module 11: Local Replication
Lesson 2: Local Replication Technologies
During this lesson the following topics are covered: Local replication technologies Restore and restart considerations
EMC Proven Professional
EMC Proven Professional. Copyright 2012 EMC Corporation. All Rights Reserved.
Module 11: Local Replication
11
Host-based Replication: LVM-based Mirroring
Logical Volume
Physical Volume 1
Volume group
Physical Volume 2
Host
EMC Proven Professional
EMC Proven Professional. Copyright 2012 EMC Corporation. All Rights Reserved.
Module 11: Local Replication
12
Host-based Replication: File System Snapshot
Pointer-based replication Uses Copy on First Write
FS Snapshot Metadata Production FS Metadata 1 Data a 2 Data b Bit 1-0 2-0 3-1 4-1 BLK 1-0 2-0 3-2 4-1
(CoFW) principle Uses bitmap and block map Requires a fraction of the space used by the production FS
3 Data C
4 Data D 1 Data d 2 Data c 3 no data
EMC Proven Professional
N Data N
4 no data
EMC Proven Professional. Copyright 2012 EMC Corporation. All Rights Reserved.
Module 11: Local Replication
13
Storage Array-based Local Replication
Replication performed by the array operating environment Source and replica are on the same array Types of array-based replication
Full-volume mirroring Pointer-based full-volume replication Pointer-based virtual replication
Source EMC Proven Professional Production Host
Replica Storage Array BC Host
EMC Proven Professional. Copyright 2012 EMC Corporation. All Rights Reserved.
Module 11: Local Replication
14
Full-Volume Mirroring
Attached
Read/Write Not Ready
Source Production Host
Target BC Host
Storage Array
Detached - PIT
Read/Write Read/Write
Source Mirroring ceases Production Host EMC Proven Professional Storage Array
Target BC Host
EMC Proven Professional. Copyright 2012 EMC Corporation. All Rights Reserved.
Module 11: Local Replication
15
Pointer-based Full-Volume Replication
Provides full copy of source data on the target Target device is immediately accessible by the BC host after the
replication session is activated PIT is determined by time of session activation Target device is at least as large as the source device Two modes
Full copy mode After session starts, all the data from source is copied to the target in the background
Copy on First Access (deferred)
EMC Proven Professional
EMC Proven Professional. Copyright 2012 EMC Corporation. All Rights Reserved.
Module 11: Local Replication
16
Copy on First Access: Write to the Source
Write to Source C
A B C C
C Target BC Host
Source Production Host
When a write is issued to the source for the first time after replication
session activation:
Original data at that address is copied to the target Then the new data is updated on the source This ensures that original data at the point-in-time of activation is
EMC Proven Professional
preserved on the target
EMC Proven Professional. Copyright 2012 EMC Corporation. All Rights Reserved.
Module 11: Local Replication
17
Copy on First Access: Write to the Target
Write to Target
A B C
B
B C
B Target Data Warehouse Host
Source Production Host
When a write is issued to the target for the first time after replication
session activation:
The original data is copied from the source to the target Then the new data is updated on the target
EMC Proven Professional
EMC Proven Professional. Copyright 2012 EMC Corporation. All Rights Reserved.
Module 11: Local Replication
18
Copy on First Access: Read from Target
Read request for data A
A B C
A B C
Source Production Host
Target BC Host
When a read is issued to the target for the first time after replication
session activation:
The original data is copied from the source to the target and is made
available to the BC host
EMC Proven Professional
EMC Proven Professional. Copyright 2012 EMC Corporation. All Rights Reserved.
Module 11: Local Replication
19
Pointer-based Virtual Replication
Targets do not hold data, but hold pointers to where the data is
located
At the start of the session the target device holds pointers to data
on source device Target requires a small fraction of the size of the source volumes
Target devices are accessible immediately when the session is
started Uses CoFW principle This method is recommended, if the changes to the source are typically less than 30%
EMC Proven Professional
EMC Proven Professional. Copyright 2012 EMC Corporation. All Rights Reserved.
Module 11: Local Replication
20
Pointer-based Virtual Replication (CoFW): Write to Source
Save Location
Source Target Virtual Device A C Write to Source B C C C
When a write is issued to the source for the first time after replication
session activation:
Original data at that address is copied to save location The pointer in the target is updated to point to this data in the save
location EMC Proven Professional
Finally, the new write is updated on the source
EMC Proven Professional. Copyright 2012 EMC Corporation. All Rights Reserved.
Module 11: Local Replication
21
Pointer-based Virtual Replication (CoFW): Write to Target
A Write to Target Save Location
Source Target Virtual Device A B C A A A
When a write is issued to the target for the first time after replication
session activation:
Original data from the source device is copied to the save location The pointer is updated to the data in save location
Another copy EMC Proven Professional
of the original data is created in the save location before the new write is updated on the save location
EMC Proven Professional. Copyright 2012 EMC Corporation. All Rights Reserved.
Module 11: Local Replication
22
Tracking Changes to Source and Target
Source At PIT Target
0 0
0 0
0 0
0 0
0 0
0 0
0 0
0 0
After PIT
Source Target
1 0
0 0
0 1
1 1
0 0
1 0
0 0
0 1
For resynchronization/restore Logical OR
Resynchronization changes to replica are overwritten
1
0
0
1
EMC Proven Professional
unchanged
changed
Restore changes to source are overwritten
EMC Proven Professional. Copyright 2012 EMC Corporation. All Rights Reserved.
Module 11: Local Replication
23
Restore and Restart Considerations
Source has a failure
Logical corruption or physical failure of source devices
Solution
Restore data from target to source (Logical corruption) Restore would typically be done incrementally Applications can be restarted even before synchronization is complete
-----OR----- Start production on target (Physical failure)
Create a Gold copy of target device before restarting on target Resolve issues with source while continuing operations on target
EMC Proven Professional
After resolving the issue, restore latest data on target to source
EMC Proven Professional. Copyright 2012 EMC Corporation. All Rights Reserved.
Module 11: Local Replication
24
Comparison of Local Replication Technologies
Factor Performance impact on source due to replica Size of target Availability of source for restoration
EMC Proven Professional
Full-Volume Mirroring
Pointer-based FullVolume Replication Full copy mode no impact CoFA mode some impact
Pointerbased Virtual Replication High impact
No impact
At least the same as the source
Not required Only after synchronization and detachment from the source
At least the same as the source
Full copy mode not required CoFA mode required Immediately accessible
Small fraction of the source
Required
Accessibility to target
Immediately accessible
EMC Proven Professional. Copyright 2012 EMC Corporation. All Rights Reserved.
Module 11: Local Replication
25
Network-based Local Replication: Continuous Data Protection Replication occurs at the network layer between the hosts and
storage arrays
Ideal for highly heterogeneous environment
Typically provides the ability to restore data to any previous
point-in-time replicly
RPOs are random and do not need to be defined in advance
Data changes are continuously captured and stored in a separate
location from the production data CDP is implemented by using
Journal volume
CDP appliance
EMC Proven Professional Write splitter
EMC Proven Professional. Copyright 2012 EMC Corporation. All Rights Reserved.
Module 11: Local Replication
26
CDP Local Replication Operation
Host Write Splitter
SAN
CDP Appliance
Storage Array EMC Proven Professional Production Volume Replica CDP Journal
EMC Proven Professional. Copyright 2012 EMC Corporation. All Rights Reserved.
Module 11: Local Replication
27
Module 11: Local Replication
Lesson 3: Local Replication in Virtualized Environment
During this lesson the following topics are covered: Mirroring of a virtual volume Replication of virtual machines
EMC Proven Professional
EMC Proven Professional. Copyright 2012 EMC Corporation. All Rights Reserved.
Module 11: Local Replication
28
Local Replication in Virtualized Environment
Local replication (mirroring) of a virtual volume assigned to a
host
Mirroring is performed by a virtualization appliance
Replication of virtual machines
VM snapshot VM clone
EMC Proven Professional
EMC Proven Professional. Copyright 2012 EMC Corporation. All Rights Reserved.
Module 11: Local Replication
29
Local Replication of Virtual Volume
Data Center
Host
I/Os
Virtualization Appliance
Mirrored Virtual Volume
Storage Pool
SAN
LUN
LUN
EMC Proven Professional
Storage Array Mirror Legs Storage Array
EMC Proven Professional. Copyright 2012 EMC Corporation. All Rights Reserved.
Module 11: Local Replication
30
VM Snapshot
Captures the state and data of a running VM at a specific PIT Uses a separate delta file to record all the changes to the virtual
disk since the snapshot session is activated Restores all settings configured in a guest OS to the PIT
EMC Proven Professional
EMC Proven Professional. Copyright 2012 EMC Corporation. All Rights Reserved.
Module 11: Local Replication
31
VM Clone
An identical copy of an existing VM
Clones are created for different use such as testing Changes made to a clone VM do not affect the parent VM and vice
versa
Clone VM is assigned a separate network identity
Clone has its own separate MAC address
Useful when multiple identical VMs need to deploy
EMC Proven Professional
EMC Proven Professional. Copyright 2012 EMC Corporation. All Rights Reserved.
Module 11: Local Replication
32
Module 11: Local Replication
Concept in Practice
EMC SnapView EMC TimeFinder EMC RecoverPoint
EMC Proven Professional
EMC Proven Professional. Copyright 2012 EMC Corporation. All Rights Reserved.
Module 11: Local Replication
33
EMC SnapView
SnapView Snapshot
Logical view of the production volume Uses CoFW principle
Full image copy
SnapView Clone
Full volume copies that require same disk
Clone
Clone
space as the source Becomes a PIT copy once the clone is fractured from the source
Source LUN
Snap
Snap
EMC Proven Professional
Logical pointin-time view
EMC Proven Professional. Copyright 2012 EMC Corporation. All Rights Reserved.
Module 11: Local Replication
34
EMC TimeFinder
TimeFinder/Snap
Creates space-saving, logical PIT (snapshots) Allows creating multiple snapshots from a single source
TimeFinder/Clone
Creates PIT copy of the source volume Uses pointer-based full-volume replication technology Allows creating multiple clones from a single source device
EMC Proven Professional
EMC Proven Professional. Copyright 2012 EMC Corporation. All Rights Reserved.
Module 11: Local Replication
35
EMC RecoverPoint
Provides continuous data protection and recovery to any PIT Uses splitting technology at server, fabric, or array to mirror a
write to a RecoverPoint appliance Provides automatic RecoverPoint appliance failover Family of product includes
RecoverPoint/CL
RecoverPoint/EX
RecoverPoint/SE
EMC Proven Professional
EMC Proven Professional. Copyright 2012 EMC Corporation. All Rights Reserved.
Module 11: Local Replication
36
Module 11: Summary
Key points covered in this module: Uses of local replicas Consistency in file system and database replication Host-based, storage array-based, and network-based replication Restore and restart considerations Local replication of a virtual volume VM snapshot and VM clone
EMC Proven Professional
EMC Proven Professional. Copyright 2012 EMC Corporation. All Rights Reserved.
Module 11: Local Replication
37
Check Your Knowledge 1
What is an advantage of pointer-based virtual replication?
A. Source device need not be healthy for restore
Save location is not required to activate session C. Less storage space is required for creating replica D. No performance impact on source due to replication
B.
Which is true about pointer-based full-volume replication?
A. Size of the target is a small fraction of the source
Size of the target is at least the same as the source C. Target can be accessed only after synchronization and detachment from source EMC D. Proven Professional Target contains only pointers to save location at all time
B.
EMC Proven Professional. Copyright 2012 EMC Corporation. All Rights Reserved.
Module 11: Local Replication
38
Check Your Knowledge 2
In continuous data protection technology, which factor
determines how far back the recovery points can go?
A. B. C. D.
Amount of space that is configured for the replica Type of write splitter used in replication Amount of space that is configured for the journal Rate of changes happening to the replica
When is the data copied from source to target in CoFA mode of
replication?
source C. A read or write occurs for the first time to a location on the target All writes issued to a location on the target EMC D. Proven Professional
A. A read occurs for the first time from a location on the source B. A read or write occurs for the first time to a location on the
EMC Proven Professional. Copyright 2012 EMC Corporation. All Rights Reserved.
Module 11: Local Replication
39
Check Your Knowledge 3
What occurs to the guest OS configuration when a VM is
reverted from its snapshot?
A. Guest OS configurations are reverted to the PIT of snapshot
creation B. Current guest OS configurations are preserved C. Guest OS configurations are duplicated to a new VM D. Guest OS settings are lost and need manual configuration
EMC Proven Professional
EMC Proven Professional. Copyright 2012 EMC Corporation. All Rights Reserved.
Module 11: Local Replication
40
Exercise: Local Replication
Scenario
Organizations mission critical data is stored on RAID 1 volumes Database application uses 1TB storage Average data that changes in 24 hours is 60 GB
Requirements
Task
Need solution to address logical corruption of database Maximum RPO of 1 hour Solution should support restore request for up to 8 hours old data Minimize the amount of storage used for data protection
Suggest an appropriate local replication solution to meet RPO
requirement with minimum amount of storage EMC Proven Professional Estimate the physical storage required by this solution
EMC Proven Professional. Copyright 2012 EMC Corporation. All Rights Reserved.
Module 11: Local Replication
41