SVC Concept
SVC Concept
June 2015
Study guide
GS41287
Software 7.5
IBM Confidential
© International Business Machines Corporation, 2015
IBM TSS Global Support Skills and Knowledge Enablement
IBM Systems, Department EYGA.
Building 203, Post Office Box 12195,
Research Triangle Park, North Carolina 27709-2195
IBM reserves the right to change specifications or other product information without
notice. This publication could include technical inaccuracies or typographical errors.
References herein to IBM products and services do not imply that IBM intends to make
them available in other countries. IBM provides this publication as is, without warranty of
any kind, either expressed or implied, including the implied warranties of merchantability
or fitness for a particular purpose. Some jurisdictions do not allow disclaimer of
expressed or implied warranties. Therefore, this disclaimer may not apply to you.
Data on competitive products is obtained from publicly obtained information and is
subject to change without notice. Contact the manufacturer for the most recent
information.
Active Memory™, Active PCI, BladeCenter®, Domino®, Etherjet®, the e-business logo,
EasyServ, Enterprise X-Architecture®, FlashSystem®, HelpCenter®, HelpWare, IBM®,
IBM XA-32, IBM XA-64, IntelliStation®, Lotus®, Lotus Notes®, Netfinity®, Netfinity
Manager, Notes®, Power Systems™, Predictive Failure Analysis, RXE Expansion Port,
SecureWay, ServeRAID, ServerProven®, ServicePac®, SmartSuite®, SMP Expansion
Module, SMP Expansion Port, Tivoli®, Wake on LAN, X-Architecture®, XceL4 Server
Accelerator Cache, XIV®, and XpandOnDemand scalability are trademarks or registered
trademarks of International Business Machines Corporation in the United States, other
countries, or both.
Microsoft®, Windows®, Windows NT®, and the Windows logo are trademarks or
registered trademarks of Microsoft Corporation in the United States, other countries, or
both.
Intel®, Intel logo, Intel Inside®, Intel Inside logo, Intel® Centrino®, Intel Centrino logo,
Celeron®, Intel Xeon®, Intel SpeedStep®, Itanium®, and Pentium® are trademarks or
registered trademarks of Intel Corporation or its subsidiaries in the United States, other
countries, or both.
Linux® is a registered trademark of Linus Torvalds in the United States, other countries,
or both.
Adobe®, the Adobe logo, PostScript®, and the PostScript logo are either registered
trademarks or trademarks of Adobe Systems Incorporated in the United States, other
countries, or both.
Other company, product, or service names may be trademarks or service marks of
others.
For more information, go to the IBM copyright and trademark information page.
Preface
SAN Volume Controller concepts
This document may not be copied or sold, either in part or in whole, to non-IBM
personnel.
Release date: June 2015
Course version: 1.0
The information in this publication is current as of the date of the latest revision and is
subject to change at any time without notice.
To provide feedback or receive more information about this course, contact the Global
Support Enablement team by emailing globaled@[Link].
Course template version: January 2015
Prerequisites
Although there are no prerequisite courses for this course, you should have a
fundamental understanding of storage area networks, Ethernet networking and storage
management concepts and problem determination and troubleshooting skills.
Objectives
After completing this course, you will be able to do the following:
1. Identify the key advantages of storage virtualization.
2. Describe block level storage.
3. Identify the IBM storage products that use SVC based software.
4. Define storage virtualization terms including node, system, I/O groups, MDisk,
and volume.
5. Describe the SAN zoning required for implementing a SVC, SVC-based or
Storwize cluster.
6. Identify key differences between striped, sequential, and image mode volumes.
7. Identify the difference between standard and thin provisioned volumes.
8. Define the terms Metro Mirroring and Global Mirroring.
.....
IBM SAN Volume Controller (SVC) is a storage virtualization system that enables a
single point of control for storage resources to help support improved business
application availability and greater resource utilization. The objective is to manage
storage resources quickly, efficiently and in real time, while avoiding increases in
administrative costs.
The SAN Volume Controller software is utilized by other IBM storage solutions, including
the IBM Storwize and FlashSystem products. This course provides an overview of the
software features that are common to the SVC and these solutions.
Storage virtualization
Storage virtualization allows an organization to implement pools of storage across
physically separate disk systems (which might be from different vendors). Storage can
then be deployed from these pools and can be migrated between pools without any
outage of the attached host systems. Storage virtualization provides a single set of tools
for advanced functions, such as instant copy and remote mirroring solutions, which
means that deploying storage can be performed by using a single tool regardless of the
underlying storage hardware.
As illustrated in Figure 1-3, the hosts are connected to the virtualization appliance (SVC,
Storwize, or other solution) to access storage (Volumes or VDisks). Depending upon the
solution, these virtual disks can be composed of internal or external storage systems.
The host does not know what the physical storage is composed of. In this example, the
host connections are via a SAN network. Zoning provides and controls access between
hosts and the appliance Fibre Channel ports. Depending on the appliance, other host
connections may be available (including iSCSI).
The storage pools or back end storage can be provided by an array of IBM and OEM
storage products. These back end devices are configured with LUNs connected to the
virtualization appliance via SAN connections.
Customers control the creation of Vdisks, host connectivity, and copy service functions
through the appliance’s interfaces (GUI or DSCLI). This provides a single point of control.
Nodes
Each SVC hardware unit is called a node. The node provides the virtualization for a set
of volumes, cache, and copy services functions. The SVC nodes are deployed in pairs
and multiple pairs make up a clustered system or system. A system can consist of 1 - 4
SVC node pairs.
Storwize products are composed of control and expansion enclosures. The control
enclosures contain pairs of node canisters. Figure 1-4 shows the front view of the 2145
DH8 SVC; a rear view (showing the node canisters) of a 2076 Storwize V7000 Gen2
control enclosure, and a FlashSystem V9000, as examples of node configurations.
One of the nodes within the system is known as the configuration node. The
configuration node manages the configuration activity for the system. If this node fails,
the system chooses a new node to become the configuration node.
Because the nodes are installed in pairs, each node provides a failover function to its
partner node if a node fails.
I/O groups
Nodes are deployed in pairs to make up a cluster. In the San Volume Controller (SVC)
there are two physical servers. The Storwize V7000 control enclosure uses the two node
canisters. Each pair of nodes is known as an I/O group. Each node can be in only one I/O
group.
I/O traffic for a particular volume (Virtual disks or VDisks) is, at any one time, managed
exclusively by the nodes in a single I/O group. Although a cluster can have eight nodes
within it, the nodes manage I/O in independent pairs. An SVC clustered system can have
up to four I/O groups.
A specific volume is always presented to a host server by a single I/O group of the
system. When a host server performs I/O to one of its volumes, all the I/Os for a specific
volume are directed to one specific I/O group in the system. Data is written to cache in
both nodes for redundancy. Under normal conditions, the I/Os for a specific volume are
always processed by the same node within the I/O group. This node is referred to as the
preferred node for this specific volume.
Each node of an I/O group acts as the preferred node for their own specific subset of the
total number of volumes that the I/O group presents to the host servers. However, each
nodes also acts as failover nodes for their respective partner node within the I/O group.
Each pair of control enclosures in a building block forms an I/O group. In a fixed
configuration, there will be one I/O group, while in a scaled solution of multiple building
blocks, there can be as many as four I/O groups (since up to four building blocks can be
included in a scaled solution). In the scaled solution the control enclosures are
connected through private (internal) SAN switches.
Clustered system
The system or clustered system consists of up to four I/O groups. All configuration,
monitoring, and service tasks are performed at the system level. Configuration settings
are replicated to all nodes in the system. To facilitate these tasks, one or two
management IP addresses are set for the system.
One node is designated as the configuration node and it is the only node that activates
the system IP address. If the configuration node fails, the system chooses a new
configuration node and the new configuration node takes over the system IP addresses.
A process is provided to back up the system configuration data onto disk so that it can be
restored if there is a disaster. This method does not back up application data. Only
system configuration information is backed up.
Stretched systems
A stretched system is an extended high availability (HA) method that enables I/O
operations to continue after the loss of half of the system. A stretched system is also
sometimes referred to as a split system because one-half of the system and I/O group is
usually in a geographically distant location from the other, often 10 kilometers (6.2 miles)
or more. The maximum distance is approximately 300 km (186.4 miles). It depends on
HyperSwap
HyperSwap is a new function that is included in SVC/Storwize software V7.5. HyperSwap
is similar to enhanced stretched cluster, but in this implementation we do not split the I/O
group between sites. Instead, the volumes are created on multiple I/O groups at different
sites. HyperSwap uses technology from Metro and Global Mirroring. Figure 1-8
illustrates a basic HyperSwap configuration.
In this example, we have a system composed of a single I/O groups at two separate
sites. The HyperSwap volumes are created using separate storage pools attached to
SAN zoning
The Fibre Channel ports in a virtualization appliance serve three distinct purposes. The
first purpose of the Fibre Channel port is to provide communication between the nodes in
the cluster. The second function is to provide host access to configured LUNs. The third
function is to connect SAN attached external storage to the cluster. These three distinct
functions need separate zoning to provide efficient operation.
Internode zones
Figure 1-6 shows an example of Internode zones. The internode zones ensure that the
nodes can communicate with each other. The recommendation is to have two SAN
fabrics, for redundancy, with the following configurations:
SAN Fabric A: all odd ports
SAN Fabric B: all even ports
These Internode communication ports should not cross Inter-Switch Links (ISLs).
If more than one I/O group is configured, the additional Fibre Channel ports on that I/O
group should be added to the fabrics. These Internode zones are used for
communication.
Connections between the cluster and its external storage require the best available
bandwidth. For optimal performance and reliability, ensure that paths between cluster
and storage systems do not cross ISLs. If you use ISLs on these paths, make sure that
sufficient bandwidth is available. SAN monitoring is required to identify faulty ISLs.
Each node in an I/O group must have a path to the same set of worldwide port names
(WWPNs) for each storage system.
Host zones
Follow basic zoning recommendations to ensure that each host has at least two network
adapters, that each adapter is on a separate network (or at minimum in a separate zone),
and is connected to both nodes in an I/O group. This setup assures a minimum of four
paths for failover and failback purposes. Zoning should be implemented using WWPNs.
Managed disks
The SVC software based system and its I/O groups view the storage that is presented to
the SAN by the back-end controllers as a number of disks or LUNs, which are known as
managed disks (MDisks). Because the SVC software does not attempt to provide
recovery from physical disk failures within the back-end controllers, an MDisk often is
provisioned from a RAID array. However, the application servers (hosts) do not see the
MDisks. Instead, they see a number of logical disks, which are known as virtual disks or
volumes, which are presented by the groups through the SAN (FC/FCoE) or LAN (iSCSI)
to the servers.
An MDisk is the unit of storage that SVC software based products virtualizes. This unit
could be a logical volume on an external storage array presented to the IBM Storwize
control unit or a RAID array consisting of internal drives. The software allocates these
MDisks into various storage pools.
Quorum disk
A quorum disk is an MDisk that contains a reserved area for use exclusively by the
system. The system uses quorum disks to break a tie when exactly half the nodes in the
system remain after a SAN failure. Quorum functionality is not supported on flash drives
within SVC nodes, but is supported on the flash modules of FlashSystem products.
Three candidate quorum disks exist. However, only one quorum disk is active at any
time.
Storage pools
A storage pool is a collection of MDisks that are grouped together to provide capacity for
volumes. Storage pools were originally called MDisk groups. All MDisks in the pool are
split into extents with the same size. Volumes are then allocated out of the storage pool
and are mapped to a host system.
MDisks can be added to a storage pool at any time to increase the capacity of the
storage pool. MDisks can belong in only one storage pool and only MDisks in
unmanaged mode can be added to the storage pool. When an MDisk is added to the
storage pool, the mode changes from unmanaged to managed and vice versa when you
remove it.
Each MDisk in the storage pool is divided into several extents. The size of the extent is
selected by the administrator at creation time of the storage pool and cannot be changed
later. The size of the extent ranges from 16 MB up to 8 GB.
Volumes
A volume (initially referred to as a Virtual disk or VDisk) is a logical disk that is presented
to a host by the clustered system. In a virtualized environment, the host system has a
volume mapped to it by SVC based cluster. The cluster translates this volume into
several extents, which are allocated across MDisks. The advantage with storage
virtualization is that the host is “decoupled” from the underlying storage, so that the
virtualization appliance can move the extents without impacting the host system.
The host system cannot directly access the underlying MDisks in the same manner as it
can access RAID arrays in a traditional storage environment.
There are three types of volumes:
• Striped: A striped volume is allocated one extent in turn from each MDisk in the
storage pool. This process continues until the space required for the volume has
been satisfied.
• Sequential: In a sequential volume, the extents are allocated one after the other, from
one MDisk to the next MDisk. Figure 1-11 compares the creation of a sequential and
a striped volume.
• Image mode: Image mode volumes are special volumes that have a direct
relationship with one MDisk. They are used to migrate existing data into and out of
the clustered system.
When the image mode volume is created, a direct mapping is made between extents
that are on the MDisk and the extents that are on the volume. The logical block
address (LBA) x on the MDisk is the same as the LBA x on the volume, which
ensures that the data on the MDisk is preserved as it is brought into the clustered
system. Figure 1-12 shows how an image-mode volume is created.
Easy Tier
In today’s storage market, SSDs and flash drives are proving to be attractive alternative
to hard disk drives (HDDs). Because of their low response times, high throughput, and
IOPS-energy-efficient characteristics, SSDs and flash drives have the potential to allow
your storage infrastructure to achieve significant savings in operational costs. However,
the current acquisition cost per GB for SSDs or flash drives is higher than for HDDs. SSD
and flash drives performance depends greatly on workload characteristics; therefore,
they should often be used with HDDs for optimal performance.
It is critical to choose the right mix of drives and the right data placement to achieve
optimal performance at low cost. Maximum value can be derived by placing “hot” data
with high I/O density and low response time requirements on SSDs or flash drives, while
targeting HDDs for “cooler” data that is accessed more sequentially and at lower rates.
Real-time Compression
At a high level, IBM patented Random Access Compression Engine (RACE) component
compresses data that is written into the storage system dynamically. This compression
occurs transparently, so Fibre Channel and iSCSI connected hosts are not aware of the
compression. RACE is an inline compression technology, which means that each host
write is compressed as it passes through the SVC-based software to the disks. This
technology has a clear benefit over other compression technologies that are post-
Encryption
The Storwize V7000 Gen2 provides optional encryption of data at rest functionality,
which protects against the potential exposure of sensitive user data and user metadata
that is stored on discarded, lost, or stolen storage devices. Encryption can only be
enabled and configured on enclosures that support encryption.
Encryption is not supported on the SVC but may be provided by the back-end storage
[Link] following are some key points about the encryption implementation:
• Uses secret keys to encode the data according to well known algorithms.
• Data at rest means the data is encrypted on the end device (drives).
• Compression is performed before encryption. Therefore both compression and
encryption can be utilized on the same data.
• Encryption is performed by the SAS hardware.
• Encryption is performed by the SAS hardware. Therefore, encryption only works on
internal drives.
• Encryption is at the array level. Data should be encrypted at the time of creation, and
it is not possible to change it once it has been created.
• A unique key is used for each array, created at array create time. Creation of multiple
keys is possible.
• There are two types of keys
Master key (one per system) The Master key is created when encryption is
enabled. It is stored on USB devices when encryption is enabled and may be
copied or backed up as necessary
Data encryption key (one per encrypted array)
Additional copies of the keys must be created and stored securely to ensure access to
the system if the USB flash drives become damaged or stolen. You are required to insert
USB flash drives into the canisters to enable encryption and to rekey the system. During
these operations, you are responsible for ensuring the security of the system.
During power on we recommend inserting USB flash drives into the USB ports on two
supported canisters to guard against any unexpected failure of the node, node’s USB
port, or the USB flash drive during power on. Use these general guidelines when
enabling encryption and managing USB flash drives that contain encryption keys.
While the system is enabling encryption, you are prompted to insert the USB flash drives
into the system. The system copies the encryption keys to these drives systematically.
The system generates and copies the encryption keys to all available USB flash drives.
Note: Ensure that each copy of the encryption key is valid before writing any
user data to the system. The system validates any key material on a USB flash
drive when it is inserted into the canister. If the key material is not valid, the
system logs an error. If the USB flash drive is not usable or failed, the system
does not display it as output.
Securely store all copies of the encryption key. As an example, any USB flash drives
which are not left inserted into the system could be locked in a safe. Comparable
precautions should be taken to securely protect any other copies of the encryption key
stored to other forms of storage.
Volume mirroring
The Volume Mirroring feature allows a volume to have two physical copies. Each volume
copy can belong to a different storage pool (MDisk group). Each copy has the same
virtual capacity. When a server writes to a mirrored volume, the cluster writes the data to
both copies. When a server reads from a mirrored volume, the cluster picks one of the
copies to read. If one of the mirrored volume copies is temporarily unavailable; for
example, because the RAID controller that provides the storage pool is unavailable, the
volume remains accessible to servers.
The cluster remembers which areas of the volume are written and resynchronizes these
areas when both copies are available. You can create a volume with one or two copies
and can convert a non-mirrored volume into a mirrored volume by adding a copy. When
a copy is added in this way, the cluster synchronizes the new copy so that it is the same
as the existing volume. Servers can access the volume during this synchronization
process. You can convert a mirrored volume into a non-mirrored volume by deleting one
copy or by splitting one copy to create a new non-mirrored volume.
The volume copy can be any type: image, striped, sequential, and thin provisioned. The
two copies can be of completely different types. Figure 1-15 illustrates the creation of a
volume copy.
Native IP replication
Remote Mirroring over IP communication is now supported on the IBM SVC and
Storwize Family systems by using Ethernet communication links. The SVC IP replication
uses innovative Bridgeworks SANSlide technology to optimize network bandwidth and
utilization. This new function enables the use of a lower-speed and lower-cost
networking infrastructure for data replication. Bridgeworks’ SANSlide technology, which
is integrated into the IBM SVC and Storwize Family Software, uses artificial intelligence
to help optimize network bandwidth utilization and adapt to changing workload and
FlashCopy
FlashCopy is the IBM branded name for Point-in-Time, which is sometimes called Time-
Zero, or T0 copy. This function makes a copy of the blocks on a source volume and can
duplicate them on 1 - 256 target volumes.
FlashCopy works by creating one or two (for incremental operations) bitmaps to track
changes to the data on the source volume. This bitmap is also used to present an image
of the source data at the point that the copy was taken to target hosts while the actual
data is being copied. This capability ensures that copies appear to be instantaneous.
User interfaces
There are three user interfaces available in SVC software. The management GUI is a
tool that helps you to monitor, manage, and configure your system. The Service
Assistant is a GUI interface that allows you to do specific maintenance procedures. The
last interface is the command line interface (CLI) that the customer can use to configure,
monitor and manage their system.
Management GUI
The SVC/Storwize products use a graphical user interface that simplifies storage
management and provide a fast and efficient management tool. The GUI is loosely
based on the IBM System Storage XIV® software and has a similar look and feel. It is
used by both the customer and the service representative to manage and repair issues.
To log in to the system, open a web browser and enter the cluster IP address. The
default user is superuser and the default password is passw0rd (with a zero). Figure 1-
18 shows the GUI interface after login, at V7.4 (note that the GUI for the FlashSystem
products differs slightly from example shown in Figure 1-18).
On the left side are the function icons.
Hovering your mouse over the icon or clicking on an icon opens a-sub menu for that
function. The center of the screen provides a virtual view of the subsystem. Clicking on a
component will provide details about that component.
Clicking the arrow at the bottom right of the system image switches the view between the
front and the rear of the system. The color of the arrow lets you know the status of the
system components.
The bottom part of the window is divided into three status areas to provide information
about your system.
• Health status indicator - The rightmost area of the control panel provides information
or alerts about internal and external connectivity.
If non-critical issues exist for your system nodes, external storage controllers, or
remote partnerships, a new status area opens next to the Health Status widget.
If a critical system connectivity error exists, the Health Status bar turns red and alerts
the system administrator for immediate action.
You can fix the error by clicking Status Alerts to direct you to the Events panel fix
procedures.
• Storage allocation indicator - The leftmost indicator shows information about the
overall physical capacity (the initial amount of storage that was allocated). This
indicator also shows the virtual capacity (thin-provisioned storage). The virtual
volume size is dynamically changed as data grows or shrinks, but you still see a fixed
capacity. Click the indicator to switch between physical and virtual capacity.
From any page in the GUI, you can access the function icons and their sub menus. To
access tasks hover the mouse pointer over the various function icons and choose a page
that you want to display, as shown in Figure 1-19.
These function icons group common configuration and administration objects and
present individual administrative tasks.
Service Assistant
There may be times when the Remote Support Center (RSC) or engineering requests
that you connect directly to a node and use the Service Assistant to perform certain
maintenance procedures.
To access the Service Assistant GUI, start a browser session and enter the configured
service IP address for a specific node canister followed by /service.
As shown in Figure 1-20, we are connected to node1 (we accessed the Service
Assistant using the service IP address of node1). In the Change Node box, on the right
side of the display, the Relationship status for this node is local. The local node is the one
you are connected to. As shown in both the top left of the window and in the body of the
display, node2 has been selected to be worked on.
Clicking on any of the main navigation options, on the left side of the screen, allows you
to perform additional functions on the selected node.
Checkpoint:
Consider the following about the information covered in this section:
Helpful links
...................................
2
.....
The following links provide access to useful information (and, in some cases, more up-to-
date information) about the IBM product name.
Table 2-1 Helpful websites and links
Website Link
IBM SAN Volume Controller w3-
(2145-DH8) GLOSSE 4 Storage [Link]/wikis/home?lang=en-
machine reference page us#!/wiki/W556ec6774532_4635_b60b_582
a859bea11/page/MREF_SVC_2145DH8
SAN Volume Controller (2145) [Link]/support/knowledgec
IBM Knowledge Center page enter/STPVGU/landing/SVC_welcome.html
SAN Volume Controller (2145) www-
Support Portal [Link]/support/entry/portal/product/sy
stem_storage/storage_software/storage_virt
ualization/san_volume_controller_%282145
%29/2145?productContext=218612669
Storwize V7000 Gen2 GLOSSE w3-
4 Storage machine reference [Link]/wikis/home?lang=en-
page us#!/wiki/W556ec6774532_4635_b60b_582
a859bea11/page/MREF_2076%20Storwize
%20V7000Gen2
IBM Storwize V7000 IBM www-
Knowledge Center page [Link]/support/knowledgecenter/ST3F
R7/welcome
Fix Central [Link]/support/fixcentral/
Redbooks [Link]
Techdocs Technical Sales [Link]/support/techdocs/
Library
Talent@IBM [Link]/learning/lms/Saba/Web/Main
Summary
...................................
3
.....
This course enabled you to:
1. Identify the key advantages of storage virtualization.
2. Describe block level storage.
3. Identify the IBM storage products that use SVC based software.
4. Define storage virtualization terms including node, system, I/O groups, MDisk, and
volume.
5. Describe the SAN zoning required for implementing a SVC, SVC-based or
Storwize cluster.
6. Identify key differences between striped, sequential, and image mode volumes.
7. Identify the difference between standard and thin provisioned volumes.
8. Define the terms Metro Mirroring and Global Mirroring.
Assessment
...................................
4
.....
To receive credit for taking this course, you must complete and pass (with a score of 80%
or higher) an exam.
To access this test, take the following steps:
1. Go to the Talent@IBM website.
2. Select the My Learning & Expertise tab and then select the In-Progress
Learning Activities tab
3. Find the assessment for this course and click the Launch button to open the
assessment.
4. Answer all of the test questions. When you are finished, click Submit.