HNAS12.
3 Global-Active Device (GAD)
Integration
HNAS12.3 GAD implementation guide
By Software integration Lab
Hitachi Data System
April, 2015
Version 2
HDS Confidential and Internal Use Only Page 1
Contents
Executive Summary .............................................................................................................................. 3
Introduction ........................................................................................................................................... 4
Test Environment .................................................................................................................................. 6
Lab Configuration.................................................................................................................................. 7
Prerequisites ......................................................................................................................................... 8
Implementation ..................................................................................................................................... 9
Allocate volumes and GAD pairs via HCS ............................................................................................ 9
HNAS Node allocation ................................................................................................................. 9
Primary site configuration........................................................................................................... 10
Secondary site configuration ...................................................................................................... 11
Host group configuration for primary and secondary ................................................................. 13
Pair management Server Setup for primary storage and secondary storage............................. 14
Storage Failover in active-active mode ............................................................................................... 15
Primary storage failed and secondary storage in active mode ................................................... 17
Conclusion .......................................................................................................................................... 19
HDS Confidential and Internal Use Only Page 2
Executive Summary
The objective of this paper is to provide implementation of HNAS 12.3 new features and VSP G1000 Global-Active
Device (GAD) integration using Hitachi HiCommand Suite software (HCS). It describes the benefits of how HNAS
preferred path feature is utilized in the GAD configuration when path failover occurs.
Preferred path is a new feature in HNAS 12.3 where HNAS will set the preferred path automatically to access the VSP
G1000 primary volume. HNAS server will detect whether the system drives presented by a VSP G1000 array are GAS
and are the primary or secondary volumes.
HDS Confidential and Internal Use Only Page 3
Introduction
The VSP G1000 provides the Global-Active Device feature (GAD) that manages the primary/secondary relationship in a
mirror configuration internally, exposing a virtual GAD volume to the host (HNAS). To HNAS, the GAD volume is shown
as normal simplex System Drive. The failover of the mirror relationship is managed internally by the VSP G1000 software
feature and is thus transparent to HNAS.
HNAS 12.3 GAD integration provides the following capabilities
1. Active-Active storage system clustering - simplifying failover operations and eliminating the downtime in case of
storage system failure
2. HNAS preferred path support – HNAS automatically set the primary volumes as preferred path
HDS Confidential and Internal Use Only Page 4
Intended Audience
This document is intended for Storage administrators seeking to utilize the new HNAS v12.3 features in GAD
configuration. The administrator requires the following knowledge
Basic knowledge of Storage Area Networks
Basic operational knowledge of Hitachi Command suite
Basic knowledge of Hitachi NAS Platform
HDS Confidential and Internal Use Only Page 5
Test Environment
Management Software
Hitachi Command suite 8.1.3-00
Hitachi Virtual Storage
VSP G1000 (Primary) Microcode SVP : 80-02-40/03
Microcode DKC : 80-02-40-00/04
HDP – NLSAS PG(5-2) Raid 6(6D+2P)
VSP G1000 (Secondary) Microcode SVP : 80-02-40/03
Microcode DKC : 80-02-40-00/04
HDP – NLSAS PG (5-6) Raid 6(6D+2P)
VSP (Quorum) Microcode DKC: 70-06-21-00/00
Microcode SVP : 70-06-14/00
Hitachi NAS
SMU 300 12.3.3826.02
HNAS 4100 cluster 12.3.3826.03a
Fiber Channel Switches
Brocade switch Model 6510
Storage Port configuration for GAD
HNAS Node Storage HNAS FC Port VSP G1000 Host Port
Node 1 Primary storage Port 1 CL3-B
Node 2 Primary storage Port 1 CL3-B
Node 1 Secondary storage Port 3 CL5-A
Node 2 Secondary storage Port 3 CL5-A
HDS Confidential and Internal Use Only Page 6
Lab Configuration
Public LAN
SMU 300
Domain Controller
PowerEdge
1950
Hitachi Command Suite
[Link]
HNAS 4100 Cluster
Windows Server 2012 Standard
HNAS communication through
Fibre Channel
Brocade Configuration
GAD Configuration
Quorum
VSP (R700)
Figure 1 - Configuration diagram
HDS Confidential and Internal Use Only Page 7
Prerequisites
Hitachi Command Suite (HCS) v8.0.1 or higher. Note: HCS [Link] is used in this test
HDP Pool must be created with at least 4 volumes on the primary as well as secondary storage. The storage
array configuration chosen for use in this exercise is for reference only and should not be used as a basis to
properly size HNAS for performance.
Note: HNAS requires at least 4 volumes in the HDP Pool for minimal configurations..
GAD environment should have the following set ups
■ Configure Remote paths
■ Configure Quorum Disks
■ Configure Pair Management Servers
■ Configure Virtual Storage Machine
HNAS 12.3 or higher is required for preferred path support
HDS Confidential and Internal Use Only Page 8
Implementation
Global-active device allows the user to create and maintain synchronous, remote copies of data volumes on the VSP
G1000. Once a GAD pair has been created, the PVOL and SVOL can accept I/O from the host. The GAD pair volumes
are seen by HNAS as a single volume on a single storage system. HNAS is not writing IO to both the primary and
secondary, instead the array is synchronously moving data from the primary to the secondary and HNAS is not writing IO
to the S-Vol.
The following shows the GAD set up and how HNAS set preferred path when the storage failover occurs
Allocate volumes and GAD pairs via HCS
HNAS nodes allocation
Primary site configuration
Secondary site configuration
Host group configuration for primary and secondary
Pair management Server Setup for primary storage and secondary storage
HNAS Node allocation
Add HNAS nodes to HCS as a Host where OS type is “Others”. Note: HNAS added as “fileservers” is currently
not supported
Figure 2 – Add HNAS as “Other”
During the HNAS host allocation process, make sure to select the allocation type as Global-Active device
HDS Confidential and Internal Use Only Page 9
Figure 3 – HNAS nodes for allocating volume Figure 4 – Volume type setting for GAD
Primary site configuration
Select the primary storage IP Address, virtual storage machine, and volume type. In this test scenario, dynamic
provisioning (HDP) is used as volume type
In the Advanced option, specify the volume criteria and select the designated DP pool for the primary site
Note: The raid level must be the same for both primary and secondary
Figure 5 – P-vols allocation
HDS Confidential and Internal Use Only Page 10
Setup LUN paths for primary storage:
Figure 6 - Configuring LUN paths for primary site
Expand the LUN path options-> Edit LUN paths
Select storage port (CL3-B) and assign to Host Port WWN/Port 1 of HNAS node 1 and HNAS Node 2, see Test
Environment for port details. Note: These ports must be zoned on the switch correctly.
Zone Name HNAS FC Ports VSP G1000 Host Ports
GAD61_4770_CL3B HNAS Node 1 Port 1 Primary site Port ID CL3-B
GAD21_4770_CL3B HNAS Node 2 Port 1 Primary site Port ID CL3-B
Table 1 – HNAS and VSP G1000 zoning for primary
Secondary site configuration
Select IP address of the secondary storage, Virtual storage machine, Volume type and Volume location just like
the primary storage
Select the HD pool created for secondary site
HDS Confidential and Internal Use Only Page 11
Figure 7 – Setting up S-Vols
Expand the LUN path options-> Edit LUN paths
Select storage port (CL5-A) and assign to Host Port WWN/Port 3 of HNAS node 1 and HNAS Node 2, see Test
Environment for port details. Note: These ports must be zoned on the switch correctly.
Zone Name HNAS FC Ports VSP G1000 Host Ports
GAD63_4771_CL5A HNAS Node 1 Port 3 Secondary site Port ID CL5-A
GAD23_4771_CL5A HNAS Node 2 Port 3 Secondary site Port ID CL5-A
Table 2 – HNAS and VSP G1000 zoning for secondary
HDS Confidential and Internal Use Only Page 12
Figure 8- LUN path for secondary
Host group configuration for primary and secondary
In this test scenario, a single local HNAS cluster is used for both primary and secondary therefore, only one host group is
configured on each storage target port. If there is a remote HNAS cluster, the second host group would be needed for
secondary
Select “Shared by All Hosts” and specify a name for host group for the primary storage
Use “Standard” host mode for the host group
There is one host group per storage target port.
HDS Confidential and Internal Use Only Page 13
Figure 9 – set up host group for primary
Use the same steps on figure 9 to set up the host groups for secondary storage
Pair management Server Setup for primary storage and secondary storage
Select the pair management server and assign an Instance ID and a UDP port number. There are restrictions
what values can be used for Instance number and UDP ports, see Pair management user guide for details
Figure 20 – Pair management settings for primary site
Use the steps in figure 10 to configure pair management server for secondary storage.
HDS Confidential and Internal Use Only Page 14
The Task for this configuration will run for several minutes. Task details can be viewed in the task status once
complete. .
Figure 11 – Task details for GAD pairs
Storage Failover in active-active mode
Active–Active storage clustering allows concurrent access of applications running on the HNAS file systems. It also
simplifies failover operations, eliminating the downtime in case of storage failure. Once the GAD pairs are successfully
created, the GAD volumes will be shown in HNAS as below
-----------------------------------------------------------------------------------------
scsil-cl3-1:$ sd-list 1 5 7 16
Device Status Alw GiByte Mirror In span Span Cap
------ ------ --- ------ ------- ---------------------------- --------
1 OK Yes 32 Pri VJ_GAD_POOL 128
5 OK Yes 32 Pri VJ_GAD_POOL 128
7 OK Yes 32 Pri VJ_GAD_POOL 128
16 OK Yes 32 Pri VJ_GAD_POOL 128
-----------------------------------------------------------------------------------------------------
The “sdpath 1” results below show the system drive presented to HNAS is connected to primary storage.
50060E8007278821 is the port WWN of the primary storage
-----------------------------------------------------------------------------------------------------
scsil-cl3-1:$ sdpath 1
Device 1 Preferred host port: None (Current: 1)
Ports: Raid controller Port name
* 03/A/50302788-1 50060E8007278821
03/A/50302788-1 50060E8007278740
The output of the “scsi-devices –d 1” console command confirms HNAS has detected a GAD volume. It also shows
HNAS has automatically set the preferred path to the primary storage in order to optimize I/O flow to the localized VSP
G1000.
HDS Confidential and Internal Use Only Page 15
scsil-cl3-1:$ scsi-devices -d 1
Logical Unit: SD 1
HITACHI OPEN-V Rev 8001 : Model VSP G1000
LUID : [Link][Link]
LUID (external) : [Link]
Device type disk is connected
Device reported status: good
Capacity : 32.00GB (67108864 blocks, block size 512)
Internal LUN : 26F
Info : SAS drives, is a GAD volume
Average Status : OK
Current Status : OK
Last 4 entries from state change log: (use "scsi-dslog -d 1 -a" to view entire log)
2015-04-07 [Link].474 Device failed, all ports are offline
2015-04-07 [Link].416 has become good
2015-04-07 [Link].681 Hport 1 Port 0 media check OK
2015-04-07 [Link].682 opened using Hport 1 Port 0 nexus 0
LUN 3 (Hport 1 SCSI port 0 nexus 0) :
Port Name : [Link]
Port Addrs : 22B00
Status : online
Last Cmd : STD Inquiry : OK (@ 2015-04-07 [Link]-07:00)
Prev cmd returning Bus Reset status: (@ 2015-04-07 [Link]-07:00)
Mode Sense10 returned Check Cond :
unit attn, power on or bus device reset (ASC 29/00)
Device opened using this nexus
Preferred path : yes (controller)
LUN 3 (Hport 3 SCSI port 5 nexus 1) :
Port Name : [Link]
Port Addrs : 51B00
Status : online
Last Cmd : Mode Sense10 : OK (@ 2015-04-07 [Link]-07:00)
Prev cmd returning not GOOD status: (@ 2015-04-07 [Link]-07:00)
VPD Inquiry, page B0h returned Check Cond :
illegal request, invalid field in CDB (ASC 24/00)
(First instance of this status @ 2015-04-07 [Link]-07:00)
Preferred path : no
================== 2015-04-07 [Link]-07:00 ==================
HDS Confidential and Internal Use Only Page 16
Primary storage failed and secondary storage in active mode
Figure 12 shows the primary storage site is down and a failover has occurred. HNAS will detect the preferred path failure
and will automatically redirect to the non-preferred path thus, host applications can still run without disruption by using S-
Vol. The “sdpath 1” outputs below shows the system drive presented to HNAS is connected to secondary storage.
50060E8007278740 is the port WWN of the secondary storage
---------------------------------------------------
scsil-cl3-1:$ sdpath 1
Device 1 Preferred host port: None (Current: 3)
Ports: Raid controller Port name
* 03/A/50302788-1 50060E8007278740
-------------------------------------------
The output of the “scsi-devices –d 1” console command confirms HNAS has detected a GAD volume and it automatically
set the path to the secondary storage.
-------------------------------------------------------------
scsil-cl3-1:$ scsi-devices -d 1
Logical Unit: SD 1
HITACHI OPEN-V Rev 8001 : Model VSP G1000
LUID : [Link][Link]
LUID (external) : [Link]
Device type disk is connected
Capacity : 32.00GB (67108864 blocks, block size 512)
Internal LUN : 26F
Info : SAS drives, is a GAD volume
Average Status : OK
Current Status : OK
Last 4 entries from state change log: (use "scsi-dslog -d 1 -a" to view entire log)
2015-04-07 [Link].664 Hport 1 Port 0 nexus 0 failed : offline
2015-04-07 [Link].685 Hport 3 Port 5 media check OK
2015-04-07 [Link].685 Hport 3 Port 5 nexus 1 selected : recover
2015-04-07 [Link].683 Path validation for slow path I/O complete
LUN 3 (Hport 1 SCSI port 0 nexus 0) :
Port Name : [Link]
Port Addrs : 22B00
Status : offline
Prev cmd returning Bus Reset status: (@ 2015-04-07 [Link]-07:00)
Mode Sense10 returned Check Cond :
unit attn, power on or bus device reset (ASC 29/00)
Preferred path : unknown
LUN 3 (Hport 3 SCSI port 5 nexus 1) :
Port Name : [Link]
Port Addrs : 51B00
Status : online
Last Cmd : STD Inquiry : OK (@ 2015-04-07 [Link]-07:00)
Prev cmd returning Bus Reset status: (@ 2015-04-07 [Link]-07:00)
Mode Sense10 returned Check Cond :
unit attn, power on or bus device reset (ASC 29/00)
Device opened using this nexus
Preferred path : no
================== 2015-04-07 [Link]-07:00 ==================
HDS Confidential and Internal Use Only Page 17
HNAS Node 1 (Active node) HNAS Node 2 (Standby Node)
AdminEVS HNAS Filesystem AdminEVS HNAS Filesystem
Fileserver HNAS 2-node Cluster Fileserver
EVS EVS
Cluster Interconnect
Cifs/nfs Cifs/nfs
shares shares
Port1 Port3 Port1 Port3
Port WWN=5003017000045D651 Port WWN=5003017000045D63 Port WWN=5003017000045C21 Port WWN=5003017000045C23
Preferred path
Non Preferred Path
Preferred path
Non Preferred Path
Storage PortID = CL3-B Storage Port ID=CL5-A
Storage Port WWN= 50060E8007278821 Storage Port WWN=50060E8007278740
Hostgroup Hostgroup
PVOL PVOL PVOL PVOL SVOL SVOL SVOL SVOL
GAD
HDP POOL HDP POOL
Primary storage system Secondary storage system
VSPG1000 VSPG1000
Quorum
VSP(R700)
Figure 12 – Primary storage down, secondary active
HDS Confidential and Internal Use Only Page 18
Conclusion
HNAS 12.3 provides the GAD preferred path feature that will set the primary/secondary path failover automatically. The
users are not required to use the HNAS sdpath command to force HNAS to set the path to storage subsystem.
HDS Confidential and Internal Use Only Page 19
Corporate Headquarters 750 Central Expressway, Santa Clara, California 95050-2627 USA
Contact Information: + 1 408 970 1000 [Link] / info@[Link]
Asia Pacific and Americas 750 Central Expressway, Santa Clara, California 95050-2627 USA
Contact Information: + 1 408 970 1000 [Link] / info@[Link]
Europe Headquarters Sefton Park, Stoke Poges, Buckinghamshire SL2 4HD United Kingdom
Contact Information: + 44 (0) 1753 618000 [Link] / [Link]@[Link]
Hitachi is a registered trademark of Hitachi, Ltd., and/or its affiliates in the United States and other countries. Hitachi Data Systems is a registered
trademark and service mark of Hitachi, Ltd. In the United States and other countries.
Hitachi Data Systems has achieved Microsoft Competency in Advanced Infrastructure Solutions.
All other trademarks, service marks, and company names are properties of their respective owners.
Notice: This document is for informational purposes only, and does not set forth any warranty, express or limited, concerning any equipment or service
offered or to be offered by Hitachi Data Systems. This document describes some capabilities that are conditioned on a maintenance contract with Hitachi
Data Systems being in effect, and that may be configuration-dependent, and features that may not be currently available. Contact your local Hitachi Data
Systems sales office for information on feature and product availability.
Hitachi Data Systems sells and licenses its products subject to certain terms and conditions, including limited warranties. To see a copy of these terms
and conditions prior to purchase or license, please go to [Link] or call your local sales representatives to obtain
a printed copy. If you purchase or license the product, you are deemed to have accepted the terms and conditions.
© Hitachi Data Systems Corporation 2008. All Rights Reserved