Installing and Configuring HCP Anywhere

and Hitachi Data Ingestor

Hitachi Data Ingestor Hardware Components

© Hitachi Vantara Corporation 2018. All rights reserved.

Module Objectives

 Upon completion of this module, you should be able to:

• Identify the hardware and functional components of Hitachi Data Ingestor
(HDI)
• Identify the storage characteristics of the different HDIs
• Describe ports and network configurations
• Identify the local area network (LAN) connections of the different HDI
networks

© Hitachi Vantara Corporation 2018. All rights reserved.

Module Topics

 Details of D51B-2U server

 HDI physical details (single node and cluster) of storage

 Network port layout

 Port names

 Network connections

© Hitachi Vantara Corporation 2018. All rights reserved.

HDI Physical Servers

 HDI platform uses quanta D51B-2U (Nitro) server

 CPUs: 2x Intel Xeon E5 2620-v3 ( 6 Cores/CPU )

 HDI single and HDI cluster uses same server platform (same as used in Hitachi Content
Platform)

© Hitachi Vantara Corporation 2018. All rights reserved.

HDI Physical Specifications

 Internal storage:
• Redundant array of independent disks (RAID) controller: LSI Logic SAS3108
• Front: Only present in single, not in cluster RAID-6 user data (file systems)
 Serial attached SCSI (SAS) 3.5” 1TB or 2TB or 4TB x6 or x12
 Or solid-state drive (SSD) 400GB or 800GB (high performance)
• Rear: present in single and cluster: RAID-1 O.S.
 SAS 2.5” 300GB x2
• Host bus adapter (HBA): present in cluster only
 Emulex LPe12002 x1 (Dual: 8Gb/sec x 2 ports )

© Hitachi Vantara Corporation 2018. All rights reserved.

HDI Physical Specifications

 Network:
• On board network interface controller NIC (Intel X540 ): 10Gb Cooper x2
• LAN Mezzanine (Intel i350): 1Gb Cooper x2
• Baseboard management controller (BMC): 1Gb Cooper x1
• Ethernet card: Different options

© Hitachi Vantara Corporation 2018. All rights reserved.

HDI Single and Cluster Specifications
# Model Server Platform Specifications
1 Single • Server model: D51B-2U
(DAS) • CPU: E5-2620v3 (2.4 GHz, 6Core) x 2
• Memory: 32GB or 64GB
• Storage: Internal HDDs (Max. 40TB usable )
• Footprint: 2U (D51B-2U)
2 Cluster • Server model: D51B-2U
(Storage Set) • CPU: E5-2620v3 (2.4 GHz, 6Core) x 2
• Memory: 32GB or 64GB
• Storage: Hitachi Virtual Storage Platform G200
• Footprint: 2U(D51B-2U) x 2 + 2U(G200) + 1U Switch Ethernet +
Total: 7 Us
3 Cluster • Server model: D51B-2U VSP G200
(Gateway) • CPU: E5-2620v3(2.4 GHz,6Core) x 2
• Memory: 32GB or 64GB +
• Storage: Any Hitachi Storage
• Footprint: 2U (D51B-2U) x 2 + Storage
+ FC switch + 1U Switch +
Ethernet
HDS Storage Array

© Hitachi Vantara Corporation 2018. All rights reserved.

HDI Physical: Storage Details

© Hitachi Vantara Corporation 2018. All rights reserved.

HDI Single: Internal Storage

RAID-1 for OS
HDI standalone has 6 or 12 internal disks 300GB 300GB
on front and 2 internal disks on rear

Data LUN for user file systems

• SAS 3.5” 1TB/2TB/4TB x6 or x12
RAID-6
• Or SSD 400 GB/800GB (high
performance)

© Hitachi Vantara Corporation 2018. All rights reserved.

 D51B-2U Server: Disk Positions
Frontal disk is present only in HDI Standalone.
Front view: It creates a RAID-6 and a virtual disk for file system.

USB port
HDD0 HDD3 HDD6 HDD9

HDD1 HDD4 HDD7 HDD10

HDD2 HDD5 HDD8 HDD11

Rear view:
Rear disks are used
as OS LU
Not used HDD12 (single and cluster)
Network Option
Not used Network Option HDD13

FC HBA Network Option

0 © Hitachi Vantara Corporation 2018. All rights reserved.

 HDI Cluster:
External Storage (Through Fibre Channel)
HDI Cluster: 2.5” drive (2U)
Drive box
RAID-1 for OS Max 24 HDDs
No internal Drive box
disks 300 300 RAID-1 for OS
on front GB GB Drive box 3.5” drive (2U)
300 300 . Max 12 hard disk drives
GB GB . (HDDs)
.
3.5” drive (4U)
Max 60 HDDs

Flash module (FMD)

drive (2U)
Cluster Max 12 FMDs
70
management LU Drive box
GB
Hitachi Virtual
1st File system LU
DKC VSP G400/G600/G800: 4U
Storage Platform
Gx00
HDI (Node1) VSP G200: 2U
2nd File system LU
HDI D51B-2U:2U x 2
Nth File system LU (Node0)

1 © Hitachi Vantara Corporation 2018. All rights reserved.

 HDI Single: Virtual Disk (VD) Configuration

 OS and user data are stored in internal disk drives of the node

 RAID controller configuration is created when the OS is installed

• The software automatically creates RAID-1 with the physical disks on rear,
RAID-6 with the physical disks on front and virtual disks

2 © Hitachi Vantara Corporation 2018. All rights reserved.

 HDI Single: Virtual Disk (VD) Configuration

RAID group configured using 2 HDDs of rear position in RAID-1

System (OS) LU
OS and management LUs
~ 300GB
System (configuration and management) LU

RAID group configured using 6 HDDs in RAID-6 (4D+2P) or 12 HDDs in RAID 6 (10D+2P)

HDD 0 HDD 1 HDD 2 HDD 3 HDD 4 HDD 5

User LU 1x user virtual disk (VD)

administrator specifies the size of the file systems that are Max capacity 38.9TB
created inside the single LU

3 © Hitachi Vantara Corporation 2018. All rights reserved.

 HDI Cluster LDEV Overview

 OS LU provisioned from server-internal rear physical disks (RAID-1)

 Management and user LUs are provisioned from the Hitachi VSP Gx00

 LUs can be basic LDEVs from parity groups or DP-VOL LDEV (V-VOL)
associated to a HDP (Hitachi Dynamic Provisioning) or HDT (Hitachi Dynamic
Tiering) pool

 Cluster management logical device (LDEV) must be 70GB

 Map management LU as LUN ID = 0

 Rest of LDEVs will be used as file system LUs and work space LUs

 Up to 511 user LUs/cluster

4 © Hitachi Vantara Corporation 2018. All rights reserved.
 HDI Cluster LU Overview

No restriction on capacity and number of LUs other than limits imposed by the storage system

CTL1 CTL2

RAID-1 for OS 300 300

GB GB 300 300
RAID-1 for OS
GB GB

fc0002 fc0003 fc0002 fc0003

5 CTL: controller © Hitachi Vantara Corporation 2018. All rights reserved.

 VMware Virtual Appliance (VMA) Configuration

 RAID group configuration and HDD performance is determined by the customer

in the physical server
• OS, system and user data are stored in the provisioned storage of the VMware ESXi
server or Hyper-V
 User data maximum total size in HDI VMA :
• Max size vDisk in VMWare ESX VMFS-5 is 64 TB
 13 vDisks x 64 TB = 806 TB
• Max size vDisk in VMWare ESX VMFS-3 is 2 TB
 13 vDisks x 2 TB = 26 TB
• Hyper-V 126TB
 In the creation of the virtual machine at least 3 vDisks must be created (OS,
systems and user data vDisks )
6 © Hitachi Vantara Corporation 2018. All rights reserved.
 VMware Virtual Appliance (VMA) Configuration

HDD N HDD N HDD N HDD N HDD N HDD N

OS Virtual Disk OS virtual disk

~ 26GB
Virtual disk for migration
Virtual Disk for Migration Control control
~ 36GB

Virtual Disk 0 for User Data – Maximum = 62TB in ESX with VMFS-5 Virtual disks for user data LUs

In VMWare up to 13 disks
maximum 62TB each in VMFS-5
Virtual Disk 12 for User Data – Maximum = 62TB in ESX with VMFS-5 Or
maximum 2TB each in VMFS-3
RAID Group determined by customer

7 © Hitachi Vantara Corporation 2018. All rights reserved.

 HDI Storage Summary

Cluster Function Size

OS LU Holds OS 300GB (RAID-1)
HDI management LU Holds resource group and migration policy 70GB
User LUs Holds the user file systems It depends on VSP Gx00

Single Node Function

OS virtual disk Holds OS 300GB (RAID-1)
System virtual disk Configuration and migration policy Part of previous RAID-1
User virtual disk Holds the user file systems Max 38.9TB (2)

Vmware or Hyper-V Function

OS vDisk Holds OS 26GB
System vDisk Configuration and migration policy 36GB
User vDisk Holds the user file systems 13 vDisks x 62 TB = 806 TB
8 © Hitachi Vantara Corporation 2018. All rights reserved.
 HDI Physical: Network Details

9 © Hitachi Vantara Corporation 2018. All rights reserved.

 D51B-2U Server: Ethernet Port Layout

3x positions for additional Ethernet cards

Rear view
Not used HDD12
PCI-X Slot
Not used PCI-X Slot HDD13

FC HBA (Cluster) PCI-X Slot

LAN mezzanine On board NIC

ports (1GbE) ports (10GbE) BMC USB port
(1GbE)
Intel i350 Intel X540

0 © Hitachi Vantara Corporation 2018. All rights reserved.

 HDI Single: Port Name

 HDI single:
PCI Slot for
1GbE or 10GbE Card
PCI Slot for
10GbE Card

PCI Slot for 1GbE Card

RAID Card Mezzanine
Do not
pm0 mng0 xgbe1 BMC
use

# Name Use
1 pm0 Maintenance port (1GbE)
2 mng0 Management port (10GbE)
3 xgbe1 10GbE data port
4 BMC Baseboard Management Controller (1GbE)

1 © Hitachi Vantara Corporation 2018. All rights reserved.

 HDI Cluster: Port Name

 HDI node part of a cluster:

PCI Slot for
1GbE or 10GbE Card
PCI Slot for
10GbE Card
PCI Slot for
FC HBA PCI Slot for 1GbE Card
RAID Card Mezzanine
pm0 hb0 mng0 pm1 BMC

# Name Use
1 pm0 Maintenance port (1GbE)
2 hba0 Heartbeat port (1GbE)
3 mng0 Management port (10GbE)
4 pm1 Reset port (10GbE)
5 BMC Baseboard Management Controller (1GbE)
2 © Hitachi Vantara Corporation 2018. All rights reserved.
 Additional Ethernet Cards: Possible
Combinations
 HDI does not support mixture of 10GbE (copper) and 10GbE (optical)
# Number of Option cards
Number of ports
1GbE 10GbE (Copper) 10GbE (Optical)

1 0 0 1 2 Prots 10GbE (Optical)

2 0 0 2 4 Ports 10GbE (Optical)
3 0 1 0 2 Prots 10GbE (Copper)
4 0 2 0 4 Ports 10GbE (Copper)
5 1 0 0 4 Ports 1GbE
6 1 0 1 4 Ports 1GbE+2Ports 10GbE (Optical)
7 1 0 2 4 Ports 1GbE+4Ports 10GbE (Optical)
8 1 1 0 4 Ports 1GbE+2Ports 10GbE (Copper)
9 1 2 0 4 Ports 1GbE+4Ports 10GbE (Copper)
10 2 0 0 8 Ports 1GbE
11 2 0 1 8 Ports 1GbE+2Ports 10GbE (Optical)
12 2 1 0 8 Ports 1GbE+2Ports 10GbE (Copper)

3 © Hitachi Vantara Corporation 2018. All rights reserved.

 Port Names (For HDI Single and Cluster)
1GbE card port name:

eth12 eth13 eth14 eth15

fc0002 fc0003 eth8 eth9 eth10 eth11

RAID Card Mezzanine

10GbE card port name:

xgbe8 xgbe9

xgbe4 xgbe5

fc0002 fc0003

RAID Card Mezzanine

4 © Hitachi Vantara Corporation 2018. All rights reserved.

 HDI Single:
Examples of Network Configurations
HDI single – 1GbE (4 ports) x 1

eth8 eth9 eth10 eth11

RAID Card Mezzanine
pm0 mng0 xgbe1 BMC

HDI single – 10GbE (2 ports) x 2

xgbe8 xgbe9

xgbe4 xgbe5

RAID Card Mezzanine

pm0 mng0 xgbe1 BMC

5 © Hitachi Vantara Corporation 2018. All rights reserved.

 HDI Cluster:
Examples of Network Configuration
HDI cluster – 1GbE (4 ports) x 2

eth12 eth13 eth14 eth15

fc0002 fc0003 eth8 eth9 eth10 eth11

RAID Card Mezzanine
pm0 hb0 mng0 pm1 BMC

HDI cluster – 10GbE (2 ports) x 2 + 1GbE (4 ports) x 1

xgbe8 xgbe9

xgbe4 xgbe5

fc0002 fc0003 eth8 eth9 eth10 eth11

RAID Card Mezzanine
pm0 hb0 mng0 pm1 BMC

6 © Hitachi Vantara Corporation 2018. All rights reserved.

 HDI Port Explanation – Pm0 and Hb0 (1GbE)

 pm0
• Maintenance port: Used to connect maintenance PC of a customer engineer
(CE) technician to HDI
• Has only assigned physical IP (no virtual IP)
• Used in HDI single and HDI cluster
• Typically used in below situations:
 In maintenance mode (boot from installation ISO)
 When customer does not allow CE to connect customer’s network
 When both management port and front-end port cannot be used
• Cannot be used for other purposes (file service, HCP connection and so on)

7 © Hitachi Vantara Corporation 2018. All rights reserved.

 HDI Port Explanation – Pm0 and Hb0 (1GbE)

 hb0
• Heartbeat port: Used for heartbeat between nodes in cluster
• Directly connected with nodes in cluster with each other
• Only used in cluster

8 © Hitachi Vantara Corporation 2018. All rights reserved.

 HDI Port Explanation – mng0 (10GbE)

 mng0
• Management port: Used for management of HDI configuration (For this we can use the
physical IP)
 Hitachi File Services Manager (HFSM) GUI connection or direct integrated GUI access
 Secure shell (SSH) login for command line interface (CLI) execution

• Mandatory for every HDI model and configuration (single, VM and cluster)
• Can be used for file services, HCP connection or other all purposes (For this we can
use the virtual IP)
• Differences from front-end ports:
 The only port activated on HDI node during OS upgrade
 No redundancy: Bonding cannot be configured
 No virtual LAN (VLAN)

9 © Hitachi Vantara Corporation 2018. All rights reserved.

 HDI Port Explanation – mng0 (10GbE)

 mng0
• It is important to connect mng0 to a redundant Ethernet switch: 60 seg
without mng0 connection entails a resource group failover in case of HDI
cluster

0 © Hitachi Vantara Corporation 2018. All rights reserved.

 HDI Port Explanation – pm1 (10GbE)

 pm1
• Special port for IP switch-less configuration in HDI cluster
• Only used in cluster
• Connected to BMC port on the other node in the cluster
• IP address is automatically assigned when BMC address is assigned

1 © Hitachi Vantara Corporation 2018. All rights reserved.

 HDI Port Explanation: BMC

 BMC
• BMC port: Used for monitoring the other node in HDI cluster
• Used for following purposes:
 Get the OS status of other node
 Reset the other node when detecting heartbeat down (Issue reset from mng0
(node0) to BMC (node1) or mng0 (node1) to BMC (node0)). Same IP network as
mng0
 Mandatory in cluster
 Power-on from HFSM
 Maintenance operation using kernel-based virtual machine (KVM)

2 © Hitachi Vantara Corporation 2018. All rights reserved.

 HDI Port Explanation: BMC

 ethN:X, xgbeN:X, agrN:X, rdnN:X

• VLAN assigned port
• Not allowed to repeat the same IP network
• Physical IP and virtual IP addresses: Through Virtual IP, the HDI clients can
access the shares or export
• HDI single and cluster

3 © Hitachi Vantara Corporation 2018. All rights reserved.

 HDI Physical: Network Connection for
HDI Standalone and VM

4 © Hitachi Vantara Corporation 2018. All rights reserved.

 HDI Standalone – Connections Diagram

Customer Front-End LAN

engineer HDI Router/Firewall
clients ADS/DNS/
Maintenance PC NTP

xgbe4 xgbe5

pm0 hb0 mng0 pm1 BMC

Administrator
Management LAN

BMC connection
is optional
5 © Hitachi Vantara Corporation 2018. All rights reserved.
 HDI VM – Connections Diagram

Front-End LAN
HDI Router /
Clients Firewall ADS/DNS/
NTP

eth0
HDI-VM
mng0

Management LAN Administrator

6 © Hitachi Vantara Corporation 2018. All rights reserved.

 Module Summary

 In this module, you should have learned to:

• Identify the hardware and functional components of Hitachi Data Ingestor
(HDI)
• Identify the storage characteristics of the different HDIs
• Describe ports and network configurations
• Identify the local area network (LAN) connections of the different HDI
networks

7 © Hitachi Vantara Corporation 2018. All rights reserved.

 Questions and Discussion

8 © Hitachi Vantara Corporation 2018. All rights reserved.

 Module Review

1. In HDI single node and in HDI cluster 2 rear HDDs are used.
(True/False)

2. In HDI single node and in HDI cluster 6 front HDDs are used.
(True/False)

9 © Hitachi Vantara Corporation 2018. All rights reserved.