LTRDCN 3077
LTRDCN 3077
Deploying a
Cisco Data Center
LTRSDN-2611 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 3
Cisco Spark
Questions?
Use Cisco Spark to communicate
with the speaker after the session
How
1. Find this session in the Cisco Live Mobile App
2. Click “Join the Discussion”
3. Install Spark or go directly to the space
4. Enter messages/questions in the space
[Link]/ciscolivebot#LTRDCN-3077
© 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public
Agenda
• Introduction
• Pod Overview
• Hands on Lab
1. Configure VXLAN EVPN
2. Configure UCSM LAN
3. Configure UCSM SAN
4. Configure UCSM Server
5. Configure VXLAN Multi-Pod using NX-API
6. Verify UCS & VXLAN EVPN
7. (Optional) Configure OTV
About the Lab
About the Lab
• Cisco AnyConnect is used to connect to the
lab environment
RDP
• Connect to [Link]
• Username is ciscolive
• Password is C1sc0L1v32017
• Each student has a specific POD for the lab
• PODXY
• X = Pod Number (1-8)
• Y = Student ID (A or B)
FAN
N7K-Spine-A FAN
N7K-Spine-B
STATUS ID STATUS ID
Pod Topology
Cisco Nexus 7004 Cisco Nexus 7004
N7K-SUP2E CONSOLE K N7K-SUP2E CONSOLE K
T T
1
LIN
1
AC LIN AC
1 RE EJE 1 RE EJE
ID S MT CT EST QU C T ID S MT CT EST QU C T
U EM E MG EJEEQU ES T SE U EM E MG EJEEQU ES T SE
AT ST TIV R T RE AT ST TIV R T RE
ST SY AC PW 2
R
ST SY AC PW 2
R
LOG LOG
SLOT0 SLOT0
FLASH FLASH
SERIAL PORT HOST PORTS SERIAL PORT HOST PORTS
MGMT ETH MGMT ETH
2 2
LIN AC LIN AC
1 RE EJE 1 RE EJE
ID S MT CT EST QU C T ID S MT CT EST QU C T
U EM E MG EJEEQU ES T SE U EM E MG EJEEQU ES T SE
AT ST TIV R T RE AT ST TIV R T RE
ST SY AC PW 2
R
ST SY AC PW 2
R
LOG LOG
SLOT0 SLOT0
FLASH FLASH
SERIAL PORT HOST PORTS SERIAL PORT HOST PORTS
MGMT ETH MGMT ETH
ESD N7K-F312FQ-25
ESD N7K-F312FQ-25
3 3
PORT GROUP
1 PORT GROUP
3 PORT GROUP
4 PORT GROUP
6 PORT GROUP
1 PORT GROUP
3 PORT GROUP
4 PORT GROUP
6
1 2 3 4 5 6 7 8 9 10 11 12 1 2 3 4 5 6 7 8 9 10 11 12
STATUS ID STATUS ID
PORT GROUP
2 PORT GROUP
5 PORT GROUP
2 PORT GROUP
5
PORT GROUP
1 PORT GROUP
2 PORT GROUP
3 PORT GROUP
4 PORT GROUP
5 PORT GROUP
1 PORT GROUP
2 PORT GROUP
3 PORT GROUP
4 PORT GROUP
5
4 4
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48
F3 PORT GROUP
6
F3 PORT GROUP
6
N7K-AC-3KW IN OUT FAULT ID N7K-AC-3KW IN OUT FAULT ID N7K-AC-3KW IN OUT FAULT ID N7K-AC-3KW IN OUT FAULT ID N7K-AC-3KW IN OUT FAULT ID N7K-AC-3KW IN OUT FAULT ID N7K-AC-3KW IN OUT FAULT ID N7K-AC-3KW IN OUT FAULT ID
O O I O O O O I O O
I I I I I I
100 -240V ~ 16 A 50 /60 Hz 100 -240V ~ 16 A 50 /60 Hz 100 -240V ~ 16 A 50 /60 Hz 100 -240V ~ 16 A 50 /60 Hz 100 -240V ~ 16 A 50 /60 Hz 100 -240V ~ 16 A 50 /60 Hz 100 -240V ~ 16 A 50 /60 Hz 100 -240V ~ 16 A 50 /60 Hz
N9K-Leaf-A N9K-Leaf-B
Nexus 9300 1/49-50 1/49-50 Nexus 9300
PoX0
1/9-16 1/9-16
ID
STAT
UCS6200-A ID
STAT
UCS6200-B
UCS 6200 UCS 6200 1/17-18
1/17-18
1/1-8 1/1-8
PoX5 PoX6
UCS 5108
Nexus 5500 4 x B240 M2 Nexus 5500
CISCO NEXUS
5548
NUP 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 CISCO NEXUS
5548
NUP 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32
UCS B440 M1/M2
2
A ! 2
A ! 2
A ! 2
A !
G
0 G
0 G
0 G
0
0 AS 0 AS 0 AS 0 AS
N5K-SAN-A N5K-SAN-B
3 B 3 B 3 B 3 B
0 S G
-3 0 S G
-3 0 S G
-3 0 S G
-3
UCS 5108 0 k 0
0 0 k 0
0 0 k 0
0 0 k 0
0
A 0 A 0 A 0 A 0
3 1 3 1 3 1 3 1 3
3
! !
ID ID
SLOT SLOT SLOT SLOT
STAT 1 1 2 2 STAT
!
Console Reset
1/19
2
A
G
0
0
3
S
A B
-0 S G
3 0
0 k 0
A 1
0
3
! 2
A
G
0
0
3
S
A B
-0 S G
3 0
0 k 0
A 1
0
3
! 2
A
G
0
0
3
0
S
A B
-0 S G
3 0
k 0
A 1
0
3
! 2
A
G
0
0
3
0
S
A B
-0 S G
3 0
k 0
A 1
0
3
!
UCS B440 M1/M2
1/19
!
SLOT SLOT
SLOT SLOT
3 1 2 4
!
Console Reset
!
SLOT SLOT SLOT SLOT
5 1 2 6
!
Console Reset
DS-X9708-K9
DS-X9708-K9
DS-X9708-K9
10-Gbps8-port FCoE Module 1 2 3 4 LINK 5 6 7 8
DS-X9708-K9
STATUS
VSAN 901
10-Gbps8-port FCoE Module 1 2 3 4 LINK 5 6 7 8
STATUS
VSAN 902
DS-X9224-96K9 1/2/4/8 Gbps 24-port FC Module
10-Gbps8-port FCoE Module 1 2 3 4 LINK 5 6 7 8
STATUS
LINK 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
STATUS
LINK 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
DS-X9530-SF2-K9
T MGMT
M LINK COM
S EM E G CONSOLE 10/100 DS-X9530-SF2-K9
T
TU ST TIV RM SE 1 USB 1
A
ST SY AC PW R
E
USB 2 T MGMT
ACT M LINK COM
S EM E G CONSOLE 10/100
T
TU ST TIV RM SE 1 USB 1
A
SUPERVISOR2 ST SY AC PW R
E
ACT USB 2
DS-X9530-SF2-K9
SUPERVISOR2
T MGMT
M LINK COM
S EM E G CONSOLE 10/100 DS-X9530-SF2-K9
T
TU ST TIV RM SE 1 USB 1
A
ST SY AC PW R
E
USB 2 T MGMT
ACT M LINK COM
S EM E G CONSOLE 10/100
T
TU ST TIV RM SE 1 USB 1
A
SUPERVISOR2 ST SY AC PW R
E
ACT USB 2
SUPERVISOR2
LTRDCN-3077 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 8
About the Lab
• Web based lab guide
• Make sure you select the right POD from [Link]
the menu
• Stick to using Google Chrome
• Table Toppers have POD and access
information
LTRDCN-3077 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 9
About the Lab
• Web based lab guide
• Make sure you select the right POD from [Link]
the menu
• Stick to using Google Chrome
• Table Toppers have POD and access
information
Pod XY
LTRDCN-3077 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 10
Lab 1
VXLAN EVPN
VXLAN Overview Classic Ethernet Frame
802.1Q
Limitations in Layer-2 Data Centers DMAC SMAC Etype Payload CRC
VLAN ID
12 bits
LTRDCN-3077 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 13
VXLAN Overview
Enter VXLAN... • VXLAN leverages the VXLAN
Network Identifier (VNI/VNID) field
• Uses Layer 3 Data Center Fabric
• Total address space of 24 bits
• No need for Spanning-Tree Protocol
• Support of ~16M segments
• Equal-Cost Multi-Path (ECMP)
• Uses IP/UDP header (MAC in IP/UDP)
• Divided into Underlay and Overlay(s) 802.1Q header removed
802.1Q 802.1Q
Classic Ethernet
DMAC SMAC Etype Payload CRC
VN Frame
I
Original Layer 2 Frame
LTRDCN-3077 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 14
Next-Hop MAC Address
Underlay
0x0800 Header
16 20 Bytes
Checksum
50 (54) Bytes of Overhead
Source IP 32
Outer IP Header Src and Dst
addresses of the
Source 16 Dest. IP 32
VTEPs
Port
UDP Header VXLAN Port 16 Hash of the inner L2/L3/L4 headers of
8 Bytes the original frame.
UDP Length 16 Enables entropy for ECMP Load
VXLAN Header UDP 4789 balancing in the Network.
Checksum 0x0000 16
Overlay
VXLAN Flags
8
RRRRIRRR
Original Layer-2 Frame Allows for 16M
possible
Reserved 24
Segments
8 Bytes
VNI 24
Reserved 8
LTRDCN-3077 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 15
VXLAN EVPN Overview
• Workload MAC and IP Addresses learnt by VXLAN Edge Devices (NVEs)
• Multi-Protocol BGP (MP-BGP) based Control-Plane using EVPN NLRI (Network
Layer Reachability Information)
• Forward based on MAC or IP address learnt via Control-Plane (MP-BGP EVPN)
• Make Forwarding decisions at VTEPs for Layer-2 (MAC) and Layer-3 (IP);
Integrated Route/Bridge (IRB)
• Bridge – L2 VNI
• Route – L3VNI
• Reduce impact of ARP on the Network using ARP Suppression
• Leverage Distributed Anycast Gateway capabilities
• Host/IP Mobility – Location (VTEP), Identifier (MAC, IP of End-Host)
LTRDCN-3077 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 16
VXLAN EVPN Overview – Control Plane
• Cisco’s VXLAN/EVPN does provide
automated Route Distinguisher (RD) VRF Info
VRF Info Name: VRF-A
• Automatic uses Type 1 format Name: VRF-A RD: 15:[Link] (auto)
RD: Imp
3:[Link] (auto) RRRoute-Target
RR 65500:50000 (auto)
• 4-byte IP Address (Router ID) Imp Route-Target 65500:50000 Exp Route-Target 65500:50000 (auto)
VRF Info (auto)
• 4-byte Value (VRF ID) Exp Route-Target 65500:50000
Name: (auto)VRF-A
RD: 62:[Link] (auto)
Imp Route-Target 65500:50000 (auto)
vrf context VRF-A Exp Route-Target 65500:50000 (auto)
vni 50000 V2
rd auto V1
address-family ipv4 unicast
route-target both auto
route-target both auto evpn
address-family ipv6 unicast
route-target both auto RR BGP Route-Reflector
route-target both auto evpn V3 iBGP Peering
LTRDCN-3077 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 17
VXLAN EVPN Overview – Control Plane
BGP Advertisement
• Cisco’s VXLAN/EVPN does provide VPN-EVPN: RD:[MAC_A][IP_A]
BGP Next-Hop: V1
automated Route Target (RT) Route Target: 65500:50000
• 8-byte Route Target (2 x 4-byte) Label (L3VNI): 50000
• ASN : VNI RR RR
Host A
MAC_A /
IP_A
LTRDCN-3077 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 18
VXLAN EVPN – ARP Handling on Lookup “Miss” (1)
RR RR MAC, IP VNI NH
Missing MAC_A, IP_A 30001 IP_V1
MAC, IP “B”VNI NH
MAC_C, IP_C 30001 IP_V3 MAC_C, IP_C 30001 IP_V3
2 MAC_Y, IP_Y 30002 IP_V3
MAC_Y, IP_Y 30002 IP_V3
1 2
MAC, IP VNI NH
MAC_A, IP_A 30001 IP_V1
Host A
MAC_A / IP_A V3 Host B
MAC_B / IP_B
ARP Request for IP_B
Src MAC: MAC_A
Dst MAC: FF:FF:FF:FF:FF:FF
1 ARP Request sent for IP_B sent from Host A
Virtual Switch
4
3
MAC, IP VNI NH
MAC_A, IP_A 30000
30001 V1
IP_V1
MAC_B, IP_B 30001 IP_V2
Host A
MAC_A / IP_A V3 Host B
MAC_B / IP_B
RR RR
MAC, IP VNI NH MAC, IP VNI NH
Underlay
DMAC: hop-by-hop DMAC: MAC_V2
Overlay
SMAC: MAC_A SMAC: MAC_A
Overlay
LTRDCN-3077 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 21
VXLAN EVPN – Packet Forwarding (Routing)
RR RR
MAC, IP VNI NH VRF MAC, IP VNI NH VRF
MAC_A, IP_A 30001 Local 50001 MAC_A, IP_A 30001 Local 50001
MAC_F, IP_F 30005 IP_V2 50001 MAC_F, IP_F 30005 E1/4 50001
SMAC: MAC_A SMAC: MAC_GW
DMAC: MAC_GW DMAC: MAC_F
SIP: IP_A V1 V2 SIP: IP_A
DIP: IP_F DIP: IP_F
1
2 3 4
SMAC: MAC_V1 SMAC: hop-by-hop
Underlay
DMAC: hop-by-hop DMAC: MAC_V2
Overlay
SMAC: MAC_A SMAC: MAC_GW
Overlay
LTRDCN-3077 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 22
Lab 1 Modules
1. Configure MP-BGP EVPN on the Spines
2. Configure MP-iBGP EVPN on the VTEPs
3. Configure VLAN to VXLAN VNI Mapping on the VTEPs
4. Configure NVE Tunnel Endpoint Interface on the VTEPs
5. Configure VXLAN Bridging on the VTEPs
6. Configure VXLAN Routing on the VTEPs
7. Verify VXLAN Configuration
LTRDCN-3077 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 23
Lab 2
UCSM LAN
UCSM
LTRDCN-3077 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 25
UCSM Service Profile Flow
UCS Manager Service Profile High Level Flow
Create Server
Pool “PODXY”
Create Network
Control Policy
Create Boot
Policy “PODXY”
Create FI-A
MAC Address Pool Create FI-A
Create FI-B vNIC Template
MAC Address Pool Create FI-B
vNIC Template
Create Service Profile
Create VLANs
PODXY-1 from Template
Create Create Service Profile
WWNN Pool Template “PODXY”
Create FI-A Create Service Profile
WWPN Pool PODXY-2 from Template
Create FI-A
Create FI-B vHBA Template
WWPN Pool
Create FI-B
vHBA Template
Create VSANs
Create UUID
Pool
Create
Maintenance Lab 3 Lab 4 Lab 5
Policy
LTRDCN-3077 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 26
UCSM LAN
N9K-Leaf-A N9K-Leaf-B
Nexus 9300 Nexus 9300
STAT
UCS6200-A ID
STAT
UCS6200-B Fabric Ports vPC
UCS 6200 UCS 6200
A 1/9-12 X1 A 1/13-16 X3
UCS 5108
B 1/9-12 X2 2
A
G
0
0 A
3
S
B
! 2
A
G
0
0 A
3
S
B
4 x B240 M2
! 2
A
G
0
0 A
3
S
B
! 2
A
G
0
0 A
3
S
B
!
UCS B440 M1/M2
B 1/13-16 X4
-0 S G -0 S G -0 S G -0 S G
3 k0 0 3 k0 0 3 k0 0 3 k0 0
UCS 5108 0
A 1 03
0
A 1 03
0
A 1 03
0
A 1 03
! !
SLOT SLOT SLOT SLOT
1 1 2 2
!
Console Reset
SLOT SLOT
SLOT SLOT
3 1 2 4
!
Console Reset
!
SLOT SLOT SLOT SLOT
5 1 2 6
!
Console Reset
VLANs
11-12,21-22
LTRDCN-3077 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 27
UCSM LAN
N9K-Leaf-A N9K-Leaf-B
MAC Pool First MAC Address
Nexus 9300 MACNexus
Pool9300 First MAC Address
PODXA-A-MAC-POOL 00:25:B5:0X:AA:00 PODXB-A-MAC-POOL 00:25:B5:0X:BA:00
PODXA-B-MAC-POOL 00:25:B5:0X:AB:00 PODXB-B-MAC-POOL 00:25:B5:0X:BB:00
vPC X1 vPC X3 vPC X2 vPC X4
CISCO UCS
6248UP 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 CISCO UCS
6248UP 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32
ID
STAT
UCS6200-A ID
STAT
UCS6200-B
UCS 6200 UCS 6200
UCS 5108
4 x B240 M2
UCS B440 M1/M2
2
A ! 2
A ! 2
A ! 2
A !
G
0 G
0 G
0 G
0
0 S 0 S 0 S 0 S
3 A B 3 A B 3 A B 3 A B
-0 S G -0 S G -0 S G -0 S G
3 k 0 3 k 0 3 k 0 3 k 0
UCS 5108 0 0
A 1 0
3
0 0
A 1 0
3
0 0
A 1 0
3
0 0
A 1 0
3
! !
SLOT SLOT SLOT SLOT
1 1 2 2
!
Console Reset
SLOT SLOT
SLOT SLOT
3 1 2 4
!
Console Reset
!
SLOT SLOT SLOT SLOT
5 1 2 6
!
Console Reset
LTRDCN-3077 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 28
Lab 2 Modules
1. Configure Named VLANs
2. Configure Ethernet Uplink Port-Channels
3. Create MAC Address Pools
4. Create vNIC Templates
LTRDCN-3077 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 29
Lab 3
UCSM SAN
UCSM Service Profile Flow
UCS Manager Service Profile High Level Flow
Create Server
Pool “PODXY”
Create Network
Control Policy
Create Boot
Policy “PODXY”
Create FI-A
MAC Address Pool Create FI-A
Create FI-B vNIC Template
MAC Address Pool Create FI-B
vNIC Template
Create Service Profile
Create VLANs
PODXY-1 from Template
Create Create Service Profile
WWNN Pool Template “PODXY”
Create FI-A Create Service Profile
WWPN Pool PODXY-2 from Template
Create FI-A
Create FI-B vHBA Template
WWPN Pool
Create FI-B
vHBA Template
Create VSANs
Create UUID
Pool
Create
Maintenance Lab 3 Lab 4 Lab 5
Policy
LTRDCN-3077 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 31
SAN Concepts
Legend
VNP_PORT
VF_PORT
zone name PODXA-SP-1 vsan 902
zone name PODXA-SP-1 vsan 901 VE_PORT member pwwn
member pwwn
50:0a:09:81:8a:72:87:8D FCoE 50:0a:09:82:8a:72:87:8D
member pwwn FC member pwwn
20:0X:00:25:B5:0A:0A:00 20:0X:00:25:B5:0B:0A:00
zone name PODXA-SP-2 vsan 901 zone name PODXA-SP-2 vsan 902
member pwwn member pwwn
50:0a:09:81:8a:72:87:8D 50:0a:09:82:8a:72:87:8D
member pwwn No FC Domain ID member pwwn
20:0X:00:25:B5:0A:0A:01 20:0X:00:25:B5:0B:0A:01
zoneset name PODX-A vsan 901 zoneset name PODX-B vsan 902
member PODXA-A-SP-1 CISCO UCS
6248UP 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 CISCO UCS
6248UP 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32
member PODXA-B-SP-1
member PODXA-A-SP-2 ID NPV UCS6200-A ID
NPV UCS6200-B member PODXA-B-SP-2
STAT STAT
WWPN-A WWPN-B
2
A ! 2
A ! 2
A ! 2
A !
G
0 G
0 G
0 G
0
0 AS 0 AS 0 AS 0 AS
WWNN
!
Console Reset
SLOT SLOT
SLOT SLOT
1 2
WWPN-A WWPN-B
3 4
!
Console Reset
WWNN
B
-0 S G B
-0 S G B
-0 S G B
-0 S G
3 0
0 k 0
0 3 0
0 k 0
0 3 0
0 k 0
0 3 0
0 k 0
0
A 1 3 A 1 3 A 1 3 A 1 3
!
SLOT SLOT SLOT SLOT
5 1 2 6
!
Console Reset
WWPN-A WWPN-B
3 0
0 k 0
0 3 0
0 k 0
0 3 0
0 k 0
0 3 0
0 k 0
0
A 1 3 A 1 3 A 1 3 A 1 3
Eth1/28
SLOT SLOT SLOT SLOT
Eth1/28
7 1 2 8
!
Console Reset
WWNN
DS-X9708-K9
DS-X9708-K9
DS-X9708-K9
10-Gbps8-port FCoE Module 1 2 3 4 LINK 5 6 7 8
DS-X9708-K9
STATUS
VSAN 902
DS-X9224-96K9 1/2/4/8 Gbps 24-port FC Module
NPIV
10-Gbps8-port FCoE Module 1 2 3 4 LINK 5 6 7 8
STATUS
LINK 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
STATUS
LINK 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
WWPN-A WWPN-B
DS-X9530-SF2-K9
T MGMT
M LINK COM
S EM E G CONSOLE 10/100 DS-X9530-SF2-K9
T
TU ST TIV RM SE 1 USB 1
A
ST SY AC PW R
E
USB 2 T MGMT
ACT M LINK COM
S EM E G CONSOLE 10/100
T
TU ST TIV RM SE 1 USB 1
A
SUPERVISOR2 ST SY AC PW R
E
ACT USB 2
DS-X9530-SF2-K9
SUPERVISOR2
T MGMT
M LINK COM
S EM E G CONSOLE 10/100 DS-X9530-SF2-K9
T
TU ST TIV RM SE 1 USB 1
A
ST SY AC PW R
E
USB 2 T MGMT
ACT M LINK COM
S EM E G CONSOLE 10/100
T
TU ST TIV RM SE 1 USB 1
A
SUPERVISOR2 ST SY AC PW R
E
ACT USB 2
SUPERVISOR2
LTRDCN-3077 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 32
UCSM SAN
ID
STAT
UCS6200-A ID
STAT
UCS6200-B
UCS 6200 UCS 6200
UCS 5108
Nexus 5500 4 x B240 M2 Nexus 5500
CISCO NEXUS
5548
NUP 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 CISCO NEXUS
5548
NUP 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32
UCS B440 M1/M2
2
A ! 2
A ! 2
A ! 2
A !
WWPN-B
G G G G
WWPN-A
0
0 S 0
0 S 0
0 S 0
0 S
N5K-SAN-A
A A A A
N5K-SAN-B
3 B 3 B 3 B 3 B
-0 S G
3 -0 S G
3 -0 S G
3 -0 S G
3
k 0
0 k 0
0 k 0
0 k 0
0
UCS 5108 0 0 0 0 0 0 0 0
3 A 1 3 A 1 3 A 1 3 A 1 3
3
! !
ID ID
SLOT SLOT SLOT SLOT
STAT 1 1 2 2 STAT
!
Console Reset
SLOT
SLOT
2
A
G
0
0 S
3
3
0
A B
-0 S G
k 0
0
A 1
0
3
! 2
A
G
0
0 S
3 A B
-0 S G
3
0 k 0
0
A 1
0
3
WWNN
! 2
A
G
0
0 S
3 A B
-0 S G
3
0 k 0
0
A 1
0
3
! 2
A
G
0
0 S
3 A B
-0 S G
3
0 k 0
0
A 1
0
3
!
UCS B440 M1/M2
SLOT
!
SLOT
3 1 2 4
WWPN-A WWPN-B
!
Console Reset
WWNN
!
SLOT SLOT SLOT SLOT
5 1 2 6
!
Console Reset
SLOT SLOT
1
WWPN-A WWPN-B SLOT
2
!
SLOT
8
Eth1/28
7
!
Console Reset
Eth1/28
WWNN
DS-X9708-K9
DS-X9708-K9
DS-X9708-K9
10-Gbps8-port FCoE Module 1 2 3 4 LINK 5 6 7 8
DS-X9708-K9
STATUS
VSAN 901
10-Gbps8-port FCoE Module 1 2 3 4 LINK 5 6 7 8
STATUS
VSAN 902
DS-X9224-96K9 1/2/4/8 Gbps 24-port FC Module
10-Gbps8-port FCoE Module 1 2 3 4 LINK 5 6 7 8
STATUS
LINK 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
STATUS
LINK 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24
DS-X9530-SF2-K9
WWPN-A
T MGMT
WWPN-B
M LINK COM
S EM E G CONSOLE 10/100 DS-X9530-SF2-K9
T
TU ST TIV RM SE 1 USB 1
A
ST SY AC PW R
E
USB 2 T MGMT
ACT M LINK COM
S EM E G CONSOLE 10/100
T
TU ST TIV RM SE 1 USB 1
A
SUPERVISOR2 ST SY AC PW R
E
ACT USB 2
DS-X9530-SF2-K9
SUPERVISOR2
T MGMT
M LINK COM
S EM E G CONSOLE 10/100 DS-X9530-SF2-K9
T
TU ST TIV RM SE 1 USB 1
A
ST SY AC PW R
E
USB 2 T MGMT
ACT M LINK COM
S EM E G CONSOLE 10/100
T
TU ST TIV RM SE 1 USB 1
A
SUPERVISOR2 ST SY AC PW R
E
ACT USB 2
SUPERVISOR2
LTRDCN-3077 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 33
UCSM SAN
Student Name: Assignment Order First WWNN: Size:
A PODXA-WWNN-POOL Default 20:0X:00:25:B5:00:0A:00 4
WWNN Pools
Student Name: Assignment Order First WWNN: Size:
B PODXB-WWNN-POOL Default 20:0X:00:25:B5:00:0B:00 4
LTRDCN-3077 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 34
UCSM SAN
CISCO UCS
6248UP 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 CISCO UCS
6248UP 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32
ID
STAT
UCS6200-A ID
STAT
UCS6200-B
UCS 6200 UCS 6200
UCS 5108
4 x B240 M2
UCS B440 M1/M2
2
A ! 2
A ! 2
A ! 2
A !
WWPN-B
G G G G
WWPN-A
0
0 S 0
0 S 0
0 S 0
0 S
3 A B 3 A B 3 A B 3 A B
-0 S G
3 -0 S G
3 -0 S G
3 -0 S G
3
k 0
0 k 0
0 k 0
0 k 0
0
UCS 5108 0 0
A 1 3
0 0
A 1 3
0 0
A 1 3
0 0
A 1 3
! !
SLOT SLOT SLOT SLOT
1 1 2 2
!
Console Reset
SLOT
SLOT
2
A
G
0
0 A
3
-0
S
S B
3 k G
0
A 0
0
0
1 3
! 2
A
G
0
0 A
3
-0
0
S
S B
3 k G
A 0
0
0
1 3
WWNN
! 2
A
G
0
0 A
3
-0
S
S B
3 k G
0
A 0
0
0
1 3
! 2
A
G
0
0 A
3
-0
0
S
S B
3 k G
A 0
0
0
1 3
!
UCS B440 M1/M2
SLOT
!
SLOT
3 1 2 4
WWPN-A WWPN-B
!
Console Reset
WWNN
!
SLOT SLOT SLOT SLOT
5 1 2 6
!
Console Reset
SLOT
7
SLOT
1
WWPN-A WWPN-B !
SLOT
2
!
SLOT
8
Console Reset
OK FAIL
WWPN-A WWPN-B
WWNN
LTRDCN-3077 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 35
Lab 3 Modules
1. Configure UCS 6200 Fabric Interconnect VSANs
2. Configure FCoE Port-Channels
3. Create SAN Pools
4. Create vHBA Templates
LTRDCN-3077 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 36
Lab 4
UCSM Server
UCSM Service Profile Flow
UCS Manager Service Profile High Level Flow
Create Server
Pool “PODXY”
Create Network
Control Policy
Create Boot
Policy “PODXY”
Create FI-A
MAC Address Pool Create FI-A
Create FI-B vNIC Template
MAC Address Pool Create FI-B
vNIC Template
Create Service Profile
Create VLANs
PODXY-1 from Template
Create Create Service Profile
WWNN Pool Template “PODXY”
Create FI-A Create Service Profile
WWPN Pool PODXY-2 from Template
Create FI-A
Create FI-B vHBA Template
WWPN Pool
Create FI-B
vHBA Template
Create VSANs
Create UUID
Pool
Create
Maintenance Lab 3 Lab 4 Lab 5
Policy
LTRDCN-3077 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 38
UCSM Service Profiles
IPv4 Address block for KVM/CIMC
LTRDCN-3077 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 39
UCSM Service Profiles
SAN Boot Policy
LTRDCN-3077 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 40
UCSM Service Profiles
UUID Pool Policy
LTRDCN-3077 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 41
UCSM Service Profiles
Server Pool Policy
LTRDCN-3077 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 42
UCSM Service Profiles
Service Profile Template
LTRDCN-3077 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 43
UCSM Service Profiles
Service Profiles from Template
LTRDCN-3077 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 44
Lab 4 Modules
1. Configure an IP Pool for External Blade Management
2. Configure Primary and Secondary Server SAN Boot Policy
3. Create a UUID Suffix Pool
4. Create a Server Pool
5. Create a Service Profile Template
6. Create Service Profiles from a Service Profile Template
LTRDCN-3077 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 45
Lab 5
VXLAN Multi-Pod using NX-API
VXLAN Multi-Pod Overview
LTRDCN-3077 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 47
VXLAN Multi-Pod using NX-API
LTRDCN-3077 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 48
Lab 5 Modules
1. Configure VXLAN Multi-Pod using NX-API
2. Verify VXLAN Multi-Pod
LTRDCN-3077 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 49
Lab 6
Verify UCS and VXLAN EVPN
Verify Blade Servers
LTRDCN-3077 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 51
Verify VXLAN Bridging & Routing
LTRDCN-3077 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 52
Summary
Summary
• A CLOS Fabric (Spine/Leaf Architecture) was configured for VXLAN EVPN to
extend Layer 2 domains
• VLANs were mapped to VXLAN VNIs
• VXLAN Bridging and Routing were configured
• All the logical components were built for compute services using the UCS B-
Series; UCS 5108, UCS 6200 Fabric Interconnects, and Blade Servers
• Servers were built with Service Profiles created within the UCSM GUI
• Server Blades SAN booted over multi-hop FCoE
LTRDCN-3077 © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 54
• Please complete your Online Complete Your Online
Session Evaluations after each Session Evaluation
session
• Complete 4 Session Evaluations
& the Overall Conference
Evaluation (available from
Thursday) to receive your Cisco
Live T-shirt
• All surveys can be completed via
the Cisco Live Mobile App or the
Communication Stations
Don’t forget: Cisco Live sessions will be
available for viewing on-demand after the
event at [Link]/Online.
© 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public
Continue Your Education
• Demos in the Cisco campus
• Walk-in Self-Paced Labs
• Lunch & Learn
• Meet the Engineer 1:1 meetings
• Related sessions
Presentation ID © 2018 Cisco and/or its affiliates. All rights reserved. Cisco Public 56
Thank you