Basic Multicast Debugging
Basic Multicast Debugging
Module 4
Module4. ppt
8/10/2001 1:55 PM
[Link]
Module Objectives
Introduction to IOS Command Line Interface (CLI) tools Understand usage and key information fields for IOS CLI tools in troubleshooting and monitoring the router and network Develop a Strategy for debugging multicast networks
Module4. ppt
8/10/2001 1:55 PM
[Link]
Module Agenda
Module4. ppt
8/10/2001 1:55 PM
[Link]
Module4. ppt
8/10/2001 1:55 PM
[Link]
R4#show ip igmp group R4#show ip igmp group IGMP Connected Group Membership IGMP Connected Group Membership Group Address Interface Group Address Interface [Link] Ethernet1 [Link] Ethernet1 [Link] Ethernet0 [Link] Ethernet0
Expires Expires Last RR eporter Last eporter 00:01:59 172.16 .7.2 00:01:59 172.16 .7.2 never 172.16 .6.2 never 172.16 .6.2
Module4. ppt
8/10/2001 1:55 PM
Uptime - shows how long there has been membership for the listed group on that interface Expires - shows when membership interest will end - IGMP reports from client members of this group are what keep this timer from expiring - you should see this value reset and not timeout as long as there are members present. When this timer expires - the multicast routing protocol is notified to stop delivery of that group onto this interface Only the last IGMP reporter is listed - this is due to report suppression
[Link]
Module4. ppt
8/10/2001 1:55 PM
This is the command to verify IGMP and CGMP are enabled or disabled on the interface IGMP version can be verified with this command - this is important if you have a mixed environment of multicast routing protocols running or other routers that support different versions of IGMP - some IGMP configuration may be required IGMP timers can be verified here for tuning purposes The multicast designated router (DR) and IGMP querier for this link can also be determined with this command
[Link]
R6#show ip pim neighbor R6#show ip pim neighbor PIM Neighbor Table PIM Neighbor Table Neighbor Address Interface Neighbor Address Interface [Link] Serial0 [Link] Serial0 [Link] Serial1 [Link] Serial1 [Link] Ethernet0 [Link] Ethernet0
Module4. ppt
8/10/2001 1:55 PM
Uptime - indicates how long the neighbor adjacency has existed Expires - indicates when the adjacency will timeout and be removed PIM hellos maintain this adjacency Mode - indicates what mode the interface is running in
[Link]
R6#show ip pim interface R6#show ip pim interface Address Interface Address Interface [Link] [Link] [Link] [Link] [Link] [Link] Serial0 Serial0 Serial1 Serial1 Ethernet0 Ethernet0
Nbr DR Nbr Query Query DR Count Intvl Count Intvl 11 30 0. 0.0.0 30 0. 0.0.0 11 30 0. 0.0.0 30 0. 0.0.0 11 30 17 [Link] 30 17 [Link]
Module4. ppt
8/10/2001 1:55 PM
Nbr Count = number of neighbors on this link DR = [Link] in this example because p2p links do not have DRs
[Link]
show ip rpf
R4#show ip rpf [Link] R4#show ip rpf [Link] RPF information for R1 ([Link]) RPF information for R1 ([Link]) RPF interface: Ethernet0 RPF interface: Ethernet0 RPF neighbor: R3 ([Link]) RPF neighbor: R3 ([Link]) RPF route/mask: [Link]/[Link] RPF route/mask: [Link]/[Link] RPF type: unicast RPF type: unicast R4#sh ip rpf [Link] R4#sh ip rpf [Link] RPF information for Source1 ([Link]) RPF information for Source1 ([Link]) RPF interface: Ethernet0 RPF interface: Ethernet0 RPF neighbor: R6 ([Link]) RPF neighbor: R6 ([Link]) RPF route/mask: [Link]/[Link] RPF route/mask: [Link]/[Link] RPF type: unicast RPF type: unicast
Module4. ppt
8/10/2001 1:55 PM
Top example is obtaining RPF information for the RP (on R1) The RPF interface is the interface used to reach the target address (The RP itself in this example) Also shown is the RPF neighbor on the RPF interface and the route and mask used to reach the target address The second example is the RPF information for the source of the multicast group
[Link]
show ip route
R4#show ip route R4#show ip route Gateway of last resort is not set Gateway of last resort is not set DD DD DD DD CC DD DD DD [Link]/24 is subnetted ,, 77 subnets [Link]/24 is subnetted subnets [Link] [90/2354611] via [Link], 4d15h, Ethernet0 [Link] [90/2354611] via [Link], 4d15h, Ethernet0 [Link] [90/2354611] via [Link], 4d15h, Ethernet0 [Link] [90/2354611] via [Link], 4d15h, Ethernet0 [Link] [90/2221056] via [Link], 4d15h, Ethernet0 [Link] [90/2221056] via [Link], 4d15h, Ethernet0 [Link] [90/2221056] via [Link], 4d15h, Ethernet0 [Link] [90/2221056] via [Link], 4d15h, Ethernet0 [Link] [90/2281542] via [Link], 4d15h, Ethernet0 [Link] [90/2281542] via [Link], 4d15h, Ethernet0 [Link] [90/2281542] via [Link], 4d15h, Ethernet 00 [Link] [90/2281542] via [Link], 4d15h, Ethernet [Link] [90/2221056] via [Link], 4d15h, Ethernet0 [Link] [90/2221056] via [Link], 4d15h, Ethernet0 [Link]/24 is subnetted, 11 subnets [Link]/24 is subnetted, subnets [Link] [90/2349056] via [Link], 3d15h, Ethernet 00 [Link] [90/2349056] via [Link], 3d15h, Ethernet
Module4. ppt
8/10/2001 1:55 PM
10 10
This slide for reference only for following slides - this table taken from R4 Recall that multicast forwarding decisions are made based on the unicast routing table - make sure you understand the UNICAST topology and stability before looking at MULTICAST issues
[Link]
10
R6#show ip mroute summary R6#show ip mroute summary IP Multicast Routing Table IP Multicast Routing Table Flags: DD -- Dense, SS -- Sparse, CC -- Connected, LL -- Local, PP -- Pruned Flags: Dense, Sparse, Connected, Local, Pruned RR -- RP-bit set, FF -- Register flag, TT -- SPT-bit set, JJ -- Join SPT RP-bit set, Register flag, SPT-bit set, Join SPT Timers: Uptime/Expires Timers: Uptime/Expires Interface state: Interface, Next-Hop, State/Mode Interface state: Interface, Next-Hop, State/Mode (*, [Link]), 00:01:47/00:02:55, RP [Link], flags: DD (*, [Link]), 00:01:47/00:02:55, RP [Link], flags: ([Link]/32, [Link]), 00:01:47/00:02:54, flags: CT ([Link]/32, [Link]), 00:01:47/00:02:54, flags: CT (*, [Link]), 3d16h/00:00:00, RP [Link], flags: DCL (*, [Link]), 3d16h/00:00:00, RP [Link], flags: DCL
Module4. ppt
8/10/2001 1:55 PM
11 11
[Link]
11
show ip mroute
barrnet -gw>show ip mroute barrnet -gw>show ip mroute IP Multicast Routing Table IP Multicast Routing Table Flags: DD -- Dense, SS -- Sparse, CC -- Connected, LL -- Local, PP -- Pruned Flags: Dense, Sparse, Connected, Local, Pruned RR -- RP-bit set, FF -- Register flag, TT -- SPT-bit set, JJ -- Join SPT RP-bit set, Register flag, SPT-bit set, Join SPT Timers: Uptime/Expires Timers: Uptime/Expires Interface state: Interface, Next-Hop, State/Mode Interface state: Interface, Next-Hop, State/Mode (*, [Link]), 00:18:53/00:02:59, RP [Link], flags: DD (*, [Link]), 00:18:53/00:02:59, RP [Link], flags: Incoming interface: Null, RPF nbr [Link] Incoming interface: Null, RPF nbr [Link] Outgoing interface list: Outgoing interface list: Fddi1/0, Forward/Dense, 00:09:20/00:02:38 Fddi1/0, Forward/Dense, 00:09:20/00:02:38 Hssi3/0, Forward/Dense, 00:18:53/00:00:00 Hssi3/0, Forward/Dense, 00:18:53/00:00:00 ([Link]/32, [Link]), 00:18:53/00:02:27, flags: TT ([Link]/32, [Link]), 00:18:53/00:02:27, flags: Incoming interface: Hssi3/0, RPF nbr [Link] Incoming interface: Hssi3/0, RPF nbr [Link] Outgoing interface list: Outgoing interface list: Fddi1/0, Forward/Dense, 00:16:16/00:02:38 Fddi1/0, Forward/Dense, 00:16:16/00:02:38 (*, [Link]), 05:35:08/00:02:58, RP [Link], flags: DP (*, [Link]), 05:35:08/00:02:58, RP [Link], flags: DP Incoming interface: Null, RPF nbr [Link] Incoming interface: Null, RPF nbr [Link] Outgoing interface list: Null Outgoing interface list: Null
Module4. ppt
8/10/2001 1:55 PM
12 12
Partial output taken from a production router in Ciscos network for more interesting output This is a generic multicast routing table Note the:
(*,G) and (S,G) entries incoming interface outgoing interface list (OIF) RP (if any) Flags times - how long the entry has been in the table and when it will expire
[Link]
12
Module4. ppt
8/10/2001 1:55 PM
13 13
Shows all active groups with an aggregate bandwidth greater than the specified kbps (4kbps is the default) Listed in each entry is:
group address session name source address and domain name averaged pps and kbps rates for this flow
[Link]
13
Module4. ppt
8/10/2001 1:55 PM
14 14
[Link]
14
show ip mcache
R6#show ip mcache R6#show ip mcache IP Multicast Fast-Switching Cache IP Multicast Fast-Switching Cache ([Link]/32, [Link]), Ethernet1, Last used: 00:02:33 ([Link]/32, [Link]), Ethernet1, Last used: 00:02:33 Serial0 MAC Header: 0F000800 Serial0 MAC Header: 0F000800 Serial1 MAC Header: 0F000800 Serial1 MAC Header: 0F000800
Module4. ppt
8/10/2001 1:55 PM
15 15
Displays IPmc fast switching cache - useful for debugging fast switching bugs
[Link]
15
sh ip pim rp mapping
sjck-rp1>show ip pim rp mapping sjck-rp1>show ip pim rp mapping PIM Group -to-RP Mappings PIM Group -to-RP Mappings This system is an RP (Auto -RP) This system is an RP (Auto -RP) This system is an RP-mapping agent (Loopback1) This system is an RP-mapping agent (Loopback1) Group(s) [Link]/4 Group(s) [Link]/4 RP [Link] (( sj-mbone-loopback0. cisco .com), v2v1 RP [Link] sj-mbone-loopback0. cisco .com), v2v1 Info source: [Link] (( sj-mbone-loopback0. cisco .com), via Auto-RP Info source: [Link] sj-mbone-loopback0. cisco .com), via Auto-RP Uptime: 4w4d, expires: 00:02:55 Uptime: 4w4d, expires: 00:02:55 Group(s) [Link]/24 Group(s) [Link]/24 RP [Link] (sjc25b-00rp-gw1-loop1. [Link]), v2v1 RP [Link] (sjc25b-00rp-gw1-loop1. [Link]), v2v1 Info source: [Link] (sjc25b-00rp-gw1-loop1. [Link]), via Auto-RP Info source: [Link] (sjc25b-00rp-gw1-loop1. [Link]), via Auto-RP Uptime: 1d18h, expires: 00:02:35 Uptime: 1d18h, expires: 00:02:35
Module4. ppt
8/10/2001 1:55 PM
16 16
This command lists the contents of the Group-to-RP Mapping Cache. In the example above, there are two group ranges covered by two different RPs, both of which have been learned via Auto-RP. (RPs can be learned either dynamically or by static configuration.) Note that there can be multiple RPs in the network each supporting a different multicast address range
[Link]
16
show ip sdr
dallas-gw>show ip sdr dallas-gw>show ip sdr SDR Cache -- 450 entries SDR Cache 450 entries *cisco 100k Field *cisco 100k Field *cisco 100K Field Sales Office *cisco 100K Field Sales Office *cisco 500k San Jose && RTP *cisco 500k San Jose RTP *cisco 500k SJ and RTP *cisco 500k SJ and RTP
. . . . . .
By default, sdr cache entries are not deleted - use the command ip sdr cache-timeout <minutes> to remove cache entries after a period of time.
Module4. ppt
8/10/2001 1:55 PM
17 17
[Link]
17
18 18
show ip sd [group | "session-name" | detail] Displays the contents of the session directory cache Example shown is an advertisement of a Cisco- internal IP/TV broadcast
[Link]
18
Module4. ppt
8/10/2001 1:55 PM
19 19
[Link]
19
debug ip igmp
R4# debug ip igmp R4# debug ip igmp IGMP: Send v2 Query on Ethernet1 to [Link] IGMP: Send v2 Query on Ethernet1 to [Link] IGMP: Received v2 Report from [Link] (Ethernet1) for 224.1.1 .1 IGMP: Received v2 Report from [Link] (Ethernet1) for 224.1.1 .1 IGMP: Received v2 Query from [Link] (Ethernet0) IGMP: Received v2 Query from [Link] (Ethernet0) IGMP: Set report delay time to 2.2 seconds for [Link] on Eth ernet0 IGMP: Set report delay time to 2.2 seconds for [Link] on Eth ernet0 IGMP: Send v2 Report for [Link] on Ethernet0 IGMP: Send v2 Report for [Link] on Ethernet0 IGMP: Received v2 Report from [Link] (Ethernet0) for 224.0.1 .40 IGMP: Received v2 Report from [Link] (Ethernet0) for 224.0.1 .40 IGMP: Received v2 Report from [Link] (Ethernet0) for 224.0.1 .40 IGMP: Received v2 Report from [Link] (Ethernet0) for 224.0.1 .40
Module4. ppt
8/10/2001 1:55 PM
20 20
This is a useful debug to make sure you are sending queries and to determine the query interval It is also useful for figuring out what IGMP version the clients are using - when the report back when queried
[Link]
20
debug ip mpacket
R6# debug ip mpacket [Link] detail R6# debug ip mpacket [Link] detail IP: MAC sa=00e0.b063.cf4b (Ethernet1), IP last-hop=[Link] IP: MAC sa=00e0.b063.cf4b (Ethernet1), IP last-hop=[Link] IP: IP tos=0x0, len =100, id=0x175, ttl=254, prot=1 IP: IP tos=0x0, len =100, id=0x175, ttl=254, prot=1 IP: s=[Link] (Ethernet1) d=[Link] len 114, mroute olist null IP: s=[Link] (Ethernet1) d=[Link] len 114, mroute olist null
Module4. ppt
8/10/2001 1:55 PM
21 21
Decode of a multicast packet USE CAUTION - when turning on packet level debugging especially when the router is servicing high multicast loads!
[Link]
21
debug ip mroute
R6# debug ip mrouting [Link] R6# debug ip mrouting [Link] MRT: Create (*, [Link]), RPF Null, PC 0x6032D254 MRT: Create (*, [Link]), RPF Null, PC 0x6032D254 MRT: Create ([Link]/32, [Link]), RPF Ethernet1/[Link], PC x6032D378 MRT: Create ([Link]/32, [Link]), RPF Ethernet1/[Link], PC x6032D378
Module4. ppt
8/10/2001 1:55 PM
22 22
[Link]
22
debug ip pim
R4# debug ip pim [Link] R4# debug ip pim [Link] PIM: Send Router -Query on Ethernet0 PIM: Send Router -Query on Ethernet0 PIM: Send Router -Query on Ethernet1 PIM: Send Router -Query on Ethernet1 PIM: Received Router-Query on Ethernet0 from [Link] PIM: Received Router-Query on Ethernet0 from [Link]
Module4. ppt
8/10/2001 1:55 PM
23 23
Periodic Router-Query messages used to keep track of PIM neighbors. This creates and maintains neighbor adjacencies. There is no other PIM router on E1/1 but R3 is seen on E0/0
[Link]
23
Module4. ppt
8/10/2001 1:55 PM
24 24
Here, the router is configured with the RP's address and hence sends out a periodic JOIN towards the RP. The RP in turn sends back an RP-Reachable message in return. The WC bits indicates (*,G) state setup.
[Link]
24
R1# R1# PIM: Received Join/Prune on Serial0 from [Link] PIM: Received Join/Prune on Serial0 from [Link] PIM: Join -list: (*, [Link]) RP [Link], RP-bit set, SS -bit set PIM: Join -list: (*, [Link]) RP [Link], RP-bit set, -bit set PIM: Add Serial0/[Link] to (*, [Link]), Forward state PIM: Add Serial0/[Link] to (*, [Link]), Forward state PIM: Received Join/Prune on Serial0 from [Link] PIM: Received Join/Prune on Serial0 from [Link] PIM: Building Join/Prune message for [Link] PIM: Building Join/Prune message for [Link] PIM: Send RP-reachability for [Link] on Serial0 PIM: Send RP-reachability for [Link] on Serial0
Module4. ppt
8/10/2001 1:55 PM
25 25
On R1, which the RP for the Group [Link] The RP receives periodic JOIN's for the (*,G) which is the pre-existing state in PIM Sparse mode. The RP updates its OIF for the (*,G) and sends back an RP-Reachability message.
[Link]
25
PIM: Received Join/Prune on Ethernet0 from [Link] PIM: Received Join/Prune on Ethernet0 from [Link] PIM: Join -list: ([Link]/32, [Link]), S-bit set PIM: Join -list: ([Link]/32, [Link]), S-bit set PIM: Add Ethernet0/[Link] to ([Link]/32, [Link]), Fo rward state PIM: Add Ethernet0/[Link] to ([Link]/32, [Link]), Fo rward state PIM: Building Join/Prune message for [Link] PIM: Building Join/Prune message for [Link] PIM: No sources in join or prune list PIM: No sources in join or prune list PIM: Received Join/Prune on Serial1 from [Link] PIM: Received Join/Prune on Serial1 from [Link] PIM: Join -list: ([Link]/32, [Link]), S-bit set PIM: Join -list: ([Link]/32, [Link]), S-bit set PIM: Add Serial1/[Link] to ([Link]/32, [Link]), Forw ard state PIM: Add Serial1/[Link] to ([Link]/32, [Link]), Forw ard state PIM: Send Null Register to [Link] PIM: Send Null Register to [Link] PIM: Received Register-Stop on Ethernet0 from [Link] PIM: Received Register-Stop on Ethernet0 from [Link]
Module4. ppt
8/10/2001 1:55 PM
26 26
Taken from R4 (router connected to the source) - this will show the initiation of the shared tree in PIM sparse mode Part 1 - When the Source initiates transmission to Group [Link] R4 uses its (*,G) entry and sends the data to the RP encapsulated i n Register packets for the Source [Link]. Part 2 - It then creates a (S,G) entry of the form ([Link]/24,[Link]) JOIN's from its PIM Neighbors come in causing the interfaces on which the JOIN's are received to be added to the OIF -list in the Mroute table. Part 3 - R4 now starts sending periodic Null Register messages to the RP and receives Register-Stop messages. This is for maintenance of the tree.
[Link]
26
8/10/2001 1:55 PM
27 27
On R1 (the RP) The RP receives the Register messages from Router R4, it decapsulates the data from the Source and forwards it down the tree towards the Receiver using the pre-existing (*,[Link]) state. Sends a JOIN towards the Source for (S,G)-> ([Link],[Link]) This builds the (S,G) mtree from the RP to the Source. (the stop the encapsulated data flow to a native IPmc flow) Meanwhile the (*,G) is periodically renewed by the routers on the Receiver side of the mtree. The RP continues to send out periodic JOIN's for (S,G) to maintain state. The RP continues to receive the Null Register messages sent out by R6. The RP then receives a PRUNE from R5 for (S,G) with the RP bit set. The RP bit indicates that the tree is switching from a Shared tree to the Shortest Path tree (SPT). The S bit also signifies the switch.
Copyright ? ?1998-2001, Cisco Systems, Inc.
[Link]
27
Module4. ppt
8/10/2001 1:55 PM
28 28
[Link]
28
Based on Unix mtrace command Split into two separate commands Both use the same mechanism
[Link]
Module4. ppt
8/10/2001 1:55 PM
29 29
[Link]
29
mtrace/mstatHow it works
src
First-hop Router
Multicast Dist. Tree Mtrace Packet
mt rac e res po ns e
dest
st ue req
Last-hop Router
e rac mt
Note: Mtracepackets use special IGMP packets with IGMP Type codes of 0x1E and 0x1F.
Module4. ppt
30 30
[Link]
30
mtrace/mstatHow it works
Uses a special IGMP packet type
IGMP type 0x1F = IGMP type 0x1E = Queries/Requests Response
8/10/2001 1:55 PM
31 31
[Link]
31
mtrace/mstatHow it works
Each hop adds data to packet
Module4. ppt
Query arrival time Incoming Interface Outgoing Interface Prev. Hop Router address Input packet count Output packet count Total packets for this Source/Group Routing Protocol TTL Threshold Forwarding/Error Code
8/10/2001 1:55 PM
32 32
[Link]
32
mtrace/mstatHow it works
Module4. ppt
8/10/2001 1:55 PM
33 33
[Link]
33
mtrace
Shows:
Multicast path from source to receiver.
Similar to unicast trace command Trace path between any two points in network TTL Thresholds & Delay shown at each node
Troubleshooting Usage:
Find where multicast traffic flow stops.
Focus on router where flow stops
8/10/2001 1:55 PM
34 34
[Link]
34
mtrace
dallas-gw>mtrace bloom-iptv-svr bwilliam-ss5 [Link] dallas-gw>mtrace bloom-iptv-svr bwilliam-ss5 [Link] Type escape sequence to abort. Type escape sequence to abort. Mtrace from [Link] to [Link] via group [Link] Mtrace from [Link] to [Link] via group [Link] From source (?) to destination ([Link]) From source (?) to destination ([Link]) Querying full reverse path... Querying full reverse path... 0 bwilliam-ss5 ([Link]) 0 bwilliam-ss5 ([Link]) -1 dallas-gw ([Link]) PIM thresh^ 0 3 ms -1 dallas-gw ([Link]) PIM thresh^ 0 3 ms -2 wan-gw4 ([Link]) PIM thresh^ 0 32 ms -2 wan-gw4 ([Link]) PIM thresh^ 0 32 ms -3 bloomington-mn-gw ([Link]) PIM thresh^ 0 717 ms -3 bloomington-mn-gw ([Link]) PIM thresh^ 0 717 ms -4 bloom-mnlab ([Link]) PIM thresh^ 0 730 ms -4 bloom-mnlab ([Link]) PIM thresh^ 0 730 ms -5 bloom-iptv-svr ([Link]) -5 bloom-iptv-svr ([Link]) dallas-gw> dallas-gw>
Module4. ppt
8/10/2001 1:55 PM
35 35
Shows all active groups with an aggregate bandwidth greater than the specified kbps (4kbps is the default) Listed in each entry is:
group address session name source address and domain name averaged pps and kbps rates for this flow
[Link]
35
mstat
Shows:
Multicast path in pseudo graphic format.
Trace path between any two points in network Drops/Duplicates shown at each node TTLs & Delay shown at each node
Troubleshooting Usage:
Locate congestion point in the flow.
Focus on router with high drop/duplicate count Duplicates indicated as negative drops
Module4. ppt
8/10/2001 1:55 PM
36 36
[Link]
36
mstat
dallas-gw>mstat [Link] bwilliam-ss5 [Link] dallas-gw>mstat [Link] bwilliam-ss5 [Link] Source Response Dest Packet Statistics For Source Response Dest Packet Statistics For [Link] [Link] All Multicast Traffic [Link] [Link] All Multicast Traffic | __/ rtt 547 ms Lost/Sent = Pct Rate | __/ rtt 547 ms Lost/Sent = Pct Rate v / hop 547 ms --------------------v / hop 547 ms --------------------[Link] [Link] [Link] bloom -mnlab [Link] bloom -mnlab | ^ ttl 0 | ^ ttl 0 v | hop -409 ms -11/168 = --% 16 pps v | hop -409 ms -11/168 = --% 16 pps [Link] [Link] [Link] bloomington-mn-gw [Link] bloomington-mn-gw | ^ ttl 1 | ^ ttl 1 v | hop 379 ms -9/170 = --% 17 pps v | hop 379 ms -9/170 = --% 17 pps [Link] [Link] [Link] wan -gw4 [Link] wan -gw4 | ^ ttl 2 | ^ ttl 2 v | hop 28 ms -3/195 = --% 19 pps v | hop 28 ms -3/195 = --% 19 pps [Link] [Link] [Link] dallas-gw [Link] dallas-gw | \__ ttl 3 | \__ ttl 3 v \ hop 0 ms 196 19 pps v \ hop 0 ms 196 19 pps [Link] [Link] [Link] [Link] Receiver Query Source Receiver Query Source
Module4. ppt
1998 2001, Cisco Systems, Inc. All rights reserved.
Only For Traffic Only For Traffic From [Link] From [Link] To [Link] To [Link] ---------------------------------------
0/67 = 0% 0/67 = 0%
6 pps 6 pps
6 pps 6 pps
0/70 = 0% 0/70 = 0%
7 pps 7 pps
70 70
7 pps 7 pps
8/10/2001 1:55 PM
37 37
Shows all active groups with an aggregate bandwidth greater than the specified kbps (4kbps is the default) Listed in each entry is:
group address session name source address and domain name averaged pps and kbps rates for this flow
[Link]
37
mstat
dallas-gw>mstat [Link] bwilliam-ss5 [Link] dallas-gw>mstat [Link] bwilliam-ss5 [Link] Source Response Dest Packet Statistics For Source Response Dest Packet Statistics For [Link] [Link] All Multicast Traffic [Link] [Link] All Multicast Traffic | __/ rtt 399 ms Lost/Sent = Pct Rate | __/ rtt 399 ms Lost/Sent = Pct Rate v / hop 399 ms --------------------v / hop 399 ms --------------------[Link] [Link] [Link] bloom -mnlab [Link] bloom -mnlab | ^ ttl 0 | ^ ttl 0 v | hop 119 ms 77/694 = 11% 69 pps v | hop 119 ms 77/694 = 11% 69 pps [Link] [Link] [Link] bloomington-mn-gw [Link] bloomington-mn-gw | ^ ttl 1 | ^ ttl 1 v | hop -150 ms 395/609 = 65% 60 pps v | hop -150 ms 395/609 = 65% 60 pps [Link] [Link] [Link] wan -gw4 [Link] wan -gw4 | ^ ttl 2 | ^ ttl 2 v | hop 30 ms -8/39 = --% 3 pps v | hop 30 ms -8/39 = --% 3 pps [Link] [Link] [Link] dallas-gw [Link] dallas-gw | \__ ttl 3 | \__ ttl 3 v \ hop 0 ms 39 3 pps v \ hop 0 ms 39 3 pps [Link] [Link] [Link] [Link] Receiver Query Source Receiver Query Source
Module4. ppt
1998 2001, Cisco Systems, Inc. All rights reserved.
Only For Traffic Only For Traffic From [Link] From [Link] To [Link] To [Link] ---------------------------------------
0/65 = 0% 0/65 = 0%
6 pps 6 pps
6 pps 6 pps
2 pps 2 pps
22 22
2 pps 2 pps
8/10/2001 1:55 PM
38 38
[Link]
38
mrinfo
berwyn-gw>mrinfo berwyn -gw berwyn-gw>mrinfo berwyn -gw [Link] (berwyn -[Link]) [version cisco 11.2] [flags: PMSA]: [Link] (berwyn -[Link]) [version cisco 11.2] [flags: PMSA]: [Link] -> [Link] [1/0/pim/ querier/leaf] [Link] -> [Link] [1/0/pim/ querier/leaf] [Link] -> [Link] [1/0/pim/querier/leaf] [Link] -> [Link] [1/0/pim/querier/leaf] [Link] -> [Link] ([Link]) [1/0/pim] [Link] -> [Link] ([Link]) [1/0/pim]
Module4. ppt
8/10/2001 1:55 PM
39 39
Used to query a peering router about multicast information Example shown is from the Cisco internal network on a remote office router - when no arguments are given - the router queries itself
[Link]
39
ping
ISP-251#ping [Link] ISP-251#ping [Link] Type escape sequence to abort. Type escape sequence to abort. Sending 1, 100 -byte ICMP Echos to [Link], timeout is 22 seconds: Sending 1, 100 -byte ICMP Echos to [Link], timeout is seconds: Reply to request 00 from [Link], 16 ms Reply to request from [Link], 16 ms Reply to request 00 from [Link], 20 ms Reply to request from [Link], 20 ms
Module4. ppt
8/10/2001 1:55 PM
40 40
Ping is the easiest way to generate multicast traffic in the lab and test the multicast tree Pings all members of the group - all members respond
[Link]
40
You can view {source, group} traffic pairs IP ident and ttl Inter-packet delay Commands
ip multicast cache-headers show ip mpacket <source> <group> [detail]
Module4. ppt
8/10/2001 1:55 PM
41 41
[Link]
41
Module4. ppt
8/10/2001 1:55 PM
42 42
[Link]
42
Debugging Strategies
What does the network look like when everything is working? What is the expected behavior? What specifically is not working? Was it ever working correctly? What has been changed?
Module4. ppt
8/10/2001 1:55 PM
43 43
Debugging Strategies
These are standard questions to consider when debugging anything, including multicast
[Link]
43
Packet Flow
8/10/2001 1:55 PM
44 44
Debugging Strategies
Signaling is the process of setting up (and tearing down) the multicast session Packet flow is the actual sending, replication, and reception of the multicast packets based on the forwarding tables created by the signalling processes Each section of the table needs to be working for the application to work A similar table could be developed for unicast IP or other technologies, but the tools used to troubleshoot each case are different
[Link]
44
Check interface counters on host Check upstream router for traffic flow
show ip mroute count show ip mroute active
Module4. ppt
8/10/2001 1:55 PM
45 45
[Link]
45
Most complex piece Depends of protocol, mode, etc. Check initial flow creation Check for pruning and timer expiration during session
Module4. ppt
8/10/2001 1:55 PM
46 46
[Link]
46
show/debug ip mroute commands show/debug ip pim commands show/debug ip dvmrp commands show ip rpf
watch oilist for null entries
Module4. ppt
8/10/2001 1:55 PM
47 47
[Link]
47
Module4. ppt
8/10/2001 1:55 PM
48 48
[Link]
48
DVMRP troubleshooting
show ip dvmrp route
can include address or interface arguments
debug ip dvmrp
Optional arguments are: detail - to capture headers ACL - to specify specific routes in | out - transmitted or recd only pruning - watch pruning and grafting only
Module4. ppt
1998 2001, Cisco Systems, Inc. All rights reserved.
8/10/2001 1:55 PM
49 49
[Link]
49
mstat command ping command show ip mroute count show ip mroute active debug ip mpacket
Be Careful with this one!
Module4. ppt
8/10/2001 1:55 PM
50 50
[Link]
50
show ip igmp interface show ip igmp groups debug ip igmp / cgmp IGMPv1 vs. IGMPv2
Module4. ppt
8/10/2001 1:55 PM
51 51
[Link]
51
Check receiver interface stats Is the stack installed and configured properly? Is the application installed and configured properly? Watch for duplicates
performance implication
Module4. ppt
8/10/2001 1:55 PM
52 52
[Link]
52
Module4. ppt
53
[Link]
53