Junos OS Multichassis Link Aggregation User Guide for EX Series, MX Series, and QFX Series Devices
File info: application/pdf · 547 pages · 2.07MB
Junos OS Multichassis Link Aggregation User Guide for EX Series, MX Series, and QFX Series Devices
256 OS Multichassis Link Aggregation User Guide for EX ...
MAC Address Management. 29. MAC Aging. 29. Address Resolution Protocol Active-Active MC-LAG Support Methodology. 29. DHCP Relay with Option 82. 30. Layer 2 Unicast Features Supported. 31. Protocol Independent Multicast.…
256 OS Multichassis Link Aggregation User Guide for EX Series ...
Mar 15, 2021 · Configuring Manual and Automatic Link Switchover for MC-LAG Interfaces on MX Series ... Routers. 335. Forcing MC-LAG Links or Interfaces with Limited LACP Capability to Be Up. 337. Increasing ARP and Netw…
Junos OS Multichassis Link Aggregation User Guide for EX...
Configuring Manual and Automatic Link Switchover for MC-LAG Interfaces on MX Series Routers. Forcing MC-LAG Links or Interfaces with Limited LACP Capability to Be Up.
Extracted Text
Junos� OS
Multichassis Link Aggregation User Guide for EX Series, MX Series, and QFX Series Devices
Published
2021-03-15
ii
Juniper Networks, Inc. 1133 Innovation Way Sunnyvale, California 94089 USA 408-745-2000 www.juniper.net
Juniper Networks, the Juniper Networks logo, Juniper, and Junos are registered trademarks of Juniper Networks, Inc. in the United States and other countries. All other trademarks, service marks, registered marks, or registered service marks are the property of their respective owners.
Juniper Networks assumes no responsibility for any inaccuracies in this document. Juniper Networks reserves the right to change, modify, transfer, or otherwise revise this publication without notice.
Junos� OS Multichassis Link Aggregation User Guide for EX Series, MX Series, and QFX Series Devices Copyright � 2021 Juniper Networks, Inc. All rights reserved.
The information in this document is current as of the date on the title page.
YEAR 2000 NOTICE
Juniper Networks hardware and software products are Year 2000 compliant. Junos OS has no known time-related limitations through the year 2038. However, the NTP application is known to have some difficulty in the year 2036.
END USER LICENSE AGREEMENT
The Juniper Networks product that is the subject of this technical documentation consists of (or is intended for use with) Juniper Networks software. Use of such software is subject to the terms and conditions of the End User License Agreement ("EULA") posted at https://support.juniper.net/support/eula/. By downloading, installing or using such software, you agree to the terms and conditions of that EULA.
iii
Table of Contents
About This Guide | xi
1
Understanding MC-LAG
Understanding Multichassis Link Aggregation Groups | 2
MC-LAG Concepts | 4
Advanced MC-LAG Concepts | 7 Understanding Configuration Synchronization | 8
Understanding Multichassis Link Aggregation Group Configuration Consistency Check | 13
Unknown Unicast and IGMP Snooping | 28
Layer 3 Unicast Feature Support | 28
MAC Address Management | 29
MAC Aging | 29
Address Resolution Protocol Active-Active MC-LAG Support Methodology | 29
DHCP Relay with Option 82 | 30
Layer 2 Unicast Features Supported | 31
Protocol Independent Multicast | 32
IGMP Report Synchronization | 33
IGMP Snooping in MC-LAG Active-Active Mode | 34
Understanding MC-LAGs on an FCoE Transit Switch | 41
Understanding EVPN-MPLS Interworking with Junos Fusion Enterprise and MC-LAG | 45
Understanding the Incremented Values of Statistical Counters for Loop-Free MC-LAG Networks | 52
Enhanced Convergence | 56
IPv6 Neighbor Discovery Protocol | 57
Anycast Gateways | 58
iv
2
Implementing MC-LAG
Getting Started with MC-LAG | 65
Configuring Multichassis Link Aggregation on MX Series Routers | 65
Configuring Multichassis Link Aggregation on EX Series Switches | 72
Configuring ICCP for MC-LAG | 78
MC-LAG Examples | 80 Example: Configuring Multichassis Link Aggregation on the QFX Series | 80 Requirements | 81 Overview | 81 Configuration | 82 Verification | 101 Troubleshooting | 104
Example: Configuring Multichassis Link Aggregation on the MX Series | 105
Requirements | 105 Overview | 106 Configuring the PE Routers | 107 Configuring the CE Device | 117 Configuring the Provider Router | 121 Verification | 125
Example: Configuring Multichassis Link Aggregation on EX9200 Switches in the Core for Campus Networks | 125
Requirements | 126 Overview | 127 Configuration | 129 (Optional) Configuring RSTP | 155 (Optional) Configuring IGMP Snooping | 157 (Optional) Configuring VRRP | 159 (Optional) Configuring MAC Address Synchronization | 162 (Optional) Configuring OSPF | 163 (Optional) Configuring PIM | 165 (Optional) Configuring DHCP Relay | 168 Verification | 171
v
Example: Configure Optional Features For Multichassis Link Aggregation | 184
Requirements | 185 Overview | 185 (Optional) Configuring RSTP | 186 (Optional) Configuring IGMP Snooping | 189 (Optional) Configuring VRRP | 190 (Optional) Configuring MAC Address Synchronization | 193 (Optional) Configuring OSPF | 194 (Optional) Configuring PIM | 195 (Optional) Configuring DHCP Relay | 199 Verification | 202 Troubleshooting | 203
Example: Simplifying Multichassis Link Aggregation on EX9200 Switches in the Core for Campus Networks | 204
Requirements | 204 Overview | 205 Configuration | 208 Verification | 238
Example: Configuring CoS for FCoE Transit Switch Traffic Across an MC-LAG | 266
Requirements | 267 Overview | 267 Configuration | 274 Verification | 287
Example: EVPN-MPLS Interworking With an MC-LAG Topology | 300 Requirements | 301 Overview and Topology | 301 PE1 and PE2 Configuration | 304 PE3 Configuration | 321
3
Other MC-LAG Configurations
Other MC-LAG Configurations | 328
Configuring Active-Active Bridging and VRRP over IRB in Multichassis Link Aggregation on MX Series Routers | 328
Configuring MC-LAG | 329 Configuring the Interchassis Link-Protection Link | 330
vi
Configuring Multiple Chassis | 330 Configuring the Service ID | 331 Configuring IGMP Snooping for Active-Active MC-LAG | 333
Configuring IGMP Snooping in MC-LAG Active-Active Mode | 334
Configuring Manual and Automatic Link Switchover for MC-LAG Interfaces on MX Series Routers | 335
Forcing MC-LAG Links or Interfaces with Limited LACP Capability to Be Up | 337
Increasing ARP and Network Discovery Protocol Entries for Enhanced MC-LAG and Layer 3 VXLAN Topologies | 338
Understanding the Need for an Increase in ARP and Network Discovery Protocol (NDP) Entries | 339
Increasing ARP and Network Discovery Protocol Entries for Enhanced MC-LAG Using IPv4 Transport | 339
Increasing ARP and Network Discovery Protocol Entries for Enhanced MC-LAG Using IPv6 Transport | 341
Increasing ARP for EVPN-VXLAN Gateway for Border-Leaf in Edge Routed Bridge (ERB) or Spine in Centrally Routed Bridge (CRB) for IPv4 Tenant Traffic | 343
Increasing ARP and Network Discovery Protocol Entries for EVPN-VXLAN gateway for Border-Leaf in Edge Routed Bridge (ERB) or Spine in Centrally Routed Bridge (CRB) for IPv6 Tenant Traffic | 345
Synchronizing and Committing Configurations | 348 Configure Devices for Configuration Synchronization | 348 Create a Global Configuration Group | 351 Create a Local Configuration Group | 354 Create a Remote Configuration Group | 357 Create Apply Groups for the Local, Remote, and Global Configurations | 359 Synchronizing and Committing Configurations | 360 Troubleshooting Remote Device Connections | 360
4
MC-LAG Upgrade Guidelines
MC-LAG Upgrade Guidelines | 365
5
Best Practices and Usage Notes
Best Practices and Usage Notes | 368
6
Troubleshooting Multichassis Link Aggregation
vii
Troubleshooting Multichassis Link Aggregation | 380 MAC Addresses Learned on Multichassis Aggregated Ethernet Interfaces Are Not Removed from the MAC Address Table | 381 MC-LAG Peer Does Not Go into Standby Mode | 382 Secondary MC-LAG Peer with Status Control Set to Standby Becomes Inactive | 383 Redirect Filters Take Priority over User-Defined Filters | 383 Operational Command Output Is Wrong | 384 ICCP Connection Might Take Up to 60 Seconds to Become Active | 385 MAC Address Age Learned on a Multichassis Aggregated Ethernet Interface Is Reset to Zero | 386 MAC Address Is Not Learned Remotely in a Default VLAN | 387 Snooping Entries Learned on Multichassis Aggregated Ethernet Interfaces Are Not Removed | 387 ICCP Does Not Come Up After You Add or Delete an Authentication Key | 388 Local Status Is Standby When It Should Be Active | 389 Packets Loop on the Server When ICCP Fails | 389 Both MC-LAG Peers Use the Default System ID After a Reboot or an ICCP Configuration Change | 390 No Commit Checks Are Done for ICL-PL Interfaces | 391 Double Failover Scenario | 391 Multicast Traffic Floods the VLAN When the ICL-PL Interface Goes Down and Up | 392 Layer 3 Traffic Sent to the Standby MC-LAG Peer Is Not Redirected to Active MC-LAG Peer | 393 Aggregated Ethernet Interfaces Go Down | 393 Flooding of Upstream Traffic | 394 ARP and MAC Table Entries Become Out of Sync in an MC-LAG Configuration | 395
Configuring Interface Diagnostics Tools to Test the Physical Layer Connections | 396 Configuring Loopback Testing | 396 Configuring BERT Testing | 399 Starting and Stopping a BERT Test | 403
viii
7
Configuration Statements
apply-groups | 407
arp-enhanced-scale | 408
arp-l2-validate | 410
authentication-key (ICCP) | 411
backup-liveness-detection | 413
backup-peer-ip | 415
bgp-peer | 416
chassis-id | 417
detection-time (Liveness Detection) | 419
enhanced-convergence | 420
groups | 422
iccp | 426
iccp | 428
interface (Multichassis Protection) | 430
local-ip-addr (ICCP) | 432
mc-ae | 433
mc-ae-id | 439
mclag | 441
mclag-arp-nd-sync | 442
mclag-arpreq-sync | 444
minimum-interval (Liveness Detection) | 445
minimum-receive-interval (Liveness Detection) | 447
mode (QFX Series) | 448
multiplier (Liveness Detection) | 450
ix
multi-chassis | 451
multi-chassis-protection | 453
multi-chassis-protection | 454
no-adaptation (Liveness Detection) | 456
peer (ICCP) | 457
peer (Multichassis) | 459
peer | 460
peers (Commit) | 462
peers-synchronize | 464
status-control | 465
session-establishment-hold-time | 467
threshold (Detection Time) | 468
transmit-interval (Liveness Detection) | 470
version (Liveness Detection) | 471
8
Operational Commands
request interface mc-ae switchover (Multichassis Link Aggregation) | 475
request interface (revert | switchover) (Aggregated Ethernet Link Protection) | 477
request lacp link-switchover | 479
show iccp | 481
show interfaces mc-ae | 484
show l2-learning redundancy-groups | 488
show multi-chassis mc-lag configuration-consistency list-of-parameters | 495
show multi-chassis mc-lag configuration-consistency | 510
show multi-chassis mc-lag configuration-consistency global-config | 517
show multi-chassis mc-lag configuration-consistency icl-config | 520
x
show multi-chassis mc-lag configuration-consistency mcae-config | 523 show multi-chassis mc-lag configuration-consistency vlan-config | 528 show multi-chassis mc-lag configuration-consistency vrrp-config | 532
xi
About This Guide
Use this guide to configure and monitor multichassis link aggregation groups (MC-LAGs).
1 CHAPTER
Understanding MC-LAG
Understanding Multichassis Link Aggregation Groups | 2 MC-LAG Concepts | 4 Advanced MC-LAG Concepts | 7
2
Understanding Multichassis Link Aggregation Groups
IN THIS SECTION Benefits of MC-LAGs | 3
NOTE: Starting in Junos OS Release 17.4R1, MC-LAG is not supported on EX switches except for EX4600, EX4650-48Y, and EX9200 switches. Use the Virtual Chassis feature instead to provide equivalent functionality.
Layer 2 networks are increasing in scale mainly because of technologies such as virtualization. Protocol and control mechanisms that limit the disastrous effects of a topology loop in the network are necessary. The Spanning Tree Protocol (STP) is the primary solution to this problem because it provides a loop-free Layer 2 environment. STP has gone through a number of enhancements and extensions, and even though it scales to very large network environments, it still only provides one active path from one device to another, regardless of how many actual connections might exist in the network. Although STP is a robust and scalable solution to redundancy in a Layer 2 network, the single logical link creates two problems: At least half of the available system bandwidth is off-limits to data traffic, and network topology changes occur. The Rapid Spanning Tree Protocol (RSTP) reduces the overhead of the rediscovery process and allows a Layer 2 network to reconverge faster, but the delay is still high. Link aggregation (IEEE 802.3ad) solves some of these problems by enabling users to use more than one link connection between switches. All physical connections are considered one logical connection. The problem with standard link aggregation is that the connections are point to point. Multichassis link aggregation groups (MC-LAGs) enable a client device to form a logical LAG interface between two MC-LAG peers. An MC-LAG provides redundancy and load balancing between the two MC-LAG peers, multihoming support, and a loop-free Layer 2 network without running STP. On one end of an MC-LAG, there is an MC-LAG client device, such as a server, that has one or more physical links in a link aggregation group (LAG). This client device uses the link as a LAG. On the other side of the MC-LAG, there can be a maximum of two MC-LAG peers. Each of the MC-LAG peers has one or more physical links connected to a single client device. The MC-LAG peers use the Inter-Chassis Control Protocol (ICCP) to exchange control information and coordinate with each other to ensure that data traffic is forwarded properly.
3 The Link Aggregation Control Protocol (LACP) is a subcomponent of the IEEE 802.3ad standard. LACP is used to discover multiple links from a client device connected to an MC-LAG peer. LACP must be configured on both MC-LAG peers for an MC-LAG to work correctly.
NOTE: You must specify a service identifier (service-id) at the global level; otherwise, multichassis link aggregation will not work.
Figure 1: Basic MC-LAG Topology
The following sections provide information regarding the functional behavior of multichassis link aggregation, configuration guidelines, and best practices.
Benefits of MC-LAGs
� Reduces operational expenses by providing active-active links within a Link Aggregation Group (LAG).
� Provides faster layer 2 convergence upon link and device failures. � Adds node-level redundancy to the normal link-level redundancy that a LAG provides. � Improves network resiliency, which reduces network down time as well as expenses.
4
MC-LAG Concepts
IN THIS SECTION ICCP and ICL | 4 Multichassis Link Protection | 4 Service ID | 5 Failure Handling | 5 Load Balancing | 6 MC-LAG Packet Forwarding | 6 Virtual Router Redundancy Protocol (VRRP) over IRB and MAC Address Synchronization | 6
ICCP and ICL
The MC-LAG peers use the Inter-Chassis Control Protocol (ICCP) to exchange control information and coordinate with each other to ensure that data traffic is forwarded properly. ICCP replicates control traffic and forwarding states across the MC-LAG peers and communicates the operational state of the MC-LAG members. Because ICCP uses TCP/IP to communicate between the peers, the two peers must be connected to each other. ICCP messages exchange MC-LAG configuration parameters and ensure that both peers use the correct LACP parameters. The interchassis link (ICL), also known as the interchassis link-protection link (ICL-PL), is used to forward data traffic across the MC-LAG peers. This link provides redundancy when a link failure (for example, an MC-LAG trunk failure) occurs on one of the active links. The ICL can be a single physical Ethernet interface or an aggregated Ethernet interface. You can configure multiple ICLs between MC-LAG peers. Each ICL can learn up to 512K MAC addresses. You can configure additional ICLs for virtual switch instances.
Multichassis Link Protection
Multichassis link protection provides link protection between the two MC-LAG peers that host an MCLAG. If the ICCP connection is up and the ICL comes up, the peer configured as standby brings up the
5
multichassis aggregated Ethernet interfaces shared with the peer. Multichassis protection must be configured on each MC-LAG peer that is hosting an MC-LAG.
Service ID
You must configure the same service ID on each MC-LAG peer when the MC-LAG logical interfaces are part of a bridge domain. The service ID, which is configured under the switch-options hierarchy, is used to synchronize applications such as IGMP, ARP, and MAC learning across MC-LAG members. If you are configuring virtual switch instances, configure a different service ID for each virtual switch instance.
Failure Handling
Configuring ICCP adjacency over an aggregated interface with child links on multiple FPCs mitigates the possibility of a split-brain state. A split-brain occurs when ICCP adjacency is lost between the MC-LAG peers. To work around this problem, enable backup liveness detection. With backup liveness detection enabled, the MC-LAG peers establish an out-of-band channel through the management network in addition to the ICCP channel.
During a split-brain state, both active and standby peers change LACP system IDs. Because both MCLAG peers change the LACP system ID, the customer edge (CE) device accepts the LACP system ID of the first link that comes up and brings down other links carrying different LACP system IDs. When the ICCP connection is active, both of the MC-LAG peers use the configured LACP system ID. If the LACP system ID is changed during failures, the server that is connected over the MC-LAG removes these links from the aggregated Ethernet bundle.
When the ICL is operationally down and the ICCP connection is active, the LACP state of the links with status control configured as standby is set to the standby state. When the LACP state of the links is changed to standby, the server that is connected over the MC-LAG makes these links inactive and does not use them for sending data.
Recovery from the split-brain state occurs automatically when the ICCP adjacency comes up between MC-LAG peers.
If only one physical link is available for ICCP, then ICCP might go down due to link failure or FPC failure, while the peer is still up. This results in a split-brain state. If you do not set a special configuration to avoid this situation, the MC-LAG interfaces change the LACP sytem ID to their local defaults, thus ensuring that only one link (the first) comes up from the downstream device. A convergence delay results from the LACP state changes on both active and standby peers.
6
Load Balancing
Load balancing of network traffic between MC-LAG peers is 100 percent local bias. Load balancing of network traffic between multiple LAG members in a local MC-LAG node is achieved through a standard LAG hashing algorithm.
MC-LAG Packet Forwarding
To prevent the server from receiving multiple copies from both of the MC-LAG peers, a block mask is used to prevent forwarding of traffic received on the ICL toward the multichassis aggregated Ethernet interface. Preventing forwarding of traffic received on the ICL interface toward the multichassis aggregated Ethernet interface ensures that traffic received on MC-LAG links is not forwarded back to the same link on the other peer. The forwarding block mask for a given MC-LAG link is cleared if all of the local members of the MC-LAG link go down on the peer. To achieve faster convergence, if all local members of the MC-LAG link are down, outbound traffic on the MC-LAG is redirected to the ICL interface on the data plane.
Virtual Router Redundancy Protocol (VRRP) over IRB and MAC Address Synchronization
There are two methods for enabling Layer 3 routing functionality across a multichassis link aggregation group (MC-LAG). You can choose either to configure the Virtual Router Redundancy Protocol (VRRP) over the integrated routing and bridging (IRB) interface or to synchronize the MAC addresses for the Layer 3 interfaces of the switches participating in the MC-LAG. VRRP over IRB or RVI requires that you configure different IP addresses on IRB or RVI interfaces, and run VRRP over the IRB or RVI interfaces. The virtual IP address is the gateway IP address for the MCLAG clients. If you are using the VRRP over IRB method to enable Layer 3 functionality, you must configure static ARP entries for the IRB interface of the remote MC-LAG peer to allow routing protocols to run over the IRB interfaces. This step is required so you can issue the ping command to reach both the physical IP addresses and virtual IP addresses of the MC-LAG peers. For example, you can issue the set interfaces irb unit 18 family inet address 10.181.18.3/8 arp 10.181.18.2 mac 00:00:5E:00:2f:f0 command.
7
When you issue the show interfaces irb command after you have configured VRRP over IRB, you will see that the static ARP entries are pointing to the IRB MAC addresses of the remote MC-LAG peer:
user@switch> show interfaces irb
Physical interface: irb, Enabled, Physical link is Up
Interface index: 180, SNMP ifIndex: 532
Type: Ethernet, Link-level type: Ethernet, MTU: 1514
Device flags : Present Running
Interface flags: SNMP-Traps
Link type
: Full-Duplex
Link flags
: None
Current address: 00:00:5E:00:2f:f0, Hardware address: 00:00:5E:00:2f:f0
Last flapped : Never
Input packets : 0
Output packets: 0
MAC address synchronization enables MC-LAG peers to forward Layer 3 packets arriving on multichassis aggregated Ethernet interfaces with either their own IRB or RVI MAC address or their peer's IRB or RVI MAC address. Each MC-LAG peer installs its own IRB or RVI MAC address as well as the peer's IRB or RVI MAC address in the hardware. Each MC-LAG peer treats the packet as if it were its own packet. If MAC address synchronization is not enabled, the IRB or RVI MAC address is installed on the MC-LAG peer as if it were learned on the ICL.
MAC address synchronization requires you to configure the same IP address on the IRB interface in the VLAN on both MC-LAG peers. To enable the MAC address synchronization feature using the standard CLI, issue the set vlan vlan-name mcae-mac-synchronize command on each MC-LAG peer. If you are using the Enhanced Layer 2 CLI, issue the set bridge-domains name mcae-mac-synchronize command on each MC-LAG peer. Configure the same IP address on both MC-LAG peers. This IP address is used as the default gateway for the MC-LAG servers or hosts.
Advanced MC-LAG Concepts
IN THIS SECTION
Understanding Configuration Synchronization | 8 Understanding Multichassis Link Aggregation Group Configuration Consistency Check | 13 Unknown Unicast and IGMP Snooping | 28
8
Layer 3 Unicast Feature Support | 28 MAC Address Management | 29 MAC Aging | 29 Address Resolution Protocol Active-Active MC-LAG Support Methodology | 29 DHCP Relay with Option 82 | 30 Layer 2 Unicast Features Supported | 31 Protocol Independent Multicast | 32 IGMP Report Synchronization | 33 IGMP Snooping in MC-LAG Active-Active Mode | 34 Understanding MC-LAGs on an FCoE Transit Switch | 41 Understanding EVPN-MPLS Interworking with Junos Fusion Enterprise and MC-LAG | 45 Understanding the Incremented Values of Statistical Counters for Loop-Free MC-LAG Networks | 52 Enhanced Convergence | 56 IPv6 Neighbor Discovery Protocol | 57 Anycast Gateways | 58
Understanding Configuration Synchronization
IN THIS SECTION Benefits of Configuration Synchronization | 9 How Configuration Synchronization Works | 9 How to Enable Configuration Synchronization | 9 How Configuration Synchronization is Supported | 10 Configuration Groups for Local, Remote and Global Configurations | 10 Creating Conditional Groups for Certain Devices | 10 Applying Configuration Groups | 10 Device Configuration Details for Configuration Synchronization | 11 How Configurations and Commits Are Synchronized Between Devices | 12
9
Configuration synchronization works on QFX Series switches, Junos Fusion Provider Edge, Junos Fusion Enterprise, EX Series switches, and MX Series routers. This topic describes:
Benefits of Configuration Synchronization
Configuration synchronization enables you to propagate, synchronize, and commit configurations from one device to another. You can log into any one of those devices to manage all devices, thus having a single point of management.
How Configuration Synchronization Works
Use configuration groups to simplify the configuration process. For example, you can create one configuration group for the local device, one or more for the remote devices, and one for the global configuration, which is essentially a configuration that is common to all devices. In addition, you can create conditional groups to specify when a configuration is synchronized with another device. You can enable the peers-synchronize statement at the [edit system commit] hierarchy to synchronize the configurations and commits across the devices by default. NETCONF over SSH provides a secure connection between the devices, and Secure Copy Protocol (SCP) copies the configurations securely between them.
How to Enable Configuration Synchronization
To enable configuration synchronization, perform the following steps: 1. Statically map the local device to the remote devices. 2. Create configuration groups for local, remote, and global configurations. 3. Create conditional groups. 4. Create apply groups. 5. Enable NETCONF over SSH. 6. Configure the device details and user authentication details for configuration synchronization. 7. Enable the peers-synchronize statement or issue the commit peers-synchronize command to
synchronize and commit the configurations between local and remote devices.
10
How Configuration Synchronization is Supported
On MX Series routers and Junos Fusion, support for configuration synchronization started with Junos OS Release 14.2R6. On QFX Series switches, support for configuration synchronization started with Junos OS Release 15.1X53-D60.
Configuration Groups for Local, Remote and Global Configurations
You can create configuration groups for local, remote and global configurations. A local configuration group is used by the local device, a remote configuration group is used by the remote device, and a global configuration group is shared between the local and remote devices. For example, you could create a local configuration group called Group A, which would include the configuration used by the local device (Switch A), a remote configuration group called Group B, which would include the configuration used by remote devices (Switch B, Switch C, and Switch D), and a global configuration group called Group C, which would include the configuration that is common to all devices. Create configuration groups at the [edit groups] hierarchy level.
NOTE: Configuration synchronization does not support nested groups.
Creating Conditional Groups for Certain Devices
You can create conditional groups to specify when a particular configuration should be applied to a device. If you want to apply the global configuration to all devices in a four-device configuration, for example, enable the when peers [<name of local peer> <name of remote peer> <name of remote peer> <name of remote peer>] statement at the [edit groups] hierarchy level. If, for example, you want to apply the global configuration (Group C) to the local and remote devices (Switch A, Switch B, Switch C, and Switch D), you could issue the set groups Group C when peers [Switch A Switch B Switch C Switch D] command.
Applying Configuration Groups
To apply configuration groups, enable the apply-groups statement at the [edit] hierarchy level. For example, to apply the local configuration group (Group A, for example), remote configuration group (Group B, for example), and global configuration group (Group C, for example), issue the set applygroups [ GroupA GroupB GroupC ] command.
11
Device Configuration Details for Configuration Synchronization
To synchronize configurations between devices, you need to configure the hostname or IP address, username, and password for the remote devices. To do this, issue the set peers <hostname-of-remotepeer> user <name-of-user> authentication <plain-text-password-string> command at the [edit system commit] hierarchy on the local device.
For example, to synchronize a configuration from Switch A to Switch B, issue the set peers SwitchB user administrator authentication test123 command on Switch A.
You also need to statically map the local device to the remote devices. To this, issue the set system commit peers
For example, to synchronize a configuration from Switch A to Switch B, Switch C, and Switch D, configure the following on Switch A:
Switch A
[edit system commit] peers {
switchB { user admin-swB; authentication "$ABC123";
} switchC {
user admin-swC; authentication ""$ABC123"; } switchD { user admin-swD; authentication "$ABC123"; } } [edit system]
static-host-mapping [ SwitchA{ inet [ 10.92.76.2 ]; } SwitchB{ inet [ 10.92.76.4 ]; } SwitchC{ inet [ 10.92.76.6 ]; }
12
SwitchD{ inet [ 10.92.76.8 ];
} } }
If you only want to synchronize configurations from Switch A to Switch B, Switch C, and Switch D, you do not need to configure the peers statement on Switch B, Switch C, and Switch D.
The configuration details from the peers statements are also used to establish a NETCONF over SSH connection between the devices. To enable NETCONF over SSH, issue the set system services netconf ssh command on all devices.
How Configurations and Commits Are Synchronized Between Devices
The local (or requesting) device on which you enable the peers-synchronize statement or issue the commit peers-synchronize command copies and loads its configuration to the remote (or responding) device. Each device then performs a syntax check on the configuration file being committed. If no errors are found, the configuration is activated and becomes the current operational configuration on all devices. The commits are propagated using a remote procedural call (RPC).
The following events occur during configuration synchronization:
1. The local device sends the sync-peers.conf file (the configuration that will be shared with the devices specified in the conditional group) to the remote devices.
2. The remote devices load the configuration, send the results of the load to the local device, export their configuration to the local device, and reply that the commit is complete.
3. The local device reads the replies from the remote devices.
4. If successful, the configuration is committed.
Configuration synchronization is not successful if either a) the remote device is unavailable or b) the remote device is reachable, but there are failures due to the following reasons:
� SSH connection fails because of user and authentication issues.
� Junos OS RPC fails because a lock cannot be obtained on the remote database.
� Loading the configuration fails because of syntax problems.
� Commit check fails.
The peers-synchronize statement uses the hostname or IP address, username, and password for the devices you configured in the peers statement. With the peers-synchronize statement enabled, you can simply issue the commit command to synchronize the configuration from one device to another. For
13
example, if you configured the peers statement on the local device, and want to synchronize the configuration with the remote device, you can simply issue the commit command on the local device. However, if you issue the commit command on the local device and the remote device is not reachable, you will receive a warning message saying that the remote device is not reachable and only the configuration on the local device is committed: Here is an example warning message:
error: netconf: could not read hello error: did not receive hello packet from server error: Setting up sessions for peer: 'peer1' failed warning: Cannot connect to remote peers, ignoring it commit complete
If you do not have the peers statement configured with the remote device information and you issue the commit command, only the configuration on the local device is committed. If the remote device is unreachable and there are other failures, the commit is unsuccessful on both the local and remote devices.
NOTE: When you enable the peers-synchronize statement and issue the commit command, the commit might take longer than a normal commit. Even if the configuration is the same across the devices and does not require synchronization, the system still attempts to synchronize the configurations.
The commit peers-synchronize command also uses the hostname or IP address, username, and password for the devices configured in the peers statement. If you issue the commit peers-synchronize command on the local device to synchronize the configuration with the remote device and the remote device is reachable but there are other failures, the commit fails on both the local and remote devices.
Understanding Multichassis Link Aggregation Group Configuration Consistency Check
IN THIS SECTION Benefits of Using MC-LAG Consistency Check | 14 How MC-LAG Consistency Checks Work | 14
14
Configuration Consistency Requirements | 15 When Remote Peers are Not Reachable | 15 Enabling MC-LAG Configuration Consistency Checking | 16 Learning the Status of a Configuration Consistency Check | 26 Support for MC-LAG Configuration Consistency Checking | 27
When there is a Multichassis Link Aggregation Group (MC-LAG) inconsistency, you are notified and can take action to resolve it. An example of an inconsistency is configuring identical chassis IDs on both peers instead of configuring unique chassis IDs on both peers. Only committed MC-LAG parameters are checked for consistency.
Benefits of Using MC-LAG Consistency Check
� This feature helps you find configuration-parameter inconsistencies between multichassis link aggregation group (MC-LAG) peers.
How MC-LAG Consistency Checks Work
The following events take place during configuration consistency check after you issue a commit on the local MC-LAG peer: 1. Commit an MC-LAG configuration on the local MC-LAG peer. 2. ICCP parses the MC-LAG configuration and then sends the configuration to the remote MC-LAG
peer. 3. The remote MC-LAG peer receives the MC-LAG configuration from the local MC-LAG peer and
compares it with its own MC-LAG configuration. If the there is a severe inconsistency between the two MC-LAG configurations, the MC-LAG interface is brought down, and syslog messages are issued. If there is a moderate inconsistency between the two configurations, syslog messages are issued. The following events take place during configuration consistency check after you issue a commit on the remote MC-LAG peer: � Commit an MC-LAG configuration on the remote MC-LAG peer. � ICCP parses the MC-LAG configuration and then sends the configuration to the local MC-LAG peer.
15
� The local MC-LAG peer receives the configuration from the remote MC-LAG peer and compares it with its own configuration.
If the there is a severe inconsistency between the two configurations, the MC-LAG interface is brought down, and syslog messages are issued.
If there is a moderate inconsistency between the two configurations, syslog messages are issued.
Configuration Consistency Requirements
There are different configuration consistency requirements depending on the MC-LAG parameters. The consistency requirements are either identical or unique, which means that some parameters must be configured identically and some must be configured uniquely on the MC-LAG peers. For example, the chassis ID must be unique on both peers, whereas the LACP mode must be identical on both peers.
The enforcement level of the consistency requirements (identical or unique) is either mandatory or desired. When the enforcement level is mandatory, and you configure the MC-LAG parameter incorrectly, the system brings down the interface and issues a syslog message.
For example, you receive a syslog message that says, "Some of the Multichassis Link Aggregation (MCLAG) configuration parameters between the peer devices are not consistent. The concerned MC-LAG interfaces were explictly brought down to prevent unwanted behavior." When you correct the inconsistency, and issue a successful commit, the system will bring up the interface. When the enforcement is desired, and you configure the MC-LAG parameter incorrectly, you receive a syslog message that says, "Some of the Multichassis Link Aggregation(MC-LAG) configuration parameters between the peer devices are not consistent. This may lead to sub-optimal performance of the feature." As noted in the syslog message, performance will be sub-optimal in this situation. You can also issue the "show interfaces mc-ae" on page 484 command to display the configuration consistency check status of the multichassis aggregated Ethernet interface.
If there are multiple inconsistencies, only the first inconsistency is shown. If the enforcement level for an MC-LAG parameter is mandatory, and you did not configure that parameter correctly, the command shows that the MC-LAG interface is down.
When Remote Peers are Not Reachable
When you issue a commit on the local peer, and the remote peer is not reachable, configuration consistency check will pass so that the local peer can come up in standalone mode. When the remote peer comes up, ICCP exchanges the configurations between the peers. If the consistency check fails, the MC-LAG interface goes down, and the system notifies you of the parameter that caused the inconsistency. When you correct the inconsistency, and issue a successful commit, the system brings up the interface.
16
Enabling MC-LAG Configuration Consistency Checking
Consistency check is not enabled by default. To enable consistency check, issue the set multi-chassis mc-lag consistency-check command.
Table 1 on page 16 provides a sample list of committed MC-LAG parameters that are checked for consistency, along with their consistency requirements (identical or unique), hierarchies in which the parameters are configured, and the consistency check enforcement levels (mandatory or desired).
Table 1: MC-LAG Parameters Checked for Configuration Consistency
Configuration Knob
Hierarchy
Consistency Requirement
Enforcement
session-establishment-hold-time
Specify the time during which an Inter-Chassis Control Protocol (ICCP) connection must be established between peers.
Global, ICCP Peer
Identical
Mandatory
mac-limit
Specify the maximum number of MAC addresses to be associated with a VLAN--the default is unlimited, which can leave the network vulnerable to flooding.
Global
Identical
Desired
mac-aging-timer
Specify how long MAC addresses remain in the Ethernet switching table.
Global
Identical
Desired
arp-aging-timer
Specify the ARP aging timer in minutes for a logical interface of inet.
Global
Identical
Desired
17
Table 1: MC-LAG Parameters Checked for Configuration Consistency (Continued)
Configuration Knob
Hierarchy
Consistency Requirement
Enforcement
rstp-system-identifier
Global
Specify different bridge identifiers for different RSTP routing instances.
Identical
Desired
mstp-system-identifier
Global
Specify different bridge identifiers for different MSTP routing instances.
Identical
Desired
rstp-bridge-priority
Global
Determine which bridge is elected as the root bridge for RSTP. If two bridges have the same path cost to the root bridge, the bridge priority determines which bridge becomes the designated bridge for a LAN segment.
Identical
Desired
mstp-bridge-priority
Global
Determine which bridge is elected as the root bridge for MSTP. If two bridges have the same path cost to the root bridge, the bridge priority determines which bridge becomes the designated bridge for a LAN segment.
Identical
Desired
18
Table 1: MC-LAG Parameters Checked for Configuration Consistency (Continued)
Configuration Knob
Hierarchy
Consistency Requirement
Enforcement
rstp-bpdu-block-on-edge
Global
Configure bridge protocol data unit (BPDU) protection on all edge ports of a switch for RSTP.
Identical
Desired
vstp-bpdu-block-on-edge
Global
Configure bridge protocol data unit (BPDU) protection on all edge ports of a switch for VSTP.
Identical
Desired
mstp-bpdu-block-on-edge
Global
Configure bridge protocol data unit (BPDU) protection on all edge ports of a switch for MSTP.
Identical
Desired
service-id
Global
Specify a service identifier for each multichassis aggregated Ethernet interface that belongs to a link aggregation group (LAG).
Identical
Mandatory
bfd minimum-interval
ICCP Peer
Configure the minimum interval after which the local routing device transmits hello packets and then expects to receive a reply from a neighbor with which it has established a BFD session.
Identical
Mandatory
19
Table 1: MC-LAG Parameters Checked for Configuration Consistency (Continued)
Configuration Knob
Hierarchy
Consistency Requirement
Enforcement
iccp/minimum-transmit-interval
Specify the minimum interval at which the local routing device transmits hello packets to a neighbor with which it has established a BFD session.
ICCP Peer
Identical
Mandatory
iccp/minimum-receive-interval
ICCP Peer
Specify the minimum interval after which the local routing device must receive a reply from a neighbor with which it has established a BFD session.
Identical
Mandatory
iccp/bfd multiplier
Configure the number of hello packets not received by a neighbor that causes the originating interface to be declared down.
ICCP Peer
Identical
Mandatory
iccp single-hop
Configure single hop BFD sessions.
ICCP Peer
Identical
Mandatory
iccp/authentication-key
Specify the authentication key password to verify the authenticity of packets sent from the peers hosting an MC-LAG.
ICCP Peer
Identical
Mandatory
20
Table 1: MC-LAG Parameters Checked for Configuration Consistency (Continued)
Configuration Knob
Hierarchy
Consistency Requirement
Enforcement
redundancy-group-id-list
Specify the redundancy group identification number. The InterChassis Control Protocol (ICCP) uses the redundancy group ID to associate multiple chassis that perform similar redundancy functions.
ICCP Peer
Identical
Mandatory
backup-liveness-detection
ICCP Peer
Determine whether a peer is up or down by exchanging keepalive messages over the management link between the two InterChassis Control Protocol (ICCP) peers.
Unique
Mandatory
mc-ae-id
Specify the identification number of the MC-LAG device.
MCAE ifd
Identical
Mandatory
mcae redundancy-group
MCAE ifd
Used by ICCP to associate multiple chassis that perform similar redundancy functions and to establish a communication channel so that applications on peering chassis can send messages to each other.
Identical
Mandatory
21
Table 1: MC-LAG Parameters Checked for Configuration Consistency (Continued)
Configuration Knob
Hierarchy
Consistency Requirement
Enforcement
mcae chassis-id
Used by LACP for calculating the port number of the MC-LAG's physical member links.
MCAE ifd
Unique
Mandatory
mcae deployment mode
MCAE ifd
Indicates whether an MC-LAG is in active-standby mode or activeactive mode.
Identical
Mandatory
mcae status-control
Specify whether the chassis becomes active or remains in standby mode when an interchassis link failure occurs.
MCAE ifd
Unique
Mandatory
force-icl-down
MCAE ifd
Specify that if the ICCP peer goes down, the system brings down the interchassis-link logical interface.
Unique
Mandatory
prefer-status-control-active
Specify that the node configured as status-control active becomes the active node if the peer of this node goes down.
MCAE ifd
Unique
Desired
lacp mode Specify LACP is active or passive.
MCAE ifd
Identical
Mandatory
22
Table 1: MC-LAG Parameters Checked for Configuration Consistency (Continued)
Configuration Knob
Hierarchy
Consistency Requirement
Enforcement
lacp periodic
Specify the interval for periodic transmission of LACP packets.
MCAE ifd
Identical
Mandatory
lacp system-id
MCAE ifd
Define the LACP system identifier at the aggregated Ethernet interface level.
Identical
Mandatory
lacp admin-key
Specify an administrative key for the router or switch.
MCAE ifd
Identical
Mandatory
native-vlan-id
Configure mixed tagging support for untagged packets on a port.
MCAE ifd
Identical
Mandatory
mcae-mac-synchronize
Synchronize the MAC addresses for the Layer 3 interfaces of the switches participating in the MCLAG.
VLAN
Identical
Mandatory
Interface mac Limit
VLAN
Configure a limit to the number of MAC addresses that can be learned from a bridge domain, VLAN, virtual switch, or set of bridge domains or VLANs.
Identical
Desired
23
Table 1: MC-LAG Parameters Checked for Configuration Consistency (Continued)
Configuration Knob
Hierarchy
Consistency Requirement
Enforcement
l3-interface
VLAN
Associate a Layer 3 interface with the VLAN.
Identical
Desired
igmp-snooping
VLAN
Enable IGMP snooping. A Layer 2 device monitors the IGMP join and leave messages sent from each connected host to a multicast router. This enables the Layer 2 device to keep track of the multicast groups and associated member ports. The Layer 2 device uses this information to make intelligent decisions and to forward multicast traffic to only the intended destination hosts.
Identical
Mandatory
family
IRB Interface
Specify the protocol family configured on the logical interface.
Identical
Mandatory
ipv4 address
Specify an IPv4 address for the IRB interface.
IRB Interface
Unique
Mandatory
ipv6 address
Specify an IPv6 address for the IRB interface.
IRB Interface
Unique
Mandatory
24
Table 1: MC-LAG Parameters Checked for Configuration Consistency (Continued)
Configuration Knob
Hierarchy
Consistency Requirement
Enforcement
vrrp-group id Specify a VRRP group identifier.
IRB Interface
Identical
Mandatory
proxy-arp-type
IRB Interface
For Ethernet interfaces only, configure the router or switch to respond to any ARP request, as long as the router or switch has an active route to the ARP request target address.
Identical
Mandatory
vrrp-group priority
VRRP Group
Configure a Virtual Router Redundancy Protocol (VRRP) router priority for becoming the primary default router. The router with the highest priority within the group becomes the primary.
Unique
Mandatory
vrrp-group authentication-key
VRRP Group
Configure a Virtual Router Redundancy Protocol (VRRP) IPv4 authentication key. You also must specify a VRRP authentication scheme by including the authentication-type statement.
Identical
Mandatory
25
Table 1: MC-LAG Parameters Checked for Configuration Consistency (Continued)
Configuration Knob
Hierarchy
Consistency Requirement
Enforcement
vrrp-group authentication-type VRRP Group
Enable Virtual Router Redundancy Protocol (VRRP) IPv4 authentication and specify the authentication scheme for the VRRP group.
Identical
Mandatory
vrrp-group virtual-address
VRRP Group
Configure the addresses of the virtual routers in a Virtual Router Redundancy Protocol (VRRP) IPv4 or IPv6 group.
Identical
Mandatory
encapsulation
Configure a logical link-layer encapsulation type.
MCAE ifd
Identical
Mandatory
flexible-vlan-tagging
MCAE ifd
Support simultaneous transmission of 802.1Q VLAN single-tag and dual-tag frames on logical interfaces on the same Ethernet port, and on pseudowire logical interfaces.
Identical
Mandatory
26
Table 1: MC-LAG Parameters Checked for Configuration Consistency (Continued)
Configuration Knob
Hierarchy
Consistency Requirement
Enforcement
vlan-tagging
MCAE ifd
For Fast Ethernet and Gigabit Ethernet interfaces, aggregated Ethernet interfaces configured for VPLS, and pseudowire subscriber interfaces, enable the reception and transmission of 802.1Q VLAN-tagged frames on the interface.
Identical
Mandatory
mtu
MCAE ifd, ICL ifd
Specify the maximum transmission unit (MTU) size for the media or protocol.
Identical
Mandatory
interface-mode
Determine whether the logical interface accepts or discards packets based on VLAN tags.
MCAE ifl
Identical
Mandatory
vlan membership
Specify the name of the VLAN that belongs to an interface.
MCAE ifl
Identical
Mandatory
Learning the Status of a Configuration Consistency Check
The following commands provide information regarding the status of configuration consistency check:
� Issue the "show multi-chassis mc-lag configuration-consistency list-of-parameters" on page 495 command to view the list of committed MC-LAG parameters that are checked for inconsistencies, the consistency requirement (identical or unique), and the enforcement level (mandatory or desired).
27
� Issue the "show multi-chassis mc-lag configuration-consistency" on page 510 command to view the list of committed MC-LAG parameters that are checked for inconsistencies, the consistency requirement (identical or unique), the enforcement level (mandatory or desired), and the result of the configuration consistency check. The results are either pass or fail.
� Issue the "show multi-chassis mc-lag configuration-consistency global-config" on page 517 command to view configuration consistency check status for all global configuration related to MC-LAG functionality, the consistency requirement (identical or unique), the enforcement level (mandatory or desired), and the result of the configuration consistency check. The results are either pass or fail..
� Issue the "show multi-chassis mc-lag configuration-consistency icl-config" on page 520 command to view configuration consistency check status for parameters related to the interchassis control link, the consistency requirement (identical or unique), the enforcement level (mandatory or desired), and the result of the configuration consistency check. The results are either pass or fail.
� Issue the "show multi-chassis mc-lag configuration-consistency mcae-config" on page 523 command to view configuration consistency check status for parameters related to the multichassis aggregated Ethernet interface, the consistency requirement (identical or unique), the enforcement level (mandatory or desired), and the result of the configuration consistency check. The results are either pass or fail.
� Issue the "show multi-chassis mc-lag configuration-consistency vlan-config" on page 528 command to view configuration consistency check status for parameters related to VLAN configuration, the consistency requirement (identical or unique), the enforcement level (mandatory or desired), and the result of the configuration consistency check. The results are either pass or fail..
� Issue the "show multi-chassis mc-lag configuration-consistency vrrp-config" on page 532 command to view configuration consistency check status for parameters related to VRRP configuration, the consistency requirement (identical or unique), the enforcement level (mandatory or desired), and the result of the configuration consistency check. The results are either pass or fail.
� Issue the "show interfaces mc-ae" on page 484 command to view configuration consistency check status of the multichassis aggregated Ethernet interface. If there are multiple inconsistencies, only the first inconsistency is shown. If the enforcement level for the MC-LAG parameter is mandatory, and you did not configure that parameter correctly, the command will show that the MC-LAG interface is down.
Support for MC-LAG Configuration Consistency Checking
Both EX Series switches and QFX Series switches support MC-LAG configuration consistency checking.
Starting with Junos OS Release 15.1X53-D60 on QFX10000 switches, configuration consistency check uses the Inter-Chassis Control Protocol (ICCP) to exchange MC-LAG configuration parameters (chassis ID, service ID, and so on) and checks for any configuration inconsistencies across MC-LAG peers.
28
SEE ALSO Configuring MC-LAG on EX9200 Switches in the Core for Campus Networks
Unknown Unicast and IGMP Snooping
� During an MC-LAG peer reboot, known multicast traffic is flooded until the IGMP snooping state is synchronized with the peer.
� Flooding happens on all links across peers if both peers have virtual LAN membership. Only one of the peers forwards traffic on a given MC-LAG link.
� Known and unknown multicast packets are forwarded across the peers by adding the ICL port as a multicast router port.
� IGMP membership learned on MC-LAG links is propagated across peers. You must configure the multichassis-lag-replicate-state statement for Internet Group Management Protocol (IGMP) snooping to work properly in an MC-LAG environment. During an MC-LAG peer reboot, known multicast traffic is flooded until the IGMP snooping state is synchronized with the peer.
Layer 3 Unicast Feature Support
Layer 3 unicast feature support includes the following: � VRRP active-standby support enables Layer 3 routing over MC-AE interfaces. � Routed VLAN interface (RVI) or IRB MAC address synchronization enables MC-LAG peers to forward
Layer 3 packets arriving on MC-AE interfaces with either its own RVI or IRB MAC address or its peers RVI or IRB MAC address. � Address Resolution Protocol (ARP) synchronization enables ARP resolution on both of the MC-LAG peers. � DHCP relay with option 82 enables option 82 on the MC-LAG peers. Option 82 provides information about the network location of DHCP clients. The DHCP server uses this information to implement IP addresses or other parameters for the client.
29
MAC Address Management
If an MC-LAG is configured to be active-active, upstream and downstream traffic could go through different MC-LAG peer devices. Because the MAC address is learned only on one of the MC-LAG peers, traffic in the reverse direction could be going through the other MC-LAG peer and flooding the network unnecessarily. Also, a single-homed client's MAC address is learned only on the MC-LAG peer that it is attached to. If a client attached to the peer MC-LAG network device needs to communicate with that single-homed client, then traffic would be flooded on the peer MC-LAG network device. To avoid unnecessary flooding, whenever a MAC address is learned on one of the MC-LAG peers, the address is replicated to the other MC-LAG peer. The following conditions are applied when MAC address replication is performed:
NOTE: Gratuitous ARP requests are not sent when the MAC address on the IRB or RVI interface changes.
� MAC addresses learned on an MC-LAG of one MC-LAG peer must be replicated as learned on the same MC-LAG of the other MC-LAG peer.
� MAC addresses learned on single-homed customer edge (CE) clients of one MC-LAG peer must be replicated as learned on the ICL interface of the other MC-LAG peer.
� MAC address learning on an ICL is disabled from the data path. It depends on software to install MAC addresses replicated through ICCP.
If you have a VLAN without an IRB or RVI configured, MAC address replication will synchronize the MAC addresses.
MAC Aging
MAC aging support in Junos OS extends aggregated Ethernet logic for a specified MC-LAG. A MAC address in software is not deleted until all Packet Forwarding Engines have deleted the MAC address.
Address Resolution Protocol Active-Active MC-LAG Support Methodology
The Address Resolution Protocol (ARP) maps IP addresses to MAC addresses. Junos OS uses ARP response packet snooping to support active-active MC-LAGs, providing easy synchronization without
30
the need to maintain any specific state. Without synchronization, if one MC-LAG peer sends an ARP request, and the other MC-LAG peer receives the response, ARP resolution is not successful. With synchronization, the MC-LAG peers synchronize the ARP resolutions by sniffing the packet at the MCLAG peer receiving the ARP response and replicating this to the other MC-LAG peer. This ensures that the entries in ARP tables on the MC-LAG peers are consistent.
When one of the MC-LAG peers restarts, the ARP destinations on its MC-LAG peer are synchronized. Because the ARP destinations are already resolved, its MC-LAG peer can forward Layer 3 packets out of the multichassis aggregated Ethernet interface.
DHCP Relay with Option 82
DHCP relay with option 82 provides information about the network location of DHCP clients. The DHCP server uses this information to implement IP addresses or other parameters for the client. With DHCP relay enabled, DHCP request packets might take the path to the DHCP server through either of the MC-LAG peers. Because the MC-LAG peers have different host names, chassis MAC addresses, and interface names, you need to observe these requirements when you configure DHCP relay with option 82:
If your environment only supports IPv6 or you must use the extended DHCP relay agent (jdhcp) process for other reasons, then as a workaround, you can configure forward-only support by using the forwarding-options dhcp-relay forward-only command for IPv4 and the forwarding-options dhcpv6 forward-only command for IPv6. You must also verify that your DHCP server in the network supports option 82.
DHCP relay with option 82 provides information about the network location of DHCP clients. The DHCP server uses this information to implement IP addresses or other parameters for the client. With DHCP relay enabled, DHCP request packets might take the path to the DHCP server through either of the MC-LAG peers. Because the MC-LAG peers have different hostnames, chassis MAC addresses, and interface names, you need to observe these requirements when you configure DHCP relay with option 82:
� Use the interface description instead of the interface name.
� Do not use the hostname as part of the circuit ID or remote ID string.
� Do not use the chassis MAC address as part of the remote ID string.
� Do not enable the vendor ID.
� If the ICL interface receives DHCP request packets, the packets are dropped to avoid duplicate packets in the network.
31
A counter called Due to received on ICL interface has been added to the show helper statistics command, which tracks the packets that the ICL interface drops. An example of the CLI output follows:
user@switch> show helper statistics BOOTP:
Received packets: 6 Forwarded packets: 0 Dropped packets: 6
Due to no interface in DHCP Relay database: 0 Due to no matching routing instance: 0 Due to an error during packet read: 0 Due to an error during packet send: 0 Due to invalid server address: 0 Due to no valid local address: 0 Due to no route to server/client: 0 Due to received on ICL interface: 6
The output shows that six packets received on the ICL interface have been dropped.
Layer 2 Unicast Features Supported
� NOTE: MAC learning is disabled on the ICL automatically. Consequently, source MAC addresses cannot be learned locally on the ICL. However, MAC addresses from a remote MCLAG node can be installed on the ICL interface. For example, the MAC address for a singlehomed client on a remote MC-LAG node can be installed on the ICL interface of the local MC-LAG node.
How layer 2 unicast learning and aging works: � Learned MAC addresses are propagated across MC-LAG peers for all of the VLANs that are spawned
across the peers. � Aging of MAC addresses occurs when the MAC address is not seen on both of the peers. � MAC addresses learned on single-homed links are propagated across all of the VLANs that have MC-
LAG links as members.
32
Protocol Independent Multicast
IN THIS SECTION PIM Operation with Normal Mode Designated Router Election | 32 PIM Operation with Dual Designated Router Mode | 33 Failure Handling | 33
Protocol Independent Multicast (PIM) and Internet Group Management Protocol (IGMP) provide support for Layer 3 multicast. In addition to the standard mode of PIM operation, there is a special mode called PIM dual designated router. PIM dual designated router minimizes multicast traffic loss in case of failures. If you are using Layer 3 multicast, configure the IP address on the active MC-LAG peer with a high IP address or a high designated router priority.
NOTE: PIM dual designated router is not supported on EX9200 and QFX10000 switches.
PIM operation is discussed in the following sections:
PIM Operation with Normal Mode Designated Router Election
In normal mode with designated router election, the IRB or RVI interfaces on both of the MC-LAG peers are configured with PIM enabled. In this mode, one of the MC-LAG peers becomes the designated router through the PIM designated router election mechanism. The elected designated router maintains the rendezvous-point tree (RPT) and shortest-path tree (SPT) so it can receive data from the source device. The elected designated router participates in periodic PIM join and prune activities toward the rendezvous point or the source. The trigger for initiating these join and prune activities is the IGMP membership reports that are received from interested receivers. IGMP reports received over multichassis aggregated Ethernet interfaces (potentially hashing on either of the MC-LAG peers) and single-homed links are synchronized to the MC-LAG peer through ICCP. Both MC-LAG peers receive traffic on their incoming interface (IIF). The non-designated router receives traffic by way of the ICL interface, which acts as a multicast router (mrouter) interface.
33
If the designated router fails, the non-designated router has to build the entire forwarding tree (RPT and SPT), which can cause multicast traffic loss.
PIM Operation with Dual Designated Router Mode
In dual designated router mode, both of the MC-LAG peers act as designated routers (active and standby) and send periodic join and prune messages upstream toward the rendezvous point, or source, and eventually join the RPT or SPT.
The primary MC-LAG peer forwards the multicast traffic to the receiver devices even if the standby MCLAG peer has a smaller preference metric.
The standby MC-LAG peer also joins the forwarding tree and receives the multicast data. The standby MC-LAG peer drops the data because it has an empty outgoing interface list (OIL). When the standby MC-LAG peer detects the primary MC-LAG peer failure, it adds the receiver VLAN to the OIL, and starts to forward the multicast traffic.
To enable a multicast dual designated router, issue the set protocols pim interface interface-name dualdr command on the VLAN interfaces of each MC-LAG peer.
Failure Handling
To ensure faster convergence during failures, configure the IP address on the primary MC-LAG peer with a higher IP address or with a higher designated router priority. Doing this ensures that the primary MCLAG peer retains the designated router membership if PIM peering goes down.
To ensure that traffic converges if an MC-AE interfaces goes down, the ICL-PL interface is always added as an mrouter port. Layer 3 traffic is flooded through the default entry or the snooping entry over the ICL-PL interface, and the traffic is forwarded on the MC-AE interface on the MC-LAG peer. If the ICL-PL interface goes down, PIM neighborship goes down. In this case, both MC-LAG peers become the designated router. The backup MC-LAG peer brings down its links and the routing peering is lost. If the ICCP connection goes down, the backup MC-LAG peer changes the LACP system ID and brings down the MC-AE interfaces. The state of PIM neighbors remains operational.
IGMP Report Synchronization
IGMP reports received over MC-AE interfaces and single-homed links are synchronized to the MC-LAG peers. The MCSNOOPD client application on the MC-LAG peer receives the synchronization packet over ICCP and then sends a copy of the packet to the kernel using the routing socket PKT_INJECT mechanism. When the kernel receives the packet, it sends the packet to the routing protocol process (rpd) enables Layer 3 multicast protocols, like PIM and IGMP, on routed VLAN interfaces (RVIs) configured on MC-LAG VLANs.
34
IGMP Snooping in MC-LAG Active-Active Mode
IN THIS SECTION IGMP Snooping in MC-LAG Active-Active Mode Functionality | 34 Typically Supported Network Topology for IGMP Snooping with MC-LAG Active-Active Bridging | 36 Control Plane State Updates Triggered by Packets Received on Remote Chassis | 37 Data Forwarding | 37 Pure Layer 2 Topology Without Integrated Routing and Bridging | 38 Qualified Learning | 38 Data Forwarding with Qualified Learning | 39 Static Groups on Single-Homed Interfaces | 40 Router-Facing Interfaces as Multichassis Links | 40
IGMP snooping in MC-LAG active-active mode is supported on MX240 routers, MX480 routers, MX960 routers and QFX Series switches. The following topics are included:
IGMP Snooping in MC-LAG Active-Active Mode Functionality
Multichassis link aggregation group (MC-LAG) active-active mode and IGMP snooping in active-standby mode are supported. MC-LAG allows one device to form a logical LAG interface with two or more network devices. MC-LAG provides additional benefits including node level redundancy, multihoming, and a loop-free Layer 2 network without running Spanning Tree Protocol (STP). The following features are supported: � State synchronization between peers for IGMP snooping in a bridge domain with only Layer 2
interfaces � Qualified learning � Router-facing multichassis links The following enhancements to active-active bridging and Virtual Router Redundancy Protocol (VRRP) over integrated routing and bridging (IRB) are supported: � MC-LAG support for IGMP snooping in a pure Layer 2 switch
35
� MC-LAG support for IGMP snooping in bridge domains doing qualified learning � Support for MC-Links being router-facing interfaces The following functions are not supported: � MC-LAG for VPLS instances � MC-Links trunk ports � Proxy mode for active-active � Adding interchassis links to outgoing interfaces on an as needed basis
Interchassis links can be added to the outgoing interface list as router-facing interfaces.
36
Typically Supported Network Topology for IGMP Snooping with MC-LAG ActiveActive Bridging
Figure 2 on page 36 depicts a typical network topology over which IGMP snooping with MC-LAG active-active bridging is supported. Figure 2: Typical Network Over Which Active-Active Is Supported
Interfaces I3 and I4 are single-homed interfaces. The multichassis links ae0.0 and ae0.1 belong to the same bridge domain in both the chassis. Interfaces I3, ae0.0, and ae0.1 are in the same bridge domain in the secondary active (S-A) router. Interfaces I4, ae0.0, and ae0.1 are in the same bridge domain in the primary active (P-A) router. Interfaces I3, I4, ae0.0, and ae0.1 are in the same learning domain as is the interchassis link (ICL) connecting the two chassis. The primary active router is the chassis in which integrated routing and bridging has become PIM-DR. The secondary active router is the chassis in which integrated routing and bridging is not PIM-DR. Router P-A is the chassis responsible for pulling traffic from the IP core. Hence, PIM-DR election is used to avoid duplication of data traffic. Learning domains are described in "Qualified Learning" on page 38.
37
For the IGMP speakers (hosts and routers) in the learning domain, P-A and S-A together should appear as one device with interfaces I4, I3, ae0.0, and ae0.1. No duplicate control packets should be sent on multichassis links, meaning the control packet should be sent through only one link.
Control Plane State Updates Triggered by Packets Received on Remote Chassis
Following are the control plane state updates that are triggered by the packets received on remote chassis: � The membership state in Layer 3 multicast routing is updated as a result of reports learned on
remote legs of multichassis links and S-links attached to the remote chassis.
� The membership state and routing entry in snooping are updated when reports are received on the remote legs of a multichassis link.
NOTE: � When reports are received on S-links attached to the remote chassis, the membership state or
routing entry in snooping is not updated.
� When synchronizing multicast snooping state between PE routers, timers, such as the Group Membership Timeout timer, are not synchronized. When the synch notification is received, the remote PE router receiving the notification starts or restarts the relevant timer.
� The list of <s,g>s for which the state is maintained is the same in both the chassis under snooping as long as the outgoing interface lists involve only multichassis links.
Data Forwarding
This discussion assumes integrated routing and bridging on Router P-A is the PIM-DR. It pulls the traffic from sources in the core. Traffic might also come on Layer 2 interfaces in the bridge domain. For hosts directly connected to the P-A chassis, there is no change in the way data is delivered. For delivering traffic to hosts connected to S-A (which is the non-DR) on the single-homed link like I3, we rely on the interchassis link. The traffic that hits P-A is sent over ICL to S-A to be delivered to the links that have reported interests in s,g and the links that are router-facing. When the ae0 leg in P-A goes down, the hosts connected to the multichassis link receive traffic through ICL. In S-A, traffic received on ICL is sent to multichassis links in the outgoing interface list for which the ae counterpart in P-A is down.
38
Pure Layer 2 Topology Without Integrated Routing and Bridging
Figure 3 on page 38 shows that the chassis connecting to the PIM-DR is the primary active (P-A) router and the other is the secondary active (S-A) router. Figure 3: Layer 2 Configuration Without Integrated Routing and Bridging
Qualified Learning
In this topology, interfaces I1, I2, I3, I4, I5, I6, I7, I8, I9, and I10 are single-homed interfaces. The multichassis links ae0.0 and ae0.1 belong to the same bridge domain in both the chassis. Interfaces I10, I1,I7,I3,I5, ae0.0 and ae0.1 are in same bridge domain, bd1 in P-A. Interfaces I9, I2, I8, I4, I6, ae0.0, and ae0.1 are in same bridge domain, bd1 in S-A.
39
This discussion assumes the following configuration:
� In P-A and S-A, qualified learning is ON in bd1.
� Interfaces I1, I2, I3, ae0.0, and I4 belong to vlan1, learning domain ld1.
� Interfaces I7, I8, I5, ae0.1, and I6 belong to vlan2, learning domain ld2.
� Interfaces I9 and I10 belong to vlan3, learning domain ld3.
For the IGMP speakers (hosts and routers) in the same learning domain ld1, P-A and S-A linked should appear to be one switch.
For the IGMP speakers (hosts and routers) in the same learning domain ld2, P-A and S-A linked should appear to be one switch.
Since there are no multichassis links in learning domain ld3, for the IGMP speakers (hosts and routers) in learning domain ld3, P-A and S-A will not appear to be one switch.
This discussion assumes interchassis link ICL1 corresponds to learning domain ld1 and interchassis link ICL2 corresponds to learning domain ld2.
Control packet flow is supported, with the exception of passing information to IRB.
Data Forwarding with Qualified Learning
This discussion assumes one learning domain (LD), ld1, and further assumes that interface I1 on Router P-A is connected to the PIM-DR in the learning domain and pulls the traffic from sources in the core.
For delivering traffic to hosts connected to Router S-A (which is the non-DR) on the single-homed link like I2, I4 (belonging to ld1), we rely on ICL1. The traffic that hits Router P-A on interface I1 is sent over interchassis link ICL1 to Router S-A to be delivered to the links that have reported interests in s,g or the links that are router-facing in learning domain ld1.
When the interface ae0 leg in Router P-A goes down, the hosts connected to the multichassis link receive traffic from interface I1 using the interchassis link ICL1. In Router S-A, traffic received on interchassis link ICL1 is sent to multichassis links in the outgoing interface list for which the aggregated Ethernet counterpart in Router P-A is down.
It is further assumed that interface I9 in Router S-A belongs to the learning domain ld3 with interests in s,g, and that interface I10 in learning domain ld3 in Router P-A receives traffic for s,g. Interface I9 does not receive data in this topology because there are no multichassis links (in a-a mode) and hence no interchassis link in learning domain ld3.
40
Static Groups on Single-Homed Interfaces
For multichassis links, the static group configuration should exist on both legs, and synchronization with the other chassis is not required. Synchronization of the static groups on single-homed interfaces between the chassis is not supported. However, the addition of logical interfaces to the default outgoing interface list supports traffic delivery to the interface within a static configuration.
Router-Facing Interfaces as Multichassis Links
IGMP queries could arrive on either leg of the multichassis links, but in both peers, the multichassis link should be considered as router-facing. Reports should exit only once from the multichassis link, that is, from only one leg. The following MC-LAG support for IGMP snooping in IRB is provided: � Non-proxy snooping � Logical interfaces must be outgoing interfaces for all routes including the default route � IGMP snooping in a pure Layer 2 switch � IGMP snooping in bridge domains doing qualified learning � Router-facing interface MC-Links The following features are not supported: � Proxy mode for active-active � MC-LAG support for VPLS instances � Trunk ports as multichassis links � Adding logical interfaces to outgoing interfaces on an as need basis.
However, logical interfaces are always added as a router-facing interface to the outgoing interface list.
SEE ALSO Example: Configuring IGMP Snooping
41
Understanding MC-LAGs on an FCoE Transit Switch
IN THIS SECTION Supported MC-LAG Topology | 41 FIP Snooping and FCoE Trusted Ports | 44 CoS and Data Center Bridging (DCB) | 44
Use an MC-LAG to provide a redundant aggregation layer for Fibre Channel over Ethernet (FCoE) traffic. This topic describes:
Supported MC-LAG Topology
To support lossless transport of FCoE traffic across an MC-LAG, you must configure the appropriate class of service (CoS) on both of the switches with MC-LAG port members. The CoS configuration must be the same on both of the MC-LAG switches because MC-LAGs do not carry forwarding class and IEEE 802.1p priority information.
42 Switches that are not directly connected to FCoE hosts and that act as pass-through transit switches support MC-LAGs for FCoE traffic in an inverted-U network topology. Figure 4 on page 42 shows an inverted-U topology using QFX3500 switches. Figure 4: Supported Topology for an MC-LAG on an FCoE Transit Switch
Standalone switches support MC-LAGs. QFabric system Node devices do not support MC-LAGs. Virtual Chassis and mixed-mode Virtual Chassis Fabric (VCF) configurations do not support FCoE. Only pure QFX5100 VCFs (consisting of only QFX5100 switches) support FCoE. Ports that are part of an FCoE-FC gateway configuration (a virtual FCoE-FC gateway fabric) do not support MC-LAGs. Ports that are members of an MC-LAG act as pass-through transit switch ports. The following rules and guidelines apply to MC-LAGs when used for FCoE traffic. The rules and guidelines help to ensure the proper handling and lossless transport characteristics required for FCoE traffic. � The two switches that form the MC-LAG (Switches S1 and S2) cannot use ports that are part of an
FCoE-FC gateway fabric. The MC-LAG switch ports must be pass-through transit switch ports (used as part of an intermediate transit switch that is not directly connected to FCoE hosts). � MC-LAG Switches S1 and S2 cannot be directly connected to the FCoE hosts.
43
� The two switches that serve as access devices for FCoE hosts (FCoE Transit Switches TS1 and TS2) use standard LAGs to connect to MC-LAG Switches S1 and S2. FCoE Transit Switches TS1 and TS2 can be standalone switches or they can be Node devices in a QFabric system.
� Transit Switches TS1 and TS2 must use transit switch ports for the FCoE hosts and for the standard LAGs to MC-LAG Switches S1 and S2.
� Enable FIP snooping on the FCoE VLAN on Transit Switches TS1 and TS2. You can configure either VN_Port to VF_Port (VN2VF_Port) FIP snooping or VN_Port to VN_Port (VN2VN_Port) FIP snooping, depending on whether the FCoE hosts need to access targets in the FC SAN (VN2VF_Port FIP snooping) or targets in the Ethernet network (VN2VN_Port FIP snooping).
FIP snooping should be performed at the access edge and is not supported on MC-LAG switches. Do not enable FIP snooping on MC-LAG Switches S1 and S2. (Do not enable FIP snooping on the MCLAG ports that connect Switches S1 and S2 to Switches TS1 and TS2 or on the LAG ports that connect Switch S1 to S2.)
NOTE: Juniper Networks QFX10000 aggregation switches do not support FIP snooping, so they cannot be used as FIP snooping access switches (Transit Switches TS1 and TS2) in this topology.
� The CoS configuration must be consistent on the MC-LAG switches. Because MC-LAGs carry no forwarding class or priority information, each MC-LAG switch needs to have the same CoS configuration to support lossless transport. (On each MC-LAG switch, the name, egress queue, and CoS provisioning of each forwarding class must be the same, and the priority-based flow control (PFC) configuration must be the same.)
Transit Switches (Server Access)
The role of FCoE Transit Switches TS1 and TS2 is to connect FCoE hosts in a multihomed fashion to the MC-LAG switches, so Transit Switches TS1 and TS2 act as access switches for the FCoE hosts. (FCoE hosts are directly connected to Transit Switches TS1 and TS2.)
The transit switch configuration depends on whether you want to do VN2VF_Port FIP snooping or VN2VN_Port FIP snooping, and whether the transit switches also have ports configured as part of an FCoE-FC gateway virtual fabric. Ports that a QFX3500 switch uses in an FCoE-FC gateway virtual fabric cannot be included in the transit switch LAG connection to the MC-LAG switches. (Ports cannot belong to both a transit switch and an FCoE-FC gateway; you must use different ports for each mode of operation.)
44
MC-LAG Switches (FCoE Aggregation)
The role of MC-LAG Switches S1 and S2 is to provide redundant, load-balanced connections between FCoE transit switches. The MC-LAG Switches S1 and S2 act as aggregation switches. FCoE hosts are not directly connected to the MC-LAG switches.
The MC-LAG switch configuration is the same regardless of which type of FIP snooping FCoE Transit Switches TS1 and TS2 perform.
FIP Snooping and FCoE Trusted Ports
To maintain secure access, enable VN2VF_Port FIP snooping or VN2VN_Port FIP snooping at the transit switch access ports connected directly to the FCoE hosts. FIP snooping should be performed at the access edge of the network to prevent unauthorized access. For example, in Figure 4 on page 42, you enable FIP snooping on the FCoE VLANs on Transit Switches TS1 and TS2 that include the access ports connected to the FCoE hosts.
Do not enable FIP snooping on the switches used to create the MC-LAG. For example, in Figure 4 on page 42, you would not enable FIP snooping on the FCoE VLANs on Switches S1 and S2.
Configure links between switches as FCoE trusted ports to reduce FIP snooping overhead and ensure that the system performs FIP snooping only at the access edge. In the sample topology, configure the Transit Switch TS1 and TS2 LAG ports connected to the MC-LAG switches as FCoE trusted ports, configure the Switch S1 and S2 MC-LAG ports connected to Switches TS1 and TS2 as FCoE trusted ports, and configure the ports in the LAG that connects Switches S1 to S2 as FCoE trusted ports.
CoS and Data Center Bridging (DCB)
The MC-LAG links do not carry forwarding class or priority information. The following CoS properties must have the same configuration on each MC-LAG switch or on each MC-LAG interface to support lossless transport:
� FCoE forwarding class name--For example, the forwarding class for FCoE traffic could use the default fcoe forwarding class on both MC-LAG switches.
� FCoE output queue--For example, the fcoe forwarding class could be mapped to queue 3 on both MC-LAG switches (queue 3 is the default mapping for the fcoe forwarding class).
� Classifier--The forwarding class for FCoE traffic must be mapped to the same IEEE 802.1p code point on each member interface of the MC-LAG on both MC-LAG switches. For example, the FCoE forwarding class fcoe could be mapped to IEEE 802.1p code point 011 (code point 011 is the default mapping for the fcoe forwarding class).
� Priority-based flow control (PFC)--PFC must be enabled on the FCoE code point on each MC-LAG switch and applied to each MC-LAG interface using a congestion notification profile.
45
You must also configure enhanced transmission selection (ETS) on the MC-LAG interfaces to provide sufficient scheduling resources (bandwidth, priority) for lossless transport. The ETS configuration can be different on each MC-LAG switch, as long as enough resources are scheduled to support lossless transport for the expected FCoE traffic. Link Layer Discovery Protocol (LLDP) and Data Center Bridging Capability Exchange Protocol (DCBX) must be enabled on each MC-LAG member interface (LLDP and DCBX are enabled by default on all interfaces).
NOTE: As with all other FCoE configurations, FCoE traffic requires a dedicated VLAN that carries only FCoE traffic, and IGMP snooping must be disabled on the FCoE VLAN.
Understanding EVPN-MPLS Interworking with Junos Fusion Enterprise and MC-LAG
IN THIS SECTION Benefits of Using EVPN-MPLS with Junos Fusion Enterprise and MC-LAG | 48 BUM Traffic Handling | 48 Split Horizon | 49 MAC Learning | 51 Handling Down Link Between Cascade and Uplink Ports in Junos Fusion Enterprise | 51 Layer 3 Gateway Support | 52
Starting with Junos OS Release 17.4R1, you can use Ethernet VPN (EVPN) to extend a Junos Fusion Enterprise or multichassis link aggregation group (MC-LAG) network over an MPLS network to a data center or campus network. With the introduction of this feature, you can now interconnect dispersed campus and data center sites to form a single Layer 2 virtual bridge. Figure 5 on page 46 shows a Junos Fusion Enterprise topology with two EX9200 switches that serve as aggregation devices (PE2 and PE3) to which the satellite devices are multihomed. The two aggregation devices use an interchassis link (ICL) and the Inter-Chassis Control Protocol (ICCP) protocol
46 from MC-LAG to connect and maintain the Junos Fusion Enterprise topology. PE1 in the EVPN-MPLS environment interworks with PE2 and PE3 in the Junos Fusion Enterprise with MC-LAG. Figure 5: EVPN-MPLS Interworking with Junos Fusion Enterprise
Figure 6 on page 47 shows an MC-LAG topology in which customer edge (CE) device CE1 is multihomed to PE2 and PE3. PE2 and PE3 use an ICL and the ICCP protocol from MC-LAG to connect
47 and maintain the topology. PE1 in the EVPN-MPLS environment interworks with PE2 and PE3 in the MC-LAG environment. Figure 6: EVPN-MPLS Interworking with MC-LAG
Throughout this topic, Figure 5 on page 46 and Figure 6 on page 47 serve as references to illustrate various scenarios and points. The use cases depicted in Figure 5 on page 46 and Figure 6 on page 47 require the configuration of both EVPN multihoming in active-active mode and MC-LAG on PE2 and PE3. EVPN with multihoming activeactive and MC-LAG have their own forwarding logic for handling traffic, in particular, broadcast, unknown unicast, and multicast (BUM) traffic. At times, the forwarding logic for EVPN with multihoming active-active and MC-LAG contradict each other and causes issues. This topic describes the issues and how the EVPN-MPLS interworking feature resolves these issues.
NOTE:
48
Other than the EVPN-MPLS interworking-specific implementations described in this topic, EVPN-MPLS, Junos Fusion Enterprise, and MC-LAG offer the same functionality and function the same as the standalone features.
Benefits of Using EVPN-MPLS with Junos Fusion Enterprise and MC-LAG
Use EVPN-MPLS with Junos Fusion Enterprise and MC-LAG to interconnect dispersed campus and data center sites to form a single Layer 2 virtual bridge.
BUM Traffic Handling
In the use cases shown in Figure 5 on page 46 and Figure 6 on page 47, PE1, PE2, and PE3 are EVPN peers, and PE2 and PE3 are MC-LAG peers. Both sets of peers exchange control information and forward traffic to each other, which causes issues. Table 2 on page 48 outlines the issues that arise, and how Juniper Networks resolves the issues in its implementation of the EVPN-MPLS interworking feature.
Table 2: BUM Traffic: Issues and Resolutions
BUM Traffic Direction
EVPN Interworking with Junos Fusion Enterprise and MCLAG Logic
Issue
Juniper Networks Implementation Approach
North bound (PE2 receives BUM packet from a locally attached single- or dual-homed interfaces).
PE2 floods BUM packet to the following:
� All locally attached interfaces, including the ICL, for a particular broadcast domain.
Between PE2 and PE3, there are two BUM forwarding paths--the MC-LAG ICL and an EVPN-MPLS path. The multiple forwarding paths result in packet duplication and loops.
� All remote EVPN peers for which PE2 has received inclusive multicast routes.
� BUM traffic is forwarded on the ICL only.
� Incoming traffic from the EVPN core is not forwarded on the ICL.
� Incoming traffic from the ICL is not forwarded to the EVPN core.
49
Table 2: BUM Traffic: Issues and Resolutions (Continued)
BUM Traffic Direction
EVPN Interworking with Junos Fusion Enterprise and MCLAG Logic
Issue
Juniper Networks Implementation Approach
South bound (PE1 forwards BUM packet to PE2 and PE3).
PE2 and PE3 both receive a copy of the BUM packet and flood the packet out of all of their local interfaces, including the ICL.
PE2 and PE3 both forward the BUM packet out of the ICL, which results in packet duplication and loops.
Split Horizon
In the use cases shown in Figure 5 on page 46 and Figure 6 on page 47, split horizon prevents multiple copies of a BUM packet from being forwarded to a CE device (satellite device). However, the EVPNMPLS and MC-LAG split horizon implementations contradict each other, which causes an issue. Table 3 on page 50 explains the issue and how Juniper Networks resolves it in its implementation of the EVPN-MPLS interworking feature.
50
Table 3: BUM Traffic: Split Horizon-Related Issue and Resolution
BUM Traffic Direction
EVPN Interworking with Junos Fusion Enterprise and MCLAG Logic
Issue
Juniper Networks Implementation Approach
North bound (PE2 receives BUM packet from a locally attached dual-homed interface).
� Per EVPN-MPLS forwarding logic:
� Only the designated forwarder (DF) for the Ethernet segment (ES) can forward BUM traffic.
The EVPN-MPLS and MC-LAG forwarding logic contradicts each other and can prevent BUM traffic from being forwarded to the ES.
Support local bias, thereby ignoring the DF and non-DF status of the port for locally switched traffic.
� The local bias rule, in which the local peer forwards the BUM packet and the remote peer drops it, is not supported.
� Per MC-LAG forwarding logic, local bias is supported.
South bound (PE1 forwards BUM packet to PE2 and PE3).
Traffic received from PE1 follows the EVPN DF and non-DF forwarding rules for a mulithomed ES.
None.
Not applicable.
51
MAC Learning
EVPN and MC-LAG use the same method for learning MAC addresses--namely, a PE device learns MAC addresses from its local interfaces and synchronizes the addresses to its peers. However, given that both EVPN and MC-LAG are synchronizing the addresses, an issue arises.
Table 4 on page 51 describes the issue and how the EVPN-MPLS interworking implementation prevents the issue. The use cases shown in Figure 5 on page 46 and Figure 6 on page 47 illustrate the issue. In both use cases, PE1, PE2, and PE3 are EVPN peers, and PE2 and PE3 are MC-LAG peers.
Table 4: MAC Learning: EVPN and MC-LAG Synchronization Issue and Implementation Details
MAC Synchronization Use Case
EVPN Interworking with Junos Fusion Enterprise and MC-LAG Logic
Issue
Juniper Networks Implementation Approach
MAC addresses learned locally on single- or dual-homed interfaces on PE2 and PE3.
� Between the EVPN peers, MAC addresses are synchronized using the EVPN BGP control plane.
� Between the MC-LAG peers, MAC addresses are synchronized using the MC-LAG ICCP control plane.
PE2 and PE3 function as both EVPN peers and MC-LAG peers, which result in these devices having multiple MAC synchronization paths.
� For PE1: use MAC addresses synchronized by EVPN BGP control plane.
� For PE2 and PE3: use MAC addresses synchronized by MC-LAG ICCP control plane.
MAC addresses learned locally on single- or dual-homed interfaces on PE1.
Between the EVPN peers, MAC addresses are synchronized using the EVPN BGP control plane.
None.
Not applicable.
Handling Down Link Between Cascade and Uplink Ports in Junos Fusion Enterprise
NOTE: This section applies only to EVPN-MPLS interworking with a Junos Fusion Enterprise.
In the Junos Fusion Enterprise shown in Figure 5 on page 46, assume that aggregation device PE2 receives a BUM packet from PE1 and that the link between the cascade port on PE2 and the
52
corresponding uplink port on satellite device SD1 is down. Regardless of whether the BUM packet is handled by MC-LAG or EVPN multihoming active-active, the result is the same--the packet is forwarded via the ICL interface to PE3, which forwards it to dual-homed SD1.
To further illustrate how EVPN with multihoming active-active handles this situation with dual-homed SD1, assume that the DF interface resides on PE2 and is associated with the down link and that the non-DF interface resides on PE3. Typically, per EVPN with multihoming active-active forwarding logic, the non-DF interface drops the packet. However, because of the down link associated with the DF interface, PE2 forwards the BUM packet via the ICL to PE3, and the non-DF interface on PE3 forwards the packet to SD1.
Layer 3 Gateway Support
The EVPN-MPLS interworking feature supports the following Layer 3 gateway functionality for extended bridge domains and VLANs:
� Integrated routing and bridging (IRB) interfaces to forward traffic between the extended bridge domains or VLANs.
� Default Layer 3 gateways to forward traffic from a physical (bare-metal) server in an extended bridge domain or VLAN to a physical server or virtual machine in another extended bridge domain or VLAN.
Understanding the Incremented Values of Statistical Counters for LoopFree MC-LAG Networks
In an MC-LAG in an active-active bridging domain, the output of the following command displays the MC-LAG color counters to be continuously increasing. This increase in the statistical count is an expected behavior because the MC-LAG color attribute or counter functions as a loop prevention mechanism.
request pfe execute target fpc0 command "show jnh 0 exceptions" |grep color
GOT: mc lag color
DISC(88) 554712463 144488623417
request pfe execute target fpc0 command "show jnh 0 exceptions" |grep color
GOT: mc lag color
DISC(88) 554712747 144488664296
The exception table stored in the Packet Forwarding Engine contains a list of counters as displayed in the following example output:
request pfe execute target fpc0 command "show jnh 0 exceptions" SENT: Ukern command: show jnh 0 exceptions
53
GOT: Reason
Type
Packets
Bytes
GOT: ==================================================================
GOT: Ucode Internal
GOT: ----------------------
GOT: mcast stack overflow
DISC(33)
0
0
GOT: sample stack error
DISC(35)
0
0
GOT: undefined nexthop opcode
DISC(36)
0
0
GOT: internal ucode error
DISC(37)
0
0
GOT: invalid fabric hdr version
DISC(41)
0
0
GOT:
GOT: PFE State Invalid
GOT: ----------------------
GOT: sw error
DISC(64) 803092438 59795128826
GOT: child ifl nonlocal to pfe
DISC(85)
0
0
GOT: invalid fabric token
DISC(75)
179
42346
GOT: unknown family
DISC(73)
0
0
GOT: unknown vrf
DISC(77)
0
0
GOT: iif down
DISC(87)
0
0
GOT: unknown iif
DISC( 1)
GOT: invalid stream
DISC(72)
0
0
GOT: egress pfe unspecified
DISC(19)
10889 1536998
GOT: invalid L2 token
DISC(86)
26
1224
GOT: mc lag color
DISC(88) 554693648
144486028726<<<<<<<<<<<<<<<<<<<<<<<<
GOT: dest interface non-local to pfe DISC(27) 10939253797 2078273071209
GOT: invalid inline-svcs state
DISC(90)
0
0
GOT: nh id out of range
DISC(93)
0
0
GOT: invalid encap
DISC(96)
0
0
GOT: replication attempt on empty irb DISC(97)
0
0
GOT: invalid selector entry
DISC(98)
0
0
GOT:
GOT:
GOT: Packet Exceptions
GOT: ----------------------
GOT: bad ipv4 hdr checksum
DISC( 2)
GOT: non-IPv4 layer3 tunnel
DISC( 4)
0
0
GOT: GRE unsupported flags
DISC( 5)
0
0
GOT: tunnel pkt too short
DISC( 6)
0
0
GOT: tunnel hdr too long
DISC( 7)
0
0
GOT: bad IPv6 options pkt
DISC( 9)
0
0
GOT: bad IP hdr
DISC(11)
0
0
GOT: bad IP pkt len
DISC(12)
0
0
GOT: L4 len too short
DISC(13)
54
GOT: invalid TCP fragment GOT: mtu exceeded GOT: frag needed but DF set GOT: ttl expired GOT: IP options GOT: xlated l2pt GOT: control pkt punt via ucode GOT: frame format error GOT: tunnel hdr needs reassembly GOT: GRE key mismatch GOT: my-mac check failed GOT: frame relay type unsupported GOT: IGMP snooping control packet GOT: bad CLNP hdr GOT: bad CLNP hdr checksum GOT: Tunnel keepalives GOT: GOT: GOT: Bridging GOT: ---------------------GOT: lt unknown ucast GOT: dmac miss GOT: mac learn limit exceeded GOT: static mac on unexpected iif GOT: no local switching GOT: bridge ucast split horizon GOT: mcast smac on bridged iif GOT: bridge pkt punt GOT: iif STP blocked GOT: oif STP blocked GOT: vlan id out of oif's range GOT: mlp pkt GOT: input trunk vlan lookup failed GOT: output trunk vlan lookup failed GOT: LSI/VT vlan validation failed GOT: GOT: GOT: Firewall GOT: ---------------------GOT: mac firewall GOT: firewall discard GOT: tcam miss GOT: firewall reject
DISC(14) DISC(21) DISC(22) PUNT( 1) PUNT( 2) PUNT(14) PUNT( 4) DISC( 0) PUNT( 8) DISC(76) DISC(28) DISC(38) PUNT(12) DISC(43) DISC(44) PUNT(58)
DISC(84) DISC(15) DISC(17) DISC(18) DISC(20) DISC(26) DISC(24) PUNT( 7) DISC( 3) DISC(31) DISC(32) PUNT(11) DISC(91) DISC(92) DISC(94)
DISC(78) DISC(67) DISC(16) PUNT(36)
0
0
0
0
0
0
9
769
16
512
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0
0 0 0 0 0 39458 1263 0
0 0 0 0 0 13232394 200152 0
15188054 0 0 0
440453569 0 0 0
0 0 155559
0 0 59137563
55
GOT: firewall send to host GOT: firewall send to host for NAT GOT: GOT: GOT: Routing GOT: ---------------------GOT: discard route GOT: dsc ifl discard route GOT: hold route GOT: mcast rpf mismatch GOT: resolve route GOT: control pkt punt via nh GOT: host route GOT: ICMP redirect GOT: mcast host copy GOT: reject route GOT: link-layer-bcast-inet-check GOT:
PUNT(54) PUNT(59)
0
0
0
0
DISC(66) DISC(95) DISC(70) DISC( 8) PUNT(33) PUNT(34) PUNT(32) PUNT( 3) PUNT( 6) PUNT(40) DISC(99)
1577352 82845749
0
0
21130 1073961
0
0
2858
154202
51807272 5283911584
23473304 1370843994
0
0
0
0
1663
289278
0
0
Consider a sample deployment in which two provider edge (PE) routers, PE1 and PE2, are connected with an aggregated Ethernet interface, ae0. respectively. Multichassis link aggregation groups (MCLAGs) are used between PE1 and PE2 to form a logical LAG interface between the two controllers. PE1 and PE2 in an MC-LAG use an interchassis control link-protection link (ICL-PL) to replicate forwarding information across the peers.
Inter-Chassis Control Protocol (ICCP) messages are sent between the two PE devices. In this example, you configure an MC-LAG across two routers, consisting of two aggregated Ethernet interfaces, an interchassis control link-protection link (ICL-PL), multichassis protection link for the ICL-PL, and ICCP for the peers hosting the MC-LAG.
The PE1 router is connected using another aggregated Ethernet interface, ae3, to a host, H1, and to another MC-LAG host called C1. MC-LAG is enabled on the ae3 interface.
Traffic received on PE1 from MC-LAG C1 can be flooded over the ICL to reach PE2. When the packets arrive at PE2, they can be flooded back to MC- LAG C1. Traffic sent by the single-homed host H1 can be flooded to MC-LAG C1 and the ICL on PE1. When PE2 receives such traffic from ICL, it can be again flooded to MC-LAG C1. To protect the MC-LAG topology from such loops, the MC-LAG color capability is implemented. This functionality is applied on the ingress of the ICL link. Therefore, when PE2 receives a packet from PE1, it sets the MC-LAG color as active or turns it on. When PE2 requires to flood the packet towards the MC-LAG link, it verifies whether the MC-LAG color bit is set or tagged as on. If the color is set, it drops the packet on the egress interface of MC-LAG ae3 member link interfaces and the mc-lag color counter in the jnh exceptions is incremented.
56
Such a behavior of increase in counter value is an expected condition in an MC-LAG configured in an active/active bridging domain and when any form of traffic that needs to be flooded, such as ARP broadcast or multicast traffic, traverses the network.
Every VLAN might drop some packets to prevent loops and such a drop of packets might not be specific to a VLAN.
Sometimes, on both MC LAGs of the MX Series routers, you might notice that the counter increases on FPC0 and FPC2, but it does not increase on FPC2 as illustrated in the following sample output:
request pfe execute target fpc0 command "show jnh 0 exceptions" |grep color
GOT: mc lag color
DISC(88) 558477875 144977739683
request pfe execute target fpc1 command "show jnh 0 exceptions" |grep color
GOT: mc lag color
DISC(88)
0
0
request pfe execute target fpc2 command "show jnh 0 exceptions" |grep color
GOT: mc lag color
DISC(88) 518499257 119130527834
This behavior occurs because on an MX Series router with a 16-port 10-Gigabit Ethernet MPC (16x10GE 3D MPC), there are four Packet Forwarding Engines for each MPC. If you examine one Packet Forwarding Engine in FPC 0, 1, and 2, PFE1 in FPC1 does not have any interfaces which are member of MC-LAG. It might contain interfaces in other aggregated Ethernet interfaces that are are not part of MCLAG. Therefore, to obtain the correct counter statistics, you must examine the other Packet Forwarding Engines by entering the request pfe execute target fpc0 command "show jnh X exceptions" |grep color command where X can be 0, 1, 2, or 3.
When the counter named dest interface non-local to pfe is increasing, it is a desired behavior when aggregated Ethernet interfaces are split over more than one FPC. Consider an example in which an ae5 interface contains the following member links: xe-0/1/0 on (FPC0) and xe-1/1/0 (FPC1) Based on the hash algorithm, traffic must be split between these two links. The hash algorithm is applied on the ingress FPC and performs an operation where it marks each packet through which FPC must be forwarded (FPC0 or FPC1). Then the packet is sent to the fabric. From the fabric, all of traffic is sent to both FPCs 0 and 1. On FPC0, the microkernel analyzes the packet and determines whether the packet needs to be forwarded by the local interface (local to pfe) or whether this packet has already been forwarded through FPC1 (non-local to pfe). If the packet has been already forwarded, the packet is dropped and the non-local to pfe counter is incremented.
Enhanced Convergence
Starting with Junos OS Release 14.2R3 on MX Series routers, enhanced convergence improves Layer 2 and Layer 3 convergence time when a multichassis aggregated Ethernet (MC-AE) link goes down or comes up in a bridge domain or VLAN. Starting with Junos OS Release 18.1R1, the number of vmembers
57
has increased to 128k, and the number of ARP and ND entries has increased to 96k when enabling the enhanced-convergence statement. Starting with Junos OS Release 19.1R1, the number of number of ARP and ND entries has increased to 256,000 when enabling the enhanced-convergence and arpenhanced-scale statements. Enhanced convergence improves Layer 2 and Layer 3 convergence time during multichassis aggregated Ethernet (MC-AE) link failures and restoration scenarios
When enhanced convergence is enabled, the MAC address, ARP or ND entries learned over the MC-AE interfaces are programmed in the forwarding table with the MC-AE link as the primary next-hop and with ICL as the backup next-hop. With this enhancement, during an MC-AE link failure or restoration, only the next-hop information in the forwarding table is updated and there is no flushing and relearning of the MAC address, ARP or ND entry. This process improves traffic convergence during MC-AE link failure or restoration because the convergence involves only next-hop repair in the forwarding plane, with the traffic being fast rerouted from the MC-AE link to the ICL.
If you have configured an IRB interface over an MC-AE interface that has enhanced convergences enabled, then you must configure enhanced convergence on the IRB interface as well. Enhanced convergence must be enabled for both Layer 2 and Layer 3 interfaces.
IPv6 Neighbor Discovery Protocol
Neighbor Discovery Protocol (NDP) is an IPv6 protocol that enables nodes on the same link to advertise their existence to their neighbors and to learn about the existence of their neighbors. NDP is built on top of Internet Control Message Protocol version 6 (ICMPv6). It replaces the following IPv4 protocols: Router Discovery (RDISC), Address Resolution Protocol (ARP), and ICMPv4 redirect.
You can use NDP in a multichassis link aggregation group (MC-LAG) active-active configuration on switches.
NDP on MC-LAGs uses the following message types:
� Neighbor solicitation (NS)--Messages used for address resolution and to test reachability of neighbors.
A host can verify that its address is unique by sending a neighbor solicitation message destined to the new address. If the host receives a neighbor advertisement in reply, the address is a duplicate.
� Neighbor advertisement (NA)--Messages used for address resolution and to test reachability of neighbors. Neighbor advertisements are sent in response to neighbor solicitation messages.
58
Anycast Gateways
IN THIS SECTION Benefits of Anycast Gateways | 59 Anycast Gateway Configuration Guidelines | 59 Anycast Gateway Configuration Limitations | 61
In an EVPN-MPLS or MC-LAG environment with two Juniper Networks devices multihomed in all-active mode, you can configure IRB interfaces on the devices. With the IRB interfaces in place, the multihomed devices function as gateways that handle inter-subnet routing. To set up an IRB interface on a Juniper Networks device, you can configure the following: � An IRB interface with:
� An IPv4 or an IPv6 address
set interface irb unit logical-unit-number family inet ipv4-address set interface irb unit logical-unit-number family inet6 ipv6-address
� A media access control (MAC) address
set interface irb unit logical-unit-number mac mac-address
NOTE: In addition to explicitly configuring a MAC address using the above command syntax, you can use the MAC address that the Juniper Networks device automatically generates (chassis MAC).
� A virtual gateway address (VGA) with: � An IPv4 or an IPv6 address
set interfaces irb unit logical-unit-number family inet address primaryipv4-address/8 virtual-gateway-address gateway-ipv4-address
59
set interfaces irb unit logical-unit-number family inet6 address primaryipv6-address/104 virtual-gateway-address gateway-ipv6-address
� A MAC address
set interface irb unit logical-unit-number virtual-gateway-v4-mac macaddress set interface irb unit logical-unit-number virtual-gateway-v6-mac macaddress
NOTE: In addition to explicitly configuring a MAC address using the above command syntax, you can use the MAC address that the Juniper Networks device automatically generates (chassis MAC).
When specifying an IP or MAC address for an IRB interface or VGA on the multihomed devices, you can now use an anycast address. This support of anycast addresses enables you to configure the same addresses for the IRB interface or VGA on each of the multihomed devices, thereby establishing the devices as anycast gateways. Your IP address subnet scheme will determine whether you use the IRB interface command syntax or the VGA command syntax to set up your anycast gateway. In an Ethernet VPN�Multiprotocol Label Switching (EVPN-MPLS) or multichassis link aggregation (MCLAG) environment, you can configure two Juniper Networks devices multihomed in all-active mode as anycast gateways. The following sections provide more information about anycast gateways.
Benefits of Anycast Gateways
� With the two multihomed Juniper Networks devices acting as anycast gateways in an EVPN-MPLS or MC-LAG network, a host in the same network that generates Layer 3 packets with destinations in other networks can now send the packets to the local anycast gateway. Upon receipt of these Layer 3 packets, the anycast gateway routes the packets in the core network based on destination IP lookup.
Anycast Gateway Configuration Guidelines
� In general, when configuring addresses for an anycast gateway: � For IPv4 or IPv6 addresses, you can specify any subnet.
60
� For MAC addresses, you can use the MAC address that the Juniper Networks device automatically generates (chassis MAC), or you can explicitly configure a MAC address using the CLI.
� Your IP address subnet scheme will determine whether you use the IRB interface command syntax or the VGA command syntax to set up your anycast gateway.
To set up your multihomed devices as anycast gateways, we provide the following configuration guidelines: � Guideline 1--If the IP address for the anycast gateways is in the /30 (for IPv4) or /126 (for IPv6)
subnet: � You must configure the same IP address for the IRB interface on each of the multihomed devices
using one of the following commands.
set interface irb unit logical-unit-number family inet ipv4-address set interface irb unit logical-unit-number family inet6 ipv6-address
� You must explicitly configure the MAC address using the following command:
set interface irb unit logical-unit-number mac mac-address
� You must not configure a VGA (IP and MAC addresses). � Guideline 2--If the IP address for the anycast gateways is in the /31 (for IPv4) or /127 (for IPv6)
subnet: � You must configure the same IP address for the IRB interface on each of the multihomed devices
using one of the following commands.
set interface irb unit logical-unit-number family inet ipv4-address set interface irb unit logical-unit-number family inet6 ipv6-address
� You must explicitly configure the MAC address using the following command:
set interface irb unit logical-unit-number mac mac-address
� You must not configure a VGA (IP and MAC addresses).
61
� We do not recommend configuring the Virtual Router Redundancy Protocol (VRRP) protocol on the IRB interface.
� Guideline 3--If the IP address for the anycast gateways is a subnet other than the ones described in the previous bullets: � You must configure the same IP address for the VGA on each of the multihomed devices using one of the following commands.
set interfaces irb unit logical-unit-number family inet address primaryipv4-address/8 virtual-gateway-address gateway-ipv4-address set interfaces irb unit logical-unit-number family inet6 address primaryipv6-address/104 virtual-gateway-address gateway-ipv6-address
� You must explicitly configure the MAC address using one of the following commands:
set interface irb unit logical-unit-number virtual-gateway-v4-mac macaddress set interface irb unit logical-unit-number virtual-gateway-v6-mac macaddress
� When specifying a MAC address for the VGA, we do not recommend using the same MAC address used for VRRP.
Anycast Gateway Configuration Limitations
When configuring the anycast gateway using guidelines described earlier in this topic, keep the following in mind: � In general, we do not recommend reusing a VRRP MAC address as a MAC address for an IRB
interface. However, if you must do so, as is the general practice when configuring VRRP on Juniper Networks devices, you must use a VRRP IPv4 MAC address for the IPv4 family and a VRRP IPv6 MAC address for the IPv6 family. Given these parameters, the only configuration guideline with which this limitation will work is configuration guideline 3.
62
� When configuring anycast gateway addresses using guidelines 1 and 2 in an EVPN-MPLS environment, you must also specify the default-gateway do-not-advertise configuration statements within a routing instance. For example:
set routing-instance routing-instance-name protocols evpn default-gateway donot-advertise
� In an EVPN-MPLS environment, if your anycast gateway IP addresses are in different subnets and you specify the addresses within multiple routing instances:
� If you configured an anycast gateway IP address using configuration guidelines 1 or 2 in one routing instance, and another anycast gateway IP address using configuration guideline 3 in a different routing instance, you must also specify the default-gateway no-gateway-community configuration statements within the routing instance:
set routing-instance routing-instance-name protocols evpn default-gateway no-gateway-community
This additional configuration applies only to the routing instance that includes anycast gateway IP addresses configuring using guidelines 1 or 2.
� For each routing instance in which you specified the anycast gateway IP address using configuration guidelines 1 and 2, we recommend specifying a single non-VRRP MAC address.
Release History Table
Release
Description
19.1R1
Starting with Junos OS Release 19.1R1, the number of number of ARP and ND entries has increased to 256,000 when enabling the enhanced-convergence and arp-enhanced-scale statements.
18.1R1
Starting with Junos OS Release 18.1R1, the number of vmembers has increased to 128k, and the number of ARP and ND entries has increased to 96k when enabling the enhanced-convergence statement.
17.4R1
Starting with Junos OS Release 17.4R1, you can use Ethernet VPN (EVPN) to extend a Junos Fusion Enterprise or multichassis link aggregation group (MC-LAG) network over an MPLS network to a data center or campus network.
15.1X53-D60 On QFX Series switches, support for configuration synchronization started with Junos OS Release 15.1X53-D60.
63
15.1X53-D60
Starting with Junos OS Release 15.1X53-D60 on QFX10000 switches, configuration consistency check uses the Inter-Chassis Control Protocol (ICCP) to exchange MC-LAG configuration parameters (chassis ID, service ID, and so on) and checks for any configuration inconsistencies across MC-LAG peers.
14.2R6
On MX Series routers and Junos Fusion, support for configuration synchronization started with Junos OS Release 14.2R6.
14.2R3
Starting with Junos OS Release 14.2R3 on MX Series routers, enhanced convergence improves Layer 2 and Layer 3 convergence time when a multichassis aggregated Ethernet (MC-AE) link goes down or comes up in a bridge domain or VLAN.
2 CHAPTER
Implementing MC-LAG
Getting Started with MC-LAG | 65 MC-LAG Examples | 80
65
Getting Started with MC-LAG
IN THIS SECTION Configuring Multichassis Link Aggregation on MX Series Routers | 65 Configuring Multichassis Link Aggregation on EX Series Switches | 72 Configuring ICCP for MC-LAG | 78
Configuring Multichassis Link Aggregation on MX Series Routers
Multichassis link aggregation (MC-LAG) enables an MX Series 5G Universal Routing Platform to form a logical LAG interface with two or more other devices. MC-LAG provides additional benefits over traditional LAG in terms of node level redundancy, multihoming support, and a loop-free Layer 2 network without the need to run Spanning Tree Protocol (STP). MC-LAG can be configured for virtual private LAN service (VPLS) routing instances, circuit cross-connect (CCC) applications, and Layer 2 circuit encapsulation types. The MC-LAG devices use Inter-Chassis Control Protocol (ICCP) to exchange the control information between two MC-LAG network devices. On one end of the MC-LAG is an MC-LAG client device that has one or more physical links in a link aggregation group (LAG). This client device does not need to be aware of the MC-LAG configuration. On the other side of the MC-LAG are two MC-LAG network devices. Each of these network devices has one or more physical links connected to a single client device. The network devices coordinate with each other to ensure that data traffic is forwarded properly. MC-LAG includes the following functionality: � Only single-active MC-LAG mode with multi-homed VPLS instance is supported. � MC-LAG operates only between two devices. � Layer 2 circuit functions are supported with ether-ccc and vlan-ccc encapsulations. � VPLS functions are supported with ether-vpls and vlan-vpls encapsulations.
66
NOTE: Ethernet connectivity fault management (CFM) specified in the IEEE 802.1ag standard for Operation, Administration, and Management (OAM) is not supported on MC-LAG interfaces.
To enable MC-LAG, include the mc-ae statement at the [edit interfaces aeX aggregated-ether-options] hierarchy level along with one of the following statements at the [edit interfaces aeX] hierarchy level: encapsulation-ethernet-bridge, encapsulation ethernet-ccc, encapsulation ethernet-vpls, or encapsulation-flexible-ethernet-services. You also need to configure the lacp, admin-key, and system-id statements at the [edit interfaces aeX aggregated-ether-options] hierarchy level:
NOTE: When you configure the prefer-status-control-active statement, you must also configure the status-control active statement. If you configure the status-control standby statement with the prefer-status-control-active statement, the system issues a warning.
To delete an MC-LAG interface from the configuration, issue the delete interfaces aeX aggregatedether-options mc-ae command at the [edit] hierarchy level in configuration mode:
[edit] user@host# delete interfaces aeX aggregated-ether-options mc-ae
Perform the following steps on each switch that is hosting an MC-LAG: 1. Specify the same multichassis aggregated Ethernet identification number for the MC-LAG that the
aggregated Ethernet interface belongs to on each switch.
[edit interfaces] user@host# set aeX aggregated-ether-options mc-ae mc-ae-id mc-ae-id
For example:
[edit interfaces] user@host# set ae1 aggregated-ether-options mc-ae mc-ae-id 3
67
2. Specify a unique chassis ID for the MC-LAG that the aggregated Ethernet interface belongs to on each switch.
[edit interfaces] user@host# set aeX aggregated-ether-options chassis-id chassis-id For example:
[edit interfaces] user@host# set ae1 aggregated-ether-options mc-ae chassis-id 0 3. Specify the mode of the MC-LAG that the aggregated Ethernet interface belongs to.
NOTE: Only active/active mode is supported for Reverse Layer 2 Gateway Protocol (RL2GP) at this time.
[edit interfaces] user@host# set aeX aggregated-ether-options mc-ae mode mode For example:
[edit interfaces] user@host# set ae1 aggregated-ether-options mc-ae mode active-active 4. Specify whether the aggregated Ethernet interface participating in the MC-LAG is primary or secondary. Primary is active, and secondary is standby.
NOTE: You must configure status control on both switches hosting the MC-LAG. If one switch is in active mode, the other must be in standby mode.
[edit interfaces] user@host# set aeX aggregated-ether-options mc-ae status-control (active | standby)
68
For example:
[edit interfaces] user@host# set aeX aggregated-ether-options mc-ae status-control (active | standby) 5. Configure the MC-LAG interface to improve Layer 2 and Layer 3 convergence time when a multichassis aggregated Ethernet link goes down or comes up in a bridge domain.
[edit interfaces] user@host# set aeX aggregated-ether-options mc-ae enhanced-convergence 6. Specify the same LACP system ID on each switch.
[edit interfaces] user@host# set aeX aggregated-ether-options lacp system-id mac-address For example:
[edit interfaces] user@host# set ae1 aggregated-ether-options lacp system-id 00:01:02:03:04:05 7. Specify the same LACP administration key on each switch.
[edit interfaces] user@host# set aeX aggregated-ether-options lacp admin-key number For example:
[edit interfaces] user@host# set ae1 aggregated-ether-options lacp admin-key 3 8. Configure ICCP by doing the following on each switch hosting the MC-LAG: a. Configure the local IP address to be used by all switches hosting the MC-LAG.
[edit protocols] user@host# set iccp local-ip-addr local-ip-address
69
For example:
[edit protocols] user@host# set iccp local-ip-addr 10.3.3.1
b. (Optional) Configure the IP address of the router and the time during which an ICCP connection must succeed between the routers hosting the MC-LAG.
[edit protocols] user@host# set iccp peer peer-ip-address session-establishment-hold-time seconds For example:
[edit protocols] user@host# set iccp peer 10.3.3.2 session-establishment-hold-time 340
c. (Optional) Configure the IP address to be used for backup liveness detection:
NOTE: By default, backup liveness detection is not enabled. Configure backup liveness detection if you require faster failover of data traffic loss during an MC-LAG peer reboot. Backup liveness detection helps achieve subsecond traffic loss during an MC-LAG peer reboot.
[edit protocols] user@host# set iccp peer peer-ip-address backup-liveness-detection backup-peer-ip ip-address For example:
[edit protocols] user@host# set iccp peer 10.3.3.2 backup-liveness-detection backup-peer-ip 10.207.64.232
d. Configure the minimum interval at which the router must receive a reply from the other router with which it has established a Bidirectional Forwarding Detection (BFD) session.
70
NOTE: Configuring the minimum receive interval is required to enable BFD.
[edit protocols] user@host# set iccp peer peer-ip-address liveness-detection minimum-receive-interval milliseconds For example:
[edit protocols] user@host# set iccp peer 10.3.3.2 liveness-detection minimum-receive-interval 60
e. Configure the minimum transmit interval during which a router must receive a reply from a router with which it has established a BFD session.
[edit protocols] user@host# set iccp peer peer-ip-address liveness-detection transmit-interval minimum-interval milliseconds For example:
[edit protocols] user@host# set iccp peer 10.3.3.2 liveness-detection transmit-interval minimum-interval 60
f. Specify the switch service ID. The switch service ID is used to synchronize applications, IGMP, ARP, and MAC learning across MC-LAG members.
[edit switch-options] user@host# set service-id number For example:
[edit switch-options] user@host# set service-id 1
71
9. Configure a multichassis protection link between the routers.
[edit] user@host# set multi-chassis multi-chassis-protection peer-ip-address interface interface-name For example:
[edit] user@host# set multi-chassis multi-chassis-protection 10.3.3.1 interface ae0 10. Enable RSTP globally on all interfaces.
[edit] user@host# set protocols rstp interface all mode point-to-point 11. Disable RSTP on the interchassis control link protection link (ICL-PL) interfaces on both routers.
[edit] user@host# set protocols rstp interface interface-name disable For example:
[edit] user@host# set protocols rstp interface ae0.0 disable 12. Configure the MC-LAG interfaces as edge ports on both routers.
user@host# set protocols rstp interface interface-name edge For example:
[edit] user@host# set protocols rstp interface ae1 edge
72
13. Enable BPDU block on all interfaces except for the ICL-PL interfaces on both routers.
[edit] user@host# set protocols rstp bpdu-block-on-edge
For example:
[edit] user@host# set protocols rstp bpdu-block-on-edge
Configuring Multichassis Link Aggregation on EX Series Switches
Multichassis link aggregation groups (MC-LAGs) enable a client device to form a logical LAG interface between two MC-LAG peers (for example, EX9200 switches). An MC-LAG provides redundancy and load balancing between the two MC-LAG peers, multihoming support, and a loop-free Layer 2 network without running Spanning Tree Protocol (STP). On one end of an MC-LAG, there is an MC-LAG client device, such as a server, that has one or more physical links in a link aggregation group (LAG). This client device does not need to have an MC-LAG configured. On the other side of MC-LAG, there are two MC-LAG peers. Each of the MC-LAG peers has one or more physical links connected to a single client device. The MC-LAG peers use Inter-Chassis Control Protocol (ICCP) to exchange control information and coordinate with each other to ensure that data traffic is forwarded properly.
NOTE: An interface with an already configured IP address cannot form part of the aggregated Ethernet interface or multichassis aggregated Ethernet interface group.
Perform the following steps on each switch that hosts an MC-LAG: 1. Specify the same multichassis aggregated Ethernet identification number for the MC-LAG that the
aggregated Ethernet interface belongs to on each switch.
[edit interfaces] user@switch# set aex aggregated-ether-options mc-ae mc-ae-id number
73
For example:
[edit interfaces] user@switch# set ae1 aggregated-ether-options mc-ae mc-ae-id 3 2. Specify a unique chassis ID for the MC-LAG that the aggregated Ethernet interface belongs to on each switch.
[edit interfaces] user@switch# set aex aggregated-ether-options mc-ae chassis-id number For example:
[edit interfaces] user@switch# set ae1 aggregated-ether-options mc-ae chassis-id 0 3. Specify the mode of the MC-LAG the aggregated Ethernet interface belongs to.
[edit interfaces] user@switch# set aex aggregated-ether-options mc-ae mode mode For example:
[edit interfaces] user@switch# set ae1 aggregated-ether-options mc-ae mode active-active 4. Specify whether the aggregated Ethernet interface participating in the MC-LAG is primary or secondary. Primary is active, and secondary is standby.
NOTE: You must configure status control on both switches that host the MC-LAG. If one switch is in active mode, the other must be in standby mode.
[edit interfaces] user@switch# set aex aggregated-ether-options mc-ae status-control (active | standby)
74
For example:
[edit interfaces] user@switch# set ae1 aggregated-ether-options mc-ae status-control active
NOTE: If you configure both nodes as prefer-status-control-active, you must also configure ICCP peering using the peer's loopback address to make sure that the ICCP session does not go down because of physical link failures. Additionally, you must configure backup liveness detection on both of the MC-LAG nodes.
NOTE: On EX9200 switches, the prefer-status-control-active statement was added in Junos OS Release 13.2R1.
5. Specify the init delay time. The init delay time specifies the number of seconds by which to delay bringing up the MC-LAG interface back to the up state when the MC-LAG peer is rebooted. By delaying the bring-up of the interface until after the protocol convergence, you can prevent packet loss during the recovery of failed links and devices.
[edit interfaces] user@switch# set aex aggregated-ether-options mc-ae init-delay-time seconds
For example:
[edit interfaces] user@switch# set ae0 aggregated-ether-options mc-ae init-delay-time 240 6. Specify the same LACP system ID on each switch.
[edit interfaces] user@switch# set aex aggregated-ether-options lacp system-id mac-address
75
For example:
[edit interfaces] user@switch# set ae1 aggregated-ether-options lacp system-id 00:01:02:03:04:05 7. Specify the same LACP administration key on each switch.
[edit interfaces] user@switch# set aex aggregated-ether-options lacp admin-key number For example:
[edit interfaces] user@switch# set ae1 aggregated-ether-options lacp admin-key 3 8. Configure ICCP by performing the following steps on each switch that hosts the MC-LAG: a. Configure the local IP address to be used by the switches that host the MC-LAG.
[edit protocols] user@switch# set iccp local-ip-addr local-ip-address For example:
[edit protocols] user@switch# set iccp local-ip-addr 10.3.3.1
b. (Optional) Configure the IP address of the switch and the time during which an ICCP connection must be established between the switches that host the MC-LAG.
[edit protocols] user@switch# set iccp peer peer-ip-address session-establishment-hold-time seconds For example:
[edit protocols] user@switch# set iccp peer 10.3.3.2 session-establishment-hold-time 340
76
c. (Optional) Configure the backup-liveness-detection statement on the management interface (fxp0) only. We recommend that you configure the backup liveness detection feature to implement faster failover of data traffic during an MC-LAG peer reboot.
NOTE: On EX9200 switches, the backup-liveness-detection statement was added in Junos OS Release 13.2R1.
NOTE: By default, backup liveness detection is not enabled. Configure backup liveness detection if you require minimal traffic loss during a reboot. Backup liveness detection helps achieve sub-second traffic loss during an MC-LAG reboot.
[edit protocols] user@switch# set iccp peer peer-ip-address backup-liveness-detection backup-peer-ip ip-address For example:
[edit protocols] user@switch# set iccp peer 10.3.3.2 backup-liveness-detection backup-peer-ip 10.207.64.232
d. Configure the minimum interval at which the switch must receive a reply from the other switch with which it has established a Bidirectional Forwarding Detection (BFD) session.
NOTE: Configuring the minimum receive interval is required to enable BFD. We recommend a minimum receive interval value of 1000 milliseconds.
[edit protocols] user@switch# set iccp peer peer-ip-address liveness-detection minimum-receive-interval milliseconds
77
For example:
[edit protocols] user@switch# set iccp peer 10.3.3.2 liveness-detection minimum-receive-interval 1000
e. Configure the minimum transmit interval during which a switch must receive a reply from a switch with which it has established a BFD session.
[edit protocols] user@switch# set iccp peer peer-ip-address liveness-detection transmit-interval minimuminterval milliseconds
For example:
[edit protocols] user@switch# set iccp peer 10.3.3.2 liveness-detection transmit-interval minimum-interval 1000 9. Specify the switch service ID. The switch service ID is used to synchronize applications, IGMP, ARP, and MAC learning across MC-LAG members.
[edit switch-options] user@switch# set service-id number
For example:
[edit switch-options] user@switch# set service-id 1 10. Configure a multichassis protection link between the switches.
[edit multi-chassis] user@switch# set multi-chassis-protection peer-ip-address interface interface-name
78
For example:
[edit multi-chassis] user@switch# set multi-chassis-protection 10.3.3.1 interface ae0
SEE ALSO Configuring MC-LAG on EX9200 Switches in the Core for Campus Networks
Configuring ICCP for MC-LAG
For multichassis link aggregation (MC-LAG), you must configure Inter-Control Center Communications Protocol (ICCP) to exchange information between two MC-LAG peers. To enable ICCP, include the iccp statement at the [edit protocols] hierarchy level:
[edit protocols] iccp {
authentication-key string; local-ip-addr ipv4-address; peer ip-address{
authentication-key string; liveness-detection {
detection-time { threshold milliseconds;
} minimum-interval milliseconds; minimum-receive-interval milliseconds; multiplier number; no-adaptation; transmit-interval {
minimum-interval milliseconds; threshold milliseconds; } version (1 | automatic); } local-ip-addr ipv4-address; redundancy-group-id-list [ redundancy-groups ];
79
session-establishment-hold-time value; } session-establishment-hold-time value; traceoptions; }
The local-ip-address statement sets the source address. This could be a specified address or interface address. The session-establishment-hold-time statement determines whether a chassis takes over as the primary at the ICCP session.
The authentication-key statement is provided by TCP Message Digest 5 (md5) option for an ICCP TCP session. The redundancy-group-id-list statement specifies the redundancy groups between ICCP peers and the liveness-detection hierarchy configures Bidirectional Forwarding Detection (BFD) protocol options.
NOTE: ICCP is based on TCP and it uses IP routes to reach the MC-LAG peer. To ensure that the ICCP session is as resilient as possible, we recommend that you configure alternative routes between the ICCP end-point IP addresses. Alternatively, configure a LAG interface that has two or more interfaces between the MC-LAG pairs to prevent session failure when there are no alternative routes.
For Inter-Control Center Communications Protocol (ICCP) in a multichassis link aggregation group (MCLAG) configured in an active-active bridge domain, you must ensure that you configure the same peer IP address hosting the MC-LAG by including the peer ip-address statement at the [edit protocols iccp] hierarchy level and the multi-chassis-protection peer ip-address statement at the [edit interfaces interface-name] hierarchy level. Multichassis protection reduces the configuration at the logical interface level for MX Series routers with multichassis aggregated Ethernet (MC-AE) interfaces. If the ICCP is UP and the interchassis data link (ICL) comes UP, the router configured as standby will bring up the MC-AE interfaces shared with the peer active-active node specified by the peer statement.
For example, the following statements illustrate how the same peer IP address can be configured for both the ICCP peer and multichassis protection link:
set interfaces ae1 unit 0 multi-chassis-protection 10.255.34.112 interface ae0 set protocols iccp peer 10.255.34.112 redundancy-group-id-list 1
Although you can commit an MC-LAG configuration with various parameters defined for it, you can configure multichassis protection between two peers without configuring the ICCP peer address. You can also configure multiple ICCP peers and commit such a configuration.
80
MC-LAG Examples
IN THIS SECTION Example: Configuring Multichassis Link Aggregation on the QFX Series | 80 Example: Configuring Multichassis Link Aggregation on the MX Series | 105 Example: Configuring Multichassis Link Aggregation on EX9200 Switches in the Core for Campus Networks | 125 Example: Configure Optional Features For Multichassis Link Aggregation | 184 Example: Simplifying Multichassis Link Aggregation on EX9200 Switches in the Core for Campus Networks | 204 Example: Configuring CoS for FCoE Transit Switch Traffic Across an MC-LAG | 266 Example: EVPN-MPLS Interworking With an MC-LAG Topology | 300
Example: Configuring Multichassis Link Aggregation on the QFX Series
IN THIS SECTION Requirements | 81 Overview | 81 Configuration | 82 Verification | 101 Troubleshooting | 104
NOTE: Our content testing team has validated and updated this example.
This example shows how multichassis link aggregation groups (MC-LAGs) enable a client device to form a logical LAG interface between two switches to provide redundancy and load balancing between the
81
two switches, multihoming support, and a loop-free Layer 2 network without running Spanning Tree Protocol (STP).
Requirements
This example uses the following hardware and software components: � Junos OS Release 13.2X51-D10 or later for the QFX5100 standalone switches, Release 15.1X53-
D10 or later for QFX10002 standalone switches. � Revalidated on Junos OS Release 17.3R1 for QFX5100 and QFX10000 switches. � Revalidated on Junos OS Release 19.4R1 for QFX10000 switches. Before you configure an MC-LAG, be sure that you understand how to: � Configure aggregated Ethernet interfaces on a switch. See Example: Configuring Link Aggregation Between a QFX Series Product and an Aggregation Switch. � Configure the Link Aggregation Control Protocol (LACP) on aggregated Ethernet interfaces on a switch. See Example: Configuring Link Aggregation with LACP Between a QFX Series Product and an Aggregation Switch.
Overview
IN THIS SECTION Topology | 82
In this example, you configure an MC-LAG across two switches, consisting of two aggregated Ethernet interfaces, an interchassis control link-protection link (ICL-PL), multichassis protection link for the ICLPL, the Inter-Chassis Control Protocol for the peers hosting the MC-LAG, and Layer 3 connectivity between MC-LAG peers. Layer 3 connectivity is required for ICCP.
82 Topology The topology used in this example consists of two switches hosting an MC-LAG. The two switches are connected to a server. Figure 7 on page 82 shows the topology used in this example. Figure 7: Configuring a Multichassis LAG Between QFX1 and QFX2
Configuration
IN THIS SECTION CLI Quick Configuration | 83 Configuring MC-LAG on Two Switches | 85 Results | 93
83
CLI Quick Configuration
To quickly configure this example, copy the following commands, paste them in a text file, remove any line breaks, change any details necessary to match your network configuration, copy and paste the commands into the CLI at the [edit] hierarchy level, and then enter commit from configuration mode.
QFX1
set chassis aggregated-devices ethernet device-count 2 set interfaces xe-0/0/0 ether-options 802.3ad ae1 set interfaces xe-0/0/1 ether-options 802.3ad ae0 set interfaces xe-0/0/2 ether-options 802.3ad ae0 set interfaces xe-0/0/3 unit 0 family ethernet-switching interface-mode access set interfaces xe-0/0/3 unit 0 family ethernet-switching vlan members v10 set interfaces ae0 aggregated-ether-options lacp active set interfaces ae0 unit 0 family ethernet-switching interface-mode trunk set interfaces ae0 unit 0 family ethernet-switching vlan members v50 set interfaces ae0 unit 0 family ethernet-switching vlan members v10 set interfaces ae1 aggregated-ether-options lacp active set interfaces ae1 aggregated-ether-options lacp system-id 00:01:02:03:04:05 set interfaces ae1 aggregated-ether-options lacp admin-key 3 set interfaces ae1 aggregated-ether-options mc-ae mc-ae-id 3 set interfaces ae1 aggregated-ether-options mc-ae redundancy-group 1 set interfaces ae1 aggregated-ether-options mc-ae chassis-id 0 set interfaces ae1 aggregated-ether-options mc-ae mode active-active set interfaces ae1 aggregated-ether-options mc-ae status-control active set interfaces ae1 aggregated-ether-options mc-ae init-delay-time 240 set interfaces ae1 unit 0 family ethernet-switching interface-mode trunk set interfaces ae1 unit 0 family ethernet-switching vlan members v10 set interfaces em0 unit 0 family inet address 10.1.1.1/24 set interfaces irb unit 10 family inet address 10.10.1.1/24 set interfaces irb unit 50 family inet address 10.50.1.1/30 set multi-chassis multi-chassis-protection 10.50.1.2 interface ae0 set protocols iccp local-ip-addr 10.50.1.1 set protocols iccp peer 10.50.1.2 session-establishment-hold-time 340 set protocols iccp peer 10.50.1.2 redundancy-group-id-list 1 set protocols iccp peer 10.50.1.2 backup-liveness-detection backup-peer-ip 10.1.1.2 set protocols iccp peer 10.50.1.2 liveness-detection minimum-receive-interval 1000 set protocols iccp peer 10.50.1.2 liveness-detection transmit-interval minimum-interval 1000 set switch-options service-id 10 set vlans v10 vlan-id 10
84
set vlans v10 l3-interface irb.10 set vlans v50 vlan-id 50 set vlans v50 l3-interface irb.50
QFX2
set chassis aggregated-devices ethernet device-count 2 set interfaces xe-0/0/0 ether-options 802.3ad ae1 set interfaces xe-0/0/1 ether-options 802.3ad ae0 set interfaces xe-0/0/2 ether-options 802.3ad ae0 set interfaces xe-0/0/3 unit 0 family ethernet-switching interface-mode access set interfaces xe-0/0/3 unit 0 family ethernet-switching vlan members v10 set interfaces ae0 aggregated-ether-options lacp active set interfaces ae0 unit 0 family ethernet-switching interface-mode trunk set interfaces ae0 unit 0 family ethernet-switching vlan members v50 set interfaces ae0 unit 0 family ethernet-switching vlan members v10 set interfaces ae1 aggregated-ether-options lacp active set interfaces ae1 aggregated-ether-options lacp system-id 00:01:02:03:04:05 set interfaces ae1 aggregated-ether-options lacp admin-key 3 set interfaces ae1 aggregated-ether-options mc-ae mc-ae-id 3 set interfaces ae1 aggregated-ether-options mc-ae redundancy-group 1 set interfaces ae1 aggregated-ether-options mc-ae chassis-id 1 set interfaces ae1 aggregated-ether-options mc-ae mode active-active set interfaces ae1 aggregated-ether-options mc-ae status-control standby set interfaces ae1 aggregated-ether-options mc-ae init-delay-time 240 set interfaces ae1 unit 0 family ethernet-switching interface-mode trunk set interfaces ae1 unit 0 family ethernet-switching vlan members v10 set interfaces em0 unit 0 family inet address 10.1.1.2/24 set interfaces irb unit 10 family inet address 10.10.1.2/24 set interfaces irb unit 50 family inet address 10.50.1.2/30 set multi-chassis multi-chassis-protection 10.50.1.1 interface ae0 set protocols iccp local-ip-addr 10.50.1.2 set protocols iccp peer 10.50.1.1 session-establishment-hold-time 340 set protocols iccp peer 10.50.1.1 redundancy-group-id-list 1 set protocols iccp peer 10.50.1.1 backup-liveness-detection backup-peer-ip 10.1.1.1 set protocols iccp peer 10.50.1.1 liveness-detection minimum-receive-interval 1000 set protocols iccp peer 10.50.1.1 liveness-detection transmit-interval minimum-interval 1000 set switch-options service-id 10 set vlans v10 vlan-id 10 set vlans v10 l3-interface irb.10
85
set vlans v50 vlan-id 50 set vlans v50 l3-interface irb.50
QFX3
set chassis aggregated-devices ethernet device-count 2 set interfaces xe-0/0/0 ether-options 802.3ad ae1 set interfaces xe-0/0/1 ether-options 802.3ad ae1 set interfaces xe-0/0/2 unit 0 family ethernet-switching interface-mode access set interfaces xe-0/0/2 unit 0 family ethernet-switching vlan members v10 set interfaces ae1 aggregated-ether-options lacp active set interfaces ae1 unit 0 family ethernet-switching interface-mode trunk set interfaces ae1 unit 0 family ethernet-switching vlan members v10 set interfaces em0 unit 0 family inet address 10.1.1.3/24 set interfaces irb unit 10 family inet address 10.10.1.3/24 set vlans v10 vlan-id 10 set vlans v10 l3-interface irb.10
Configuring MC-LAG on Two Switches
Step-by-Step Procedure
The following example requires you to navigate various levels in the configuration hierarchy. For information about navigating the CLI, see Using the CLI Editor in Configuration Mode. To enable interfaces and multichassis protection link between MC-LAG peers: 1. Configure the number of LAGs on both QFX1 and QFX2.
[edit chassis] user@switch# set aggregated-devices ethernet device-count 2
2. Add member interfaces to the aggregated Ethernet interfaces on both QFX1 and QFX2.
QFX1 and QFX2: [edit interfaces] user@switch# set xe-0/0/0 ether-options 802.3ad ae1 [edit interfaces] user@switch# set xe-0/0/1 ether-options 802.3ad ae0
86
[edit interfaces] user@switch# set xe-0/0/2 ether-options 802.3ad ae0 3. Configure an access interface to the connected end host.
[edit interfaces] user@switch# set xe-0/0/3 unit 0 family ethernet-switching interface-mode access 4. Add member interfaces to VLAN v10.
[edit interfaces] user@switch# set interfaces xe-0/0/3 unit 0 family ethernet-switching vlan members v10 5. Configure a trunk interface between QFX1 and QFX2.
[edit interfaces] user@switch# set ae0 unit 0 family ethernet-switching interface-mode trunk 6. Enable VLANs on the MC-LAG between QFX1 and QFX2.
[edit] user@switch# set vlans v10 vlan-id 10
[edit] user@switch# set vlans v50 vlan-id 50
[edit interfaces] user@switch# set ae0 unit 0 family ethernet-switching vlan members v10
[edit interfaces] user@switch# set ae0 unit 0 family ethernet-switching vlan members v50
87
7. Configure an IRB 50.
[edit irb] user@switch# set irb.50 8. Assign VLAN 50 to irb.50.
[edit] user@switch# set vlans v50 l3-interface irb.50 9. Configure an IRB 10.
[edit irb] user@switch# set irb.10 10. Assign VLAN 10 irb.10.
[edit] user@switch# set vlans v10 l3-interface irb.10 11. Enable LACP on the MC-LAG interface on QFX1 and QFX2.
NOTE: At least one end needs to be active. The other end can be either active or passive.
[edit interfaces] user@switch# set ae0 aggregated-ether-options lacp active [edit interfaces] user@switch# set ae1 aggregated-ether-options lacp active
88
12. Specify the same LACP system ID for the MC-LAG on QFX1 and QFX2.
[edit interfaces] user@switch# set ae1 aggregated-ether-options lacp system-ID 00:01:02:03:04:05 13. Specify the same LACP administration key on both QFX1 and QFX2.
[edit interfaces] user@switch# set ae1 aggregated-ether-options lacp admin-key 3 14. Specify the same multichassis aggregated Ethernet identification number on both MC-LAG peers on QFX1 and QFX2.
[edit interfaces] user@switch# set ae1 aggregated-ether-options mc-ae mc-ae-id 3 15. Specify a unique chassis ID for the MC-LAG on the MC-LAG peers on QFX1 and QFX2.
QFX1: [edit interfaces] user@switch# set ae1 aggregated-ether-options mc-ae chassis-id 0
QFX2: [edit interfaces] user@switch# set ae1 aggregated-ether-options mc-ae chassis-id 1 16. Specify the operating mode of the MC-LAG on both QFX1 and QFX2.
NOTE: Only active-active mode is supported at this time.
[edit interfaces] user@switch# set ae1 aggregated-ether-options mc-ae mode active-active 17. Specify the status control for MC-LAG on QFX1 and QFX2.
89
NOTE: You must configure status control on both QFX1 and QFX2 hosting the MC-LAG. If one peer is in active mode, the other must be in standby mode.
QFX1: [edit interfaces] user@switch# set ae1 aggregated-ether-options mc-ae status-control active
QFX2: [edit interfaces] user@switch# set ae1 aggregated-ether-options mc-ae status-control standby
18. Specify the number of seconds by which the bring-up of the multichassis aggregated Ethernet interface should be deferred after you reboot QFX1 and QFX2.
NOTE: The recommended value for maximum VLAN configuration (for example, 4,000 VLANS) is 240 seconds. If IGMP snooping is enabled on all of the VLANs, the recommended value is 420 seconds.
[edit interfaces] user@switch# set ae1 aggregated-ether-options mc-ae init-delay-time 240
19. Configure Layer 3 connectivity between the MC-LAG peers on both QFX1 and QFX2.
[edit vlans] user@switch# set v50 vlan-id 50
[edit vlans] user@switch# set v50 l3-interface irb.50
[edit interfaces] user@switch# set ae0 unit 0 family ethernet-switching interface-mode trunk vlan members v50
90
20. Configure a multichassis protection link between QFX1 and QFX2.
QFX1: [edit] user@switch# set multi-chassis multi-chassis-protection 10.50.1.2 interface ae0
QFX2: [edit] user@switch# set multi-chassis multi-chassis-protection 10.50.1.1 interface ae0
21. Configure the local IP address to be in the ICCP connection on QFX1 and QFX2.
QFX1: [edit protocols] user@switch# set iccp local-ip-addr 10.50.1.1
QFX2: [edit protocols] user@switch# set iccp local-ip-addr 10.50.1.2
22. (Optional) Configure the time during which an ICCP connection must succeed between MC-LAG peers on QFX1 and QFX2.
NOTE: On QFX Series switches, the default session establishment hold time is 300 seconds. However, the session establishment time must be at least 100 seconds higher than the init
91
delay time. You can optionally update the session establishment time to be 340 seconds and the init delay time to be 240 seconds.
QFX1: [edit protocols] user@switch# set iccp peer 10.50.1.2 session-establishment-hold-time 340
QFX2: [edit protocols] user@switch# set iccp peer 10.50.1.1 session-establishment-hold-time 340
23. Configure the redundancy groups for ICCP on QFX1 and QFX2.
QFX1: [edit protocols] user@switch# set iccp peer 10.50.1.2 redundancy-group-id-list 1
QFX2: [edit protocols] user@switch# set iccp peer 10.50.1.1 redundancy-group-id-list 1
24. (Optional) Configure the backup IP address to be used for backup liveness detection on both QFX1 and QFX2.
92
NOTE: By default, backup liveness detection is not enabled. Configuring a backup IP address helps achieve sub-second traffic loss during an MC-LAG peer reboot.
QFX1: [edit protocols] user@switch# set iccp peer 10.50.1.2 backup-liveness-detection backup-peer-ip 10.1.1.2
QFX2: [edit protocols] user@switch# set iccp peer 10.50.1.1 backup-liveness-detection backup-peer-ip 10.1.1.1
25. Configure the peer IP address and minimum receive interval for a BFD session for ICCP on QFX1 and QFX2.
QFX1: [edit protocols] user@switch# set iccp peer 10.50.1.2 liveness-detection minimum-receive-interval 1000
QFX2: [edit protocols] user@switch# set iccp peer 10.50.1.1 liveness-detection minimum-receive-interval 1000
26. Configure the peer IP address and minimum transmit interval for BFD session for ICCP on QFX1 and QFX2.
QFX1: [edit protocols] user@switch# set iccp peer 10.50.1.2 liveness-detection transmit-interval minimum-interval 1000
QFX2: [edit protocols] user@switch# set iccp peer 10.50.1.1 liveness-detection transmit-interval minimum-interval 1000
93
27. To enable the service ID on QFX1 and QFX2:
The switch service ID is used to synchronize applications, IGMP, ARP, and MAC learning across MC-LAG members.
[edit switch-options] user@switch# set service-id 10
Results
Here are the results of your configuration on QFX1.
chassis { aggregated-devices { ethernet { device-count 2; } }
} interfaces {
xe-0/0/0 { ether-options { 802.3ad ae1; }
} xe-0/0/1 {
ether-options { 802.3ad ae0;
} } xe-0/0/2 {
ether-options { 802.3ad ae0;
} } xe-0/0/3 {
unit 0 { family ethernet-switching { interface-mode access; vlan { members v10;
94
} } } } ae0 { aggregated-ether-options { lacp {
active; } } unit 0 { family ethernet-switching {
interface-mode trunk; vlan {
members [ v50 v10 ]; } } } } ae1 { aggregated-ether-options { lacp { active; system-id 00:01:02:03:04:05; admin-key 3; } mc-ae { mc-ae-id 3; redundancy-group 1; chassis-id 0; mode active-active; status-control active; init-delay-time 240; } } unit 0 { family ethernet-switching { interface-mode trunk; vlan {
members v10; } } }
95
} em0 {
unit 0 { family inet { address 10.1.1.1/24; }
} } irb {
unit 10 { family inet { address 10.10.1.1/24; }
} unit 50 {
family inet { address 10.50.1.1/30;
} } } } multi-chassis { multi-chassis-protection 10.50.1.2 { interface ae0; } } protocols { iccp { local-ip-addr 10.50.1.1; peer 10.50.1.2 {
session-establishment-hold-time 340; redundancy-group-id-list 1; backup-liveness-detection {
backup-peer-ip 10.1.1.2; } liveness-detection {
minimum-receive-interval 1000; transmit-interval {
minimum-interval 1000; } } } }
96
} switch-options {
service-id 10; } vlans {
v10 { vlan-id 10; l3-interface irb.10; mcae-mac-synchronize;
} v50 {
vlan-id 50; l3-interface irb.50; } }
Display the results of the configuration on QFX2.
chassis { aggregated-devices { ethernet { device-count 2; } }
} interfaces {
xe-0/0/0 { ether-options { 802.3ad ae1; }
} xe-0/0/1 {
ether-options { 802.3ad ae0;
} } xe-0/0/2 {
ether-options { 802.3ad ae0;
} } xe-0/0/3 {
97
unit 0 { family ethernet-switching { interface-mode access; vlan { members v10; } }
} } ae0 {
aggregated-ether-options { lacp { active; }
} unit 0 {
family ethernet-switching { interface-mode trunk; vlan { members [ v50 v10 ]; }
} } } ae1 { aggregated-ether-options {
lacp { active; system-id 00:01:02:03:04:05; admin-key 3;
} mc-ae {
mc-ae-id 3; redundancy-group 1; chassis-id 1; mode active-active; status-control standby; init-delay-time 240; } } unit 0 { family ethernet-switching { interface-mode trunk;
98
vlan { members v10;
} } } } em0 { unit 0 { family inet {
address 10.1.1.2/24; } } } irb { unit 10 { family inet {
address 10.10.1.2/24; } } unit 50 { family inet {
address 10.50.1.2/30; } } } } multi-chassis { multi-chassis-protection 10.50.1.1 { interface ae0; } } protocols { iccp { local-ip-addr 10.50.1.2; peer 10.50.1.1 { session-establishment-hold-time 340; redundancy-group-id-list 1; backup-liveness-detection {
backup-peer-ip 10.1.1.1; } liveness-detection {
minimum-receive-interval 1000; transmit-interval {
99
minimum-interval 1000; } } } } } switch-options { service-id 10; } vlans { v10 { vlan-id 10; l3-interface irb.10; mcae-mac-synchronize; } v50 { vlan-id 50; l3-interface irb.50; } }
Display the results of the configuration on QFX3.
chassis { aggregated-devices { ethernet { device-count 2; } }
} interfaces {
xe-0/0/0 { ether-options { 802.3ad ae1; }
} xe-0/0/1 {
ether-options { 802.3ad ae1;
} } xe-0/0/2 {
100
unit 0 { family ethernet-switching { interface-mode access; vlan { members v10; } }
} } ae1 {
aggregated-ether-options { lacp { active; }
} unit 0 {
family ethernet-switching { interface-mode trunk; vlan { members v10; }
} } } em0 { unit 0 {
family inet { address 10.1.1.3/24;
} } } irb { unit 10 {
family inet { address 10.10.1.3/24;
} } } } vlans { v10 { vlan-id 10; l3-interface irb.10;
101
} }
Verification
IN THIS SECTION Verifying That ICCP Is Working on QFX1 | 101 Verifying That LACP Is Active on QFX1 | 102 Verifying That the MC-AE and ICL-PL Interfaces Are Up on QFX1 | 102 Verifying That MAC Learning Is Occurring on QFX1 | 103 Verifying That Host1 Can Connect to Host2 | 104
Verify that the configuration is working properly. Verifying That ICCP Is Working on QFX1 Purpose Verify that ICCP is running on QFX1. Action
user@switch> show iccp
Redundancy Group Information for peer 10.50.1.2
TCP Connection
: Established
Liveliness Detection : Up
Backup liveness peer status: Up
Redundancy Group ID
Status
1
Up
Client Application: lacpd Redundancy Group IDs Joined: 1
Client Application: l2ald_iccpd_client Redundancy Group IDs Joined: 1
102
Meaning This output shows that the TCP connection between the peers hosting the MC-LAG is up, liveness detection is up, and MCSNOOPD and ESWD client applications are running. Verifying That LACP Is Active on QFX1 Purpose Verify that LACP is active on QFX1. Action
user@switch> show lacp interfaces
Aggregated interface: ae0
LACP state:
Role Exp Def Dist Col Syn Aggr Timeout Activity
xe-0/0/1
Actor No No Yes Yes Yes Yes
Fast Active
xe-0/0/1
Partner No No Yes Yes Yes Yes
Fast Active
xe-0/0/2
Actor No No Yes Yes Yes Yes
Fast Active
xe-0/0/2
Partner No No Yes Yes Yes Yes
Fast Active
LACP protocol:
Receive State Transmit State
Mux State
xe-0/0/1
Current Fast periodic Collecting distributing
xe-0/0/2
Current Fast periodic Collecting distributing
Aggregated interface: ae1
LACP state:
Role Exp Def Dist Col Syn Aggr Timeout Activity
xe-0/0/0
Actor No No Yes Yes Yes Yes
Fast Active
xe-0/0/0
Partner No No Yes Yes Yes Yes
Fast Active
LACP protocol:
Receive State Transmit State
Mux State
xe-0/0/0
Current Fast periodic Collecting distributing
Meaning This output shows that QFX1 is participating in LACP negotiation. Verifying That the MC-AE and ICL-PL Interfaces Are Up on QFX1 Purpose Verify that the MC-AE and ICL-PL interfaces are up on QFX1.
103
Action
user@switch> show interfaces mc-ae
Member Link
: ae1
Current State Machine's State: mcae active state
Local Status
: active
Local State
: up
Peer Status
: active
Peer State
: up
Logical Interface
: ae1.0
Topology Type
: bridge
Local State
: up
Peer State
: up
Peer Ip/MCP/State
: 10.50.1.2 ae0.0 up
Meaning This output shows that the MC-AE interface on QFX1 is up and active. Verifying That MAC Learning Is Occurring on QFX1 Purpose Verify that MAC learning is working on QFX1. Action
user@switch> show ethernet-switching table MAC flags (S - static MAC, D - dynamic MAC, L - locally learned, P - Persistent static, C - Control MAC
SE - statistics enabled, NM - non configured MAC, R - remote PE MAC, O - ovsdb MAC)
Ethernet switching table : 3 entries, 3 learned
Routing instance : default-switch
Vlan
MAC
MAC
Age
Logical
NH
RTR
name
address
flags
interface
Index
ID
104
v10 ae0.0
v10 xe-0/0/3.0
v10 ae1.0
00:50:56:93:73:cd DR
-
0
0
00:50:56:93:87:58 DL
-
0
0
00:50:56:93:89:a0 DLR
-
0
0
Meaning The output shows three learned MAC addresses entries. Verifying That Host1 Can Connect to Host2 Purpose Verify that Host1 can ping Host2. Action
[edit] user@HOST1> ping 10.10.1.102 PING 10.10.1.102 (10.10.1.102): 56 data bytes 64 bytes from 10.10.1.102: icmp_seq=0 ttl=64 time=157.788 ms 64 bytes from 10.10.1.102: icmp_seq=1 ttl=64 time=153.965 ms 64 bytes from 10.10.1.102: icmp_seq=2 ttl=64 time=102.126 ms ...
Meaning The output shows that HOST1 can successfully ping HOST2. Troubleshooting
IN THIS SECTION Troubleshooting a LAG That Is Down | 105
105
Troubleshooting a LAG That Is Down Problem The show interfaces terse command shows that the MC-LAG is down. Solution Check the following: 1. Verify that there is no configuration mismatch. 2. Verify that all member ports are up. 3. Verify that the MC-LAG is part of family Ethernet switching (Layer 2 LAG). 4. Verify that the MC-LAG member is connected to the correct MC-LAG member at the other end.
Example: Configuring Multichassis Link Aggregation on the MX Series
IN THIS SECTION Requirements | 105 Overview | 106 Configuring the PE Routers | 107 Configuring the CE Device | 117 Configuring the Provider Router | 121 Verification | 125
This example shows how to configure a multichassis link aggregation group (MC-LAG) in an activeactive scenario, which load balances traffic across the PEs.
Requirements
This example uses the following hardware and software components:
106
NOTE: This example also applies to QFX10002 and QFX10008 switches.
� Four Juniper Networks MX Series routers ( MX240, MX480, MX960) � Junos OS Release 11.2 or later running on all four routers
Overview
IN THIS SECTION Topology Diagram | 107
Consider a sample topology in which a customer edge router, CE, is connected to two provider edge (PE) routers, PE1 and PE2, respectively. The two PE devices each have a link aggregation group (LAG) connected to the CE device. The configured mode is active -active, meaning that both PE routers' LAG ports are active and carrying traffic at the same time. PE1 and PE2 are connected to a single service provider router, P. In this example, the CE router is not aware that its aggregated Ethernet links are connected to two separate PE devices. The two PE devices each have a LAG connected to the CE device. The configured mode is active-active, meaning that both PE routers' LAG ports are active and carrying traffic at the same time. In Figure 8 on page 107, from the perspective of Router CE, all four ports belonging to a LAG are connected to a single service provider device. Because the configured mode is active-active, all four ports are active, and the CE device load-balances the traffic to the peering PE devices. On the PE routers, a regular LAG is configured facing the CE device. On one end of an MC-LAG is an MC-LAG client device, such as a server, that has one or more physical links in a LAG. This client device does not need to detect the MC-LAG. On the other side of an MC-LAG are two MC-LAG routers. Each of the routers has one or more physical links connected to a single client device. The routers coordinate with each other to ensure that data traffic is forwarded properly. ICCP messages are sent between the two PE devices. In this example, you configure an MC-LAG across two routers, consisting of two aggregated Ethernet interfaces, an interchassis link-protection link (ICLPL), multichassis protection link for the ICL-PL, and ICCP for the peers hosting the MC-LAG.
107 Topology Diagram Figure 8 on page 107 shows the topology used in this example. Figure 8: MC-LAG Active-Active Mode on MX Series Routers
Configuring the PE Routers
IN THIS SECTION CLI Quick Configuration | 107 Configuring the PE1 Router | 110 Results | 114
CLI Quick Configuration To quickly configure this example, copy the following commands, paste them in a text file, remove any line breaks, change any details necessary to match your network configuration, copy and paste the commands into the CLI at the [edit] hierarchy level, and then enter commit from configuration mode.
108
Router PE1
set chassis aggregated-devices ethernet device-count 5 set interfaces ge-1/0/1 gigether-options 802.3ad ae1 set interfaces ge-1/0/2 unit 0 family inet address 10.100.100.1/30 set interfaces ge-1/0/6 gigether-options 802.3ad ae0 set interfaces ge-1/1/1 flexible-vlan-tagging set interfaces ge-1/1/1 encapsulation flexible-ethernet-services set interfaces ge-1/1/1 unit 0 encapsulation vlan-bridge set interfaces ge-1/1/1 unit 0 vlan-id-range 100-110 set interfaces ge-1/1/4 flexible-vlan-tagging set interfaces ge-1/1/4 encapsulation flexible-ethernet-services set interfaces ge-1/1/4 unit 0 encapsulation vlan-bridge set interfaces ge-1/1/4 unit 0 vlan-id-range 100-110 set interfaces ae0 flexible-vlan-tagging set interfaces ae0 encapsulation flexible-ethernet-services set interfaces ae0 aggregated-ether-options lacp active set interfaces ae0 aggregated-ether-options lacp system-priority 100 set interfaces ae0 aggregated-ether-options lacp system-id 00:00:00:00:00:05 set interfaces ae0 aggregated-ether-options lacp admin-key 1 set interfaces ae0 aggregated-ether-options mc-ae mc-ae-id 5 set interfaces ae0 aggregated-ether-options mc-ae redundancy-group 10 set interfaces ae0 aggregated-ether-options mc-ae chassis-id 1 set interfaces ae0 aggregated-ether-options mc-ae mode active-active set interfaces ae0 aggregated-ether-options mc-ae status-control active set interfaces ae0 unit 0 encapsulation vlan-bridge set interfaces ae0 unit 0 vlan-id-range 100-110 set interfaces ae0 unit 0 multi-chassis-protection 10.100.100.2 interface ge-1/1/4.0 set interfaces ae1 flexible-vlan-tagging set interfaces ae1 encapsulation flexible-ethernet-services set interfaces ae1 aggregated-ether-options lacp active set interfaces ae1 aggregated-ether-options lacp system-priority 100 set interfaces ae1 aggregated-ether-options lacp system-id 00:00:00:00:00:05 set interfaces ae1 aggregated-ether-options lacp admin-key 1 set interfaces ae1 aggregated-ether-options mc-ae mc-ae-id 10 set interfaces ae1 aggregated-ether-options mc-ae redundancy-group 10 set interfaces ae1 aggregated-ether-options mc-ae chassis-id 1 set interfaces ae1 aggregated-ether-options mc-ae mode active-active set interfaces ae1 aggregated-ether-options mc-ae status-control active set interfaces ae1 unit 0 encapsulation vlan-bridge
109
set interfaces ae1 unit 0 vlan-id-range 100-110 set interfaces ae1 unit 0 multi-chassis-protection 10.100.100.2 interface ge-1/1/4.0 set bridge-domains bd0 domain-type bridge set bridge-domains bd0 vlan-id all set bridge-domains bd0 service-id 20 set bridge-domains bd0 interface ae1.0 set bridge-domains bd0 interface ge-1/0/3.0 set bridge-domains bd0 interface ge-1/1/1.0 set bridge-domains bd0 interface ge-1/1/4.0 set bridge-domains bd0 interface ae0.0 set protocols iccp local-ip-addr 10.100.100.1 set protocols iccp peer 10.100.100.2 redundancy-group-id-list 10 set protocols iccp peer 10.100.100.2 liveness-detection minimum-interval 1000 set switch-options service-id 10
Router PE2
set chassis aggregated-devices ethernet device-count 5 set interfaces ge-1/0/2 unit 0 family inet address 10.100.100.2/30 set interfaces ge-1/0/3 flexible-vlan-tagging set interfaces ge-1/0/3 encapsulation flexible-ethernet-services set interfaces ge-1/0/3 unit 0 encapsulation vlan-bridge set interfaces ge-1/0/3 unit 0 vlan-id-range 100-110 set interfaces ge-1/0/4 flexible-vlan-tagging set interfaces ge-1/0/4 encapsulation flexible-ethernet-services set interfaces ge-1/0/4 unit 0 encapsulation vlan-bridge set interfaces ge-1/0/4 unit 0 vlan-id-range 100-110 set interfaces ge-1/0/5 gigether-options 802.3ad ae0 set interfaces ge-1/1/0 gigether-options 802.3ad ae1 set interfaces ae0 flexible-vlan-tagging set interfaces ae0 encapsulation flexible-ethernet-services set interfaces ae0 aggregated-ether-options lacp active set interfaces ae0 aggregated-ether-options lacp system-priority 100 set interfaces ae0 aggregated-ether-options lacp system-id 00:00:00:00:00:05 set interfaces ae0 aggregated-ether-options lacp admin-key 1 set interfaces ae0 aggregated-ether-options mc-ae mc-ae-id 5 set interfaces ae0 aggregated-ether-options mc-ae redundancy-group 10 set interfaces ae0 aggregated-ether-options mc-ae chassis-id 0 set interfaces ae0 aggregated-ether-options mc-ae mode active-active set interfaces ae0 aggregated-ether-options mc-ae status-control standby
110
set interfaces ae0 unit 0 encapsulation vlan-bridge set interfaces ae0 unit 0 vlan-id-range 100-110 set interfaces ae0 unit 0 multi-chassis-protection 10.100.100.1 interface ge-1/0/4.0 set interfaces ae1 flexible-vlan-tagging set interfaces ae1 encapsulation flexible-ethernet-services set interfaces ae1 aggregated-ether-options lacp active set interfaces ae1 aggregated-ether-options lacp system-priority 100 set interfaces ae1 aggregated-ether-options lacp system-id 00:00:00:00:00:05 set interfaces ae1 aggregated-ether-options lacp admin-key 1 set interfaces ae1 aggregated-ether-options mc-ae mc-ae-id 10 set interfaces ae1 aggregated-ether-options mc-ae redundancy-group 10 set interfaces ae1 aggregated-ether-options mc-ae chassis-id 0 set interfaces ae1 aggregated-ether-options mc-ae mode active-active set interfaces ae1 aggregated-ether-options mc-ae status-control standby set interfaces ae1 unit 0 encapsulation vlan-bridge set interfaces ae1 unit 0 vlan-id-range 100-110 set interfaces ae1 unit 0 multi-chassis-protection 10.100.100.1 interface ge-1/0/4.0 set bridge-domains bd0 domain-type bridge set bridge-domains bd0 vlan-id all set bridge-domains bd0 service-id 20 set bridge-domains bd0 interface ae1.0 set bridge-domains bd0 interface ge-1/0/3.0 set bridge-domains bd0 interface ge-1/0/4.0 set bridge-domains bd0 interface ae0.0 set protocols iccp local-ip-addr 10.100.100.2 set protocols iccp peer 10.100.100.1 redundancy-group-id-list 10 set protocols iccp peer 10.100.100.1 liveness-detection minimum-interval 1000 set switch-options service-id 10
Configuring the PE1 Router
Step-by-Step Procedure
The following example requires you to navigate various levels in the configuration hierarchy. For information about navigating the CLI, see Using the CLI Editor in Configuration Mode .
To configure Router PE1:
111
1. Specify the number of aggregated Ethernet interfaces to be created.
[edit chassis] user@PE1# set aggregated-devices ethernet device-count 5
2. Specify the members to be included within the aggregated Ethernet bundles.
[edit interfaces] user@PE1# set ge-1/0/1 gigether-options 802.3ad ae1 user@PE1# set ge-1/0/6 gigether-options 802.3ad ae0
3. Configure the interfaces that connect to senders or receivers, the ICL interfaces, and the ICCP interfaces.
[edit interfaces] user@PE1# set ge-1/1/1 flexible-vlan-tagging user@PE1# set ge-1/1/1 encapsulation flexible-ethernet-services user@PE1# set ge-1/1/1 unit 0 encapsulation vlan-bridge user@PE1# set ge-1/1/1 unit 0 vlan-id-range 100-110
user@PE1# set ge-1/1/4 flexible-vlan-tagging user@PE1# set ge-1/1/4 encapsulation flexible-ethernet-services user@PE1# set ge-1/1/4 unit 0 encapsulation vlan-bridge user@PE1# set ge-1/1/4 unit 0 vlan-id-range 100-110
user@PE1# set ge-1/0/2 unit 0 family inet address 10.100.100.1/30
4. Configure parameters on the aggregated Ethernet bundles.
[edit interfaces ae0] user@PE1# set flexible-vlan-tagging user@PE1# set encapsulation flexible-ethernet-services user@PE1# set unit 0 encapsulation vlan-bridge user@PE1# set unit 0 vlan-id-range 100-110 user@PE1# set unit 0 multi-chassis-protection 10.100.100.2 interface ge-1/1/4.0 [edit interfaces ae1] user@PE1# set flexible-vlan-tagging user@PE1# set encapsulation flexible-ethernet-services
112
user@PE1# set unit 0 encapsulation vlan-bridge user@PE1# set unit 0 vlan-id-range 100-110 user@PE1# set unit 0 multi-chassis-protection 10.100.100.2 interface ge-1/1/4.0
5. Configure LACP on the aggregated Ethernet bundles.
[edit interfaces ae0 aggregated-ether-options] user@PE1# set lacp active user@PE1# set lacp system-priority 100 user@PE1# set lacp system-id 00:00:00:00:00:05 user@PE1# set lacp admin-key 1 [edit interfaces ae1 aggregated-ether-options] user@PE1# set lacp active user@PE1# set lacp system-priority 100 user@PE1# set lacp system-id 00:00:00:00:00:05 user@PE1# set lacp admin-key 1
6. Configure the MC-LAG interfaces.
[edit interfaces ae0 aggregated-ether-options] user@PE1# set mc-ae mc-ae-id 5 user@PE1# set mc-ae redundancy-group 10 user@PE1# set mc-ae chassis-id 1 user@PE1# set mc-ae mode active-active user@PE1# set mc-ae status-control active [edit interfaces ae1 aggregated-ether-options] user@PE1# set mc-ae mc-ae-id 10 user@PE1# set mc-ae redundancy-group 10 user@PE1# set mc-ae chassis-id 1 user@PE1# set mc-ae mode active-active user@PE1# set mc-ae status-control active
The multichassis aggregated Ethernet identification number (mc-ae-id) specifies which link aggregation group the aggregated Ethernet interface belongs to. The ae0 interfaces on Router PE1 and Router PE2 are configured with mc-ae-id 5. The ae1 interfaces on Router PE1 and Router PE2 are configured with mc-ae-id 10.
The redundancy-group 10 statement is used by ICCP to associate multiple chassis that perform similar redundancy functions and to establish a communication channel so that applications on
113
peering chassis can send messages to each other. The ae0 and ae1 interfaces on Router PE1 and Router PE2 are configured with the same redundancy group, redundancy-group 10. The chassis-id statement is used by LACP for calculating the port number of the MC-LAG's physical member links. Router PE1 uses chassid-id 1 to identify both its ae0 and ae1 interfaces. Router PE2 uses chassis-id 0 to identify both its ae0 and ae1 interfaces. The mode statement indicates whether an MC-LAG is in active-standby mode or active-active mode. Chassis that are in the same group must be in the same mode.
7. Configure a domain that includes the set of logical ports.
[edit bridge-domains bd0] user@PE1# set domain-type bridge user@PE1# set vlan-id all user@PE1# set service-id 20 user@PE1# set interface ae0.0 user@PE1# set interface ae1.0 user@PE1# set interface ge-1/1/1.0 user@PE1# set interface ge-1/1/4.0
The ports within a bridge domain share the same flooding or broadcast characteristics in order to perform Layer 2 bridging. The bridge-level service-id statement is required to link related bridge domains across peers (in this case Router PE1 and Router PE2), and must be configured with the same value.
8. Configure ICCP parameters.
[edit protocols iccp] user@PE1# set local-ip-addr 10.100.100.1 user@PE1# set peer 10.100.100.2 redundancy-group-id-list 10 user@PE1# set peer 10.100.100.2 liveness-detection minimum-interval 1000
9. Configure the service ID at the global level.
[edit switch-options] user@PE1# set service-id 10
114
You must configure the same unique network-wide configuration for a service in the set of PE routers providing the service. This service ID is required if the multichassis aggregated Ethernet interfaces are part of a bridge domain.
Results
From configuration mode, confirm your configuration by entering the show bridge-domains, show chassis, show interfaces, show protocols, and show switch-options commands. If the output does not display the intended configuration, repeat the instructions in this example to correct the configuration.
user@PE1# show bridge-domains bd0 {
domain-type bridge; vlan-id all; service-id 20; interface ae1.0; interface ge-1/1/1.0; interface ge-1/1/4.0; interface ae0.0; }
user@PE1# show chassis aggregated-devices {
ethernet { device-count 5;
} }
user@PE1# show interfaces ge-1/0/1 {
gigether-options { 802.3ad ae1;
} } ge-1/0/6 {
gigether-options { 802.3ad ae0;
} }
115
ge-1/0/2 { unit 0 { family inet { address 10.100.100.1/30; } }
} ge-1/1/1 {
flexible-vlan-tagging; encapsulation flexible-ethernet-services; unit 0 {
encapsulation vlan-bridge; vlan-id-range 100-110; } } ge-1/1/4 { flexible-vlan-tagging; encapsulation flexible-ethernet-services; unit 0 { encapsulation vlan-bridge; vlan-id-range 100-110; } } ae0 { flexible-vlan-tagging; encapsulation flexible-ethernet-services; aggregated-ether-options { lacp {
active; system-priority 100; system-id 00:00:00:00:00:05; admin-key 1; } mc-ae { mc-ae-id 5; redundancy-group 10; chassis-id 1; mode active-active; status-control active; } } unit 0 { encapsulation vlan-bridge;
116
vlan-id-range 100-110; multi-chassis-protection 10.100.100.2 {
interface ge-1/1/4.0; } } } ae1 { flexible-vlan-tagging; encapsulation flexible-ethernet-services; aggregated-ether-options { lacp {
active; system-priority 100; system-id 00:00:00:00:00:05; admin-key 1; } mc-ae { mc-ae-id 10; redundancy-group 10; chassis-id 1; mode active-active; status-control active; } } unit 0 { encapsulation vlan-bridge; vlan-id-range 100-110; multi-chassis-protection 10.100.100.2 { interface ge-1/1/4.0; } } }
user@PE1# show protocols iccp {
local-ip-addr 10.100.100.1; peer 10.100.100.2 {
redundancy-group-id-list 10; liveness-detection {
minimum-interval 1000; }
117
} }
user@PE1# show switch-options service-id 10;
If you are done configuring the device, enter commit from configuration mode. Repeat the procedure for Router PE2, using the appropriate interface names and addresses.
Configuring the CE Device
IN THIS SECTION CLI Quick Configuration | 117 Configuring the CE Device | 118 Results | 120
CLI Quick Configuration
To quickly configure this example, copy the following commands, paste them in a text file, remove any line breaks, change any details necessary to match your network configuration, copy and paste the commands into the CLI at the [edit] hierarchy level , and then enter commit from configuration mode. Device CE
set chassis aggregated-devices ethernet device-count 2 set interfaces ge-2/0/2 gigether-options 802.3ad ae0 set interfaces ge-2/0/3 gigether-options 802.3ad ae0 set interfaces ge-2/1/6 flexible-vlan-tagging set interfaces ge-2/1/6 encapsulation flexible-ethernet-services set interfaces ge-2/1/6 unit 0 encapsulation vlan-bridge set interfaces ge-2/1/6 unit 0 vlan-id-range 100-110 set interfaces ae0 flexible-vlan-tagging set interfaces ae0 encapsulation flexible-ethernet-services set interfaces ae0 aggregated-ether-options lacp active set interfaces ae0 aggregated-ether-options lacp system-priority 100
118
set interfaces ae0 unit 0 encapsulation vlan-bridge set interfaces ae0 unit 0 vlan-id-range 100-110 set bridge-domains bd0 domain-type bridge set bridge-domains bd0 vlan-id all set bridge-domains bd0 interface ge-2/1/6.0 set bridge-domains bd0 interface ae0.0
Configuring the CE Device
Step-by-Step Procedure
The following example requires you to navigate various levels in the configuration hierarchy. For information about navigating the CLI, see Using the CLI Editor in Configuration Mode . To configure the CE device: 1. Specify the number of aggregated Ethernet interfaces to be created.
[edit chassis] user@CE# set aggregated-devices ethernet device-count 2
2. Specify the members to be included within the aggregated Ethernet bundle.
[edit interfaces] user@CE# set ge-2/0/2 gigether-options 802.3ad ae0 user@CE# set ge-2/0/3 gigether-options 802.3ad ae0
3. Configure an interface that connects to senders or receivers.
[edit interfaces ge-2/1/6] user@CE# set flexible-vlan-tagging user@CE# set encapsulation flexible-ethernet-services user@CE# set unit 0 encapsulation vlan-bridge user@CE# set unit 0 vlan-id-range 100-110
119
4. Configure parameters on the aggregated Ethernet bundle.
[edit interfaces ae0] user@CE# set flexible-vlan-tagging user@CE# set encapsulation flexible-ethernet-services user@CE# set unit 0 encapsulation vlan-bridge user@CE# set unit 0 vlan-id-range 100-110
5. Configure LACP on the aggregated Ethernet bundle.
[edit interfaces ae0 aggregated-ether-options] user@CE# set lacp active user@CE# set lacp system-priority 100
The active statement initiates transmission of LACP packets. For the system-priority statement, a smaller value indicates a higher priority. The device with the lower system priority value determines which links between LACP partner devices are active and which are in standby mode for each LACP group. The device on the controlling end of the link uses port priorities to determine which ports are bundled into the aggregated bundle and which ports are put in standby mode. Port priorities on the other device (the noncontrolling end of the link) are ignored. 6. Configure a domain that includes the set of logical ports.
[edit bridge-domains bd0] user@CE# set domain-type bridge user@CE# set vlan-id all user@CE# set interface ge-2/1/6.0 user@CE# set interface ae0.0
The ports within a bridge domain share the same flooding or broadcast characteristics in order to perform Layer 2 bridging.
120
Results
From configuration mode, confirm your configuration by entering the show bridge-domains, show chassis, and show interfaces commands. If the output does not display the intended configuration, repeat the instructions in this example to correct the configuration.
user@CE# show bridge-domains bd0 {
domain-type bridge; vlan-id all; interface ge-2/1/6.0; interface ae0.0; }
user@CE# show chassis aggregated-devices {
ethernet { device-count 2;
} }
user@CE# show interfaces ge-2/0/2 {
gigether-options { 802.3ad ae0;
} } ge-2/0/3 {
gigether-options { 802.3ad ae0;
} } ge-2/1/6 {
flexible-vlan-tagging; encapsulation flexible-ethernet-services; unit 0 {
encapsulation vlan-bridge; vlan-id-range 100-110; }
121
} ae0 {
flexible-vlan-tagging; encapsulation flexible-ethernet-services; aggregated-ether-options {
lacp { active; system-priority 100;
} } unit 0 {
encapsulation vlan-bridge; vlan-id-range 100-110; } }
If you are done configuring the device, enter commit from configuration mode.
Configuring the Provider Router
IN THIS SECTION CLI Quick Configuration | 121 Configuring the PE Router | 122 Results | 123
CLI Quick Configuration
To quickly configure this example, copy the following commands, paste them in a text file, remove any line breaks, change any details necessary to match your network configuration, copy and paste the commands into the CLI at the [edit] hierarchy level, and then enter commit from configuration mode. Router P
set chassis aggregated-devices ethernet device-count 2 set interfaces ge-1/0/5 gigether-options 802.3ad ae1 set interfaces ge-1/0/11 gigether-options 802.3ad ae1 set interfaces ge-1/1/3 flexible-vlan-tagging set interfaces ge-1/1/3 encapsulation flexible-ethernet-services
122
set interfaces ge-1/1/3 unit 0 encapsulation vlan-bridge set interfaces ge-1/1/3 unit 0 vlan-id-range 100-110 set interfaces ae1 flexible-vlan-tagging set interfaces ae1 encapsulation flexible-ethernet-services set interfaces ae1 aggregated-ether-options lacp active set interfaces ae1 aggregated-ether-options lacp system-priority 100 set interfaces ae1 unit 0 encapsulation vlan-bridge set interfaces ae1 unit 0 vlan-id-range 100-110 set bridge-domains bd0 vlan-id all set bridge-domains bd0 domain-type bridge set bridge-domains bd0 interface ge-1/1/3.0 set bridge-domains bd0 interface ae1.0
Configuring the PE Router
Step-by-Step Procedure
The following example requires you to navigate various levels in the configuration hierarchy. For information about navigating the CLI, see Using the CLI Editor in Configuration Mode . To configure the P router: 1. Specify the number of aggregated Ethernet interfaces to be created.
[edit chassis] user@P# set aggregated-devices ethernet device-count 2
2. Specify the members to be included within the aggregated Ethernet bundle.
[edit interfaces] user@P# set ge-1/0/5 gigether-options 802.3ad ae1 user@P# set ge-1/0/11 gigether-options 802.3ad ae1
3. Configure an interface that connects to senders or receivers.
[edit interfaces ge-1/1/3] user@P# set flexible-vlan-tagging user@P# set encapsulation flexible-ethernet-services
123
user@P# set unit 0 encapsulation vlan-bridge user@P# set unit 0 vlan-id-range 100-500
4. Configure parameters on the aggregated Ethernet bundle.
[edit interfaces ae1] user@P# set flexible-vlan-tagging user@P# set encapsulation flexible-ethernet-services user@P# set unit 0 encapsulation vlan-bridge user@P# set unit 0 vlan-id-range 100-110
5. Configure LACP on the aggregated Ethernet bundle.
[edit interfaces ae1 aggregated-ether-options] user@P# set lacp active user@P# set lacp system-priority 100
6. Configure a domain that includes the set of logical ports.
[edit bridge-domains bd0] user@P# set vlan-id all user@P# set domain-type bridge user@P# set interface ge-1/1/3.0 user@P# set interface ae1.0
Results
From configuration mode, confirm your configuration by entering the show bridge-domains, show chassis, and show interfaces commands. If the output does not display the intended configuration, repeat the instructions in this example to correct the configuration.
user@P# show bridge-domains bd0 {
domain-type bridge; vlan-id all; interface ge-1/1/3.0;
124
interface ae1.0; }
user@P# show chassis aggregated-devices {
ethernet { device-count 2;
} }
user@P# show interfaces ge-1/0/5 {
gigether-options { 802.3ad ae1;
} } ge-1/0/11 {
gigether-options { 802.3ad ae1;
} } ge-1/1/3 {
flexible-vlan-tagging; encapsulation flexible-ethernet-services; unit 0 {
encapsulation vlan-bridge; vlan-id-range 100-500; } } ae1 { flexible-vlan-tagging; encapsulation flexible-ethernet-services; aggregated-ether-options { lacp {
active; system-priority 100; } } unit 0 { encapsulation vlan-bridge;
125
vlan-id-range 100-110; } }
If you are done configuring the device, enter commit from configuration mode.
Verification
Confirm that the configuration is working properly by running the following commands: � show iccp � show interfaces ae0 � show interfaces ae1 � show interfaces mc-ae � show pim interfaces � show vrrp � show igmp � show ospf � show dhcp relay � show l2-learning instance
Example: Configuring Multichassis Link Aggregation on EX9200 Switches in the Core for Campus Networks
IN THIS SECTION Requirements | 126 Overview | 127 Configuration | 129 (Optional) Configuring RSTP | 155 (Optional) Configuring IGMP Snooping | 157
126
(Optional) Configuring VRRP | 159 (Optional) Configuring MAC Address Synchronization | 162 (Optional) Configuring OSPF | 163 (Optional) Configuring PIM | 165 (Optional) Configuring DHCP Relay | 168 Verification | 171
MC-LAG in a campus configuration allows you to bond two or more physical links into a logical link between core-aggregation or aggregation-access switches. MC-LAG improves availability by providing active/active links between multiple switches over a standard Link Aggregation Group (LAG), eliminates the need for the Spanning Tree Protocol (STP), and provides faster Layer 2 convergence upon link and device failures. With multiple active network paths, MC-LAG enables you to load balance traffic across the multiple physical links. If a link fails, the traffic can be forwarded through the other available links and the aggregated link remains available.
Requirements
This example uses the following hardware and software components: � Junos OS Release 13.2R5.10 for EX Series � Two EX9200 switches
NOTE: This configuration example has been tested using the software release listed and is assumed to work on all later releases.
Before you configure an MC-LAG, be sure that you understand how to: � Configure aggregated Ethernet interfaces on a switch. See Configuring an Aggregated Ethernet
Interface. � Configure the Link Aggregation Control Protocol (LACP) on aggregated Ethernet interfaces on a
switch. See Configuring Aggregated Ethernet LACP (CLI Procedure).
127
Overview
IN THIS SECTION Topology | 127
In this example, you configure an MC-LAG across two switches, consisting of two aggregated Ethernet interfaces, an interchassis link-protection link (ICL-PL), multichassis protection link for the ICL-PL, ICCP for the peers hosting the MC-LAG, and Layer 3 connectivity between MC-LAG peers. Layer 3 connectivity is required for ICCP. Topology The topology used in this example consists of two switches hosting an MC-LAG. The two switches are connected to an EX4600 switch and an MX80 router. Figure 9 on page 127 shows the topology of this example. Figure 9: Topology Diagram
Table 5 on page 128 details the topology used in this configuration example.
128
Table 5: Components of the Topology for Configuring a Multichassis LAG Between Two Switches
Hostname
Base Hardware
Multichassis Link Aggregation Group
EX9200-A EX9200-B
EX9200 EX9200
ae0 is configured as an aggregated Ethernet interface, and is used as an ICCP link. The following interfaces are part of ae0: et-1/0/0 and et-1/0/1 on EX9200-A and
et-1/0/0 and et-1/0/1 on EX9200-B.
ae1 is configured as an aggregated Ethernet interface and is used as an ICL link, and the following two interfaces are part of ae1:
xe-2/0/3 and xe-2/0/4 on EX9200-A and
xe-2/0/3 and xe-2/0/4 on EX9200-B.
ae2 is configured as an MC-LAG, and the following interfaces are part of ae2:
et-1/2/0 on EX9200-A and et-1/2/0 on EX9200-B.
ae4 is configured as an MC-LAG, and the following interfaces are part of ae4:
xe-2/0/0 on EX9200-A and xe-2/0/0 on EX9200-B.
129
Configuration
IN THIS SECTION CLI Quick Configuration | 129 Configuring MC-LAG on Switch A | 132 Configuring MC-LAG on Switch B | 139 Results | 145
CLI Quick Configuration
To quickly configure this example, copy the following commands, paste them in a text file, remove any line breaks, change any details necessary to match your network configuration, copy and paste the commands into the CLI at the [edit] hierarchy level, and then enter commit from configuration mode. EX9200-A
set chassis aggregated-devices ethernet device-count 20 set interfaces et-1/0/0 ether-options 802.3ad ae0 set interfaces et-1/0/1 ether-options 802.3ad ae0 set interfaces et-1/2/0 ether-options 802.3ad ae2 set interfaces xe-2/0/3 hold-time up 100 set interfaces xe-2/0/3 hold-time down 9000 set interfaces xe-2/0/3 ether-options 802.3ad ae1 set interfaces xe-2/0/4 hold-time up 100 set interfaces xe-2/0/4 hold-time down 9000 set interfaces xe-2/0/4 ether-options 802.3ad ae1 set interfaces xe-2/0/0 ether-options 802.3ad ae4 set interfaces ae0 aggregated-ether-options lacp active set interfaces ae0 aggregated-ether-options lacp periodic fast set interfaces ae0 unit 0 family inet address 192.168.90.1/24 set interfaces ae1 description ICL-LINK set interfaces ae1 aggregated-ether-options lacp active set interfaces ae1 aggregated-ether-options lacp periodic fast set interfaces ae1 unit 0 family ethernet-switching interface-mode trunk set interfaces ae1 unit 0 family ethernet-switching vlan members all set interfaces ae2 aggregated-ether-options lacp active
130
set interfaces ae2 aggregated-ether-options lacp periodic fast set interfaces ae2 aggregated-ether-options lacp system-id 00:01:02:03:04:05 set interfaces ae2 aggregated-ether-options lacp admin-key 3 set interfaces ae2 aggregated-ether-options mc-ae mc-ae-id 3 set interfaces ae2 aggregated-ether-options mc-ae redundancy-group 1 set interfaces ae2 aggregated-ether-options mc-ae chassis-id 0 set interfaces ae2 aggregated-ether-options mc-ae mode active-active set interfaces ae2 aggregated-ether-options mc-ae status-control active set interfaces ae2 aggregated-ether-options mc-ae init-delay-time 520 set interfaces ae2 aggregated-ether-options mc-ae events iccp-peer-down prefer-status-control-active set interfaces ae2 unit 0 family ethernet-switching interface-mode trunk set interfaces ae2 unit 0 family ethernet-switching vlan members all set interfaces ae4 aggregated-ether-options lacp active set interfaces ae4 aggregated-ether-options lacp periodic fast set interfaces ae4 aggregated-ether-options lacp system-id 00:01:02:03:04:06 set interfaces ae4 aggregated-ether-options lacp admin-key 7 set interfaces ae4 aggregated-ether-options mc-ae mc-ae-id 7 set interfaces ae4 aggregated-ether-options mc-ae redundancy-group 1 set interfaces ae4 aggregated-ether-options mc-ae chassis-id 0 set interfaces ae4 aggregated-ether-options mc-ae mode active-active set interfaces ae4 aggregated-ether-options mc-ae status-control active set interfaces ae4 aggregated-ether-options mc-ae init-delay-time 520 set interfaces ae4 aggregated-ether-options mc-ae events iccp-peer-down prefer-status-control-active set interfaces ae4 unit 0 family ethernet-switching interface-mode trunk set interfaces ae4 unit 0 family ethernet-switching vlan members v54 set vlans rack_1 vlan-id 100 set vlans rack_1 vlan-id 54 set vlans rack_1 l3-interface irb.100 set vlans v54 l3-interface irb.54 set interfaces irb unit 54 family inet address 192.168.54.2/24 arp 192.168.54.1 l2-interface ae1.0 set interfaces irb unit 54 family inet address 192.168.54.2/24 arp 192.168.54.1 mac 3c:8a:b0:85:78:70 set interfaces irb unit 100 family inet address 192.168.10.3/24 arp 192.168.10.2 l2-interface ae1.0 set interfaces irb unit 100 family inet address 192.168.10.3/24 arp 192.168.10.2 mac 3c:8a:b0:85:78:70 set interfaces lo0 unit 0 family inet address 192.168.39.1/32 set protocols iccp local-ip-addr 192.168.39.1 set protocols iccp peer 192.168.39.2 session-establishment-hold-time 50 set protocols iccp peer 192.168.39.2 redundancy-group-id-list 1 set protocols iccp peer 192.168.39.2 backup-liveness-detection backup-peer-ip 10.105.5.6 set protocols iccp peer 192.168.39.2 liveness-detection minimum-interval 2000 set protocols iccp peer 192.168.39.2 liveness-detection multiplier 4
131
set multi-chassis multi-chassis-protection 192.168.39.2 interface ae1 set switch-options service-id 1
EX9200-B
set chassis aggregated-devices ethernet device-count 20 set interfaces et-1/0/0 ether-options 802.3ad ae0 set interfaces et-1/0/1 ether-options 802.3ad ae0 set interfaces et-1/2/0 ether-options 802.3ad ae2 set interfaces xe-2/0/0 ether-options 802.3ad ae4 set interfaces xe-2/0/3 hold-time up 100 set interfaces xe-2/0/3 hold-time down 9000 set interfaces xe-2/0/3 ether-options 802.3ad ae1 set interfaces xe-2/0/4 hold-time up 100 set interfaces xe-2/0/4 hold-time down 9000 set interfaces xe-2/0/4 ether-options 802.3ad ae1 set interfaces ae0 aggregated-ether-options lacp active set interfaces ae0 aggregated-ether-options lacp periodic fast set interfaces ae0 unit 0 family inet address 192.168.90.2/24 set interfaces ae1 description ICL-LINK set interfaces ae1 aggregated-ether-options lacp active set interfaces ae1 aggregated-ether-options lacp periodic fast set interfaces ae1 unit 0 family ethernet-switching interface-mode trunk set interfaces ae1 unit 0 family ethernet-switching vlan members all set interfaces ae2 aggregated-ether-options lacp active set interfaces ae2 aggregated-ether-options lacp periodic fast set interfaces ae2 aggregated-ether-options lacp system-id 00:01:02:03:04:05 set interfaces ae2 aggregated-ether-options lacp admin-key 3 set interfaces ae2 aggregated-ether-options mc-ae mc-ae-id 3 set interfaces ae2 aggregated-ether-options mc-ae redundancy-group 1 set interfaces ae2 aggregated-ether-options mc-ae chassis-id 1 set interfaces ae2 aggregated-ether-options mc-ae mode active-active set interfaces ae2 aggregated-ether-options mc-ae init-delay-time 520 set interfaces ae2 aggregated-ether-options mc-ae events iccp-peer-down prefer-status-control-active set interfaces ae2 aggregated-ether-options mc-ae status-control standby set interfaces ae2 unit 0 family ethernet-switching interface-mode trunk set interfaces ae2 unit 0 family ethernet-switching vlan members all set interfaces ae4 aggregated-ether-options lacp active set interfaces ae4 aggregated-ether-options lacp periodic fast set interfaces ae4 aggregated-ether-options lacp system-id 00:01:02:03:04:06
132
set interfaces ae4 aggregated-ether-options lacp admin-key 7 set interfaces ae4 aggregated-ether-options mc-ae mc-ae-id 7 set interfaces ae4 aggregated-ether-options mc-ae redundancy-group 1 set interfaces ae4 aggregated-ether-options mc-ae chassis-id 1 set interfaces ae4 aggregated-ether-options mc-ae mode active-active set interfaces ae4 aggregated-ether-options mc-ae status-control standby set interfaces ae4 aggregated-ether-options mc-ae init-delay-time 520 set interfaces ae4 unit 0 family ethernet-switching interface-mode trunk set interfaces ae4 unit 0 family ethernet-switching vlan members v54 set vlans rack_1 vlan-id 100 set vlans rack_1 l3-interface irb.100 set vlans v54 vlan-id 54 set vlans v54 l3-interface irb.54 set interfaces irb unit 54 family inet address 192.168.54.1/24 arp 192.168.54.2 l2-interface ae1.0 set interfaces irb unit 54 family inet address 192.168.54.1/24 arp 192.168.54.2 mac 00:1f:12:b6:6f:f0 set interfaces irb unit 100 family inet address 192.168.10.2/24 arp 192.168.10.3 l2-interface ae1.0 set interfaces irb unit 100 family inet address 192.168.10.2/24 arp 192.168.10.3 mac 00:1f:12:b6:6f:f0 set interfaces lo0 unit 0 family inet address 192.168.39.2/32 set protocols iccp local-ip-addr 192.168.39.2 set protocols iccp peer 192.168.39.1 session-establishment-hold-time 50 set protocols iccp peer 192.168.39.1 redundancy-group-id-list 1 set protocols iccp peer 192.168.39.1 backup-liveness-detection backup-peer-ip 10.105.5.5 set protocols iccp peer 192.168.39.1 liveness-detection minimum-interval 2000 set protocols iccp peer 192.168.39.1 liveness-detection multiplier 4 set multi-chassis multi-chassis-protection 192.168.39.1 interface ae1 set switch-options service-id 1
Configuring MC-LAG on Switch A
Step-by-Step Procedure
The following example requires you to navigate various levels in the configuration hierarchy.
1. Configure the number of aggregated Ethernet interfaces to be created on Switch A.
[edit chassis] user@switch# set aggregated-devices ethernet device-count 20
133
2. Add member interfaces to the aggregated Ethernet interfaces that will be used for the Inter-Chassis Control Protocol (ICCP) interface.
[edit interfaces] user@switch# set et-1/0/0 ether-options 802.3ad ae0 user@switch# set et-1/0/1 ether-options 802.3ad ae0
Specify the member interfaces that belong to interface ae2.
[edit interfaces] user@switch# set et-1/2/0 ether-options 802.3ad ae2
3. Configure the member interfaces for the interchassis link (ICL) with a hold-time value that is higher than the configured BFD timer to prevent the ICL from being advertised as being down before the ICCP link is down. If the ICL goes down before the ICCP link goes down, the MC-LAG interface configured as the standby status-control peer goes up and down. The interface going up and down causes a delay in convergence.
[edit interfaces] user@switch# set xe-2/0/3 hold-time up 100 user@switch# set xe-2/0/3 hold-time down 9000 user@switch# set xe-2/0/3 ether-options 802.3ad ae1 user@switch# set xe-2/0/4 hold-time up 100 user@switch# set xe-2/0/4 hold-time down 9000 user@switch# set xe-2/0/4 ether-options 802.3ad ae1
4. Specify the members that belong to ae4. Specify the members that belong to ae4.
[edit interfaces] user@switch# set xe-2/0/0 ether-options 802.3ad ae4
134
5. Configure ae0 as a Layer 3 interface.
[edit interfaces] user@switch# set ae0 aggregated-ether-options lacp active user@switch# set ae0 aggregated-ether-options lacp periodic fast user@switch# set ae0 unit 0 family inet address 192.168.90.1/24
6. Configure ae1 as a Layer 2 interface.
[edit interfaces] user@switch# set ae1 description ICL-LINK user@switch# set ae1 aggregated-ether-options lacp active user@switch# set ae1 aggregated-ether-options lacp periodic fast
7. Configure a trunk interface between EX9200-A and EX9200-B.
[edit interfaces] user@switch# set ae1 unit 0 family ethernet-switching interface-mode trunk user@switch# set ae1 unit 0 family ethernet-switching vlan members all
8. Configure the LACP parameters on ae2.
[edit interfaces] user@switch# set ae2 aggregated-ether-options lacp active user@switch# set ae2 aggregated-ether-options lacp periodic fast
9. Configure the LACP administration key on ae2.
[edit interfaces] user@switch# set ae2 aggregated-ether-options lacp system-id 00:01:02:03:04:06
10. Configure the MC-AE interface properties.
[edit interfaces] user@switch# set ae2 aggregated-ether-options lacp admin-key 3
135
user@switch# set ae2 aggregated-ether-options mc-ae mc-ae-id 3 user@switch# set ae2 aggregated-ether-options mc-ae redundancy-group 1
11. Specify a unique chassis ID for the MC-LAG that the aggregated Ethernet interface belongs to.
[edit interfaces] user@switch# set ae2 aggregated-ether-options mc-ae chassis-id 0
12. Specify the mode of the MC-LAG that the aggregated Ethernet interface belongs to.
[edit interfaces] user@switch# set ae2 aggregated-ether-options mc-ae mode active-active
13. Configure the status control on the switch that hosts the MC-LAG. If one switch is in active mode, then the other switch must be in standby mode.
[edit interfaces] user@switch# set ae2 aggregated-ether-options mc-ae status-control active
14. Specify the time in seconds by when routing adjacencies must form.
[edit interfaces] user@switch# set ae2 aggregated-ether-options mc-ae init-delay-time 520
15. Specify that if a peer of the MC-LAG group goes down, the peer that is configured as status-control active becomes the active peer.
[edit interfaces] user@switch# set ae2 aggregated-ether-options mc-ae events iccp-peer-down prefer-status-controlactive
136
16. Configure ae2 as a trunk port with membership in all VLANs.
[edit interfaces] user@switch# set ae2 unit 0 family ethernet-switching interface-mode trunk user@switch# set ae2 unit 0 family ethernet-switching vlan members all
17. Configure the LACP parameters on ae4.
[edit interfaces] user@switch# set ae4 aggregated-ether-options lacp active user@switch# set ae4 aggregated-ether-options lacp periodic fast
18. Specify the LACP administration key.
[edit interfaces] user@switch# set ae4 aggregated-ether-options lacp system-id 00:01:02:03:04:06 user@switch# set ae4 aggregated-ether-options lacp admin-key 7 user@switch# set ae4 aggregated-ether-options mc-ae mc-ae-id 7 user@switch# set ae4 aggregated-ether-options mc-ae redundancy-group 1
19. Specify a unique chassis ID for the MC-LAG that the aggregated Ethernet interface belongs to.
[edit interfaces] user@switch# set ae4 aggregated-ether-options mc-ae chassis-id 0 user@switch# set ae4 aggregated-ether-options mc-ae mode active-active
20. Configure the status control on the switch that hosts the MC-LAG. If one switch is in active mode, then the other switch must be in standby mode.
[edit interfaces] user@switch# set ae4 aggregated-ether-options mc-ae status-control active user@switch# set ae4 aggregated-ether-options mc-ae init-delay-time 520 user@switch# set ae4 aggregated-ether-options mc-ae events iccp-peer-down prefer-status-controlactive
137
21. Configure ae4 as a Layer 2 interface.
[edit interfaces] user@switch# set ae4 unit 0 family ethernet-switching interface-mode trunk user@switch# set ae4 unit 0 family ethernet-switching vlan members v54
22. Configure VLAN rack_1 and configure a Layer 3 IRB interface on VLAN rack_1.
[edit vlans] user@switch# set rack_1 vlan-id 100 user@switch# set rack_1 l3-interface irb.100
23. Configure VLAN rack_1.
[edit vlans] user@switch# set rack_1 vlan-id 54
24. Configure VLAN 54 and configure a Layer 3 IRB on VLAN 54.
[edit vlans] user@switch# set v54 vlan-id 54 user@switch# set v54 l3-interface irb.54
25. Configure an IRB interface on VLAN 54. You must configure static ARP on the MC-LAG peers to allow routing protocols to traverse over the IRB interface.
[edit interfaces] user@switch# set irb unit 54 family inet address 192.168.54.2/24 arp 192.168.54.1 l2-interface ae1.0 user@switch# set irb unit 54 family inet address 192.168.54.2/24 arp 192.168.54.1 mac 3c:8a:b0:85:78:70
138
26. Configure static ARP on the MC-LAG peers to allow routing protocols to traverse over the IRB interface
[edit interfaces] user@switch# set irb unit 100 family inet address 192.168.10.3/24 arp 192.168.10.2 l2-interface ae1.0 user@switch# set irb unit 100 family inet address 192.168.10.3/24 arp 192.168.10.2 mac 3c:8a:b0:85:78:70
27. Configure a loopback interface.
[edit interfaces] user@switch# set lo0 unit 0 family inet address 192.168.39.2/32
28. Configure ICCP using the loopback address.
[edit protocols] user@switch# set iccp local-ip-addr 192.168.39.1
29. Configure the session establishment hold time for ICCP to connect faster.
[edit protocols] user@switch# set iccp peer 192.168.39.2 session-establishment-hold-time 50 user@switch# set iccp peer 192.168.39.2 redundancy-group-id-list 1 user@switch# set iccp peer 192.168.39.2 backup-liveness-detection backup-peer-ip 10.105.5.6
30. To enable Bidirectional Forwarding Detection (BFD), configure the minimum receive interval. We recommend a minimum receive interval value of 6 seconds.
[edit protocols] user@switch# set iccp peer 192.168.39.2 liveness-detection minimum-interval 2000 user@switch# set iccp peer 192.168.39.2 liveness-detection multiplier 4 [edit multi-chassis] user@switch# set multi-chassis-protection 192.168.39.2 interface ae1
31. Specify the switch service ID.
139
The switch service ID is used to synchronize applications, IGMP, ARP, and MAC learning across MC-LAG members.
[edit switch-options] user@switch# set service-id 1
Configuring MC-LAG on Switch B
Step-by-Step Procedure The following example requires you to navigate various levels in the configuration hierarchy. 1. Configure the number of aggregated Ethernet interfaces to be created on Switch A.
[edit chassis] user@switch# set aggregated-devices ethernet device-count 20
2. Add member interfaces to the aggregated Ethernet interfaces that will be used for the Inter-Chassis Control Protocol (ICCP) interface.
[edit interfaces] user@switch# set et-1/0/0 ether-options 802.3ad ae0 user@switch# set et-1/0/1 ether-options 802.3ad ae0
3. Specify the member interfaces that belong to interface ae2.
[edit interfaces] user@switch# set et-1/2/0 ether-options 802.3ad ae2
4. Configure the member interfaces for the interchassis link (ICL) with a hold-time value that is higher than the configured BFD timer to prevent the ICL from being advertised as being down before the ICCP link is down.
140
If the ICL goes down before the ICCP link goes down, the MC-LAG interface configured as the standby status-control peer goes up and down. The interface going up and down causes a delay in convergence.
[edit interfaces] user@switch# set xe-2/0/3 hold-time up 100 user@switch# set xe-2/0/3 hold-time down 9000 user@switch# set xe-2/0/3 ether-options 802.3ad ae1 user@switch# set xe-2/0/4 hold-time up 100 user@switch# set xe-2/0/4 hold-time down 9000 user@switch# set xe-2/0/4 ether-options 802.3ad ae1
5. Specify the members that belong to ae4.
[edit interfaces] user@switch# set xe-2/0/0 ether-options 802.3ad ae4
6. Configure ae0 as a Layer 3 interface.
[edit interfaces] user@switch# set ae0 aggregated-ether-options lacp active user@switch# set ae0 aggregated-ether-options lacp periodic fast user@switch# set ae0 unit 0 family inet address 192.168.90.2/24
7. Configure ae1 as a Layer 2 interface.
[edit interfaces] user@switch# set ae1 description ICL-LINK user@switch# set ae1 aggregated-ether-options lacp active user@switch# set ae1 aggregated-ether-options lacp periodic fast
8. Configure a trunk interface between EX9200-A and EX9200-B.
[edit interfaces] user@switch# set ae1 unit 0 family ethernet-switching interface-mode trunk user@switch# set ae1 unit 0 family ethernet-switching vlan members all
141
9. Configure the LACP parameters on ae2.
[edit interfaces] user@switch# set ae2 aggregated-ether-options lacp active user@switch# set ae2 aggregated-ether-options lacp periodic fast
10. Configure the LACP administration key on ae2.
[edit interfaces] user@switch# set ae2 aggregated-ether-options lacp system-id 00:01:02:03:04:05
11. Configure the MC-AE interface properties.
[edit interfaces] user@switch# set ae2 aggregated-ether-options lacp admin-key 3 user@switch# set ae2 aggregated-ether-options mc-ae mc-ae-id 3 user@switch# set ae2 aggregated-ether-options mc-ae redundancy-group 1
12. Specify a unique chassis ID for the MC-LAG that the aggregated Ethernet interface belongs to.
[edit interfaces] user@switch# set ae2 aggregated-ether-options mc-ae chassis-id 1
13. Specify the mode of the MC-LAG that the aggregated Ethernet interface belongs to.
[edit interfaces] user@switch# set ae2 aggregated-ether-options mc-ae mode active-active
14. Specify the time in seconds by when routing adjacencies must form.
[edit interfaces] user@switch# set ae2 aggregated-ether-options mc-ae init-delay-time 520
142
15. Specify that if a peer of the MC-LAG group goes down, the peer that is configured as status-control active becomes the active peer.
[edit interfaces] user@switch# set ae2 aggregated-ether-options mc-ae events iccp-peer-down prefer-status-controlactive
16. Configure the status control on the switch that hosts the MC-LAG. If one switch is in active mode, then the other switch must be in standby mode.
[edit interfaces] user@switch# set ae2 aggregated-ether-options mc-ae status-control standby
17. Configure ae2 as a trunk port with membership in all VLANs.
[edit interfaces] user@switch# set ae2 unit 0 family ethernet-switching interface-mode trunk user@switch# set ae2 unit 0 family ethernet-switching vlan members all
18. Configure the LACP parameters on ae4.
[edit interfaces] user@switch# set ae4 aggregated-ether-options lacp active user@switch# set ae4 aggregated-ether-options lacp periodic fast
19. Specify the LACP administration key.
[edit interfaces] user@switch# set ae4 aggregated-ether-options lacp system-id 00:01:02:03:04:06 user@switch# set ae4 aggregated-ether-options lacp admin-key 7 user@switch# set ae4 aggregated-ether-options mc-ae mc-ae-id 7 user@switch# set ae4 aggregated-ether-options mc-ae redundancy-group 1
143
20. Specify a unique chassis ID for the MC-LAG that the aggregated Ethernet interface belongs to.
[edit interfaces] user@switch# set ae4 aggregated-ether-options mc-ae chassis-id 1 user@switch# set ae4 aggregated-ether-options mc-ae mode active-active
21. Configure the status control on the switch that hosts the MC-LAG. If one switch is in active mode, then the other switch must be in standby mode.
[edit interfaces] user@switch# set ae4 aggregated-ether-options mc-ae status-control standby user@switch# set ae4 aggregated-ether-options mc-ae init-delay-time 520 user@switch# set ae4 aggregated-ether-options mc-ae events iccp-peer-down prefer-status-controlactive
22. Configure ae4 as a Layer 2 interface.
[edit interfaces] user@switch# set ae4 unit 0 family ethernet-switching interface-mode trunk user@switch# set ae4 unit 0 family ethernet-switching vlan members v54
23. Configure VLAN rack_1 and configure a Layer 3 IRB interface on VLAN rack_1.
[edit vlans] user@switch# set rack_1 vlan-id 100 user@switch# set rack_1 l3-interface irb.100
24. Configure VLAN 54 and configure an IRB on VLAN 54.
[edit vlans] user@switch# set v54 vlan-id 54 user@switch# set v54 l3-interface irb.54
144
25. Configure static ARP on the MC-LAG peers to allow routing protocols to traverse over the IRB interface.
[edit interfaces] user@switch# set irb unit 54 family inet address 192.168.54.1/24 arp 192.168.54.2 l2-interface ae1.0 user@switch# set irb unit 54 family inet address 192.168.54.1/24 arp 192.168.54.2 mac mac 00:1f:12:b6:6f:f0
26. Configure static Address Resolution Protocol (ARP) on the MC-LAG IRB peers to allow routing protocols to traverse the IRB interface.
[edit interfaces] user@switch# set irb unit 100 family inet address 192.168.10.2/24 arp 192.168.10.3 l2-interface ae1.0 user@switch# set irb unit 100 family inet address 192.168.10.2/24 arp 192.168.10.3 mac 00:1f:12:b6:6f:f0
27. Configure a loopback interface.
[edit interfaces] user@switch# set lo0 unit 0 family inet address 192.168.39.2/32
28. Configure ICCP using the loopback address.
[edit protocols] user@switch# set iccp local-ip-addr 192.168.39.2
29. Configure the session establishment hold time for ICCP to connect faster.
[edit protocols] user@switch# set iccp peer 192.168.39.1 session-establishment-hold-time 50 user@switch# set iccp peer 192.168.39.1 redundancy-group-id-list 1 user@switch# set iccp peer 192.168.39.1 backup-liveness-detection backup-peer-ip 10.105.5.5
30. To enable Bidirectional Forwarding Detection (BFD), configure the minimum receive interval.
145
We recommend a minimum receive interval value of 6 seconds.
[edit protocols] user@switch# set iccp peer 192.168.39.1 liveness-detection minimum-interval 2000 user@switch# set iccp peer 192.168.39.1 liveness-detection multiplier 4 [edit multi-chassis] user@switch# set multi-chassis-protection 192.168.39.1 interface ae1
31. Specify the switch service ID. The switch service ID is used to synchronize applications, IGMP, ARP, and MAC learning across MC-LAG members.
[edit switch-options] user@switch# set service-id 1
Results
Display the results of the configuration on EX9200-A.
user@switch> show chassis chassis { redundancy { graceful-switchover; } aggregated-devices { ethernet { device-count 20; } } }
user@switch> show interfaces interfaces { et-1/0/0 { ether-options { 802.3ad ae0; }
146
} et-1/0/1 {
ether-options { 802.3ad ae0;
} } et-1/2/0 {
ether-options { 802.3ad ae2;
} } xe-2/0/3 {
hold-time up 100 down 7000; ether-options {
802.3ad ae1; } } xe-2/0/4 { hold-time up 100 down 7000; ether-options {
802.3ad ae1; } } ae0 { aggregated-ether-options {
lacp { active; periodic fast;
} } unit 0 {
family inet { address 192.168.90.1/24;
} } } ae1 { description ICL-LINK; aggregated-ether-options {
lacp { active; periodic fast;
}
147
} unit 0 {
family ethernet-switching { interface-mode trunk; vlan { members all; }
} } } ae2 { aggregated-ether-options {
lacp { active; periodic fast; system-id 00:01:02:03:04:05; admin-key 3;
} mc-ae {
mc-ae-id 3; redundancy-group 1; chassis-id 0; mode active-active; status-control active; init-delay-time 520; events {
iccp-peer-down { prefer-status-control-active;
} } } } unit 0 { family ethernet-switching { interface-mode trunk; vlan {
members all; } } } } ae4 { aggregated-ether-options {
148
lacp { active; periodic fast; system-id 00:01:02:03:04:06; admin-key 7;
} mc-ae {
mc-ae-id 7; redundancy-group 1; chassis-id 0; mode active-active; status-control standby; init-delay-time 520; events {
iccp-peer-down { prefer-status-control-active;
} } } } unit 0 { family ethernet-switching {
interface-mode trunk; vlan {
members [ rack_1 v54 ]; } } irb { arp-l2-validate; unit 54 { family inet {
address 192.168.54.2/24 { arp 192.168.54.1 l2-interface ae1.0 mac
3c:8a:b0:85:78:70; }
} }
unit 100 { family inet { address 192.168.10.3/24 { arp 192.168.10.2 l2-interface ae1.0 mac
3c:8a:b0:85:78:70; }
149
} } } lo0 { unit 0 { family inet {
address 192.168.39.1/32; } } }
user@switch> show multi-chassis multi-chassis { multi-chassis-protection 192.168.39.2 { interface ae1; } }
user@switch> show protocols protocols { iccp { local-ip-addr 192.168.39.1; peer 192.168.39.2 { session-establishment-hold-time 50; redundancy-group-id-list 1; backup-liveness-detection { backup-peer-ip 10.105.5.6; } liveness-detection { minimum-interval 2000; multiplier 3; } } } lldp { interface all; } layer2-control { nonstop-bridging;
150
} }
user@switch> show switch-options switch-options { service-id 1; }
user@switch> show vlans vlans { rack_1 { vlan-id 100; l3-interface irb.100;
} v54 { vlan-id 54; l3-interface irb.54; }
}
Display the results of the configuration on EX9200-B.
user@switch> show chassis chassis { redundancy { graceful-switchover; } aggregated-devices { ethernet { device-count 20; } } }
user@switch> show interfaces interfaces { et-1/0/0 {
151
ether-options { 802.3ad ae0;
} } et-1/0/1 {
ether-options { 802.3ad ae0;
} } et-1/2/0 {
ether-options { 802.3ad ae2;
} } xe-2/0/3 {
hold-time up 100 down 7000; ether-options {
802.3ad ae1; } } xe-2/0/4 { hold-time up 100 down 7000; ether-options {
802.3ad ae1; } } ae0 { aggregated-ether-options {
lacp { active; periodic fast;
} }
unit 0 { family inet { address 192.168.90.2/24;
} } ae1 {
description ICL-LINK; aggregated-ether-options {
lacp { active;
152
periodic fast; } } unit 0 { family ethernet-switching {
interface-mode trunk; vlan {
members all; } } } } ae2 { aggregated-ether-options { lacp { active; periodic fast; system-id 00:01:02:03:04:05; admin-key 3; } mc-ae { mc-ae-id 3; redundancy-group 1; chassis-id 1; mode active-active; status-control active; init-delay-time 520; events {
iccp-peer-down { prefer-status-control-active;
} } } } unit 0 { family ethernet-switching { interface-mode trunk; vlan {
members all; } } } }
153
ae4 { aggregated-ether-options { lacp { active; periodic fast; system-id 00:01:02:03:04:06; admin-key 7; } mc-ae { mc-ae-id 7; redundancy-group 1; chassis-id 1; mode active-active; status-control standby; init-delay-time 520; } } unit 0 { family ethernet-switching { interface-mode trunk; vlan { members [rack_1 v54 ]; } } irb { arp-l2-validate; unit 54 { family inet { address 192.168.54.1/24 { arp 192.168.54.2 l2-interface ae1.0 mac
00:1f:12:b6:6f:f0; }
} }
unit 100 { family inet { address 192.168.10.2/24 { arp 192.168.10.3 l2-interface ae1.0 mac
00:1f:12:b6:6f:f0; }
} } lo0 {
154
unit 0 { family inet { address 192.168.39.2/32; }
}
user@switch> show multi-chassis multi-chassis { multi-chassis-protection 192.168.39.1 { interface ae1; } }
user@switch> show protocols protocols { iccp { local-ip-addr 192.168.39.2; peer 192.168.39.1 { session-establishment-hold-time 50; redundancy-group-id-list 1; backup-liveness-detection { backup-peer-ip 10.105.5.5; } liveness-detection { minimum-interval 2000; multiplier 3; } } } lldp { interface all; } layer2-control { nonstop-bridging; } }
user@switch> show switch-options switch-options {
155
service-id 1; }
user@switch> show vlans vlans { rack_1 { vlan-id 100; l3-interface irb.100;
} v54 {
vlan-id 54; l3-interface irb.54; } }
(Optional) Configuring RSTP
IN THIS SECTION CLI Quick Configuration | 155 Configuring Switch A and Switch B | 156
CLI Quick Configuration Switch A and Switch B
set protocols rstp interface ae2 set protocols rstp interface ae4 set protocols rstp system-identifier 00:01:02:03:04:05 set protocols rstp bridge-priority 0
156
Configuring Switch A and Switch B
Step-by-Step Procedure The following example requires you to navigate various levels in the configuration hierarchy. For information about navigating the CLI, see Using the CLI Editor in Configuration Mode . To configure Switch A and Switch B: 1. Enable the Rapid Spanning Tree Protocol on the ae2 and ae4 interfaces for optional loop prevention.
[edit protocols] user@switch# set rstp interface ae2 user@switch# set rstp interface ae4
2. Configure the system identifier.
[edit protocols] user@switch# set rstp system-identifier 00:01:02:03:04:05
3. Set Rapid Spanning Tree Protocol priority to 0. This will make the MC-AE node the highest priority.
[edit protocols] user@switch# set rstp bridge-priority 0
Switch A and Switch B From configuration mode, confirm your configuration by entering the show protocols rstp commands. If the output does not display the intended configuration, repeat the instructions in this example to correct the configuration.
user@switch> show protocols rstp rstp {
system-identifier 00:01:02:03:04:05; interface ae2; interface ae4; }
157
(Optional) Configuring IGMP Snooping
IN THIS SECTION CLI Quick Configuration | 157 Configuring Switch A and Switch B | 157
CLI Quick Configuration Switch A and Switch B
set protocols igmp-snooping vlan rack_1 set protocols igmp-snooping vlan v54 set multicast-snooping-options multichassis-lag-replicate-state set protocols igmp-snooping vlan rack_1 interface ae1.0 multicast-router-interface set protocols igmp-snooping vlan v54 interface ae1.0 multicast-router-interface
Configuring Switch A and Switch B Step-by-Step Procedure The following example requires you to navigate various levels in the configuration hierarchy. For information about navigating the CLI, see Using the CLI Editor in Configuration Mode . To configure Switch A and Switch B: 1. Enable IGMP snooping for all VLANs.
[edit protocols] user@switch# set igmp-snooping vlan rack_1 user@switch# set igmp-snooping vlan v54
2. Synchronize multicast states across MC-LAG peers when bridge domains are configured.
158
At the global level, IGMP join and leave messages are replicated from the MC-LAG interface active link to the standby link to enable faster recovery of membership information after a failover.
[edit multicast-snooping-options] user@switch# set multichassis-lag-replicate-state
3. Configure the ICL-PL interface as a router-facing interface.
[edit protocols] user@switch# set igmp-snooping vlan rack_1 interface ae1.0 multicast-router-interface user@switch# set igmp-snooping vlan v54 interface ae1.0 multicast-router-interface
Switch A and Switch B
From configuration mode, confirm your configuration by entering the show protocols igmp and show multicast-snooping-options commands. If the output does not display the intended configuration, repeat the instructions in this example to correct the configuration.
user@switch> show protocols igmp igmp-snooping {
vlan rack_1 { interface ae1.0 { multicast-router-interface; }
} vlan v54 {
interface ae1.0 { multicast-router-interface;
} } }
user@switch> show multicast-snooping-options multicast-snooping-options { multichassis-lag-replicate-state; }
159
(Optional) Configuring VRRP
IN THIS SECTION CLI Quick Configuration | 159 Configuring Switch A | 159 Configuring Switch B | 161
NOTE: You cannot configure both VRRP and MAC address synchronization.
CLI Quick Configuration Switch A
set interfaces irb unit 100 family inet address 192.168.10.3/24 vrrp-group 1 virtual-address 192.168.10.1 set interfaces irb unit 100 family inet address 192.168.10.3/24 vrrp-group 1 priority 150 set interfaces irb unit 100 family inet address 192.168.10.3/24 vrrp-group 1 accept-data set interfaces irb unit 54 family inet address 192.168.54.2/24 vrrp-group 4 virtual-address 192.168.54.3 set interfaces irb unit 54 family inet address 192.168.54.2/24 vrrp-group 4 priority 200 Switch B
set interfaces irb unit 100 family inet address 192.168.10.2/24 vrrp-group 1 virtual-address 192.168.10.1 set interfaces irb unit 100 family inet address 192.168.10.2/24 vrrp-group 1 priority 200 set interfaces irb unit 100 family inet address 192.168.10.2/24 vrrp-group 1 accept-data set interfaces irb unit 54 family inet address 192.168.54.1/24 vrrp-group 4 virtual-address 192.168.54.3 set interfaces irb unit 54 family inet address 192.168.54.1/24 vrrp-group 4 priority 150
Configuring Switch A Step-by-Step Procedure The following example requires you to navigate various levels in the configuration hierarchy. For information about navigating the CLI, see Using the CLI Editor in Configuration Mode .
160
To configure Switch A: 1. Enable VRRP on the MC-LAGs by creating an IRB interface for each MC-LAG, assign a virtual IP
address that is shared between each switch in the VRRP group, and assign an individual IP address for each individual member in the VRRP group.
[edit interfaces] user@switch# set irb unit 100 family inet address 192.168.10.3/24 vrrp-group 1 virtual-address 192.168.10.1 user@switch# set irb unit 100 family inet address 192.168.10.3/24 vrrp-group 1 priority 150 user@switch# set irb unit 100 family inet address 192.168.10.3/24 vrrp-group 1 accept-data
2. Enable VRRP on the MC-LAGs by creating an IRB interface for each MC-LAG, assign a virtual IP address that is shared between each switch in the VRRP group, and assign an individual IP address for each individual member in the VRRP group.
[edit interfaces] user@switch# set irb unit 54 family inet address 192.168.54.2/24 vrrp-group 4 virtual-address 192.168.54.3 user@switch# set irb unit 54 family inet address 192.168.54.2/24 vrrp-group 4 priority 200
Switch A
From configuration mode, confirm your configuration by entering the show interfaces irb unit 100 family inet address 192.168.10.3/24 vrrp-group and show interfaces irb unit 100 family inet address 192.168.54.2/24 vrrp-group commands. If the output does not display the intended configuration, repeat the instructions in this example to correct the configuration.
user@switch> show interfaces irb unit 100 family inet address 192.168.10.3/24 vrrp-group vrrp-group 1 {
virtual-address 192.168.10.1; priority 150; accept-data; }
user@switch> show interfaces irb unit 100 family inet address 192.168.54.2/24 vrrp-group vrrp-group 4 {
virtual-address 192.168.54.3;
161
priority 150; }
Configuring Switch B
Step-by-Step Procedure
The following example requires you to navigate various levels in the configuration hierarchy. For information about navigating the CLI, see Using the CLI Editor in Configuration Mode . To configure Switch A: 1. Enable VRRP on the MC-LAGs by creating an IRB interface for each MC-LAG, assign a virtual IP
address that is shared between each switch in the VRRP group, and assign an individual IP address for each individual member in the VRRP group.
[edit interfaces] user@switch# set irb unit 100 family inet address 192.168.10.2/24 vrrp-group 1 virtual-address 192.168.10.1 user@switch# set irb unit 100 family inet address 192.168.10.2/24 vrrp-group 1 priority 150 user@switch# set irb unit 100 family inet address 192.168.10.2/24 vrrp-group 1 accept-data
2. Enable VRRP on the MC-LAGs by creating an IRB interface for each MC-LAG, assign a virtual IP address that is shared between each switch in the VRRP group, and assign an individual IP address for each individual member in the VRRP group.
[edit interfaces] user@switch# set irb unit 54 family inet address 192.168.54.1/24 vrrp-group 4 virtual-address 192.168.54.3 user@switch# set irb unit 54 family inet address 192.168.54.1/24 vrrp-group 4 priority 150
Switch B
From configuration mode, confirm your configuration by entering the show protocols rstp commands. If the output does not display the intended configuration, repeat the instructions in this example to correct the configuration.
user@switch> show interfaces irb unit 100 family inet address 192.168.10.2/24 vrrp-group vrrp-group 1 {
162
virtual-address 192.168.10.1; priority 200; accept-data; }
user@switch> show interfaces irb unit 100 family inet address 192.168.54.1/24 vrrp-group vrrp-group 4 {
virtual-address 192.168.54.3; priority 150; }
(Optional) Configuring MAC Address Synchronization
IN THIS SECTION CLI Quick Configuration | 162 Configuring Switch A and Switch B | 162
NOTE: You cannot configure both MAC synchronization and VRRP.
CLI Quick Configuration Switch A and Switch B
set vlans v100 mcae-mac-synchronize set vlans v54 mcae-mac-synchronize
Configuring Switch A and Switch B Step-by-Step Procedure The following example requires you to navigate various levels in the configuration hierarchy. For information about navigating the CLI, see Using the CLI Editor in Configuration Mode .
163
To configure Switch A: 1. Configure MAC address synchronization in the MC-LAG VLAN on both Switch A and Switch B.
[edit] user@switch# set vlans v100 mcae-mac-synchronize [edit] user@switch# set vlans v54 mcae-mac-synchronize
Switch A and Switch B
From configuration mode, confirm your configuration by entering the show vlans v100 and show vlans v54 commands. If the output does not display the intended configuration, repeat the instructions in this example to correct the configuration.
user@switch> show vlans v100 v100 {
vlan-id 100; l3-interface irb.100; mcae-mac-synchronize; }
user@switch> show vlans v54 v54 {
vlan-id 54; l3-interface irb.54; mcae-mac-synchronize; }
(Optional) Configuring OSPF
IN THIS SECTION CLI Quick Configuration | 164 Configuring Switch A and Switch B | 164
164
CLI Quick Configuration
Switch A and Switch B
set protocols ospf area 0.0.0.0 interface lo0.0 set protocols ospf area 0.0.0.0 interface ae0.0 set protocols ospf area 0.0.0.0 interface irb.54 set protocols ospf area 0.0.0.0 interface irb.100
Configuring Switch A and Switch B
Step-by-Step Procedure
The following example requires you to navigate various levels in the configuration hierarchy. For information about navigating the CLI, see Using the CLI Editor in Configuration Mode . To configure Switch A and Switch B: 1. Configure an OSPF area.
[edit protocols] user@switch# set ospf area 0.0.0.0 interface lo0.0 user@switch# set ospf area 0.0.0.0 interface ae0.0 user@switch# set ospf area 0.0.0.0 interface irb.54 user@switch# set ospf area 0.0.0.0 interface irb.100
Switch A and Switch B
From configuration mode, confirm your configuration by entering the show protocols ospf commands. If the output does not display the intended configuration, repeat the instructions in this example to correct the configuration.
user@switch> show protocols ospf ospf {
area 0.0.0.0 { interface lo0.0; interface ae0.0; interface irb.54; interface irb.100;
165
} }
(Optional) Configuring PIM
IN THIS SECTION CLI Quick Configuration | 165 Configuring Switch A | 165 Configuring Switch B | 167
CLI Quick Configuration Switch A
set protocols pim interface irb.54 set protocols pim interface irb.100 set protocols pim interface lo0.0 set protocols pim rp bootstrap-priority 150 set protocols pim rp local address 192.168.39.1
Switch B
set protocols pim interface irb.54 set protocols pim interface irb.100 set protocols pim interface lo0.0 set protocols pim rp bootstrap-priority 200 set protocols pim rp local address 192.168.39.2
Configuring Switch A Step-by-Step Procedure The following example requires you to navigate various levels in the configuration hierarchy. For information about navigating the CLI, see Using the CLI Editor in Configuration Mode .
166
To configure Switch A: 1. Configure Protocol Independent Multicast (PIM) as the multicast protocol.
[edit protocols] user@switch# set pim interface irb.54 user@switch# set pim interface irb.100
2. Configure the loopback interface.
[edit protocols] user@switch# set pim interface lo0.0
3. Configure the switch as a secondary rendezvous point (RP). A lower priority setting indicates that the secondary RP is in a bootstrap configuration.
[edit protocols] user@switch# set pim rp bootstrap-priority 150 user@switch# set pim rp local address 192.168.39.1
Switch A
From configuration mode, confirm your configuration by entering the show protocols pim commands. If the output does not display the intended configuration, repeat the instructions in this example to correct the configuration.
user@switch> show protocols pim pim {
rp { bootstrap-priority 150; local { address 192.168.39.1; }
} interface irb.54; interface irb.100;
167
interface lo0.0; }
Configuring Switch B
Step-by-Step Procedure The following example requires you to navigate various levels in the configuration hierarchy. For information about navigating the CLI, see Using the CLI Editor in Configuration Mode . To configure Switch A: 1. Configure Protocol Independent Multicast (PIM) as the multicast protocol.
[edit protocols] user@switch# set pim interface irb.54 user@switch# set pim interface irb.100
2. Configure the loopback interface.
[edit protocols] user@switch# set pim interface lo0.0
3. Configure the switch as a secondary rendezvous point (RP). A lower priority setting indicates that the secondary RP is in a bootstrap configuration.
[edit protocols] user@switch# set pim rp bootstrap-priority 200 user@switch# set pim rp local address 192.168.39.2
168
Switch B
From configuration mode, confirm your configuration by entering the show protocols pim commands. If the output does not display the intended configuration, repeat the instructions in this example to correct the configuration.
user@switch> show protocols pim pim {
rp { bootstrap-priority 200; local { address 192.168.39.2; }
} interface irb.54; interface irb.100; interface lo0.0; }
(Optional) Configuring DHCP Relay
IN THIS SECTION CLI Quick Configuration | 168 Configuring Switch A and Switch B | 169
CLI Quick Configuration
Switch A and Switch B
set forwarding-options dhcp-relay forward-snooped-clients all-interfaces set forwarding-options dhcp-relay overrides allow-snooped-clients set forwarding-options dhcp-relay server-group GVP-DHCP 10.105.5.202 set forwarding-options dhcp-relay active-server-group GVP-DHCP set forwarding-options dhcp-relay route-suppression destination
169
set forwarding-options dhcp-relay group Floor1 interface irb.100 set forwarding-options dhcp-relay relay-option-82 circuit-id use-interface-description device
Configuring Switch A and Switch B Step-by-Step Procedure The following example requires you to navigate various levels in the configuration hierarchy. For information about navigating the CLI, see Using the CLI Editor in Configuration Mode . To configure Switch A and Switch B: 1. Configure forward snooped unicast packets on all interfaces.
[edit fowarding-options] user@switch# set dhcp-relay forward-snooped-clients all-interfaces
2. Create a binding entry to snoop unicast clients.
[edit forwarding-options] user@switch# set dhcp-relay overrides allow-snooped-clients
3. Create a DHCP server group.
[edit forwarding-options] user@switch# set dhcp-relay server-group GVP-DHCP 10.105.5.202
4. Apply a DHCP relay agent configuration to the named group of DHCP server addresses.
[edit forwarding-options] user@switch# set dhcp-relay active-server-group GVP-DHCP
5. Configure the relay agent to suppress the installation of ARP and route entries for corresponding client binding.
[edit forwarding-options] user@switch# set dhcp-relay route-suppression destination
170
6. Create a DHCP relay group that includes at least one interface. DHCP runs on the interfaces defined in the DHCP groups.
[edit forwarding-options] user@switch# set dhcp-relay group Floor1 interface irb.100
7. Configure DHCP relay with option 82.
[edit forwarding-options] user@switch# set dhcp-relay relay-option-82 circuit-id use-interface-description device
Switch A and Switch B
From configuration mode, confirm your configuration by entering the show protocols pim commands. If the output does not display the intended configuration, repeat the instructions in this example to correct the configuration.
user@switch> show forwarding-options dhcp-relay dhcp-relay {
forward-snooped-clients all-interfaces; overrides {
allow-snooped-clients; } relay-option-82 {
circuit-id { use-interface-description device;
} } server-group {
GVP-DHCP { 10.105.5.202;
}
} active-server-group GVP-DHCP; route-suppression {
destination; } group Floor1 {
171
interface irb.100;
} }
Verification
IN THIS SECTION Verifying ICCP on MC-LAG | 171 Verifying LACP on MC-LAG | 172 Verifying Aggregated Ethernet Interfaces in MC-LAG | 176 Verifying MAC Learning on MC-LAG | 178 Verifying VRRP in MC-LAG | 181 Verifying OSPF on MC-LAG | 182
Confirm that the configuration is working properly. Verifying ICCP on MC-LAG Purpose Verify that ICCP is running on each device in the MC-LAG. Action 1. Verify that ICCP is running on Switch A.
root@EX92000-A> show iccp
Redundancy Group Information for peer 192.168.39.2
TCP Connection
: Established
Liveliness Detection : Up
Backup liveness peer status: Up
Redundancy Group ID
Status
1
Up
172
Client Application: l2ald_iccpd_client Redundancy Group IDs Joined: 1
Client Application: lacpd Redundancy Group IDs Joined: 1
Client Application: MCSNOOPD Redundancy Group IDs Joined: 1
2. Verify that ICCP is running on Switch B.
root@EX9200-B> show iccp
Redundancy Group Information for peer 192.168.39.1
TCP Connection
: Established
Liveliness Detection : Up
Backup liveness peer status: Up
Redundancy Group ID
Status
1
Up
Client Application: lacpd Redundancy Group IDs Joined: 1
Client Application: l2ald_iccpd_client Redundancy Group IDs Joined: 1
Client Application: MCSNOOPD Redundancy Group IDs Joined: 1
Meaning This output shows that the TCP connection between the peers hosting the MC-LAG is up, liveness detection is up, and MCSNOOPD and ESWD client applications are running.
Verifying LACP on MC-LAG
Purpose Verify that LACP is working properly on each device in the MC-LAG.
173
Action 1. Verify that the LACP interfaces are up and running on Switch A.
root@EX9200-A> show lacp interfaces
Aggregated interface: ae0
LACP state:
Role Exp Def Dist Col Syn Aggr Timeout
Activity
et-1/0/0
Actor No No Yes Yes Yes Yes
Fast
Active
et-1/0/0
Partner No No Yes Yes Yes Yes
Fast
Active
et-1/0/1
Actor No No Yes Yes Yes Yes
Fast
Active
et-1/0/1
Partner No No Yes Yes Yes Yes
Fast
Active
LACP protocol:
Receive State Transmit State
Mux State
et-1/0/0
Current Fast periodic Collecting
distributing
et-1/0/1
Current Fast periodic Collecting
distributing
Aggregated interface: ae1
LACP state:
Role Exp Def Dist Col Syn Aggr Timeout
Activity
xe-2/0/3
Actor No No Yes Yes Yes Yes
Fast
Active
xe-2/0/3
Partner No No Yes Yes Yes Yes
Fast
Active
xe-2/0/4
Actor No No Yes Yes Yes Yes
Fast
Active
xe-2/0/4
Partner No No Yes Yes Yes Yes
Fast
Active
LACP protocol:
Receive State Transmit State
Mux State
xe-2/0/3
Current Fast periodic Collecting
distributing
xe-2/0/4
Current Fast periodic Collecting
distributing
Aggregated interface: ae3
LACP state:
Role Exp Def Dist Col Syn Aggr Timeout
Activity
174
xe-2/0/1
Actor No No
Active
xe-2/0/1
Partner No No
Passive
xe-2/0/2
Actor No No
Active
xe-2/0/2
Partner No No
Passive
LACP protocol:
Receive State
xe-2/0/1
Current
distributing
xe-2/0/2
Current
distributing
Yes Yes Yes Yes
Fast
Yes Yes Yes Yes
Fast
Yes Yes Yes Yes
Fast
Yes Yes Yes Yes
Fast
Transmit State
Mux State
Fast periodic Collecting
Fast periodic Collecting
Aggregated interface: ae4
LACP state:
Role Exp Def Dist Col Syn Aggr Timeout
Activity
xe-2/0/0
Actor No No Yes Yes Yes Yes
Fast
Active
xe-2/0/0
Partner No No Yes Yes Yes Yes
Fast
Active
LACP protocol:
Receive State Transmit State
Mux State
xe-2/0/0
Current Fast periodic Collecting
distributing
2. Verify that the LACP interfaces are up and running on Switch B.
root@EX9200-B> show lacp interfaces
Aggregated interface: ae0
LACP state:
Role Exp Def Dist Col Syn Aggr Timeout
Activity
et-1/0/0
Actor No No Yes Yes Yes Yes
Fast
Active
et-1/0/0
Partner No No Yes Yes Yes Yes
Fast
Active
et-1/0/1
Actor No No Yes Yes Yes Yes
Fast
Active
et-1/0/1
Partner No No Yes Yes Yes Yes
Fast
Active
LACP protocol:
Receive State Transmit State
Mux State
et-1/0/0
Current Fast periodic Collecting
175
distributing et-1/0/1
distributing
Current Fast periodic Collecting
Aggregated interface: ae1
LACP state:
Role Exp Def Dist Col Syn Aggr Timeout
Activity
xe-2/0/3
Actor No No Yes Yes Yes Yes
Fast
Active
xe-2/0/3
Partner No No Yes Yes Yes Yes
Fast
Active
xe-2/0/4
Actor No No Yes Yes Yes Yes
Fast
Active
xe-2/0/4
Partner No No Yes Yes Yes Yes
Fast
Active
LACP protocol:
Receive State Transmit State
Mux State
xe-2/0/3
Current Fast periodic Collecting
distributing
xe-2/0/4
Current Fast periodic Collecting
distributing
Aggregated interface: ae2
LACP state:
Role Exp Def Dist Col Syn Aggr Timeout
Activity
et-1/2/0
Actor No No Yes Yes Yes Yes
Fast
Active
et-1/2/0
Partner No No Yes Yes Yes Yes
Fast
Passive
LACP protocol:
Receive State Transmit State
Mux State
et-1/2/0
Current Fast periodic Collecting
distributing
Aggregated interface: ae4
LACP state:
Role Exp Def Dist Col Syn Aggr Timeout
Activity
xe-2/0/0
Actor No No Yes Yes Yes Yes
Fast
Active
xe-2/0/0
Partner No No Yes Yes Yes Yes
Fast
Active
LACP protocol:
Receive State Transmit State
Mux State
xe-2/0/0
Current Fast periodic Collecting
176 distributing
Meaning This output means that both devices and all related interfaces are properly participating in LACP negotiations. Verifying Aggregated Ethernet Interfaces in MC-LAG Purpose Verify that all of the ae interfaces are configured properly in the MCLAG. Action 1. Verify the ae interfaces on Switch A.
user@EX9200-A> show interfaces mc-ae
Member Link
: ae2
Current State Machine's State: mcae active state
Local Status
: active
Local State
: up
Peer Status
: active
Peer State
: up
Logical Interface
: ae2.0
Topology Type
: bridge
Local State
: up
Peer State
: up
Peer Ip/MCP/State
: 192.168.39.2 ae1.0 up
Member Link
: ae4
Current State Machine's State: mcae active state
Local Status
: active
Local State
: up
Peer Status
: active
Peer State
: up
Logical Interface
: ae4.0
Topology Type
: bridge
Local State
: up
177
Peer State Peer Ip/MCP/State
: up : 192.168.39.2 ae1.0 up
2. Verify the ae interfaces on Switch B.
root@EX9200-B> show interface mc-ae
Member Link
: ae2
Current State Machine's State: mcae active state
Local Status
: active
Local State
: up
Peer Status
: active
Peer State
: up
Logical Interface
: ae2.0
Topology Type
: bridge
Local State
: up
Peer State
: up
Peer Ip/MCP/State
: 192.168.39.1 ae1.0 up
Member Link
: ae4
Current State Machine's State: mcae active state
Local Status
: active
Local State
: up
Peer Status
: active
Peer State
: up
Logical Interface
: ae4.0
Topology Type
: bridge
Local State
: up
Peer State
: up
Peer Ip/MCP/State
: 192.168.39.1 ae1.0 up
Meaning This output means that the mc-ae interfaces on each device are up and active.
178
Verifying MAC Learning on MC-LAG Purpose Verify that MAC learning between devices is happening in the MC-LAG. Action 1. Show Ethernet switching table in Switch A.
root@EX9200-A> show ethernet-switching table MAC flags (S - static MAC, D - dynamic MAC, L - locally learned, P Persistent static
SE - statistics enabled, NM - non configured MAC, R - remote PE MAC)
Ethernet switching table : 68 entries, 68 learned
Routing instance : default-switch
Vlan
MAC
MAC
name
address
flags
dmzuplink
00:00:5e:00:01:ba DL
ae4.0
dmzuplink
00:10:db:bc:f5:9d DR
ae4.0
dmzuplink
00:10:db:ff:10:01 DL
ae3.0
dmzuplink
00:19:e2:57:33:81 DR
ae4.0
dmzuplink
00:26:88:92:ef:1d DR
ae4.0
dmzuplink
28:8a:1c:74:fb:07 DR
ae4.0
dmzuplink
28:8a:1c:75:05:1f DR
ae4.0
dmzuplink
28:c0:da:6a:1d:2a DR
ae4.0
dmzuplink
2c:21:72:7d:40:01 DL
ae4.0
dmzuplink
3c:8a:b0:77:a9:d6 DR
ae4.0
Age Logical interface
-
179
dmzuplink
5c:5e:ab:0e:cd:e0 DL
-
ae4.0
dmzuplink
84:18:88:8d:9d:2a DL
-
ae4.0
MAC flags (S - static MAC, D - dynamic MAC, L - locally learned, P Persistent static
SE - statistics enabled, NM - non configured MAC, R - remote PE MAC)
Ethernet switching table : 68 entries, 68 learned
Routing instance : default-switch
Vlan
MAC
MAC
name
address
flags
rack_1
00:50:56:9b:01:57 DR
ae2.0
rack_1
00:50:56:9b:09:95 DL
ae2.0
rack_1
00:50:56:9b:15:2e DL
ae2.0
rack_1
00:50:56:9b:20:44 DL
ae2.0
rack_1
00:50:56:9b:20:a7 DL
ae2.0
rack_1
00:50:56:9b:22:a8 DR
ae2.0
rack_1
00:50:56:9b:38:01 DL
ae2.0
rack_1
00:50:56:9b:66:dc DL
ae2.0
rack_1
00:50:56:9b:75:60 DR
ae2.0
Age Logical interface
-
MAC flags (S - static MAC, D - dynamic MAC, L - locally learned, P Persistent static
SE - statistics enabled, NM - non configured MAC, R - remote PE MAC)
Ethernet switching table : 68 entries, 68 learned
Routing instance : default-switch
Vlan
MAC
MAC
Age Logical
name v54 ae4.0
180
address 80:71:1f:c1:85:f0
flags DL
interface -
2. Show Ethernet switching table in Switch B.
root@EX9200-B> show ethernet-switching table
MAC flags (S - static MAC, D - dynamic MAC, L - locally learned, P Persistent static
SE - statistics enabled, NM - non configured MAC, R - remote PE MAC)
Ethernet switching table : 66 entries, 66 learned
Routing instance : default-switch
Vlan
MAC
MAC
name
address
flags
rack_1
00:50:56:9b:01:57 DL
ae2.0
rack_1
00:50:56:9b:09:95 DR
ae2.0
rack_1
00:50:56:9b:15:2e DR
ae2.0
rack_1
00:50:56:9b:20:44 DR
ae2.0
rack_1
00:50:56:9b:20:a7 DR
ae2.0
rack_1
00:50:56:9b:22:a8 DL
ae2.0
rack_1
00:50:56:9b:38:01 DR
ae2.0
rack_1
00:50:56:9b:66:dc DR
ae2.0
rack_1
00:50:56:9b:75:60 DL
ae2.0
Age Logical interface
-
MAC flags (S - static MAC, D - dynamic MAC, L - locally learned, P Persistent static
SE - statistics enabled, NM - non configured MAC, R - remote PE MAC)
181
Ethernet switching table : 66 entries, 66 learned
Routing instance : default-switch
Vlan
MAC
MAC
name
address
flags
Age Logical interface
MAC flags (S - static MAC, D - dynamic MAC, L - locally learned, P Persistent static
SE - statistics enabled, NM - non configured MAC, R - remote PE MAC)
Ethernet switching table : 66 entries, 66 learned
Routing instance : default-switch
Vlan
MAC
MAC
name
address
flags
v54
80:71:1f:c1:85:f0 DR
ae4.0
Age Logical interface
-
Meaning This output means that the MAC addresses are properly learned within the shared VLANs defined in the MC-LAG. This includes IRB interfaces to define the MC-LAG as well as the ICL interfaces used to configure VRRP.
Verifying VRRP in MC-LAG
Purpose Verify that VRRP is up and active between the devices in the MC-LAG.
Action 1. Confirm that VRRP is up and active on Switch A.
root@EX9200-A> show vrrp
Interface
State
irb.54
up
192.168.54.1
Group 4
192.168.54.3
VR state VR Mode backup Active
Timer Type Address D 3.090 lcl
vip
182
192.168.54.2
irb.100
up
192.168.10.3
1 backup Active
192.168.10.1
192.168.10.2
In this example, Switch A is the backup VRRP member. 2. Confirm that VRRP is up and active on Switch B.
mas D 2.655 lcl
vip mas
root@EX9200-B> show vrrp
Interface irb.54 192.168.54.2
State up
192.168.54.3
irb.100
up
192.168.10.2
192.168.10.1
Group 4
VR state VR Mode master Active
Timer Type Address A 0.900 lcl
vip
1 master Active
A 0.175 lcl
vip
In this example, Switch B is the primary VRRP member.
Meaning This output means that VRRP is up and running properly.
Verifying OSPF on MC-LAG
Purpose Verify that OSPF is properly up and running with MC-LAG.
183
Action 1. Show OSPF neighbors on Switch A.
root@EX9200-A> show ospf neighbor
Address
Interface
192.168.90.2
ae0.0
192.168.10.2
irb.100
192.168.54.2
irb.54
2. Show OSPF routing table on Switch A.
State Full Full Full
ID 192.168.39.2 192.168.39.2 192.168.39.2
Pri Dead 128 35 128 33 128 38
root@EX9200-A> show ospf route Topology default Route Table:
Prefix Nexthop
192.168.39.2 192.168.90.2
Path Route
NH
Type Type Intra Router
Type IP
192.168.39.1/32 192.168.39.2/32 192.168.90.2
Intra Network IP Intra Network IP
192.168.10.0/24 Intra Network IP 192.168.54.0/24 Intra Network IP 192.168.90.0/24 Intra Network IP
Metric NextHop
Interface 1 ae0.0
irb.100 irb.54 0 lo0.0 1 ae0.0
irb.100 irb.54 1 irb.100 1 irb.54 1 ae0.0
Address/LSP
192.168.10.2 192.168.54.2
192.168.10.2 192.168.54.2
3. Show OSPF neighbors on Switch B.
root@EX9200-B> show ospf neighbor
Address
Interface
192.168.90.1
ae0.0
192.168.10.3
irb.100
192.168.54.1
irb.54
State Full Full Full
ID 192.168.39.1 192.168.39.1 192.168.39.1
Pri Dead 128 32 128 34 128 37
184
4. Show OSPF routing table on Switch B.
root@EX9200-B> show ospf route Topology default Route Table:
Prefix Nexthop
192.168.39.1 192.168.90.1
Path Route
NH
Type Type Intra Router
Type IP
192.168.39.1/32 192.168.90.1
Intra Network IP
192.168.39.2/32 192.168.10.0/24 192.168.54.0/24 192.168.90.0/24
Intra Network IP Intra Network IP Intra Network IP Intra Network IP
Metric NextHop
Interface 1 ae0.0
irb.100 irb.54 1 ae0.0
irb.100 irb.54 0 lo0.0 1 irb.100 1 irb.54 1 ae0.0
Address/LSP
192.168.10.3 192.168.54.1
192.168.10.3 192.168.54.1
SEE ALSO Example: Simplifying Multichassis Link Aggregation on EX9200 Switches in the Core for Campus Networks | 0
Example: Configure Optional Features For Multichassis Link Aggregation
IN THIS SECTION Requirements | 185 Overview | 185 (Optional) Configuring RSTP | 186 (Optional) Configuring IGMP Snooping | 189 (Optional) Configuring VRRP | 190
185
(Optional) Configuring MAC Address Synchronization | 193 (Optional) Configuring OSPF | 194 (Optional) Configuring PIM | 195 (Optional) Configuring DHCP Relay | 199 Verification | 202 Troubleshooting | 203
This example shows how to deploy and verify MC LAG with optional features.
Requirements
This example uses the following hardware and software components: � Two EX3200 switches for the access switches and one EX4200 switch for the distribution switch � Junos OS Release 10.4 or later for EX Series switches Before you begin: � Create zones. See Example: Creating Security Zones. � Configure an address book and create addresses for use in the policy. See Example: Configuring
Address Books and Address Sets. � Create an application (or application set) that indicates that the policy applies to traffic of that type.
See Example: Configuring Security Policy Applications and Application Sets. No special configuration beyond device initialization is required before configuring this feature.
Overview
IN THIS SECTION Topology | 186
Start overview here .................
186
Topology
(Optional) Configuring RSTP
IN THIS SECTION CLI Quick Configuration | 186 Configuring QFX1 and QFX2 | 186 Configuring QFX3 | 188
CLI Quick Configuration QFX1 and QFX2
set protocols rstp interface xe-0/0/3 edge set protocols rstp interface ae0 disable set protocols rstp interface all mode point-to-point set protocols rstp bpdu-block-on-edge
Configuring QFX1 and QFX2 Step-by-Step Procedure To enable RSTP: The following example requires you to navigate various levels in the configuration hierarchy. For information about navigating the CLI, see Using the CLI Editor in Configuration Mode. 1. Configure the MC-LAG interfaces as edge ports on QFX1 and QFX2.
[edit] user@switch# set protocols rstp interface xe-0/0/3 edge
187
2. Disable RSTP on the ICL-PL interfaces on QFX1 and QFX2:
[edit] user@switch# set protocols rstp interface ae0 disable
3. Enable RSTP globally on all interfaces on QFX1 and QFX2.
[edit] user@switch# set protocols rstp interface all mode point-to-point
4. Enable BPDU blocking on all interfaces except for the ICL-PL interfaces on QFX1 and QFX2.
NOTE: The ae1 interface is a downstream interface. This is why RSTP and bpdu-block-onedge need to be configured.
[edit] user@switch# set protocols rstp bpdu-block-on-edge
QFX1 and QFX2
From configuration mode, confirm your configuration by entering the show protocols rstp commands. If the output does not display the intended configuration, repeat the instructions in this example to correct the configuration.
user@switch> show protocols rstp rstp {
interface xe-0/0/3 { edge;
} interface ae0 {
disable; } interface all {
mode point-to-point; } bpdu-block-on-edge;
188
Configuring QFX3 CLI Quick Configuration QFX3
set protocols rstp interface xe-0/0/2 edge set protocols rstp interface all mode point-to-point set protocols rstp bpdu-block-on-edge
Step-by-Step Procedure To enable RSTP: The following example requires you to navigate various levels in the configuration hierarchy. For information about navigating the CLI, see Using the CLI Editor in Configuration Mode. 1. Configure an interface as an edge port on QF3.
[edit] user@switch# set protocols rstp interface xe-0/0/2 edge
2. Enable RSTP globally on all QFX3.
[edit] user@switch# set protocols rstp interface all mode point-to-point
3. Enable BPDU blocking on all interfaces on QFX3.
NOTE: The ae1 interface is a downstream interface. This is why RSTP and bpdu-block-onedge need to be configured.
[edit] user@switch# set protocols rstp bpdu-block-on-edge
189
QFX3 From configuration mode, confirm your configuration by entering the show protocols rstp commands. If the output does not display the intended configuration, repeat the instructions in this example to correct the configuration.
user@switch> show protocols rstp rstp {
interface xe-0/0/2 { edge;
} interface all {
mode point-to-point; } bpdu-block-on-edge; } }
(Optional) Configuring IGMP Snooping
IN THIS SECTION CLI Quick Configuration | 189 Configuring QFX1 and QFX2 | 190
CLI Quick Configuration QFX1 and QFX2
set protocols igmp-snooping vlan all
190
Configuring QFX1 and QFX2
Step-by-Step Procedure The following example requires you to navigate various levels in the configuration hierarchy. For information about navigating the CLI, see Using the CLI Editor in Configuration Mode . To configure QFX1 and QFX2: 1. Enable IGMP snooping for all VLANs.
[edit protocols] user@switch# set igmp-snooping vlan all
QFX1 and QFX2 From configuration mode, confirm your configuration by entering the show protocols igmp and show multicast-snooping-options commands. If the output does not display the intended configuration, repeat the instructions in this example to correct the configuration.
user@switch> show protocols igmp igmp-snooping {
vlan all; }
(Optional) Configuring VRRP
IN THIS SECTION CLI Quick Configuration | 191 Configuring QFX1 | 191 Configuring QFX2 | 192
191
CLI Quick Configuration
QFX1
set interfaces irb unit 50 family inet address 10.50.1.1/30 vrrp-group 1 virtual-address 50.1.1/30 set interfaces irb unit 50 family inet address 10.50.1.1/30 vrrp-group 1 priority 200 set interfaces irb unit 50 family inet address 10.50.1.1/30 vrrp-group 1 accept-data
QFX2
set interfaces irb unit 50 family inet address 10.50.1.2/30 vrrp-group 1 virtual-address 50.1.2/30 set interfaces irb unit 50 family inet address 10.50.1.2/30 vrrp-group 1 priority 150 set interfaces irb unit 50 family inet address 10.50.1.2/30 vrrp-group 1 accept-data
Configuring QFX1
Step-by-Step Procedure
The following example requires you to navigate various levels in the configuration hierarchy. For information about navigating the CLI, see Using the CLI Editor in Configuration Mode . To configure QFX1: 1. Enable VRRP on the MC-LAGs by creating an IRB interface for each MC-LAG, assign a virtual IP
address that is shared between each switch in the VRRP group, and assign an individual IP address for each individual member in the VRRP group.
[edit interfaces] user@switch# set interfaces irb unit 50 family inet address 10.50.1.1/30 vrrp-group 1 virtual-address 50.1.1/30 user@switch# set interfaces irb unit 50 family inet address 10.50.1.1/30 vrrp-group 1 priority 200 user@switch# set interfaces irb unit 50 family inet address 10.50.1.2/30 vrrp-group 1 accept-data
192
QFX1
From configuration mode, confirm your configuration by entering the show interfaces irb unit 100 family inet address 10.1.1.11/8 vrrp-group command. If the output does not display the intended configuration, repeat the instructions in this example to correct the configuration.
user@switch> show interfaces irb unit 500 family inet address 10.3.3.2/30 vrrp-group vrrp-group 1 {
virtual-address 10.1.1.1; priority 200; accept-data; }
Configuring QFX2
Step-by-Step Procedure
The following example requires you to navigate various levels in the configuration hierarchy. For information about navigating the CLI, see Using the CLI Editor in Configuration Mode . To configure QFX1: 1. Enable VRRP on the MC-LAGs by creating an IRB interface for each MC-LAG, assign a virtual IP
address that is shared between each switch in the VRRP group, and assign an individual IP address for each individual member in the VRRP group.
[edit interfaces] user@switch# set interfaces irb unit 500 family inet address 10.3.3.1/30 vrrp-group 1 virtual-address 3.3.1/24 user@switch# set interfaces irb unit 500 family inet address 10.3.3.1/30 vrrp-group 1 priority 150 user@switch# set interfaces irb unit 500 family inet address 10.3.3.1/30 vrrp-group 1 accept-data
193
QFX2 From configuration mode, confirm your configuration by entering the show interfaces irb unit 500 family inet address 10.1.1.10/8 vrrp-group commands. If the output does not display the intended configuration, repeat the instructions in this example to correct the configuration.
user@switch> show interfaces irb unit 0 family inet address 10.1.1.10/8 vrrp-group vrrp-group 1 {
virtual-address 10.1.1.1; priority 150; accept-data; }
(Optional) Configuring MAC Address Synchronization
IN THIS SECTION CLI Quick Configuration | 193 Configuring QFX1 and QFX2 | 193
NOTE: You cannot configure both MAC synchronization and VRRP.
CLI Quick Configuration QFX1 and QFX2
set vlans v10 mcae-mac-synchronize
Configuring QFX1 and QFX2 Step-by-Step Procedure The following example requires you to navigate various levels in the configuration hierarchy. For information about navigating the CLI, see Using the CLI Editor in Configuration Mode .
194
To configure QFX1: 1. Configure MAC address synchronization in the MC-LAG VLAN on both QFX1 and QFX2.
[edit] user@switch# set vlans v10 mcae-mac-synchronize
QFX1 and QFX2 From configuration mode, confirm your configuration by entering the show vlans v10 command. If the output does not display the intended configuration, repeat the instructions in this example to correct the configuration.
user@switch> show vlans v10 v10 {
vlan-id 10; l3-interface irb.10; mcae-mac-synchronize; }
(Optional) Configuring OSPF
IN THIS SECTION CLI Quick Configuration | 194 Configuring QFX1 and QFX2 | 195
CLI Quick Configuration QFX1, QFX2, and QFX3
set protocols ospf area 0.0.0.0 interface irb.10
195
Configuring QFX1 and QFX2
Step-by-Step Procedure The following example requires you to navigate various levels in the configuration hierarchy. For information about navigating the CLI, see Using the CLI Editor in Configuration Mode . To configure QFX1 and QFX2: 1. Configure an OSPF area on QFX1, QFX2, and QFX3.
[edit protocols] user@switch# set ospf area 0.0.0.0 interface irb.10
QFX1, QFX2, and QFX3 From configuration mode, confirm your configuration by entering the show protocols ospf commands. If the output does not display the intended configuration, repeat the instructions in this example to correct the configuration.
user@switch> show protocols ospf ospf {
area 0.0.0.0 { interface irb.10 { }
} }
(Optional) Configuring PIM
IN THIS SECTION CLI Quick Configuration | 196 Configuring QFX1 and QFX2 | 196
196
CLI Quick Configuration
QFX1
set protocols pim rp static address 10.0.0.3 group-ranges 233.252.0.0/8 set protocols pim interface irb.50 priority 200 set protocols pim interface irb.50 dual-dr set protocols pim interface.irb.50 bfd-liveness-detection minimum-receive-interval 700 set protocols pim interface irb.50 bfd-liveness-detection transmit-interval minimum-interval 350 set protocols pim interface irb.50 bfd-liveness-detection transmit-interval threshold 500
QFX2
set protocols pim rp static address 10.0.0.3 group-ranges 233.252.0.0/8 set protocols pim interface irb.500 priority 500 set protocols pim interface irb.500 dual-dr set protocols pim interface.irb.500 bfd-liveness-detection minimum-receive-interval 700 set protocols pim interface irb.500 bfd-liveness-detection transmit-interval minimum-interval 350 set protocols pim interface irb.500 bfd-liveness-detection transmit-interval threshold 500
Configuring QFX1 and QFX2
Step-by-Step Procedure
The following example requires you to navigate various levels in the configuration hierarchy. For information about navigating the CLI, see Using the CLI Editor in Configuration Mode . To configure PIM as the multicast protocol on QFX1: 1. Configure a static rendezvous point (RP) address on QFX1 and QFX2.
[edit protocols pim] user@switch# set rp static address 10.0.0.3
197
2. Configure the address ranges of the multicast groups for which QFX1 and QFX2 can be a rendezvous point (RP).
[edit protocols pim rp static address 10.0.0.3] user@switch# set group-ranges 233.252.0.0/8
3. Enable PIM on the VLAN interfaces for the MC-LAGs on QFX1 and QFX2.
[edit protocols pim] user@switch# set interface irb.500 dual-dr
4. Configure each PIM interface's priority for being selected as the designated router (DR) on QFX1 and QFX2. An interface with a higher priority value has a higher probability of being selected as the DR.
QFX1: [edit protocols pim] user@switch# set interface irb.500 priority 200
QFX2: [edit protocols pim] user@switch# set interface irb.500 priority 100
5. Configure the minimum receive interval, minimum transmit interval, and transmit interval threshold for a Bidirectional Forwarding Detection (BFD) session for the PIM interfaces on QFX1 and QFX2.
[edit protocols pim] user@switch# set interface irb.500 bfd-liveness-detection minimum-receive-interval 700 user@switch# set interface irb.500 bfd-liveness-detection transmit-interval minimum-interval 350 user@switch# set interface irb.1500 bfd-liveness-detection transmit-interval threshold 500
Results
QFX1
198
From configuration mode, confirm your configuration by entering the show protocols pim commands. If the output does not display the intended configuration, repeat the instructions in this example to correct the configuration.
user@QFX1> show protocols pim pim {
rp { static { address 10.0.0.3 { group-ranges { 233.252.0.0/8; } } }
} interface irb.500 {
priority 200; dual-dr; bfd-liveness-detection {
minimum-receive-interval 700; transmit-interval {
minimum-interval 350; threshold 500; } } } }
QFX2
From configuration mode, confirm your configuration by entering the show protocols pim commands. If the output does not display the intended configuration, repeat the instructions in this example to correct the configuration.
user@switch> show protocols pim pim {
rp { static { address 10.0.0.3 { group-ranges {
199
233.252.0.0/8; } } } } interface irb.500 { priority 100; dual-dr; bfd-liveness-detection { ## Warning: 'bfd-liveness-detection' is deprecated minimum-receive-interval 700; transmit-interval { minimum-interval 350; threshold 500; } } } interface vlan.200 { priority 500; dual-dr; bfd-liveness-detection { ## Warning: 'bfd-liveness-detection' is deprecated minimum-receive-interval 700; transmit-interval { minimum-interval 350; threshold 500; } } } }
(Optional) Configuring DHCP Relay
IN THIS SECTION
CLI Quick Configuration | 200 Configuring QFX1 and QFX2 | 200
200
CLI Quick Configuration QFX1 and QFX2
set forwarding-options dhcp-relay forward-snooped-clients all-interfaces set forwarding-options dhcp-relay overrides allow-snooped-clients set forwarding-options dhcp-relay server-group GVP-DHCP 10.105.5.202 set forwarding-options dhcp-relay active-server-group GVP-DHCP set forwarding-options dhcp-relay route-suppression destination set forwarding-options dhcp-relay group Floor1 interface irb.500 set forwarding-options dhcp-relay relay-option-82 circuit-id use-interface-description device
Configuring QFX1 and QFX2
Step-by-Step Procedure The following example requires you to navigate various levels in the configuration hierarchy. For information about navigating the CLI, see Using the CLI Editor in Configuration Mode . To configure QFX1 and QFX2: 1. Configure forward snooped unicast packets on all interfaces.
[edit fowarding-options] user@switch# set dhcp-relay forward-snooped-clients all-interfaces
2. Create a binding entry to snoop unicast clients.
[edit forwarding-options] user@switch# set dhcp-relay overrides allow-snooped-clients
3. Create a DHCP server group.
[edit forwarding-options] user@switch# set dhcp-relay server-group GVP-DHCP 10.105.5.202
201
4. Apply a DHCP relay agent configuration to the named group of DHCP server addresses.
[edit forwarding-options] user@switch# set dhcp-relay active-server-group GVP-DHCP
5. Configure the relay agent to suppress the installation of ARP and route entries for corresponding client binding.
[edit forwarding-options] user@switch# set dhcp-relay route-suppression destination
6. Create a DHCP relay group that includes at least one interface. DHCP runs on the interfaces defined in the DHCP groups.
[edit forwarding-options] user@switch# set dhcp-relay group Floor1 interface irb.500
7. Configure DHCP relay with option 82.
[edit forwarding-options] user@switch# set dhcp-relay relay-option-82 circuit-id use-interface-description device
QFX1 and QFX2
From configuration mode, confirm your configuration by entering the show protocols pim commands. If the output does not display the intended configuration, repeat the instructions in this example to correct the configuration.
user@switch> show forwarding-options dhcp-relay dhcp-relay {
forward-snooped-clients all-interfaces; overrides {
allow-snooped-clients; } relay-option-82 {
circuit-id { use-interface-description device;
202
} } server-group {
GVP-DHCP { 10.105.5.202;
}
} active-server-group GVP-DHCP; route-suppression {
destination; } group Floor1 {
interface irb.500;
} }
Verification
IN THIS SECTION Verifying .... | 202 Verifying ... | 203
Confirm that the configuration is working properly.
Verifying ....
Purpose Verify that....is enabled or not.
Action From operational mode, enter the show ... command.
203
Meaning When BPDUs are sent from the PCs to interface ge-0/0/5.0 and interface ge-0/0/6.0 on Switch 2, the output from the operational mode command show spanning-tree interface shows that the interfaces have transitioned to a BPDU inconsistent state. The BPDU inconsistent state causes the interfaces to shut down. If the PCs connected to Switch 2 send BPDUs to the interfaces again, BPDU protection is triggered once more and the interfaces transition back to the BPDU inconsistent state, causing them to shut down. In such cases, you need to find and repair the misconfiguration on the PCs that is sending BPDUs to Switch 2. The field VLAN members shows that the ge-0/0/2.0 interface supports both the data-vlan VLAN and voice-vlan VLAN. The State field shows that the interface is up. Verifying ... Purpose Verify that...is working. Action From operational mode, enter the show ... command. Meaning
Troubleshooting
IN THIS SECTION Troubleshooting ... | 203
To troubleshoot [item], perform these tasks: Troubleshooting ... Problem
204
Solution
Example: Simplifying Multichassis Link Aggregation on EX9200 Switches in the Core for Campus Networks
IN THIS SECTION Requirements | 204 Overview | 205 Configuration | 208 Verification | 238
Requirements
This example uses the following hardware and software components: � Junos OS Release 16.1R1 for EX Series � Two EX9200 switches
NOTE: This configuration example has been tested using the software release listed and is assumed to work on all later releases.
Before you configure an MC-LAG, be sure that you understand how to: � Configure aggregated Ethernet interfaces on a switch. See Configuring an Aggregated Ethernet
Interface . � Configure the Link Aggregation Control Protocol (LACP) on aggregated Ethernet interfaces on a
switch. See Configuring Aggregated Ethernet LACP (CLI Procedure) .
205
Overview
IN THIS SECTION Topology | 206
In this example, you configure an MC-LAG across two switches, consisting of two aggregated Ethernet interfaces, multichassis protection using the ICL, ICCP for the peers hosting the MC-LAG, and Layer 3 connectivity between MC-LAG peers. Layer 3 connectivity is required for ICCP. To simplify the MC-LAG configuration process, you will enable configuration synchronization and configuration consistency check. Configuration synchronization enables you to easily propagate, synchronize, and commit configurations from one MC-LAG peer to another. You can log into any one of the MC-LAG peers to manage both MC-LAG peers, thus having a single point of management. Configuration consistency check uses the Inter-Chassis Control Protocol (ICCP) to exchange MC-LAG configuration parameters (chassis ID, service ID, and so on) and checks for any configuration inconsistencies across MC-LAG peers. When there is an inconsistency, you are notified and can take action to resolve it. Configuration consistency check is invoked after you issue a commit on an MC-LAG peer. On the EX9200-A switch, you will configure the following configuration synchronization and configuration consistency check parameters: � Local, remote, and global configuration groups that are synchronized to the EX9200-B switch. � Conditional groups. � Apply groups. � NETCONF over SSH. � MC-LAG peer details and user authentication details for MC-LAG configuration synchronization. � peers-synchronize statement to synchronize the configurations between local and remote MC-LAG
peers by default. � set multi-chassis mc-lag consistency-check command for consistency check. On the EX9200-B switch, the configuration process is much shorter and simpler. You will configure the following configuration synchronization and configuration consistency check parameters: � Apply groups. � NETCONF over SSH.
206 � MC-LAG peer details and user authentication details for MC-LAG configuration synchronization. � peers-synchronize statement to synchronize and commit the configurations between local and
remote MC-LAG peers. � multi-chassis mc-lag consistency-check statement to enable consistency check. Topology The topology used in this example consists of two switches hosting an MC-LAG. Figure 10 on page 206 shows the topology of this example. Figure 10: Topology Diagram
Table 6 on page 207 details the topology used in this configuration example.
207
Table 6: Components of the Topology for Configuring a Multichassis LAG Between Two Switches
Hostname
Base Hardware
Multichassis Link Aggregation Group
EX9200-A EX9200-B
EX9200 EX9200
ae0 is configured as an aggregated Ethernet interface, and is used as an ICCP link, and the following interfaces are part of ae0:
xe-0/3/6 and xe-1/3/6.
ae1 is configured as an aggregated Ethernet interface and is used as an ICL link, and the following interfaces are part of ae1:
xe-0/3/7 and xe-1/3/7.
ae2 is configured as an MC-LAG, and the following interfaces are part of ae2:
xe-0/0/1 on Switch B and xe-1/0/1 on Switch A.
ae3 is configured as an MC-LAG, and the following interface is part of ae3 on both Switch A and Switch B:
xe-0/0/2.
208
Table 6: Components of the Topology for Configuring a Multichassis LAG Between Two Switches (Continued)
Hostname
Base Hardware
Multichassis Link Aggregation Group
Virtual Chassis Virtual Chassis
Not applicable. Virtual Chassis are shown only for illustration purposes.
The Virtual Chassis are connected to the two EX9200 switches through LAG interfaces. The Virtual Chassis configuration is not included in this example and is only shown to illustrate a sample topology.
Configuration
IN THIS SECTION CLI Quick Configuration | 208 Configuring MC-LAG on EX9200-A | 212 Configuring MC-LAG on EX9200-B | 225 Results | 228
CLI Quick Configuration
To quickly configure this example, copy the following commands, paste them in a text file, remove any line breaks, change any details necessary to match your network configuration, copy and paste the commands into the CLI at the [edit] hierarchy level, and then enter commit from configuration mode.
EX9200-A
set system login user MCLAG_Admin uid 2000 set system login user MCLAG_Admin class super-user set system login user MCLAG_Admin authentication encrypted-password "$ABC123" set system static-host-mapping EX9200-A inet 10.92.76.2 set system static-host-mapping EX9200-B inet 10.92.76.4 set system services netconf ssh
209
set system commit peers-synchronize set system commit peers EX9200-B user MCLAG_Admin set system commit peers EX9200-B authentication "$ABC123" set interfaces irb unit 100 family inet address 192.168.100.2/24 arp 192.168.100.3 l2-interface ae1 set interfaces irb unit 100 family inet address 192.168.100.2/24 arp 192.168.100.3 mac 28:8a:1c:e5:3b:f0 set interfaces irb unit 100 family inet address 192.168.100.2/24 vrrp-group 1 virtual-address 192.168.100.1 set interfaces irb unit 100 family inet address 192.168.100.2/24 vrrp-group 1 priority 150 set interfaces irb unit 100 family inet address 192.168.100.2/24 vrrp-group 1 accept-data set interfaces lo0 unit 0 family inet address 172.16.32.5/32 set routing-options static route 0.0.0.0/0 next-hop 10.92.77.254 set protocols ospf area 0.0.0.0 interface lo0.0 passive set protocols ospf area 0.0.0.0 interface ae0.0 set protocols lldp interface all set chassis aggregated-devices ethernet device-count 20 set groups MC_Config_Global set groups MC_Config_Global when peers EX9200-A set groups MC_Config_Global when peers EX9200-B set groups MC_Config_Global interfaces xe-0/3/6 ether-options 802.3ad ae0 set groups MC_Config_Global interfaces xe-1/3/6 ether-options 802.3ad ae0 set groups MC_Config_Global interfaces ae0 description "ICCP Layer 3 Link with 2 members,xe-0/3/6,xe-1/3/6" set groups MC_Config_Global interfaces ae0 aggregated-ether-options lacp active set groups MC_Config_Global interfaces ae0 aggregated-ether-options lacp periodic fast set groups MC_Config_Global interfaces ae0 aggregated-ether-options lacp system-id 00:01:02:03:04:05 set groups MC_Config_Global interfaces ae0 aggregated-ether-options lacp admin-key 0 set groups MC_Config_Global interfaces xe-0/3/7 ether-options 802.3ad ae1 set groups MC_Config_Global interfaces xe-1/3/7 ether-options 802.3ad ae1 set groups MC_Config_Global interfaces ae1 description "ICL Layer 2 link with 2 members,xe-0/3/7,1/3/7" set groups MC_Config_Global interfaces ae1 unit 0 family ethernet-switching interface-mode trunk set groups MC_Config_Global interfaces ae1 unit 0 family ethernet-switching vlan members all set groups MC_Config_Global interfaces ae1 vlan-tagging set groups MC_Config_Global interfaces ae1 aggregated-ether-options lacp active set groups MC_Config_Global interfaces ae1 aggregated-ether-options lacp periodic fast set groups MC_Config_Global interfaces ae1 aggregated-ether-options lacp system-id 00:01:02:03:04:06 set groups MC_Config_Global interfaces ae1 aggregated-ether-options lacp admin-key 1 set groups MC_Config_Global interfaces xe-0/0/1 ether-options 802.3ad ae2 set groups MC_Config_Global interfaces xe-1/0/1 ether-options 802.3ad ae2 set groups MC_Config_Global interfaces ae2 unit 0 description "MC-LAG interface with members xe-0/0/1,xe-1/0/1" set groups MC_Config_Global interfaces ae2 unit 0 family ethernet-switching interface-mode trunk set groups MC_Config_Global interfaces ae2 unit 0 family ethernet-switching vlan members all
210
set groups MC_Config_Global interfaces ae2 aggregated-ether-options lacp active set groups MC_Config_Global interfaces ae2 aggregated-ether-options lacp periodic fast set groups MC_Config_Global interfaces ae2 aggregated-ether-options lacp system-id 00:01:02:03:04:07 set groups MC_Config_Global interfaces ae2 aggregated-ether-options lacp admin-key 2 set groups MC_Config_Global interfaces ae2 aggregated-ether-options mc-ae mc-ae-id 2 set groups MC_Config_Global interfaces ae2 aggregated-ether-options mc-ae redundancy-group 1 set groups MC_Config_Global interfaces ae2 aggregated-ether-options mc-ae mode active-active set groups MC_Config_Global interfaces ae2 aggregated-ether-options mc-ae init-delay-time 520 set groups MC_Config_Global interfaces ae2 aggregated-ether-options mc-ae events iccp-peer-down preferstatus-control-active set groups MC_Config_Global interfaces xe-0/0/2 ether-options 802.3ad ae3 set groups MC_Config_Global interfaces ae3 unit 0 description "MC-LAG interface with members xe-0/0/2 on both switches" set groups MC_Config_Global interfaces ae3 unit 0 family ethernet-switching interface-mode trunk set groups MC_Config_Global interfaces ae3 unit 0 family ethernet-switching vlan members all set groups MC_Config_Global interfaces ae3 aggregated-ether-options lacp active set groups MC_Config_Global interfaces ae3 aggregated-ether-options lacp periodic fast set groups MC_Config_Global interfaces ae3 aggregated-ether-options lacp system-id 00:01:02:03:04:08 set groups MC_Config_Global interfaces ae3 aggregated-ether-options lacp admin-key 3 set groups MC_Config_Global interfaces ae3 aggregated-ether-options mc-ae mc-ae-id 3 set groups MC_Config_Global interfaces ae3 aggregated-ether-options mc-ae redundancy-group 1 set groups MC_Config_Global interfaces ae3 aggregated-ether-options mc-ae mode active-active set groups MC_Config_Global interfaces ae3 aggregated-ether-options mc-ae init-delay-time 520 set groups MC_Config_Global interfaces ae3 aggregated-ether-options mc-ae events iccp-peer-down preferstatus-control-active set groups MC_Config_Global vlans v100 vlan-id 100 set groups MC_Config_Global vlans v100 l3-interface irb.100 set groups MC_Config_Global multi-chassis mc-lag consistency-check set groups MC_Config_Global protocols rstp interface ae2 set groups MC_Config_Global protocols rstp interface ae3 set groups MC_Config_Global protocols rstp bridge-priority 0 set groups MC_Config_Global protocols rstp system-id 00:01:02:03:04:09 set groups MC_Config_Global switch-options service-id 1 set groups MC_Config_Local set groups MC_Config_Local interfaces ae0 unit 0 family inet address 172.16.32.9/30 set groups MC_Config_Local interfaces ae2 aggregated-ether-options mc-ae chassis-id 0 set groups MC_Config_Local interfaces ae2 aggregated-ether-options mc-ae status-control active set groups MC_Config_Local interfaces ae3 aggregated-ether-options mc-ae chassis-id 0 set groups MC_Config_Local interfaces ae3 aggregated-ether-options mc-ae status-control active set groups MC_Config_Remote set groups MC_Config_Remote interfaces ae0 unit 0 family inet address 172.16.32.10/30
211
set groups MC_Config_Remote interfaces ae2 aggregated-ether-options mc-ae chassis-id 1 set groups MC_Config_Remote interfaces ae2 aggregated-ether-options mc-ae status-control standby set groups MC_Config_Remote interfaces ae3 aggregated-ether-options mc-ae chassis-id 1 set groups MC_Config_Remote interfaces ae3 aggregated-ether-options mc-ae status-control standby set interfaces ae2 unit 0 multi-chassis-protection 172.16.32.6 interface ae1 set interfaces ae3 unit 0 multi-chassis-protection 172.16.32.6 interface ae1 set protocols iccp local-ip-addr 172.16.32.5 set protocols iccp peer 172.16.32.6 session-establishment-hold-time 50 set protocols iccp peer 172.16.32.6 redundancy-group-id-list 1 set protocols iccp peer 172.16.32.6 backup-liveness-detection backup-peer-ip 10.92.76.4 set protocols iccp peer 172.16.32.6 liveness-detection minimum-interval 2000 set protocols iccp peer 172.16.32.6 liveness-detection multiplier 4 set multi-chassis multi-chassis-protection 172.16.32.6 interface ae1 set apply-groups [ MC_Config_Global MC_Config_Local MC_Config_Remote ]
EX9200-B
set system login user MCLAG_Admin uid 2000 set system login user MCLAG_Admin class super-user set system login user MCLAG_Admin authentication encrypted-password "$ABC123" set system static-host-mapping EX9200-A inet 10.92.76.2 set system static-host-mapping EX9200-B inet 10.92.76.4 set system services netconf ssh set system commit peers-synchronize set system commit peers EX9200-A user MCLAG_Admin set system commit peers EX9200-A authentication "$ABC123" set interfaces irb unit 100 family inet address 192.168.100.3/24 arp 192.168.100.2 l2-interface ae1 set interfaces irb unit 100 family inet address 192.168.100.3/24 arp 192.168.100.2 mac 28:8a:1c:e3:f7:f0 set interfaces irb unit 100 family inet address 192.168.100.3/24 vrrp-group 1 virtual-address 192.168.100.1 set interfaces irb unit 100 family inet address 192.168.100.3/24 vrrp-group 1 priority 100 set interfaces irb unit 100 family inet address 192.168.100.3/24 vrrp-group 1 accept-data set interfaces lo0 unit 0 family inet address 172.16.32.6/32 set routing-options static route 0.0.0.0/0 next-hop 10.92.77.254 set protocols ospf area 0.0.0.0 interface lo0 passive set protocols ospf area 0.0.0.0 interface ae0 set protocols lldp interface all set chassis aggregated-devices ethernet device-count 20 set interfaces ae2 unit 0 multi-chassis-protection 172.16.32.5 interface ae1 set interfaces ae3 unit 0 multi-chassis-protection 172.16.32.5 interface ae1 set protocols iccp local-ip-addr 172.16.32.6
212
set protocols iccp peer 172.16.32.5 session-establishment-hold-time 50 set protocols iccp peer 172.16.32.5 redundancy-group-id-list 1 set protocols iccp peer 172.16.32.5 backup-liveness-detection backup-peer-ip 10.92.76.2 set protocols iccp peer 172.16.32.5 liveness-detection minimum-interval 2000 set protocols iccp peer 172.16.32.5 liveness-detection multiplier 4 set apply-groups [ MC_Config_Global MC_Config_Local MC_Config_Remote ]
Configuring MC-LAG on EX9200-A
Step-by-Step Procedure The following example requires you to navigate various levels in the configuration hierarchy. 1. Create a user account to access the switch, along with a user identifier (UID), a login class, and a
password.
[edit system] user@EX9200-A# set login user MCLAG_Admin uid 2000 user@EX9200-A# set login user MCLAG_Admin class super-user user@EX9200-A# set login user MCLAG_Admin authentication encrypted-password "$ABC123"
2. Statically map EX9200-A to 10.92.76.2 and EX9200-B to 10.92.76.4.
[edit system] user@EX9200-A# set static-host-mapping EX9200-A inet 10.92.76.2 user@EX9200-A# set static-host-mapping EX9200-B inet 10.92.76.4
3. Enable NETCONF service using SSH.
[edit system] user@EX9200-A# set services netconf ssh
4. Enable the peers-synchronize statement to copy and load the MC-LAG configuration from EX9200-A to EX9200-B by default.
[edit system] user@EX9200-A# set commit peers-synchronize
213
5. Configure the hostname, usernames, and authentication details for EX9200-B, the peer with which EX9200-A will be synchronizing the MC-LAG configuration.
[edit system] user@EX9200-A# set commit peers EX9200-B user MCLAG_Admin user@EX9200-A# set commit peers EX9200-B user authentication "$ABC123"
6. Configure an MC-LAG IRB and configure static Address Resolution Protocol (ARP) on the MC-LAG IRB peers to allow routing protocols to traverse the IRB interface.
[edit interfaces] user@EX9200-A# set irb unit 100 family inet address 192.168.100.2/24 arp 192.168.100.3 l2interface ae1 user@EX9200-A# set irb unit 100 family inet address 192.168.100.2/24 arp 192.168.100.3 mac 28:8a:1c:e5:3b:f0
7. Enable VRRP on the MC-LAGs by assigning a virtual IP address that is shared between each switch in the VRRP group, and assigning an individual IP address for each individual member in the VRRP group.
[edit interfaces] user@EX9200-A# set irb unit 100 family inet address 192.168.100.2/24 vrrp-group 1 virtual-address 192.168.100.1 user@EX9200-A# set irb unit 100 family inet address 192.168.100.2/24 vrrp-group 1 priority 150 user@EX9200-A# set irb unit 100 family inet address 192.168.100.2/24 vrrp-group 1 accept-data
8. Configure a loopback interface.
[edit interfaces] user@EX9200-A# set lo0 unit 0 family inet address 172.16.32.5/32
9. Configure a default gateway.
[edit routing-options] user@EX9200-A# set static route 0.0.0.0 next-hop 10.92.77.254
214
10. Configure an OSPF area that includes the loopback interface and the ICCP interface.
[edit protocols] user@EX9200-A# set ospf area 0.0.0.0 interface lo0 passive user@EX9200-A# set ospf area 0.0.0.0 interface ae0
11. Configure Link Layer Discovery Protocol for all interfaces.
[edit protocols] user@EX9200-A# set lldp interface all
12. Configure the number of aggregated Ethernet interfaces to be created on EX9200-A.
[edit chassis] user@EX9200-A# set aggregated-devices ethernet device-count 20
13. Configure a configuration group for a global MC-LAG configuration that applies to both EX9200-A and EX9200-B. The global configuration is synchronized between EX9200-A and EX9200-B.
[edit groups] user@EX9200-A# set MC_Config_Global
14. Specify the peers that will apply the MC_Config_Global configuration group.
[edit groups] user@EX9200-A# set MC_Config_Global when peers EX9200-A user@EX9200-A# set MC_Config_Global when peers EX9200-B
15. Add member interfaces to the aggregated Ethernet interfaces that will be used for the Inter-Chassis Control Protocol (ICCP) interface.
[edit groups] user@EX9200-A# set MC_Config_Global interfaces xe-0/3/6 ether-options 802.3ad ae0 user@EX9200-A# set MC_Config_Global interfaces xe-1/3/6 ether-options 802.3ad ae0
215
16. Configure the aggregated Ethernet interface (ae0) that will be used for the Inter-Chassis Control Protocol (ICCP) interface.
NOTE: You will be configuring the IP address for ae0 in a later step.
[edit groups] user@EX9200-A# set MC_Config_Global interfaces ae0 description "ICCP Layer 3 Link with 2 members,xe-0/3/6,xe-1/3/6"
17. Configure the LACP parameters on ae0.
[edit groups] user@EX9200-A# set MC_Config_Global interfaces ae0 aggregated-ether-options lacp active user@EX9200-A# set MC_Config_Global interfaces ae0 aggregated-ether-options lacp periodic fast
18. Configure the LACP system ID on ae0.
[edit groups] user@EX9200-A# set MC_Config_Global interfaces ae0 aggregated-ether-options lacp system-id 00:01:02:03:04:05
19. Configure the LACP administrative key on ae0.
[edit groups] user@EX9200-A# set MC_Config_Global interfaces ae0 aggregated-ether-options lacp admin-key 0
20. Add member interfaces to the aggregated Ethernet interface (ae1) that will be used for the ICL.
[edit groups] user@EX9200-A# set MC_Config_Global interfaces xe-0/3/7 ether-options 802.3ad ae1 user@EX9200-A# set MC_Config_Global interfaces xe-1/3/7 ether-options 802.3ad ae1
216
21. Configure the aggregated Ethernet interface that will be used for the ICL.
[edit groups] user@EX9200-A# set MC_Config_Global interfaces ae1 description "ICL Layer 2 link with 2 members,xe-0/3/7,1/3/7"
22. Configure ae1 as a Layer 2 interface.
[edit groups] user@EX9200-A# set MC_Config_Global ae1 unit 0 family ethernet-switching interface-mode trunk user@EX9200-A# set MC_Config_Global ae1 unit 0 family ethernet-switching vlan members all
23. Enable the reception and transmission of 802.1Q VLAN-tagged frames on ae1.
[edit groups] user@EX9200-A# set MC_Config_Global interfaces ae1 vlan-tagging
24. Configure the LACP parameters on ae1.
[edit groups] user@EX9200-A# set MC_Config_Global interfaces ae1 aggregated-ether-options lacp active user@EX9200-A# set MC_Config_Global interfaces ae1 aggregated-ether-options lacp periodic fast
25. Configure the LACP system ID on ae1.
[edit groups] user@EX9200-A# set MC_Config_Global interfaces ae1 aggregated-ether-options lacp system-id 00:01:02:03:04:06
26. Configure the LACP administrative key on ae1.
[edit groups] user@EX9200-A# set MC_Config_Global interfaces ae1 aggregated-ether-options lacp admin-key 1
217
27. Add member interfaces to the aggregated Ethernet interface (ae2) that will be used as the MC-LAG interface.
[edit groups] user@EX9200-A# set MC_Config_Global interfaces xe-0/0/1 ether-options 802.3ad ae2 user@EX9200-A# set MC_Config_Global interfaces xe-1/0/1 ether-options 802.3ad ae2
28. Configure the aggregated Ethernet interface (ae2) that will be used as an MC-LAG interface.
[edit groups] user@EX9200-A# set MC_Config_Global interfaces ae2 description "MC-LAG interface with members xe-0/0/1,xe-1/0/1"
29. Configure ae2 as a Layer 2 interface.
[edit groups] user@EX9200-A# set MC_Config_Global interfaces ae2 unit 0 family ethernet-switching interfacemode trunk user@EX9200-A# set MC_Config_Global interfaces ae2 unit 0 family ethernet-switching vlan members all
30. Configure the LACP parameters on ae2.
[edit groups] user@EX9200-A# set MC_Config_Global interfaces ae2 aggregated-ether-options lacp active user@EX9200-A# set MC_Config_Global interfaces ae2 aggregated-ether-options lacp periodic fast
31. Configure the LACP system ID on ae2.
[edit groups] user@EX9200-A# set MC_Config_Global interfaces ae2 aggregated-ether-options lacp system-id 00:01:02:03:04:07
218
32. Configure the LACP administrative key on ae2.
[edit groups] user@EX9200-A# set MC_Config_Global interfaces ae2 aggregated-ether-options lacp admin-key 2
33. Configure the MC-AE interface properties on ae2.
[edit groups] user@EX9200-A# set MC_Config_Global interfaces ae2 aggregated-ether-options mc-ae mc-ae-id 2 user@EX9200-A# set MC_Config_Global interfaces ae2 aggregated-ether-options mc-ae redundancygroup 1
34. Specify the mode of ae2 to be active-active.
[edit groups] user@EX9200-A# set MC_Config_Global interfaces ae2 aggregated-ether-options mc-ae mode activeactive
35. Specify the time in seconds to delay bringing the MC-AE interface to the up state after rebooting an MC-LAG peer. By delaying the bring-up of the interface until after protocol convergence, you can prevent packet loss during the recovery of failed links and devices. This network configuration example uses a delay time of 520 seconds. This delay time might not be optimal for your network and should be adjusted to fit your network requirements.
[edit groups] user@EX9200-A# set MC_Config_Global interfaces ae2 aggregated-ether-options mc-ae init-delaytime 520
36. Specify that if a peer of the MC-LAG group goes down, the peer that is configured as status-control active becomes the active peer.
[edit groups] user@EX9200-A# set MC_Config_Global interfaces ae2 aggregated-ether-options mc-ae events iccppeer-down prefer-status-control-active
219
37. Add member interfaces to the aggregated Ethernet interface (ae3) that will be used as the MC-LAG interface.
NOTE: EX9200-B uses the same interface name of xe-0/0/2.
[edit groups] user@EX9200-A# set MC_Config_Global interfaces xe-0/0/2 ether-options 802.3ad ae3
38. Configure the aggregated Ethernet interface (ae3) that will be used as an MC-LAG interface.
[edit groups] user@EX9200-A# set groups MC_Config_Global interfaces ae3 description "MC-LAG interface with members xe-0/0/2 on both switches"
39. Configure ae3 as a Layer 2 interface.
[edit groups] user@EX9200-A# set MC_Config_Global interfaces ae3 unit 0 family ethernet-switching interfacemode trunk user@EX9200-A# set MC_Config_Global interfaces ae3 unit 0 family ethernet-switching vlan members all
40. Configure the LACP parameters on ae3.
[edit groups] user@EX9200-A# set MC_Config_Global interfaces ae3 aggregated-ether-options lacp active user@EX9200-A# set MC_Config_Global interfaces ae3 aggregated-ether-options lacp periodic fast
41. Configure the LACP system ID on ae3.
[edit groups] user@EX9200-A# set MC_Config_Global interfaces ae3 aggregated-ether-options lacp system-id 00:01:02:03:04:08
220
42. Configure the LACP administrative key on ae3.
[edit groups] user@EX9200-A# set MC_Config_Global interfaces ae3 aggregated-ether-options lacp admin-key 3
43. Configure the MC-AE interface properties on ae3.
[edit groups] user@EX9200-A# set MC_Config_Global interfaces ae3 aggregated-ether-options mc-ae mc-ae-id 3 user@EX9200-A# set MC_Config_Global interfaces ae3 aggregated-ether-options mc-ae redundancygroup 1
44. Specify the mode of ae3 to be active-active.
[edit groups] user@EX9200-A# set MC_Config_Global interfaces ae3 aggregated-ether-options mc-ae mode activeactive
45. Specify the time in seconds to delay bringing the MC-AE interface to the up state after rebooting an MC-LAG peer. By delaying the bring-up of the interface until after protocol convergence, you can prevent packet loss during the recovery of failed links and devices. This network configuration example uses a delay time of 520 seconds. This delay time might not be optimal for your network and should be adjusted to fit your network requirements.
[edit groups] user@EX9200-A# set MC_Config_Global interfaces ae3 aggregated-ether-options mc-ae init-delaytime 520
46. Specify that if a peer of the MC-LAG group goes down, the peer that is configured as status-control active becomes the active peer.
[edit groups] user@EX9200-A# set MC_Config_Global interfaces ae3 aggregated-ether-options mc-ae events iccppeer-down prefer-status-control-active
221
47. Configure VLAN 100 to connect end users.
[edit groups] user@EX9200-A# set MC_Config_Global vlans v100 vlan-id 100
48. Configure the routed VLAN interface for VLAN 100.
[edit groups] user@EX9200-A# set MC_Config_Global vlans v100 l3-interface irb.100
49. Enable consistency check.
[edit groups] user@EX9200-A# set MC_Config_Global multi-chassis mc-lag consistency-check
50. Enable the Rapid Spanning Tree Protocol on the ae2 and ae3 interfaces (MC-LAG interfaces) for optional loop prevention.
[edit groups] user@EX9200-A# set MC_Config_Global protocols rstp interfaces ae2 user@EX9200-A# set MC_Config_Global protocols rstp interfaces ae3
51. Configure the RSTP bridge priority. Setting the bridge priority to 0 will make the MC-AE nodes of EX9200-A and EX9200-B the best priority.
[edit groups] user@EX9200-A# set MC_Config_Global protocols rstp bridge-priority 0
52. Configure the RSTP system identifier value.
[edit groups] user@EX9200-A# set MC_Config_Global protocols rstp system-id 00:01:02:03:04:09
53. Specify the switch service ID.
222
The switch service ID is used to synchronize applications, ARP, and MAC learning across MC-LAG members.
[edit groups] user@EX9200-A# set MC_Config_Global switch-options service-id 1
54. Configure a configuration group for an MC-LAG configuration that applies to the local peer.
[edit groups] user@EX9200-A# set MC_Config_Local
55. Configure the ICCP interface (ae0) as a Layer 3 interface.
[edit groups] user@EX9200-A# set MC_Config_Local interfaces ae0 unit 0 family inet address 172.16.32.9/30
56. Specify a unique chassis ID for the MC-LAG (ae2) that the aggregated Ethernet interface belongs to.
[edit groups] user@EX9200-A# set MC_Config_Local interfaces ae2 aggregated-ether-options mc-ae chassis-id 0
57. Specify the status-control setting of ae2 to be active.
[edit groups] user@EX9200-A# set MC_Config_Local interfaces ae2 aggregated-ether-options mc-ae status-control active
58. Specify a unique chassis ID for the MC-LAG (ae3) that the aggregated Ethernet interface belongs to.
[edit groups] user@EX9200-A# set MC_Config_Local interfaces ae3 aggregated-ether-options mc-ae chassis-id 0
223
59. Specify the status-control setting of ae3 to be active..
[edit groups] user@EX9200-A# set MC_Config_Local interfaces ae3 aggregated-ether-options mc-ae status-control active
60. Configure a configuration group for an MC-LAG configuration that applies to the remote peer.
[edit groups] user@EX9200-A# set MC_Config_Remote
61. Configure ae0 as a Layer 3 interface.
[edit groups] user@EX9200-A# set MC_Config_Remote interfaces ae0 unit 0 family inet address 172.16.32.10/30
62. Specify a unique chassis ID for the MC-LAG (ae2) that the aggregated Ethernet interface belongs to.
[edit groups] user@EX9200-A# set MC_Config_Remote interfaces ae2 aggregated-ether-options mc-ae chassis-id 1
63. Specify the status-control setting of ae2 to be standby.
[edit groups] user@EX9200-A# set MC_Config_Remote interfaces ae2 aggregated-ether-options mc-ae statuscontrol standby
64. Specify a unique chassis ID for the MC-LAG (ae3) that the aggregated Ethernet interface belongs to.
[edit groups] user@EX9200-A# set MC_Config_Remote interfaces ae3 aggregated-ether-options mc-ae chassis-id 1
224
65. Specify the status-control setting of ae3 to be standby.
[edit interfaces] user@EX9200-A# set MC_Config_Remote interfaces ae3 aggregated-ether-options mc-ae statuscontrol standby
66. Specify that if a peer of the MC-LAG group goes down, the peer that is configured as status-control active becomes the active peer.
[edit interfaces] user@EX9200-A# set MC_Config_Remote interfaces ae3 aggregated-ether-options mc-ae events iccppeer-down prefer-status-control-standby
67. Enable link protection between the two MC-LAG peers. Assign interface ae1 to act as the ICL to protect the MC-AE interfaces, ae2 and ae3, in case of failure.
[edit interfaces] user@EX9200-A# set ae2 unit 0 multi-chassis-protection 172.16.32.6 interface ae1
user@EX9200-A# set ae3 unit 0 multi-chassis-protection 172.16.32.6 interface ae1
68. Specify the local IP address of the ICCP interface.
[edit protocols] user@EX9200-A# set iccp local-ip-addr 172.16.32.5
69. Configure the session establishment hold time for ICCP to connect faster.
NOTE: We recommend 50 seconds as the session establishment hold time value.
[edit protocols] user@EX9200-A# set iccp peer 172.16.32.6 session-establishment-hold-time 50
225
user@EX9200-A# set iccp peer 172.16.32.6 redundancy-group-id-list 1 user@EX9200-A# set iccp peer 172.16.32.6 backup-liveness-detection backup-peer-ip 10.92.76.4
70. To enable BFD for ICCP, configure the minimum receive interval. We recommend a minimum receive interval value of 6 seconds.
[edit protocols] user@EX9200-A# set iccp peer 172.16.32.6 liveness-detection minimum-interval 2000 user@EX9200-A# set iccp peer 172.16.32.6 liveness-detection multiplier 4
71. Apply the groups configured earlier, so that the Junos configuration will inherit the statements from the MC_Config_Global, MC_Config_Local, and MC_Config_Remote configuration groups.
[edit] user@EX9200-A# set apply-groups [ MC_Config_Global MC_Config_Local MC_Config_Remote ]
Configuring MC-LAG on EX9200-B
Step-by-Step Procedure The following example requires you to navigate various levels in the configuration hierarchy. 1. Create a user account to access the switch, along with a user identifier (UID), a login class, and a
password.
[edit system] user@EX9200-A# set login user MCLAG_Admin uid 2000 user@EX9200-B# set login user MCLAG_Admin class super-user user@EX9200-B# set login user MCLAG_Admin authentication encrypted-password "$ABC123"
2. Statically map EX9200-A to 10.92.76.2 and EX9200-B to 10.92.76.4.
[edit system] user@EX9200-B# set static-host-mapping EX9200-A inet 10.92.76.2 user@EX9200-B# set static-host-mapping EX9200-B inet 10.92.76.4
226
3. Enable NETCONF service using SSH.
[edit system] user@EX9200-B# set services netconf ssh
4. Enable the peers-synchronize statement to copy and load the MC-LAG configuration from EX9200-B to EX9200-A by default.
[edit system] user@EX9200-B# set commit peers-synchronize
5. Configure the hostname, usernames, and authentication details for EX9200-A, the peer with which EX9200-B will be synchronizing the MC-LAG configuration.
[edit system] user@EX9200-B# set commit peers EX9200-A user MCLAG_Admin user@EX9200-A# set commit peers EX9200-A authentication "$ABC123"
6. Configure an MC-LAG IRB and configure static Address Resolution Protocol (ARP) on the MC-LAG IRB peers to allow routing protocols to traverse the IRB interface.
[edit interfaces] user@EX9200-B# set irb unit 100 family inet address 192.168.100.3/24 arp 192.168.100.2 l2interface ae1 user@EX9200-B# set irb unit 100 family inet address 192.168.100.3/24 arp 192.168.100.2 mac 28:8a:1c:e3:f7:f0
7. Enable VRRP on the MC-LAGs by assigning a virtual IP address that is shared between each switch in the VRRP group, and assigning an individual IP address for each individual member in the VRRP group.
[edit interfaces] user@EX9200-B# set irb unit 100 family inet address 192.168.100.3/24 vrrp-group 1 virtual-address 192.168.100.1 user@EX9200-B# set irb unit 100 family inet address 192.168.100.3/24 vrrp-group 1 priority 100 user@EX9200-B# set irb unit 100 family inet address 192.168.100.3/24 vrrp-group 1 accept-data
227
8. Configure a loopback interface.
[edit interfaces] user@EX9200-B# set lo0 unit 0 family inet address 172.16.32.6/32
9. Configure a default gateway.
[edit routing-options] user@EX9200-B# set static route 0.0.0.0 next-hop 10.92.77.254
10. Configure an OSPF area that includes the loopback interface and the ICCP interface.
[edit protocols] user@EX9200-B# set ospf area 0.0.0.0 interface lo0 passive user@EX9200-B# set ospf area 0.0.0.0 interface ae0
11. Configure Link Layer Discovery Protocol for all interfaces.
[edit protocols] user@EX9200-B# set lldp interface all
12. Configure the number of aggregated Ethernet interfaces to be created on EX9200-B.
[edit chassis] user@EX9200-B# set aggregated-devices ethernet device-count 20
13. Enable link protection between the two MC-LAG peers. Assign interface ae1 to act as the ICL to protect the MC-AE interfaces, ae2 and ae3, in case of failure.
[edit interfaces] user@EX9200-B# set ae2 unit 0 multi-chassis-protection 172.16.32.5 interface ae1 user@EX9200-B# set ae3 unit 0 multi-chassis-protection 172.16.32.5 interface ae1
228
14. Specify the local IP address of the ICCP interface.
[edit protocols] user@EX9200-B# set iccp local-ip-addr 172.16.32.6
15. Configure the session establishment hold time for ICCP to connect faster.
NOTE: We recommend 50 seconds as the session establishment hold time value.
[edit protocols] user@EX9200-B# set iccp peer 172.16.32.5 session-establishment-hold-time 50 user@EX9200-B# set iccp peer 172.16.32.5 redundancy-group-id-list 1 user@EX9200-B# set iccp peer 172.16.32.5 backup-liveness-detection backup-peer-ip 10.92.76.2
16. To enable BFD for ICCP, configure the minimum receive interval. We recommend a minimum receive interval value of 6 seconds.
[edit protocols] user@EX9200-B# set iccp peer 172.16.32.5 liveness-detection minimum-interval 2000 user@EX9200-B# set iccp peer 172.16.32.5 liveness-detection multiplier 4
17. Apply the groups configured earlier, so that the Junos configuration will inherit the statements from the MC_Config_Global, MC_Config_Local, and MC_Config_Remote configuration groups.
[edit] user@EX9200-B# set apply-groups [ MC_Config_Global MC_Config_Local MC_Config_Remote ]
Results Display the results of the configuration on EX9200-A before you commit the configuration.
user@EX9200-A# show system services netconf {
229
ssh; }
user@EX9200-A# show system commit peers-synchronize;
peers { EX9200-B { user MCLAG_Admin; authentication "$ABC123"; }
} }
user@EX9200-A# show interfaces ae2 {
unit 0 { multi-chassis-protection 172.16.32.6 { interface ae1; }
} } ae3 {
unit 0 { multi-chassis-protection 172.16.32.6 { interface ae1; }
} } irb {
unit 100 { family inet { address 192.168.100.2/24 { arp 192.168.100.3 l2-interface ae1.0 mac 28:8a:1c:e5:3b:f0; vrrp-group 1 { virtual-address 192.168.100.1; priority 150; accept-data; } } }
230
} } lo0 {
unit 0 { family inet { address 172.16.32.5/32; }
} }
user@EX9200-A# show routing-options static {
route 0.0.0.0/0 next-hop 10.92.77.254; }
user@EX9200-A# show protocols ospf {
area 0.0.0.0 { interface lo0.0 { passive; } interface ae0.0;
} } iccp {
local-ip-addr 172.16.32.5; peer 172.16.32.6 {
session-establishment-hold-time 50; redundancy-group-id-list 1; backup-liveness-detection {
backup-peer-ip 10.92.76.4; } liveness-detection {
minimum-interval 2000; multiplier 4; } } } lldp {
231
interface all; }
user@EX9200-A# show chassis aggregated-devices {
ethernet { device-count 20;
} }
user@EX9200-A# show groups MC_Config_Global when {
peers [ EX9200-A EX9200-B ]; } interfaces {
xe-0/3/6 { ether-options { 802.3ad ae0; }
} xe-1/3/6 {
ether-options { 802.3ad ae0;
} } ae0 {
description "ICCP Layer 3 Link with 2 members,xe-0/3/6,xe-1/3/6"; aggregated-ether-options {
lacp { active; periodic fast; system-id 00:01:02:03:04:05; admin-key 0;
} } } xe-0/3/7 { ether-options {
802.3ad ae1; }
232
} xe-1/3/7 {
ether-options { 802.3ad ae1;
} } ae1 {
description "ICL Layer 2 link with 2 members,xe-0/3/7,1/3/7"; vlan-tagging; aggregated-ether-options {
lacp { active; periodic fast; system-id 00:01:02:03:04:06; admin-key 1;
} } unit 0 {
family ethernet-switching { interface-mode trunk; vlan { members all; }
} } } xe-0/0/1 { ether-options {
802.3ad ae2; } } xe-1/0/1 { ether-options {
802.3ad ae2; } } ae2 { description "MC-LAG interface with members xe-0/0/1,xe-1/0/1"; aggregated-ether-options {
lacp { active; periodic fast; system-id 00:01:02:03:04:07;
233
admin-key 2; } mc-ae {
mc-ae-id 2; redundancy-group 1; mode active-active; init-delay-time 520; events {
iccp-peer-down { prefer-status-control-active;
} } } } unit 0 { family ethernet-switching { interface-mode trunk; vlan {
members all; } } } } xe-0/0/2 { ether-options { 802.3ad ae3; } } ae3 { description "MC-LAG interface with members xe-0/0/2 on both switches" aggregated-ether-options { lacp { active; periodic fast; system-id 00:01:02:03:04:08; admin-key 3; } mc-ae { mc-ae-id 3; redundancy-group 1; mode active-active; init-delay-time 520; events {
234
iccp-peer-down { prefer-status-control-active;
} } } } unit 0 { family ethernet-switching { interface-mode trunk; vlan {
members all; } } } } } multi-chassis { mc-lag { consistency-check; } } protocols { rstp { bridge-priority 0; system-id 00:01:02:03:04:09; interface ae2; interface ae3; } } switch-options { service-id 1; } vlans { v100 { vlan-id 100; l3-interface irb.100; } }
user@EX9200-A# show groups MC_Config_Local interfaces {
235
ae0 { unit 0 { family inet { address 172.16.32.9/30; } }
} ae2 {
aggregated-ether-options { mc-ae { chassis-id 0; status-control active; }
} } ae3 {
aggregated-ether-options { mc-ae { chassis-id 0; status-control active; }
} } }
user@EX9200-A# show groups MC_Config_Remote interfaces {
ae0 { unit 0 { family inet { address 172.16.32.10/30; } }
} ae2 {
aggregated-ether-options { mc-ae { chassis-id 1; status-control standby; }
}
236
} ae3 {
aggregated-ether-options { mc-ae { chassis-id 1; status-control standby; }
} } }
user@EX9200-A# show apply-groups apply-groups [ MC_Config_Global MC_Config_Local MC_Config_Remote ];
Display the results of the configuration on EX9200-B before you commit the configuration.
user@EX9200-B# show system services netconf {
ssh; }
user@EX9200-B# show system commit peers-synchronize; peers {
EX9200-A { user MCLAG_Admin; authentication "$ABC123";
} }
user@EX9200-B# show interfaces ae2 {
unit 0 { multi-chassis-protection 172.16.32.5 { interface ae1; }
} }
237
ae3 { unit 0 { multi-chassis-protection 172.16.32.5 { interface ae1; } }
} irb {
unit 100 { family inet { address 192.168.100.3/24 { arp 192.168.100.2 l2-interface ae1.0 mac 28:8a:1c:e3:f7:f0; vrrp-group 1 { virtual-address 192.168.100.1; priority 100; accept-data; } } }
} } lo0 {
unit 0 { family inet { address 172.16.32.6/32; }
} }
user@EX9200-B# show routing-options static {
route 0.0.0.0/0 next-hop 10.92.77.254; }
user@EX9200-B# show protocols ospf {
area 0.0.0.0 { interface lo0.0 { passive; }
238
interface ae0.0; } } iccp { local-ip-addr 172.16.32.6; peer 172.16.32.5 {
session-establishment-hold-time 50; redundancy-group-id-list 1; backup-liveness-detection {
backup-peer-ip 10.92.76.2; } liveness-detection {
minimum-interval 2000; multiplier 4; } } } lldp { interface all; }
user@EX9200-B# show chassis aggregated-devices {
ethernet { device-count 20;
} }
user@EX9200-B# show apply-groups [ MC_Config_Global MC_Config_Local MC_Config_Remote ];
Verification
IN THIS SECTION
Verifying ICCP on MC-LAG | 239 Verifying LACP on MC-LAG | 240
239
Verifying Aggregated Ethernet Interfaces in MC-LAG | 244 Verifying MAC Learning on MC-LAG | 245 Verifying VRRP in MC-LAG | 247 Verifying OSPF on MC-LAG | 248 Verifying that Configuration Consistency Check Passed | 249 Verifying the Configuration Consistency Check Status for the Global Configuration | 255 Verifying the Configuration Consistency Check Status for the Interchassis Control Link | 257 Verifying the Configuration Consistency Check Status for the MC-LAG Interfaces | 258 Verifying the Configuration Consistency Check Status for the VLAN Configuration | 263 Verifying the Configuration Consistency Check Status for VRRP | 264
Verifying ICCP on MC-LAG Purpose Verify that ICCP is running on each device in the MC-LAG. Action 1. Verify that ICCP is running on EX9200-A.
user@EX92000-A> show iccp
Redundancy Group Information for peer 172.16.32.6
TCP Connection
: Established
Liveliness Detection : Up
Backup liveness peer status: Up
Redundancy Group ID
Status
1
Up
Client Application: lacpd Redundancy Group IDs Joined: 1
Client Application: l2ald_iccpd_client Redundancy Group IDs Joined: 1
240
Client Application: mclag_cfgchkd Redundancy Group IDs Joined: 1
2. Verify that ICCP is running on EX9200-B.
user@EX9200-B> show iccp
Redundancy Group Information for peer 172.16.32.5
TCP Connection
: Established
Liveliness Detection : Up
Backup liveness peer status: Up
Redundancy Group ID
Status
1
Up
Client Application: lacpd Redundancy Group IDs Joined: 1
Client Application: l2ald_iccpd_client Redundancy Group IDs Joined: 1
Client Application: mclag_cfgchkd Redundancy Group IDs Joined: 1
Meaning
This output shows that the TCP connection between the peers hosting the MC-LAG is up, liveness detection is up, Backup liveness peer status is up, and LACPD, MCLAG_CFGCHKD,and L2ALD _ICCP_CLIENT client applications are running.
Verifying LACP on MC-LAG
Purpose
Verify that LACP is working properly on each device in the MC-LAG.
241
Action 1. Verify that the LACP interfaces are up and running on EX9200-A.
user@EX9200-A> show lacp interfaces
Aggregated interface: ae0
LACP state:
Role Exp Def Dist Col Syn Aggr Timeout
Activity
xe-0/3/6
Actor No No Yes Yes Yes Yes
Fast
Active
xe-0/3/6
Partner No No Yes Yes Yes Yes
Fast
Active
xe-1/3/6
Actor No No Yes Yes Yes Yes
Fast
Active
xe-1/3/6
Partner No No Yes Yes Yes Yes
Fast
Active
LACP protocol:
Receive State Transmit State
Mux State
xe-0/3/6
Current Fast periodic Collecting
distributing
xe-1/3/6
Current Fast periodic Collecting
distributing
Aggregated interface: ae1
LACP state:
Role Exp Def Dist Col Syn Aggr Timeout
Activity
xe-0/3/7
Actor No No Yes Yes Yes Yes
Fast
Active
xe-0/3/7
Partner No No Yes Yes Yes Yes
Fast
Active
xe-1/3/7
Actor No No Yes Yes Yes Yes
Fast
Active
xe-1/3/7
Partner No No Yes Yes Yes Yes
Fast
Active
LACP protocol:
Receive State Transmit State
Mux State
xe-0/3/7
Current Fast periodic Collecting
distributing
xe-1/3/7
Current Fast periodic Collecting
distributing
Aggregated interface: ae2
LACP state:
Role Exp Def Dist Col Syn Aggr Timeout
242
Activity
xe-0/0/1
Actor No Yes
Active
xe-0/0/1
Partner No Yes
Passive
LACP protocol:
Receive State
xe-0/0/1
Current
distributing
xe-1/0/1
Port disabled
distributing
No No No Yes
Fast
No No No Yes
Fast
Transmit State
Mux State
Fast periodic Collecting
Fast periodic Collecting
Aggregated interface: ae3
LACP state:
Role Exp Def Dist Col Syn Aggr Timeout
Activity
xe-0/0/2
Actor No Yes No No No Yes
Fast
Active
xe-0/0/2
Partner No Yes No No No Yes
Fast
Passive
LACP protocol:
Receive State Transmit State
Mux State
xe-0/0/2
Current Fast periodic Collecting
distributing
2. Verify that the LACP interfaces are up and running on EX9200-B.
user@EX9200-B> show lacp interfaces
Aggregated interface: ae0
LACP state:
Role Exp Def Dist Col Syn Aggr Timeout
Activity
xe-0/3/6
Actor No No Yes Yes Yes Yes
Fast
Active
xe-0/3/6
Partner No No Yes Yes Yes Yes
Fast
Active
xe-1/3/6
Actor No No Yes Yes Yes Yes
Fast
Active
xe-1/3/6
Partner No No Yes Yes Yes Yes
Fast
Active
LACP protocol:
Receive State Transmit State
Mux State
xe-0/3/6
Current Fast periodic Collecting
distributing
xe-1/3/6
Current Fast periodic Collecting
distributing
243
Aggregated interface: ae1
LACP state:
Role Exp Def Dist Col Syn Aggr Timeout
Activity
xe-0/3/7
Actor No No Yes Yes Yes Yes
Fast
Active
xe-0/3/7
Partner No No Yes Yes Yes Yes
Fast
Active
xe-1/3/7
Actor No No Yes Yes Yes Yes
Fast
Active
xe-1/3/7
Partner No No Yes Yes Yes Yes
Fast
Active
LACP protocol:
Receive State Transmit State
Mux State
xe-0/3/7
Current Fast periodic Collecting
distributing
xe-1/3/7
Current Fast periodic Collecting
distributing
Aggregated interface: ae2
LACP state:
Role Exp Def Dist Col Syn Aggr Timeout
Activity
xe-1/0/1
Actor No Yes No No No Yes
Fast
Active
xe-1/0/1
Partner No Yes No No No Yes
Fast
Passive
LACP protocol:
Receive State Transmit State
Mux State
xe-0/0/1
Current Fast periodic Collecting
distributing
xe-1/0/1
Current Fast periodic Collecting
distributing
Aggregated interface: ae3
LACP state:
Role Exp Def Dist Col Syn Aggr Timeout
Activity
xe-0/0/2
Actor No Yes No No No Yes
Fast
Active
xe-0/0/2
Partner No Yes No No No Yes
Fast
Passive
LACP protocol:
Receive State Transmit State
Mux State
xe-0/0/2
Current Fast periodic Collecting
distributing
244
Meaning This output means that both devices and all related interfaces are properly participating in LACP negotiations. Verifying Aggregated Ethernet Interfaces in MC-LAG Purpose Verify that all of the ae interfaces are configured properly in the MC�LAG. Action 1. Verify the ae interfaces on EX9200-A.
user@EX9200-A> show interfaces mc-ae
Member Link
: ae2
Current State Machine's State: mcae active state
Configuration Error Status : No Error
Local Status
: active
Local State
: up
Peer Status
: active
Peer State
: up
Logical Interface
: ae2.0
Topology Type
: bridge
Local State
: up
Peer State
: up
Peer Ip/MCP/State
: 172.16.32.6 ae1.0 up
Member Link
: ae3
Current State Machine's State: mcae active state
Configuration Error Status : No Error
Local Status
: active
Local State
: up
Peer Status
: active
Peer State
: up
Logical Interface
: ae3.0
Topology Type
: bridge
Local State
: up
Peer State
: up
Peer Ip/MCP/State
: 172.16.32.6 ae1.0 up
245
2. Verify the ae interfaces on EX9200-B.
user@EX9200-B> show interface mc-ae
Member Link
: ae2
Current State Machine's State: mcae active state
Configuration Error Status : No Error
Local Status
: active
Local State
: up
Peer Status
: active
Peer State
: up
Logical Interface
: ae2.0
Topology Type
: bridge
Local State
: up
Peer State
: up
Peer Ip/MCP/State
: 172.16.32.5 ae1.0 up
Member Link
: ae3
Current State Machine's State: mcae active state
Configuration Error Status : No Error
Local Status
: active
Local State
: down
Peer Status
: active
Peer State
: down
Logical Interface
: ae3.0
Topology Type
: bridge
Local State
: up
Peer State
: up
Peer Ip/MCP/State
: 172.16.32.5 ae1.0 up
Meaning This output means that the mc-ae interfaces on each device are up and active. Verifying MAC Learning on MC-LAG Purpose Verify that MAC learning between devices is happening in the MC-LAG.
246
Action
1. Show the Ethernet switching table on EX9200-A.
user@EX9200-A> show ethernet-switching table MAC flags (S - static MAC, D - dynamic MAC, L - locally learned, P Persistent static, C - Control MAC
SE - statistics enabled, NM - non configured MAC, R - remote PE MAC, O - ovsdb MAC)
Ethernet switching table : 2 entries, 2 learned
Routing instance : EVPN-2
Vlan
MAC
MAC
Age
Logical
NH
RTR
name
address
flags
interface
Index
ID
v100
10:0e:7e:b1:01:80 DC
-
pip-7.040010000000
1048580 1048580
v100
4c:96:14:e7:fd:81 DRC
-
ae10.200
0
0
2. Show the Ethernet switching table on EX9200-B.
user@EX9200-B> show ethernet-switching table MAC flags (S - static MAC, D - dynamic MAC, L - locally learned, P Persistent static, C - Control MAC
SE - statistics enabled, NM - non configured MAC, R - remote PE MAC, O - ovsdb MAC)
Ethernet switching table : 2 entries, 2 learned
Routing instance : EVPN-2
Vlan name
MAC address
MAC flags
Age
Logical interface
NH Index
RTR
ID
v100
10:0e:7e:b1:01:80
DC
-
pip-7.060010000000
1048581
1048580
v100
247
4c:96:14:e7:fd:81 ae10.200
D
-
0
0
Meaning This output means that the MAC addresses are properly learned within the shared VLANs defined in the MC-LAG. Verifying VRRP in MC-LAG Purpose Verify that VRRP is up and active between the devices in the MC-LAG. Action 1. Confirm that VRRP is up and active on EX9200-A.
user@EX9200-A> show vrrp
Interface
State
irb.100
up
192.168.100.2
192.168.100.1
Group 1
VR state VR Mode master Active
Timer Type Address A 0.789 lcl
vip
In this example, Switch A is the primary VRRP member. 2. Confirm that VRRP is up and active on EX9200-B.
user@EX9200-B> show vrrp
Interface
State
irb.100
up
192.168.100.3
192.168.100.1
192.168.100.2
Group 1
VR state VR Mode backup Active
Timer Type Address D 2.887 lcl
vip
mas
In this example, Switch B is the backup VRRP member.
248
Meaning This output means that VRRP is up and running properly. Verifying OSPF on MC-LAG Purpose Verify that OSPF is properly up and running with MC-LAG. Action 1. Show the OSPF neighbors on EX9200-A.
user@EX9200-A> show ospf neighbor
Address
Interface
172.16.32.10
ae0.0
2. Show the OSPF routing table on EX9200-A.
State Full
ID 172.16.32.6
Pri Dead 128 33
user@EX9200-A> show ospf route Topology default Route Table:
Prefix Nexthop
172.16.32.6 172.16.32.5/32 172.16.32.6/32 172.16.32.8/30
Path Route
NH
Type Type Intra Router Intra Network Intra Network Intra Network
Type IP IP IP IP
Metric NextHop
Interface 1 ae0.0 0 lo0.0 1 ae0.0 1 ae0.0
Address/LSP 172.16.32.10
172.16.32.10
3. Show the OSPF neighbors on EX9200-B.
user@EX9200-B> show ospf neighbor
Address
Interface
172.16.32.9
ae0.0
State Full
ID 172.16.32.5
Pri Dead 128 31
249
4. Show the OSPF routing table on EX9200-B.
user@EX9200-B> show ospf route Topology default Route Table:
Prefix Nexthop
172.16.32.5 172.16.32.5/32 172.16.32.6/32 172.16.32.8/30
Path Route
NH
Type Type Intra Router Intra Network Intra Network Intra Network
Type IP IP IP IP
Metric NextHop
Interface 1 ae0.0 1 ae0.0 0 lo0.0 1 ae0.0
Address/LSP 172.16.32.9 172.16.32.9
Meaning
The output shows that the neighboring devices are fully adjacent.
Verifying that Configuration Consistency Check Passed
Purpose
View the list of committed MC-LAG parameters that are checked for inconsistencies, the consistency requirement (identical or unique), the enforcement level (mandatory or desired), and the result of the configuration consistency check. The results are either pass or fail.
Action
1. Show the list of committed MC-LAG parameters that passed or failed configuration consistency check on EX9200-A.
user@EX9200-A> show multi-chassis mc-lag configuration-consistency
Configuration Item
Enforcement Level
Value
Peer Value
Result
------------------
-----------------
-----------
----------
-------
ICL interface
Mandatory
ae1
ae1
PASS
rstp-bridge-priority
Desirable
0
0
PASS
service-id
Mandatory
Local
250
1
1
session-establishment-hold-time
300
300
local-ip-addr
172.16.32.5
172.16.32.6
backup-liveness-detection
10.92.76.4
10.92.76.2
iccp/bfd multiplier
4
4
bfd minimum-interval
2000
2000
session-establishment-hold-time
50
50
PASS Mandatory
PASS Mandatory
PASS Mandatory
PASS Mandatory
PASS Mandatory
PASS Mandatory
PASS
Local Physical Interface:ae2
Peer Physical Interface :ae2
Configuration Item
Enforcement Level
Value
Peer Value
Result
------------------
-----------------
-----------
----------
-------
lacp admin-key
Mandatory
2
2
PASS
lacp system-id
Mandatory
00:01:02:03:04:07
00:01:02:03:04:07
PASS
lacp periodic
Mandatory
0
0
PASS
lacp mode
Mandatory
0
0
PASS
prefer-status-control-active
Desirable
TRUE
--
PASS
mcae status-control
Mandatory
standby
active
PASS
mcae deployment mode
Mandatory
active
active-active
PASS
mcae chassis-id
Mandatory
0
1
PASS
mcae redundancy-group
Mandatory
1
1
PASS
Local active-
Local Logical Interface:ae2.0
Peer Logical Interface :ae2.0
Configuration Item
Value
Peer Value
Enforcement Level Result
Local
251
---------------------------vlan membership 100 interface-mode trunk
---------100 trunk
-----------------------
Mandatory PASS
Mandatory PASS
Local Physical Interface:ae3
Peer Physical Interface :ae3
Configuration Item
Enforcement Level
Value
Peer Value
Result
------------------
-----------------
-----------
----------
-------
lacp admin-key
Mandatory
3
3
PASS
lacp system-id
Mandatory
00:01:02:03:04:08
00:01:02:03:04:08
PASS
lacp periodic
Mandatory
0
0
PASS
lacp mode
Mandatory
0
0
PASS
prefer-status-control-active
Desirable
TRUE
--
PASS
mcae status-control
Mandatory
standby
active
PASS
mcae deployment mode
Mandatory
active
active-active
PASS
mcae chassis-id
Mandatory
0
1
PASS
mcae redundancy-group
Mandatory
1
1
PASS
Local active-
Local Logical Interface:ae3.0
Peer Logical Interface :ae3.0
Configuration Item
Value
Peer Value
------------------
-----------
----------
vlan membership
100
100
interface-mode
trunk
trunk
Enforcement Level Result
-----------------------
Mandatory PASS
Mandatory PASS
Local
252
Local VLAN:v100 Peer VLAN :v100
Local IRB:irb.100
Peer IRB :irb.100
Configuration Item
Enforcement Level
Value
Peer Value
Result
------------------
-----------------
-----------
----------
-------
vrrp-group id
Mandatory
1
1
PASS
ipv4 address
Mandatory
192.168.100.2/24
192.168.100.3/24
PASS
Local
2. Show the list of committed MC-LAG parameters that passed or failed configuration consistency check on EX9200-B.
user@EX9200-B> show multi-chassis mc-lag configuration-consistency
Configuration Item
Enforcement Level
Value
Peer Value
Result
------------------
-----------------
-----------
----------
-------
ICL interface
Mandatory
ae1
ae1
PASS
rstp-bridge-priority
Desirable
0
0
PASS
service-id
Mandatory
1
1
PASS
session-establishment-hold-time
Mandatory
300
300
PASS
local-ip-addr
Mandatory
172.16.32.6
172.16.32.5
PASS
backup-liveness-detection
Mandatory
10.92.76.2
10.92.76.4
PASS
iccp/bfd multiplier
Mandatory
4
4
PASS
bfd minimum-interval
Mandatory
2000
2000
PASS
session-establishment-hold-time
Mandatory
50
50
PASS
Local
253
Local Physical Interface:ae2
Peer Physical Interface :ae2
Configuration Item
Enforcement Level
Value
Peer Value
Result
------------------
-----------------
-----------
----------
-------
lacp admin-key
Mandatory
2
2
PASS
lacp system-id
Mandatory
00:01:02:03:04:07
00:01:02:03:04:07
PASS
lacp periodic
Mandatory
0
0
PASS
lacp mode
Mandatory
0
0
PASS
mcae status-control
Mandatory
active
standby
PASS
mcae deployment mode
Mandatory
active
active-active
PASS
mcae chassis-id
Mandatory
1
0
PASS
mcae redundancy-group
Mandatory
1
1
PASS
prefer-status-control-active
Desirable
--
TRUE
PASS
Local active-
Local Logical Interface:ae2.0
Peer Logical Interface :ae2.0
Configuration Item
Value
Peer Value
------------------
-----------
----------
vlan membership
100
100
interface-mode
trunk
trunk
Enforcement Level Result
-----------------------
Mandatory PASS
Mandatory PASS
Local
Local Physical Interface:ae3
Peer Physical Interface :ae3
Configuration Item
Value
Peer Value
------------------
-----------
----------
lacp admin-key
Enforcement Level Result
-----------------------
Mandatory
Local
254
3
3
PASS
lacp system-id
Mandatory
00:01:02:03:04:08
00:01:02:03:04:08
PASS
lacp periodic
Mandatory
0
0
PASS
lacp mode
Mandatory
0
0
PASS
mcae status-control
Mandatory
active
standby
PASS
mcae deployment mode
Mandatory
active
active-active
PASS
mcae chassis-id
Mandatory
1
0
PASS
mcae redundancy-group
Mandatory
1
1
PASS
prefer-status-control-active
Desirable
--
TRUE
PASS
active-
Local Logical Interface:ae3.0
Peer Logical Interface :ae3.0
Configuration Item
Value
Peer Value
------------------
-----------
----------
vlan membership
100
100
interface-mode
trunk
trunk
Enforcement Level Result
-----------------------
Mandatory PASS
Mandatory PASS
Local
Local VLAN:v100 Peer VLAN :v100
Local IRB:irb.100
Peer IRB :irb.100
Configuration Item
Value
Peer Value
------------------
-----------
----------
vrrp-group id
1
1
ipv4 address
Enforcement Level Result
-----------------------
Mandatory PASS
Mandatory
Local
255
192.168.100.3/24
192.168.100.2/24
PASS
Meaning
The output shows that all configured and committed MC-LAG parameters have passed configuration consistency check.
Verifying the Configuration Consistency Check Status for the Global Configuration
Purpose
View configuration consistency check status for all committed global configuration related to MC-LAG functionality, the consistency requirement (identical or unique), the enforcement level (mandatory or desired), and the result of the configuration consistency check. The results are either pass or fail. This command shows only a subset of what is shown in the show multi-chassis mc-lag configurationconsistency command. The following parameters related to the global configuration are checked for consistency. � ICL interface � RSTP bridge priority � service ID � session establishment hold time � local IP address of the ICCP interface � backup liveness detection peer IP address � ICCP/BFD multiplier Parameters specific to the ICL, MC-LAG interfaces, and VLAN and VRRP configurations are shown later in this document.
Action
1. Show the list of committed global configuration parameters that passed or failed configuration consistency check on EX9200-A.
256
The output below shows all of the parameters that directly affect the MC-LAG configuration.
user@EX9200-A> show multi-chassis mc-lag configuration-consistency global-config
Configuration Item
Enforcement Level Local
Value
Peer Value
Result
------------------
-----------------
-----------
----------
-------
ICL interface
Mandatory
ae1
ae1
PASS
rstp-bridge-priority
Desirable
0
0
PASS
service-id
Mandatory
1
1
PASS
session-establishment-hold-time
Mandatory
300
300
PASS
local-ip-addr
Mandatory
172.16.32.5
172.16.32.6
PASS
backup-liveness-detection
Mandatory
10.92.76.4
10.92.76.2
PASS
iccp/bfd multiplier
Mandatory
4
4
PASS
bfd minimum-interval
Mandatory
2000
2000
PASS
session-establishment-hold-time
Mandatory
50
50
PASS
2. Show the list of committed global configuration parameters that passed or failed configuration consistency check on EX9200-B
user@EX9200-B> show multi-chassis mc-lag configuration-consistency global-config
Configuration Item
Enforcement Level Local
Value
Peer Value
Result
------------------
-----------------
-----------
----------
-------
ICL interface
Mandatory
ae1
ae1
PASS
rstp-bridge-priority
Desirable
0
0
PASS
service-id
Mandatory
1
1
PASS
session-establishment-hold-time
Mandatory
257
300
300
local-ip-addr
172.16.32.6
172.16.32.5
backup-liveness-detection
10.92.76.2
10.92.76.4
iccp/bfd multiplier
4
4
bfd minimum-interval
2000
2000
session-establishment-hold-time
50
50
PASS Mandatory
PASS Mandatory
PASS Mandatory
PASS Mandatory
PASS Mandatory
PASS
Meaning
The output shows that the committed global configuration related to MC-LAG have passed configuration consistency check.
Verifying the Configuration Consistency Check Status for the Interchassis Control Link
Purpose
View configuration consistency check status for parameters related to the ICL, the consistency requirement (identical or unique), the enforcement level (mandatory or desired), and the result of the configuration consistency check. The results are either pass or fail. Some example of parameters related to the ICL interface are the interface mode and which VLAN the interface belongs to. This command shows only a subset of what is shown in the show multi-chassis mc-lag configurationconsistency command. The following parameters related to the ICL configuration are checked for consistency check: � VLAN membership � interface mode
Action
1. Show the list of committed ICL configuration parameters that passed or failed configuration consistency check on EX9200-A
user@EX9200-A> show multi-chassis mc-lag configuration-consistency icl-config Local Physical Interface:ae1 Peer Physical Interface :ae1
258
Local Logical Interface:ae1.0
Peer Logical Interface :ae1.0
Configuration Item
Enforcement Level
Value
Peer Value
Result
------------------
-----------------
-----------
----------
-------
vlan membership
Mandatory
100
100
PASS
interface-mode
Mandatory
trunk
trunk
PASS
Local
2. Show the list of committed ICL configuration parameters that passed or failed configuration consistency check on EX9200-B
user@EX9200-B> show multi-chassis mc-lag configuration-consistency icl-config Local Physical Interface:ae1 Peer Physical Interface :ae1
Local Logical Interface:ae1.0
Peer Logical Interface :ae1.0
Configuration Item
Enforcement Level
Value
Peer Value
Result
------------------
-----------------
-----------
----------
-------
vlan membership
Mandatory
100
100
PASS
interface-mode
Mandatory
trunk
trunk
PASS
Local
Meaning
The output shows that the committed MC-LAG parameters related to the ICL have passed configuration consistency check.
Verifying the Configuration Consistency Check Status for the MC-LAG Interfaces
Purpose
View configuration consistency check status for committed parameters related to the multichassis aggregated Ethernet interfaces, the consistency requirement (identical or unique), the enforcement level
259
(mandatory or desired), and the result of the configuration consistency check. The results are either pass or fail. This command shows only a subset of what is shown in the show multi-chassis mc-lag configurationconsistency command. The following parameters related to the MC-AE interfaces are checked for consistency: � LACP administrative key � LACP system ID � LACP periodic interval � prefer status control setting � status control setting � mode � chassis ID � redundancy group ID � VLAN membership of the ICL � interface mode of the ICL
Action
1. Show the list of committed MC-LAG interface configuration parameters that passed or failed configuration consistency check on EX9200-A.
user@EX9200-A> show multi-chassis mc-lag configuration-consistency mcae-config
Local Physical Interface:ae2
Peer Physical Interface :ae2
Configuration Item
Enforcement Level Local
Value
Peer Value
Result
------------------
-----------------
-----------
----------
-------
lacp admin-key
Mandatory
2
2
PASS
lacp system-id
Mandatory
00:01:02:03:04:07
00:01:02:03:04:07
PASS
lacp periodic
Mandatory
0
0
PASS
lacp mode
Mandatory
260
0
0
prefer-status-control-active
TRUE
--
mcae status-control
standby
active
mcae deployment mode
active
active-active
mcae chassis-id
0
1
mcae redundancy-group
1
1
PASS Desirable
PASS Mandatory
PASS Mandatory PASS Mandatory
PASS Mandatory
PASS
active-
Local Logical Interface:ae2.0
Peer Logical Interface :ae2.0
Configuration Item
Value
Peer Value
------------------
-----------
----------
vlan membership
100
100
interface-mode
trunk
trunk
Enforcement Level Result
-----------------------
Mandatory PASS
Mandatory PASS
Local
Local Physical Interface:ae3
Peer Physical Interface :ae3
Configuration Item
Enforcement Level
Value
Peer Value
Result
------------------
-----------------
-----------
----------
-------
lacp admin-key
Mandatory
3
3
PASS
lacp system-id
Mandatory
00:01:02:03:04:05
00:01:02:03:04:05
PASS
lacp periodic
Mandatory
0
0
PASS
lacp mode
Mandatory
0
0
PASS
prefer-status-control-active
Desirable
TRUE
--
PASS
mcae status-control
Mandatory
standby
active
PASS
mcae deployment mode
Mandatory
active
active-active
PASS
Local active-
261
mcae chassis-id
0
1
mcae redundancy-group
1
1
Local Logical Interface:ae3.0
Peer Logical Interface :ae3.0
Configuration Item
Value
Peer Value
------------------
-----------
----------
vlan membership
100
100
interface-mode
trunk
trunk
Mandatory PASS
Mandatory PASS
Enforcement Level Result
-----------------------
Mandatory PASS
Mandatory PASS
Local
2. Show the list of committed MC-LAG interface configuration parameters that passed or failed configuration consistency check on EX9200-B.
user@EX9200-B> show multi-chassis mc-lag configuration-consistency mcae-config
Local Physical Interface:ae2
Peer Physical Interface :ae2
Configuration Item
Enforcement Level Local
Value
Peer Value
Result
------------------
-----------------
-----------
----------
-------
lacp admin-key
Mandatory
2
2
PASS
lacp system-id
Mandatory
00:01:02:03:04:05
00:01:02:03:04:05
PASS
lacp periodic
Mandatory
0
0
PASS
lacp mode
Mandatory
0
0
PASS
mcae status-control
Mandatory
active
standby
PASS
mcae deployment mode
Mandatory
active-
active
active-active
PASS
mcae chassis-id
Mandatory
1
0
PASS
mcae redundancy-group
Mandatory
1
1
PASS
262
prefer-status-control-active
--
TRUE
Desirable PASS
Local Logical Interface:ae2.0
Peer Logical Interface :ae2.0
Configuration Item
Value
Peer Value
------------------
-----------
----------
vlan membership
100
100
interface-mode
trunk
trunk
Enforcement Level Result
-----------------------
Mandatory PASS
Mandatory PASS
Local
Local Physical Interface:ae3
Peer Physical Interface :ae3
Configuration Item
Enforcement Level
Value
Peer Value
Result
------------------
-----------------
-----------
----------
-------
lacp admin-key
Mandatory
3
3
PASS
lacp system-id
Mandatory
00:01:02:03:04:08
00:01:02:03:04:08
PASS
lacp periodic
Mandatory
0
0
PASS
lacp mode
Mandatory
0
0
PASS
mcae status-control
Mandatory
active
standby
PASS
mcae deployment mode
Mandatory
active
active-active
PASS
mcae chassis-id
Mandatory
1
0
PASS
mcae redundancy-group
Mandatory
1
1
PASS
prefer-status-control-active
Desirable
--
TRUE
PASS
Local active-
Local Logical Interface:ae3.0
Peer Logical Interface :ae3.0
Configuration Item
Value
Peer Value
Enforcement Level Result
Local
263
---------------------------vlan membership 100 interface-mode trunk
---------100 trunk
-----------------------
Mandatory PASS
Mandatory PASS
Meaning
The output shows that the committed MC-LAG parameters related to the MC-AE interfaces have passed configuration consistency check.
Verifying the Configuration Consistency Check Status for the VLAN Configuration
Purpose
View configuration consistency check status for committed parameters related to MC-LAG VLAN configuration, the consistency requirement (identical or unique), the enforcement level (mandatory or desired), and the result of the configuration consistency check. The results are either pass or fail. This command shows only a subset of what is shown in the show multi-chassis mc-lag configurationconsistency command. The following parameters related to the VLAN and IRB configuration are checked for consistency: � VRRP group ID � IP address of IRB interface
Action
1. Show the list of committed VLAN configuration parameters that passed or failed configuration consistency check on EX9200-A.
user@EX9200-A> show multi-chassis mc-lag configuration-consistency vlan-config Local VLAN:v100 Peer VLAN :v100
Local IRB:irb.100
Peer IRB :irb.100
Configuration Item
Value
Peer Value
------------------
Enforcement Level Result
-----------------
Local
264
----------vrrp-group id 1 ipv4 address 192.168.100.2/24
----------
-------
Mandatory
1
PASS
Mandatory
192.168.100.3/24
PASS
2. Show the list of committed VLAN configuration parameters that passed or failed configuration consistency check on EX9200-B.
user@EX9200-B> show multi-chassis mc-lag configuration-consistency vlan-config Peer VLAN :v100
Local IRB:irb.100
Peer IRB :irb.100
Configuration Item
Enforcement Level
Value
Peer Value
Result
------------------
-----------------
-----------
----------
-------
vrrp-group id
Mandatory
1
1
PASS
ipv4 address
Mandatory
192.168.100.3/24
192.168.100.2/24
PASS
Local
Meaning
The output shows that the committed MC-LAG parameters related to the VLAN and IRB configurations have passed configuration consistency check.
Verifying the Configuration Consistency Check Status for VRRP
Purpose
View configuration consistency check status for committed parameters related to VRRP configuration, the consistency requirement (identical or unique), the enforcement level (mandatory or desired), and the result of the configuration consistency check. The results are either pass or fail. This command shows only a subset of what is shown in the show multi-chassis mc-lag configurationconsistency command. The following parameters related to the VRRP configuration are checked for consistency: VRRP group virtual IP address and VRRP group priority value.
265
Action
1. Show the list of committed VRRP configuration parameters that passed or failed configuration consistency check on EX9200-A.
user@EX9200-A> show multi-chassis mc-lag configuration-consistency vrrp-config Local VRRP Group:1
Peer VRRP Group :1
Configuration Item
Enforcement Level
Value
Peer Value
Result
------------------
-----------------
-----------
----------
-------
vrrp-group virtual-address
Mandatory
192.168.100.001
192.168.100.001
PASS
vrrp-group priority
Mandatory
150
100
PASS
Local
2. Show the list of committed VRRP configuration parameters that passed or failed configuration consistency check on EX9200-B.
user@EX9200-B> show multi-chassis mc-lag configuration-consistency vrrp-config Local VRRP Group:1
Peer VRRP Group :1
Configuration Item
Enforcement Level
Value
Peer Value
Result
------------------
-----------------
-----------
----------
-------
vrrp-group virtual-address
Mandatory
192.168.100.001
192.168.100.001
PASS
vrrp-group priority
Mandatory
100
150
PASS
Local
Meaning
The output shows that the committed MC-LAG parameters related to VRRP configuration have passed configuration consistency check.
266
SEE ALSO Example: Configuring Multichassis Link Aggregation on EX9200 Switches in the Core for Campus Networks | 0
Example: Configuring CoS for FCoE Transit Switch Traffic Across an MCLAG
IN THIS SECTION Requirements | 267 Overview | 267 Configuration | 274 Verification | 287
Multichassis link aggregation groups (MC-LAGs) provide redundancy and load balancing between two switches, multihoming support for client devices such as servers, and a loop-free Layer 2 network without running Spanning Tree Protocol (STP).
NOTE: This example uses Junos OS without support for the Enhanced Layer 2 Software (ELS) configuration style. If your switch runs software that does support ELS, see Example: Configuring CoS Using ELS for FCoE Transit Switch Traffic Across an MC-LAG. For ELS details, see Using the Enhanced Layer 2 Software CLI.
You can use an MC-LAG to provide a redundant aggregation layer for Fibre Channel over Ethernet (FCoE) traffic in an inverted-U topology. To support lossless transport of FCoE traffic across an MC-LAG, you must configure the appropriate class of service (CoS) on both of the switches with MC-LAG port members. The CoS configuration must be the same on both of the MC-LAG switches because an MCLAG does not carry forwarding class and IEEE 802.1p priority information.
NOTE: This example describes how to configure CoS to provide lossless transport for FCoE traffic across an MC-LAG that connects two switches. It also describes how to configure CoS on the FCoE transit switches that connect FCoE hosts to the two switches that form the MC-LAG.
267
This example does not describe how to configure the MC-LAG itself. However, this example includes a subset of MC-LAG configuration that only shows how to configure interface membership in the MC-LAG.
Ports that are part of an FCoE-FC gateway configuration (a virtual FCoE-FC gateway fabric) do not support MC-LAGs. Ports that are members of an MC-LAG act as FCoE pass-through transit switch ports. QFX Series switches and EX4600 switches support MC-LAGs. QFabric system Node devices do not support MC-LAGs.
Requirements
This example uses the following hardware and software components: � Two Juniper Networks QFX3500 switches that form an MC-LAG for FCoE traffic. � Two Juniper Networks QFX3500 switches that provide FCoE server access in transit switch mode
and that connect to the MC-LAG switches. These switches can be standalone QFX3500 switches or they can be Node devices in a QFabric system. � FCoE servers (or other FCoE hosts) connected to the transit switches. � Junos OS Release 12.2 or later for the QFX Series.
Overview
IN THIS SECTION Topology | 268
FCoE traffic requires lossless transport. This example shows you how to: � Configure CoS for FCoE traffic on the two QFX3500 switches that form the MC-LAG, including
priority-based flow control (PFC) and enhanced transmission selection (ETS; hierarchical scheduling of resources for the FCoE forwarding class priority and for the forwarding class set priority group).
NOTE: Configuring or changing PFC on an interface blocks the entire port until the PFC change is completed. After a PFC change is completed, the port is unblocked and traffic
268
resumes. Blocking the port stops ingress and egress traffic, and causes packet loss on all queues on the port until the port is unblocked.
� Configure CoS for FCoE on the two FCoE transit switches that connect FCoE hosts to the MC-LAG switches and enable FIP snooping on the FCoE VLAN at the FCoE transit switch access ports.
� Disable IGMP snooping on the FCoE VLAN.
NOTE: This is only necessary if IGMP snooping is enabled on the VLAN. Before Junos OS Release 13.2, IGMP snooping was enabled by default on VLANs. Beginning with Junos OS Release 13.2, IGMP snooping is enabled by default only on the default VLAN.
� Configure the appropriate port mode, MTU, and FCoE trusted or untrusted state for each interface to support lossless FCoE transport.
Topology Switches that act as transit switches support MC-LAGs for FCoE traffic in an inverted-U network topology, as shown in Figure 11 on page 268.
Figure 11: Supported Topology for an MC-LAG on an FCoE Transit Switch
269
Table 7 on page 269 shows the configuration components for this example. Table 7: Components of the CoS for FCoE Traffic Across an MC-LAG Configuration Topology
Component
Settings
Hardware
Four QFX3500 switches (two to form the MCLAG as pass-through transit switches and two transit switches for FCoE access).
Forwarding class (all switches)
Default fcoe forwarding class.
Classifier (forwarding class mapping of incoming traffic to IEEE priority)
Default IEEE 802.1p trusted classifier on all FCoE interfaces.
270
Table 7: Components of the CoS for FCoE Traffic Across an MC-LAG Configuration Topology (Continued)
Component
Settings
LAGs and MC-LAG
S1--Ports xe-0/0/10 and x-0/0/11 are members of LAG ae0, which connects Switch S1 to Switch S2.
Ports xe-0/0/20 and xe-0/0/21 are members of MC-LAG ae1.
All ports are configured in trunk port mode, as fcoe-trusted, and with an MTU of 2180.
S2--Ports xe-0/0/10 and x-0/0/11 are members of LAG ae0, which connects Switch S2 to Switch S1.
Ports xe-0/0/20 and xe-0/0/21 are members of MC-LAG ae1.
All ports are configured in trunk port mode, as fcoe-trusted, and with an MTU of 2180.
NOTE: Ports xe-0/0/20 and xe-0/0/21 on Switches S1 and S2 are the members of the MCLAG.
TS1--Ports xe-0/0/25 and x-0/0/26 are members of LAG ae1, configured in trunk port mode, as fcoe-trusted, and with an MTU of 2180.
Ports xe-0/0/30, xe-0/0/31, xe-0/0/32, and xe-0/0/33 are configured in tagged-access port mode, with an MTU of 2180.
TS2--Ports xe-0/0/25 and x-0/0/26 are members of LAG ae1, configured in trunk port mode, as fcoe-trusted, and with an MTU of 2180.
271
Table 7: Components of the CoS for FCoE Traffic Across an MC-LAG Configuration Topology (Continued)
Component
Settings
Ports xe-0/0/30, xe-0/0/31, xe-0/0/32, and xe-0/0/33 are configured in tagged-access port mode, with an MTU of 2180.
FCoE queue scheduler (all switches)
fcoe-sched: Minimum bandwidth 3g Maximum bandwidth 100% Priority low
Forwarding class-to-scheduler mapping (all switches)
Scheduler map fcoe-map: Forwarding class fcoe Scheduler fcoe-sched
Forwarding class set (FCoE priority group, all switches)
fcoe-pg:
Forwarding class fcoe Egress interfaces: � S1--LAG ae0 and MC-LAG ae1 � S2--LAG ae0 and MC-LAG ae1 � TS1--LAG ae1, interfaces xe-0/0/30,
xe-0/0/31, xe-0/0/32, and xe-0/0/33 � TS2--LAG ae1, interfaces xe-0/0/30,
xe-0/0/31, xe-0/0/32, and xe-0/0/33
272
Table 7: Components of the CoS for FCoE Traffic Across an MC-LAG Configuration Topology (Continued)
Component
Settings
Traffic control profile (all switches)
fcoe-tcp: Scheduler map fcoe-map Minimum bandwidth 3g Maximum bandwidth 100%
PFC congestion notification profile (all switches) fcoe-cnp:
Code point 011 Ingress interfaces: � S1--LAG ae0 and MC-LAG ae1 � S2--LAG ae0 and MC-LAG ae1 � TS1--LAG ae1, interfaces xe-0/0/30,
xe-0/0/31, xe-0/0/32, and xe-0/0/33 � TS2--LAG ae1, interfaces xe-0/0/30,
xe-0/0/31, xe-0/0/32, and xe-0/0/33
FCoE VLAN name and tag ID
Name--fcoe_vlan
ID--100 Include the FCoE VLAN on the interfaces that carry FCoE traffic on all four switches. Disable IGMP snooping on the interfaces that belong to the FCoE VLAN on all four switches.
273
Table 7: Components of the CoS for FCoE Traffic Across an MC-LAG Configuration Topology (Continued)
Component
Settings
FIP snooping
Enable FIP snooping on Transit Switches TS1 and TS2 on the FCoE VLAN. Configure the LAG interfaces that connect to the MC-LAG switches as FCoE trusted interfaces so that they do not perform FIP snooping.
This example enables VN2VN_Port FIP snooping on the FCoE transit switch interfaces connected to the FCoE servers. The example is equally valid with VN2VF_Port FIP snooping enabled on the transit switch access ports. The method of FIP snooping you enable depends on your network configuration.
NOTE: This example uses the default IEEE 802.1p trusted BA classifier, which is automatically applied to trunk mode and tagged access mode ports if you do not apply an explicitly configured classifier.
To configure CoS for FCoE traffic across an MC-LAG:
� Use the default FCoE forwarding class and forwarding-class-to-queue mapping (do not explicitly configure the FCoE forwarding class or output queue). The default FCoE forwarding class is fcoe, and the default output queue is queue 3.
NOTE: In Junos OS Release 12.2, traffic mapped to explicitly configured forwarding classes, even lossless forwarding classes such as fcoe, is treated as lossy (best-effort) traffic and does not receive lossless treatment. To receive lossless treatment in Release 12.2, traffic must use one of the default lossless forwarding classes (fcoe or no-loss). In Junos OS Release 12.3 and later, you can include the no-loss packet drop attribute in the explicit forwarding class configuration to configure a lossless forwarding class.
� Use the default trusted BA classifier, which maps incoming packets to forwarding classes by the IEEE 802.1p code point (CoS priority) of the packet. The trusted classifier is the default classifier for interfaces in trunk and tagged-access port modes. The default trusted classifier maps incoming
274
packets with the IEEE 802.1p code point 3 (011) to the FCoE forwarding class. If you choose to configure the BA classifier instead of using the default classifier, you must ensure that FCoE traffic is classified into forwarding classes in exactly the same way on both MC-LAG switches. Using the default classifier ensures consistent classifier configuration on the MC-LAG ports.
� Configure a congestion notification profile that enables PFC on the FCoE code point (code point 011 in this example). The congestion notification profile configuration must be the same on both MC-LAG switches.
� Apply the congestion notification profile to the interfaces.
� Configure enhanced transmission selection (ETS, also known as hierarchical scheduling) on the interfaces to provide the bandwidth required for lossless FCoE transport. Configuring ETS includes configuring bandwidth scheduling for the FCoE forwarding class, a forwarding class set (priority group) that includes the FCoE forwarding class, and a traffic control profile to assign bandwidth to the forwarding class set that includes FCoE traffic.
� Apply the ETS scheduling to the interfaces.
� Configure the port mode, MTU, and FCoE trusted or untrusted state for each interface to support lossless FCoE transport.
In addition, this example describes how to enable FIP snooping on the Transit Switch TS1 and TS2 ports that are connected to the FCoE servers and how to disable IGMP snooping on the FCoE VLAN. To provide secure access, FIP snooping must be enabled on the FCoE access ports.
This example focuses on the CoS configuration to support lossless FCoE transport across an MC-LAG. This example does not describe how to configure the properties of MC-LAGs and LAGs, although it does show you how to configure the port characteristics required to support lossless transport and how to assign interfaces to the MC-LAG and to the LAGs.
Before you configure CoS, configure:
� The MC-LAGs that connect Switches S1 and S2 to Switches TS1 and TS2.
� The LAGs that connect the Transit Switches TS1 and TS2 to MC-LAG Switches S1 and S2.
� The LAG that connects Switch S1 to Switch S2.
Configuration
IN THIS SECTION
CLI Quick Configuration | 275 Configuring MC-LAG Switches S1 and S2 | 277
275
Configuring FCoE Transit Switches TS1 and TS2 | 280 Results | 284
To configure CoS for lossless FCoE transport across an MC-LAG, perform these tasks:
CLI Quick Configuration
To quickly configure CoS for lossless FCoE transport across an MC-LAG, copy the following commands, paste them in a text file, remove line breaks, change variables and details to match your network configuration, and then copy and paste the commands into the CLI for MC-LAG Switch S1 and MC-LAG Switch S2 at the [edit] hierarchy level. The configurations on Switches S1 and S2 are identical because the CoS configuration must be identical, and because this example uses the same ports on both switches. Switch S1 and Switch S2
set class-of-service schedulers fcoe-sched priority low transmit-rate 3g set class-of-service schedulers fcoe-sched shaping-rate percent 100 set class-of-service scheduler-maps fcoe-map forwarding-class fcoe scheduler fcoe-sched set class-of-service forwarding-class-sets fcoe-pg class fcoe set class-of-service traffic-control-profiles fcoe-tcp scheduler-map fcoe-map guaranteed-rate 3g set class-of-service traffic-control-profiles fcoe-tcp shaping-rate percent 100 set class-of-service interfaces ae0 forwarding-class-set fcoe-pg output-traffic-control-profile fcoe-tcp set class-of-service interfaces ae1 forwarding-class-set fcoe-pg output-traffic-control-profile fcoe-tcp set class-of-service congestion-notification-profile fcoe-cnp input ieee-802.1 code-point 011 pfc set class-of-service interfaces ae0 congestion-notification-profile fcoe-cnp set class-of-service interfaces ae1 congestion-notification-profile fcoe-cnp set vlans fcoe_vlan vlan-id 100 set protocols igmp-snooping vlan fcoe_vlan disable set interfaces xe-0/0/10 ether-options 802.3ad ae0 set interfaces xe-0/0/11 ether-options 802.3ad ae0 set interfaces xe-0/0/20 ether-options 802.3ad ae1 set interfaces xe-0/0/21 ether-options 802.3ad ae1 set interfaces ae0 unit 0 family ethernet-switching port-mode trunk vlan members fcoe_vlan set interfaces ae1 unit 0 family ethernet-switching port-mode trunk vlan members fcoe_vlan
276
set interfaces ae0 mtu 2180 set interfaces ae1 mtu 2180 set ethernet-switching-options secure-access-port interface ae0 fcoe-trusted set ethernet-switching-options secure-access-port interface ae1 fcoe-trusted
To quickly configure CoS for lossless FCoE transport across an MC-LAG, copy the following commands, paste them in a text file, remove line breaks, change variables and details to match your network configuration, and then copy and paste the commands into the CLI for Transit Switch TS1 and Transit Switch TS2 at the [edit] hierarchy level. The configurations on Switches TS1 and TS2 are identical because the CoS configuration must be identical, and because this example uses the same ports on both switches.
Switch TS1 and Switch TS2
set class-of-service schedulers fcoe-sched priority low transmit-rate 3g set class-of-service schedulers fcoe-sched shaping-rate percent 100 set class-of-service scheduler-maps fcoe-map forwarding-class fcoe scheduler fcoe-sched set class-of-service forwarding-class-sets fcoe-pg class fcoe set class-of-service traffic-control-profiles fcoe-tcp scheduler-map fcoe-map guaranteed-rate 3g set class-of-service traffic-control-profiles fcoe-tcp shaping-rate percent 100 set class-of-service interfaces ae1 forwarding-class-set fcoe-pg output-traffic-control-profile fcoe-tcp set class-of-service interfaces xe-0/0/30 forwarding-class-set fcoe-pg output-traffic-control-profile fcoe-tcp set class-of-service interfaces xe-0/0/31 forwarding-class-set fcoe-pg output-traffic-control-profile fcoe-tcp set class-of-service interfaces xe-0/0/32 forwarding-class-set fcoe-pg output-traffic-control-profile fcoe-tcp set class-of-service interfaces xe-0/0/33 forwarding-class-set fcoe-pg output-traffic-control-profile fcoe-tcp set class-of-service congestion-notification-profile fcoe-cnp input ieee-802.1 code-point 011 pfc set class-of-service interfaces ae1 congestion-notification-profile fcoe-cnp set class-of-service interfaces xe-0/0/30 congestion-notification-profile fcoe-cnp set class-of-service interfaces xe-0/0/31 congestion-notification-profile fcoe-cnp set class-of-service interfaces xe-0/0/32 congestion-notification-profile fcoe-cnp set class-of-service interfaces xe-0/0/33 congestion-notification-profile fcoe-cnp set vlans fcoe_vlan vlan-id 100 set protocols igmp-snooping vlan fcoe_vlan disable set interfaces xe-0/0/25 ether-options 802.3ad ae1 set interfaces xe-0/0/26 ether-options 802.3ad ae1 set interfaces ae1 unit 0 family ethernet-switching port-mode trunk vlan members fcoe_vlan set interfaces xe-0/0/30 unit 0 family ethernet-switching port-mode tagged-access vlan members fcoe_vlan set interfaces xe-0/0/31 unit 0 family ethernet-switching port-mode tagged-access vlan members fcoe_vlan
277
set interfaces xe-0/0/32 unit 0 family ethernet-switching port-mode tagged-access vlan members fcoe_vlan set interfaces xe-0/0/33 unit 0 family ethernet-switching port-mode tagged-access vlan members fcoe_vlan set interfaces ae1 mtu 2180 set interfaces xe-0/0/30 mtu 2180 set interfaces xe-0/0/31 mtu 2180 set interfaces xe-0/0/32 mtu 2180 set interfaces xe-0/0/33 mtu 2180 set ethernet-switching-options secure-access-port interface ae1 fcoe-trusted set ethernet-switching-options secure-access-port vlan fcoe_vlan examine-fip examine-vn2v2 beacon-period 90000
Configuring MC-LAG Switches S1 and S2
Step-by-Step Procedure
To configure CoS resource scheduling (ETS), PFC, the FCoE VLAN, and the LAG and MC-LAG interface membership and characteristics to support lossless FCoE transport across an MC-LAG (this example uses the default fcoe forwarding class and the default classifier to map incoming FCoE traffic to the FCoE IEEE 802.1p code point 011, so you do not configure them): 1. Configure output scheduling for the FCoE queue.
[edit class-of-service schedulers fcoe-sched] user@switch# set priority low transmit-rate 3g user@switch# set shaping-rate percent 100
2. Map the FCoE forwarding class to the FCoE scheduler (fcoe-sched).
[edit class-of-service] user@switch# set scheduler-maps fcoe-map forwarding-class fcoe scheduler fcoe-sched
3. Configure the forwarding class set (fcoe-pg) for the FCoE traffic.
[edit class-of-service] user@switch# set forwarding-class-sets fcoe-pg class fcoe
278
4. Define the traffic control profile (fcoe-tcp) to use on the FCoE forwarding class set.
[edit class-of-service traffic-control-profiles fcoe-tcp] user@switch# set scheduler-map fcoe-map guaranteed-rate 3g user@switch# set shaping-rate percent 100
5. Apply the FCoE forwarding class set and traffic control profile to the LAG and MC-LAG interfaces.
[edit class-of-service] user@switch# set interfaces ae0 forwarding-class-set fcoe-pg output-traffic-control-profile fcoe-tcp user@switch# set interfaces ae1 forwarding-class-set fcoe-pg output-traffic-control-profile fcoe-tcp
6. Enable PFC on the FCoE priority by creating a congestion notification profile (fcoe-cnp) that applies FCoE to the IEEE 802.1 code point 011.
[edit class-of-service] user@switch# set congestion-notification-profile fcoe-cnp input ieee-802.1 code-point 011 pfc
7. Apply the PFC configuration to the LAG and MC-LAG interfaces.
[edit class-of-service] user@switch# set interfaces ae0 congestion-notification-profile fcoe-cnp user@switch# set interfaces ae1 congestion-notification-profile fcoe-cnp
8. Configure the VLAN for FCoE traffic (fcoe_vlan).
[edit vlans] user@switch# set fcoe_vlan vlan-id 100
9. Disable IGMP snooping on the FCoE VLAN.
[edit protocols] user@switch# set igmp-snooping vlan fcoe_vlan disable
279
10. Add the member interfaces to the LAG between the two MC-LAG switches.
[edit interfaces] user@switch# set xe-0/0/10 ether-options 802.3ad ae0 user@switch# set xe-0/0/11 ether-options 802.3ad ae0
11. Add the member interfaces to the MC-LAG.
[edit interfaces] user@switch# set xe-0/0/20 ether-options 802.3ad ae1 user@switch# set xe-0/0/21 ether-options 802.3ad ae1
12. Configure the port mode as trunk and membership in the FCoE VLAN (fcoe_vlan)for the LAG (ae0) and for the MC-LAG (ae1).
[edit interfaces] user@switch# set ae0 unit 0 family ethernet-switching port-mode trunk vlan members fcoe_vlan user@switch# set ae1 unit 0 family ethernet-switching port-mode trunk vlan members fcoe_vlan
13. Set the MTU to 2180 for the LAG and MC-LAG interfaces. 2180 bytes is the minimum size required to handle FCoE packets because of the payload and header sizes. You can configure the MTU to a higher number of bytes if desired, but not less than 2180 bytes.
[edit interfaces] user@switch# set ae0 mtu 2180 user@switch# set ae1 mtu 2180
14. Set the LAG and MC-LAG interfaces as FCoE trusted ports.
280
Ports that connect to other switches should be trusted and should not perform FIP snooping.
[edit ethernet-switching-options secure-access-port interface] user@switch# set ae0 fcoe-trusted user@switch# set ae1 fcoe-trusted
Configuring FCoE Transit Switches TS1 and TS2
Step-by-Step Procedure The CoS configuration on FCoE Transit Switches TS1 and TS2 is similar to the CoS configuration on MCLAG Switches S1 and S2. However, the port configurations differ, and you must enable FIP snooping on the Switch TS1 and Switch TS2 FCoE access ports. To configure resource scheduling (ETS), PFC, the FCoE VLAN, and the LAG interface membership and characteristics to support lossless FCoE transport across the MC-LAG (this example uses the default fcoe forwarding class and the default classifier to map incoming FCoE traffic to the FCoE IEEE 802.1p code point 011, so you do not configure them): 1. Configure output scheduling for the FCoE queue.
[edit class-of-service schedulers fcoe-sched] user@switch# set priority low transmit-rate 3g user@switch# set shaping-rate percent 100
2. Map the FCoE forwarding class to the FCoE scheduler (fcoe-sched).
[edit class-of-service] user@switch# set scheduler-maps fcoe-map forwarding-class fcoe scheduler fcoe-sched
3. Configure the forwarding class set (fcoe-pg) for the FCoE traffic.
[edit class-of-service] user@switch# set forwarding-class-sets fcoe-pg class fcoe
281
4. Define the traffic control profile (fcoe-tcp) to use on the FCoE forwarding class set.
[edit class-of-service] user@switch# set traffic-control-profiles fcoe-tcp scheduler-map fcoe-map guaranteed-rate 3g user@switch# set traffic-control-profiles fcoe-tcp shaping-rate percent 100
5. Apply the FCoE forwarding class set and traffic control profile to the LAG interface and to the FCoE access interfaces.
[edit class-of-service] user@switch# set interfaces ae1 forwarding-class-set fcoe-pg output-traffic-control-profile fcoe-tcp user@switch# set interfaces xe-0/0/30 forwarding-class-set fcoe-pg output-traffic-control-profile fcoe-tcp user@switch# set interfaces xe-0/0/31 forwarding-class-set fcoe-pg output-traffic-control-profile fcoe-tcp user@switch# set interfaces xe-0/0/32 forwarding-class-set fcoe-pg output-traffic-control-profile fcoe-tcp user@switch# set interfaces xe-0/0/33 forwarding-class-set fcoe-pg output-traffic-control-profile fcoe-tcp
6. Enable PFC on the FCoE priority by creating a congestion notification profile (fcoe-cnp) that applies FCoE to the IEEE 802.1 code point 011.
[edit class-of-service] user@switch# set congestion-notification-profile fcoe-cnp input ieee-802.1 code-point 011 pfc
7. Apply the PFC configuration to the LAG interface and to the FCoE access interfaces.
[edit class-of-service] user@switch# set interfaces ae1 congestion-notification-profile fcoe-cnp user@switch# set interfaces xe-0/0/30 congestion-notification-profile fcoe-cnp user@switch# set interfaces xe-0/0/31 congestion-notification-profile fcoe-cnp user@switch# set interfaces xe-0/0/32 congestion-notification-profile fcoe-cnp user@switch# set interfaces xe-0/0/33 congestion-notification-profile fcoe-cnp
282
8. Configure the VLAN for FCoE traffic (fcoe_vlan).
[edit vlans] user@switch# set fcoe_vlan vlan-id 100
9. Disable IGMP snooping on the FCoE VLAN.
[edit protocols] user@switch# set igmp-snooping vlan fcoe_vlan disable
10. Add the member interfaces to the LAG.
[edit interfaces] user@switch# set xe-0/0/25 ether-options 802.3ad ae1 user@switch# set xe-0/0/26 ether-options 802.3ad ae1
11. On the LAG (ae1), configure the port mode as trunk and membership in the FCoE VLAN (fcoe_vlan).
[edit interfaces] user@switch# set ae1 unit 0 family ethernet-switching port-mode trunk vlan members fcoe_vlan
12. On the FCoE access interfaces (xe-0/0/30, xe-0/0/31, xe-0/0/32, xe-0/0/33), configure the port mode as tagged-access and membership in the FCoE VLAN (fcoe_vlan).
[edit interfaces] user@switch# set xe-0/0/30 unit 0 family ethernet-switching port-mode tagged-access vlan members fcoe_vlan user@switch# set xe-0/0/31 unit 0 family ethernet-switching port-mode tagged-access vlan members fcoe_vlan user@switch# set xe-0/0/32 unit 0 family ethernet-switching port-mode tagged-access vlan members fcoe_vlan user@switch# set xe-0/0/33 unit 0 family ethernet-switching port-mode tagged-access vlan members fcoe_vlan
283
13. Set the MTU to 2180 for the LAG and FCoE access interfaces. 2180 bytes is the minimum size required to handle FCoE packets because of the payload and header sizes; you can configure the MTU to a higher number of bytes if desired, but not less than 2180 bytes.
[edit interfaces] user@switch# set ae1 mtu 2180 user@switch# set xe-0/0/30 mtu 2180 user@switch# set xe-0/0/31 mtu 2180 user@switch# set xe-0/0/32 mtu 2180 user@switch# set xe-0/0/33 mtu 2180
14. Set the LAG interface as an FCoE trusted port. Ports that connect to other switches should be trusted and should not perform FIP snooping:
[edit ethernet-switching-options] user@switch# set secure-access-port interface ae1 fcoe-trusted
NOTE: Access ports xe-0/0/30, xe-0/0/31, xe-0/0/32, and xe-0/0/33 are not configured as FCoE trusted ports. The access ports remain in the default state as untrusted ports because they connect directly to FCoE devices and must perform FIP snooping to ensure network security.
15. Enable FIP snooping on the FCoE VLAN to prevent unauthorized FCoE network access (this example uses VN2VN_Port FIP snooping; the example is equally valid if you use VN2VF_Port FIP snooping).
[edit ethernet-switching-options] user@switch# set secure-access-port vlan fcoe_vlan examine-fip examine-vn2vn beacon-period 90000
284
Results
Display the results of the CoS configuration on MC-LAG Switch S1 and on MC-LAG Switch S2 (the results on both switches are the same).
user@switch> show configuration class-of-service traffic-control-profiles {
fcoe-tcp { scheduler-map fcoe-map; shaping-rate percent 100; guaranteed-rate 3g;
} } forwarding-class-sets {
fcoe-pg { class fcoe;
} } congestion-notification-profile {
fcoe-cnp { input { ieee-802.1 { code-point 011 { pfc; } } }
} } interfaces {
ae0 { forwarding-class-set { fcoe-pg { output-traffic-control-profile fcoe-tcp; } } congestion-notification-profile fcoe-cnp;
} ae1 {
forwarding-class-set { fcoe-pg { output-traffic-control-profile fcoe-tcp;
285
} } congestion-notification-profile fcoe-cnp; } } scheduler-maps { fcoe-map { forwarding-class fcoe scheduler fcoe-sched; } } schedulers { fcoe-sched { transmit-rate 3g; shaping-rate percent 100; priority low; } }
NOTE: The forwarding class and classifier configurations are not shown because the show command does not display default portions of the configuration.
Display the results of the CoS configuration on FCoE Transit Switch TS1 and on FCoE Transit Switch TS2 (the results on both transit switches are the same).
user@switch> show configuration class-of-service traffic-control-profiles {
fcoe-tcp { scheduler-map fcoe-map; shaping-rate percent 100; guaranteed-rate 3g;
} } forwarding-class-sets {
fcoe-pg { class fcoe;
} } congestion-notification-profile {
fcoe-cnp { input {
286
ieee-802.1 { code-point 011 { pfc; }
} } } } interfaces { xe-0/0/30 { forwarding-class-set {
fcoe-pg { output-traffic-control-profile fcoe-tcp;
} } congestion-notification-profile fcoe-cnp; } xe-0/0/31 { forwarding-class-set {
fcoe-pg { output-traffic-control-profile fcoe-tcp;
} } congestion-notification-profile fcoe-cnp; } xe-0/0/32 { forwarding-class-set {
fcoe-pg { output-traffic-control-profile fcoe-tcp;
} } congestion-notification-profile fcoe-cnp; } xe-0/0/33 { forwarding-class-set {
fcoe-pg { output-traffic-control-profile fcoe-tcp;
} } congestion-notification-profile fcoe-cnp; } ae1 { forwarding-class-set {
287
fcoe-pg { output-traffic-control-profile fcoe-tcp;
} } congestion-notification-profile fcoe-cnp; } } scheduler-maps { fcoe-map { forwarding-class fcoe scheduler fcoe-sched; } } schedulers { fcoe-sched { transmit-rate 3g; shaping-rate percent 100; priority low; } }
Verification
IN THIS SECTION
Verifying That the Output Queue Schedulers Have Been Created | 288 Verifying That the Priority Group Output Scheduler (Traffic Control Profile) Has Been Created | 289 Verifying That the Forwarding Class Set (Priority Group) Has Been Created | 290 Verifying That Priority-Based Flow Control Has Been Enabled | 290 Verifying That the Interface Class of Service Configuration Has Been Created | 292 Verifying That the Interfaces Are Correctly Configured | 294 Verifying That FIP Snooping Is Enabled on the FCoE VLAN on FCoE Transit Switches TS1 and TS2 Access Interfaces | 298 Verifying That the FIP Snooping Mode Is Correct on FCoE Transit Switches TS1 and TS2 | 299 Verifying That IGMP Snooping Is Disabled on the FCoE VLAN | 299
288
To verify that the CoS components and FIP snooping have been configured and are operating properly, perform these tasks. Because this example uses the default fcoe forwarding class and the default IEEE 802.1p trusted classifier, the verification of those configurations is not shown.
Verifying That the Output Queue Schedulers Have Been Created
Purpose
Verify that the output queue scheduler for FCoE traffic has the correct bandwidth parameters and priorities, and is mapped to the correct forwarding class (output queue). Queue scheduler verification is the same on each of the four switches.
Action
List the scheduler map using the operational mode command show class-of-service scheduler-map fcoe-map:
user@switch> show class-of-service scheduler-map fcoe-map Scheduler map: fcoe-map, Index: 9023
Scheduler: fcoe-sched, Forwarding class: fcoe, Index: 37289
Transmit rate: 3000000000 bps, Rate Limit: none, Buffer size: remainder,
Buffer Limit: none, Priority: low
Excess Priority: unspecified
Shaping rate: 100 percent,
drop-profile-map-set-type: mark
Drop profiles:
Loss priority Protocol Index Name
Low
any
1 <default-drop-profile>
Medium high
any
1 <default-drop-profile>
High
any
1 <default-drop-profile>
Meaning
The show class-of-service scheduler-map fcoe-map command lists the properties of the scheduler map fcoe-map. The command output includes: � The name of the scheduler map (fcoe-map) � The name of the scheduler (fcoe-sched) � The forwarding classes mapped to the scheduler (fcoe)
289
� The minimum guaranteed queue bandwidth (transmit rate 3000000000 bps) � The scheduling priority (low) � The maximum bandwidth in the priority group the queue can consume (shaping rate 100 percent) � The drop profile loss priority for each drop profile name. This example does not include drop profiles
because you do not apply drop profiles to FCoE traffic.
Verifying That the Priority Group Output Scheduler (Traffic Control Profile) Has Been Created
Purpose
Verify that the traffic control profile fcoe-tcp has been created with the correct bandwidth parameters and scheduler mapping. Priority group scheduler verification is the same on each of the four switches.
Action
List the FCoE traffic control profile properties using the operational mode command show class-ofservice traffic-control-profile fcoe-tcp:
user@switch> show class-of-service traffic-control-profile fcoe-tcp Traffic control profile: fcoe-tcp, Index: 18303
Shaping rate: 100 percent Scheduler map: fcoe-map Guaranteed rate: 3000000000
Meaning
The show class-of-service traffic-control-profile fcoe-tcp command lists all of the configured traffic control profiles. For each traffic control profile, the command output includes: � The name of the traffic control profile (fcoe-tcp) � The maximum port bandwidth the priority group can consume (shaping rate 100 percent) � The scheduler map associated with the traffic control profile (fcoe-map) � The minimum guaranteed priority group port bandwidth (guaranteed rate 3000000000 in bps)
290
Verifying That the Forwarding Class Set (Priority Group) Has Been Created
Purpose
Verify that the FCoE priority group has been created and that the fcoe priority (forwarding class) belongs to the FCoE priority group. Forwarding class set verification is the same on each of the four switches.
Action
List the forwarding class sets using the operational mode command show class-of-service forwardingclass-set fcoe-pg:
user@switch> show class-of-service forwarding-class-set fcoe-pg
Forwarding class set: fcoe-pg, Type: normal-type, Forwarding class set index:
31420
Forwarding class
Index
fcoe
1
Meaning
The show class-of-service forwarding-class-set fcoe-pg command lists all of the forwarding classes (priorities) that belong to the fcoe-pg priority group, and the internal index number of the priority group. The command output shows that the forwarding class set fcoe-pg includes the forwarding class fcoe.
Verifying That Priority-Based Flow Control Has Been Enabled
Purpose
Verify that PFC is enabled on the FCoE code point. PFC verification is the same on each of the four switches.
Action
List the FCoE congestion notification profile using the operational mode command show class-ofservice congestion-notification fcoe-cnp:
user@switch> show class-of-service congestion-notification fcoe-cnp
Type: Input, Name: fcoe-cnp, Index: 6879
Cable Length: 100 m
Priority
PFC
MRU
291
000 001 010 011 100 101 110 111 Type: Output Priority 000
001
010
011
100
101
110
111
Disabled Disabled Disabled Enabled Disabled Disabled Disabled Disabled
2500
Flow-Control-Queues
0
1
2
3
4
5
6
7
Meaning
The show class-of-service congestion-notification fcoe-cnp command lists all of the IEEE 802.1p code points in the congestion notification profile that have PFC enabled. The command output shows that PFC is enabled on code point 011 (fcoe queue) for the fcoe-cnp congestion notification profile.
The command also shows the default cable length (100 meters), the default maximum receive unit (2500 bytes), and the default mapping of priorities to output queues because this example does not include configuring these options.
292
Verifying That the Interface Class of Service Configuration Has Been Created
Purpose
Verify that the CoS properties of the interfaces are correct. The verification output on MC-LAG Switches S1 and S2 differs from the output on FCoE Transit Switches TS1 and TS2.
Action
List the interface CoS configuration on MC-LAG Switches S1 and S2 using the operational mode command show configuration class-of-service interfaces:
user@switch> show configuration class-of-service interfaces ae0 {
forwarding-class-set { fcoe-pg { output-traffic-control-profile fcoe-tcp; }
} congestion-notification-profile fcoe-cnp; }
ae1 { forwarding-class-set { fcoe-pg { output-traffic-control-profile fcoe-tcp; } } congestion-notification-profile fcoe-cnp;
}
List the interface CoS configuration on FCoE Transit Switches TS1 and TS2 using the operational mode command show configuration class-of-service interfaces:
user@switch> show configuration class-of-service interfaces xe-0/0/30 {
forwarding-class-set { fcoe-pg { output-traffic-control-profile fcoe-tcp; }
293
} congestion-notification-profile fcoe-cnp; } xe-0/0/31 { forwarding-class-set {
fcoe-pg { output-traffic-control-profile fcoe-tcp;
} } congestion-notification-profile fcoe-cnp; } xe-0/0/32 { forwarding-class-set {
fcoe-pg { output-traffic-control-profile fcoe-tcp;
} } congestion-notification-profile fcoe-cnp; } xe-0/0/33 { forwarding-class-set {
fcoe-pg { output-traffic-control-profile fcoe-tcp;
} } congestion-notification-profile fcoe-cnp; } ae1 { forwarding-class-set {
fcoe-pg { output-traffic-control-profile fcoe-tcp;
} } congestion-notification-profile fcoe-cnp; }
Meaning
The show configuration class-of-service interfaces command lists the class of service configuration for all interfaces. For each interface, the command output includes:
294
� The name of the interface (for example, ae0 or xe-0/0/30)
� The name of the forwarding class set associated with the interface (fcoe-pg)
� The name of the traffic control profile associated with the interface (output traffic control profile, fcoe-tcp)
� The name of the congestion notification profile associated with the interface (fcoe-cnp)
NOTE: Interfaces that are members of a LAG are not shown individually. The LAG or MC-LAG CoS configuration is applied to all interfaces that are members of the LAG or MC-LAG. For example, the interface CoS configuration output on MC-LAG Switches S1 and S2 shows the LAG CoS configuration but does not show the CoS configuration of the member interfaces separately. The interface CoS configuration output on FCoE Transit Switches TS1 and TS2 shows the LAG CoS configuration but also shows the configuration for interfaces xe-0/0/30, xe-0/0/31, xe-0/0/32, and xe-0/0/33, which are not members of a LAG.
Verifying That the Interfaces Are Correctly Configured
Purpose
Verify that the LAG membership, MTU, VLAN membership, and port mode of the interfaces are correct. The verification output on MC-LAG Switches S1 and S2 differs from the output on FCoE Transit Switches TS1 and TS2.
Action
List the interface configuration on MC-LAG Switches S1 and S2 using the operational mode command show configuration interfaces:
user@switch> show configuration interfaces xe-0/0/10 {
ether-options { 802.3ad ae0;
} } xe-0/0/11 {
ether-options { 802.3ad ae0;
} }
295
xe-0/0/20 { ether-options { 802.3ad ae1; }
} xe-0/0/21 {
ether-options { 802.3ad ae1;
} } ae0 {
mtu 2180; unit 0 {
family ethernet-switching { port-mode trunk; vlan { members fcoe_vlan; }
} } } ae1 { mtu 2180; unit 0 {
family ethernet-switching { port-mode trunk; vlan { members fcoe_vlan; }
} } }
List the interface configuration on FCoE Transit Switches TS1 and TS2 using the operational mode command show configuration interfaces:
user@switch> show configuration interfaces xe-0/0/25 {
ether-options { 802.3ad ae1;
}
296
} xe-0/0/26 {
ether-options { 802.3ad ae1;
} } xe-0/0/30 {
mtu 2180; unit 0 {
family ethernet-switching { port-mode tagged-access; vlan { members fcoe_vlan; }
} } } xe-0/0/31 { mtu 2180; unit 0 {
family ethernet-switching { port-mode tagged-access; vlan { members fcoe_vlan; }
} } } xe-0/0/32 { mtu 2180; unit 0 {
family ethernet-switching { port-mode tagged-access; vlan { members fcoe_vlan; }
} } } xe-0/0/33 { mtu 2180; unit 0 {
family ethernet-switching {
297
port-mode tagged-access; vlan {
members fcoe_vlan; } } } }
ae1 { mtu 2180; unit 0 { family ethernet-switching { port-mode trunk; vlan { members fcoe_vlan; } } }
}
Meaning
The show configuration interfaces command lists the configuration of each interface by interface name.
For each interface that is a member of a LAG, the command lists only the name of the LAG to which the interface belongs.
For each LAG interface and for each interface that is not a member of a LAG, the command output includes:
� The MTU (2180)
� The unit number of the interface (0)
� The port mode (trunk mode for interfaces that connect two switches, tagged-access mode for interfaces that connect to FCoE hosts)
� The name of the VLAN in which the interface is a member (fcoe_vlan)
298
Verifying That FIP Snooping Is Enabled on the FCoE VLAN on FCoE Transit Switches TS1 and TS2 Access Interfaces
Purpose
Verify that FIP snooping is enabled on the FCoE VLAN access interfaces. FIP snooping is enabled only on the FCoE access interfaces, so it is enabled only on FCoE Transit Switches TS1 and TS2. FIP snooping is not enabled on MC-LAG Switches S1 and S2 because FIP snooping is done at the Transit Switch TS1 and TS2 FCoE access ports.
Action
List the port security configuration on FCoE Transit Switches TS1 and TS2 using the operational mode command show configuration ethernet-switching-options secure-access-port:
user@switch> show configuration ethernet-switching-options secure-access-port interface ae1.0 {
fcoe-trusted; } vlan fcoe_vlan {
examine-fip { examine-vn2vn { beacon-period 90000; }
} }
Meaning
The show configuration ethernet-switching-options secure-access-port command lists port security information, including whether a port is trusted. The command output shows that:
� LAG port ae1.0, which connects the FCoE transit switch to the MC-LAG switches, is configured as an FCoE trusted interface. FIP snooping is not performed on the member interfaces of the LAG (xe-0/0/25 and xe-0/0/26).
� FIP snooping is enabled (examine-fip) on the FCoE VLAN (fcoe_vlan), the type of FIP snooping is VN2VN_Port FIP snooping (examine-vn2vn), and the beacon period is set to 90000 milliseconds. On Transit Switches TS1 and TS2, all interface members of the FCoE VLAN perform FIP snooping unless the interface is configured as FCoE trusted. On Transit Switches TS1 and TS2, interfaces xe-0/0/30, xe-0/0/31, xe-0/0/32, and xe-0/0/33 perform FIP snooping because they are not configured as
299
FCoE trusted. The interface members of LAG ae1 (xe-0/0/25 and xe-0/0/26) do not perform FIP snooping because the LAG is configured as FCoE trusted.
Verifying That the FIP Snooping Mode Is Correct on FCoE Transit Switches TS1 and TS2
Purpose Verify that the FIP snooping mode is correct on the FCoE VLAN. FIP snooping is enabled only on the FCoE access interfaces, so it is enabled only on FCoE Transit Switches TS1 and TS2. FIP snooping is not enabled on MC-LAG Switches S1 and S2 because FIP snooping is done at the Transit Switch TS1 and TS2 FCoE access ports.
Action List the FIP snooping configuration on FCoE Transit Switches TS1 and TS2 using the operational mode command show fip snooping brief:
user@switch> show fip snooping brief VLAN: fcoe_vlan, Mode: VN2VN Snooping
FC-MAP: 0e:fd:00 ...
NOTE: The output has been truncated to show only the relevant information.
Meaning The show fip snooping brief command lists FIP snooping information, including the FIP snooping VLAN and the FIP snooping mode. The command output shows that: � The VLAN on which FIP snooping is enabled is fcoe_vlan � The FIP snooping mode is VN2VN_Port FIP snooping (VN2VN Snooping)
Verifying That IGMP Snooping Is Disabled on the FCoE VLAN
Purpose Verify that IGMP snooping is disabled on the FCoE VLAN on all four switches.
300
Action List the IGMP snooping protocol information on each of the four switches using the show configuration protocols igmp-snooping command:
user@switch> show configuration protocols igmp-snooping vlan fcoe_vlan {
disable; }
Meaning The show configuration protocols igmp-snooping command lists the IGMP snooping configuration for the VLANs configured on the switch. The command output shows that IGMP snooping is disabled on the FCoE VLAN (fcoe_vlan).
SEE ALSO Example: Configuring CoS PFC for FCoE Traffic
Example: EVPN-MPLS Interworking With an MC-LAG Topology
IN THIS SECTION Requirements | 301 Overview and Topology | 301 PE1 and PE2 Configuration | 304 PE3 Configuration | 321
This example shows how to use Ethernet VPN (EVPN) to extend a multichassis link aggregation (MCLAG) network over an MPLS network to a data center network or geographically distributed campus network.
301
EVPN-MPLS interworking is supported with an MC-LAG topology in which two MX Series routers, two EX9200 switches, or a mix of the two Juniper Networks devices function as MC-LAG peers, which use the Inter-Chassis Control Protocol (ICCP) and an interchassis link (ICL) to connect and maintain the topology. The MC-LAG peers are connected to a provider edge (PE) device in an MPLS network. The PE device can be either an MX Series router or an EX9200 switch. This example shows how to configure the MC-LAG peers and PE device in the MPLS network to interwork with each other.
Requirements
This example uses the following hardware and software components: � Three EX9200 switches:
� PE1 and PE2, which both function as MC-LAG peers in the MC-LAG topology and EVPN BGP peers in the EVPN-MPLS overlay network.
� PE3, which functions as an EVPN BGP peer in the EVPN-MPLS overlay network. � The EX9200 switches are running Junos OS Release 17.4R1 or later software.
NOTE: Although the MC-LAG topology includes two customer edge (CE) devices, this example focuses on the configuration of the PE1, PE2, and PE3.
Overview and Topology
Figure 12 on page 302 shows an MC-LAG topology with provider edge devices PE1 and PE2 that are configured as MC-LAG peers. The MC-LAG peers exchange control information over an ICCP link and
302 data traffic over an ICL. In this example, the ICL is an aggregated Ethernet interface that is comprised of two interfaces. Figure 12: EVPN-MPLS Interworking With an MC-LAG Topology
The topology in Figure 12 on page 302 also includes CE devices CE1 and CE2, which are both multihomed to each PE device. The links between CE1 and the two PE devices are bundled as an aggregated Ethernet interface on which MC-LAG in active-active mode is configured. The topology in Figure 12 on page 302 also includes PE3 at the edge of an MPLS network. PE3 functions as the gateway between the MC-LAG network and either a data center or a geographically distributed campus network. PE1, PE2, and PE3 run EVPN, which enables hosts in the MC-LAG network to communicate with hosts in the data center or other campus network by way of an intervening MPLS network. From the perspective of the EVPN-MPLS interworking feature, PE3 functions solely as an EVPN BGP peer, and PE1 and PE2 in the MC-LAG topology have dual roles:
303
� MC-LAG peers in the MC-LAG network.
� EVPN BGP peers in the EVPN-MPLS network.
Because of the dual roles, PE1 and PE2 are configured with MC-LAG, EVPN, BGP, and MPLS attributes. Table 8 on page 303 outlines key MC-LAG and EVPN (BGP and MPLS) attributes configured on PE1, PE2, and PE3. Table 8: Key MC-LAG and EVPN (BGP and MPLS) Attributes Configured on PE1, PE2, and PE3
Key Attributes
PE1
PE2
PE3
MC-LAG Attributes
Interfaces
ICL: aggregated Ethernet interface ae1, which is comprised of xe-2/1/1 and xe-2/1/2
ICL: aggregated Ethernet interface ae1, which is comprised of xe-2/1/1 and xe-2/1/2
Not applicable
ICCP: xe-2/1/0
ICCP: xe-2/1/0
EVPN-MPLS
Interfaces
Connection to PE3: xe-2/0/0
Connection to PE2: xe-2/0/2
Connection to PE3: xe-2/0/2
Connection to PE1: xe-2/0/0
Connection to PE1: xe-2/0/2
Connection to PE2: xe-2/0/3
IP addresses
BGP peer address: 198.51.100.1
BGP peer address: 198.51.100.2
BGP peer address: 198.51.100.3
Autonomous system
65000
65000
65000
Virtual switch routing instances
evpn1, evpn2, evpn3
evpn1, evpn2, evpn3
evpn1, evpn2, evpn3
Note the following about the EVPN-MPLS interworking feature and its configuration:
304
� You must configure Ethernet segment identifiers (ESIs) on the dual-homed interfaces in the MC-LAG topology. The ESIs enable EVPN to identify the dual-homed interfaces.
� The only type of routing instance that is supported is the virtual switch instance (set routinginstances name instance-type virtual-switch).
� On the MC-LAG peers, you must include the bgp-peer configuration statement in the [edit routinginstances name protocols evpn mclag] hierarchy level. This configuration statement enables the interworking of EVPN-MPLS with MC-LAG on the MC-LAG peers.
� Address Resolution Protocol (ARP) suppression is not supported.
PE1 and PE2 Configuration
IN THIS SECTION CLI Quick Configuration | 304 PE1: Configuring MC-LAG | 310 PE1: Configuring EVPN-MPLS | 313 PE2: Configuring MC-LAG | 316 PE2: Configuring EVPN-MPLS | 318
To configure PE1 and PE2, perform these tasks:
CLI Quick Configuration
PE1: MC-LAG Configuration
set chassis aggregated-devices ethernet device-count 3 set interfaces xe-2/0/1 gigether-options 802.3ad ae0 set interfaces ae0 flexible-vlan-tagging set interfaces ae0 encapsulation flexible-ethernet-services set interfaces ae0 aggregated-ether-options lacp active set interfaces ae0 aggregated-ether-options lacp periodic fast set interfaces ae0 aggregated-ether-options lacp system-id 00:00:11:11:11:11 set interfaces ae0 aggregated-ether-options lacp admin-key 1 set interfaces ae0 aggregated-ether-options mc-ae mc-ae-id 1 set interfaces ae0 aggregated-ether-options mc-ae redundancy-group 2
305
set interfaces ae0 aggregated-ether-options mc-ae chassis-id 0 set interfaces ae0 aggregated-ether-options mc-ae mode active-active set interfaces ae0 aggregated-ether-options mc-ae status-control active set interfaces ae0 unit 1 esi 00:11:22:33:44:55:66:77:88:99 set interfaces ae0 unit 1 esi all-active set interfaces ae0 unit 1 family ethernet-switching interface-mode trunk set interfaces ae0 unit 1 family ethernet-switching vlan members 1 set interfaces ae0 unit 2 esi 00:11:11:11:11:11:11:11:11:11 set interfaces ae0 unit 2 esi all-active set interfaces ae0 unit 2 family ethernet-switching interface-mode trunk set interfaces ae0 unit 2 family ethernet-switching vlan members 2 set interfaces ae0 unit 3 esi 00:11:22:22:22:22:22:22:22:22 set interfaces ae0 unit 3 esi all-active set interfaces ae0 unit 3 family ethernet-switching interface-mode trunk set interfaces ae0 unit 3 family ethernet-switching vlan members 3 set interfaces xe-2/0/6 enable set interfaces xe-2/0/6 flexible-vlan-tagging set interfaces xe-2/0/6 encapsulation flexible-ethernet-services set interfaces xe-2/0/6 unit 1 family ethernet-switching interface-mode trunk set interfaces xe-2/0/6 unit 1 family ethernet-switching vlan members 1 set interfaces xe-2/0/6 unit 2 family ethernet-switching interface-mode trunk set interfaces xe-2/0/6 unit 2 family ethernet-switching vlan members 2 set interfaces xe-2/0/6 unit 3 family ethernet-switching interface-mode trunk set interfaces xe-2/0/6 unit 3 family ethernet-switching vlan members 3 set interfaces xe-2/1/0 unit 0 family inet address 203.0.113.1/24 set interfaces xe-2/1/1 gigether-options 802.3ad ae1 set interfaces xe-2/1/2 gigether-options 802.3ad ae1 set interfaces ae1 flexible-vlan-tagging set interfaces ae1 encapsulation flexible-ethernet-services set interfaces ae1 aggregated-ether-options lacp active set interfaces ae1 unit 1 family ethernet-switching interface-mode trunk set interfaces ae1 unit 1 family ethernet-switching vlan members 1 set interfaces ae1 unit 2 family ethernet-switching interface-mode trunk set interfaces ae1 unit 2 family ethernet-switching vlan members 2 set interfaces ae1 unit 3 family ethernet-switching interface-mode trunk set interfaces ae1 unit 3 family ethernet-switching vlan members 3 set multi-chassis multi-chassis-protection 203.0.113.2 interface ae1 set protocols iccp local-ip-addr 203.0.113.1 set protocols iccp peer 203.0.113.2 session-establishment-hold-time 600 set protocols iccp peer 203.0.113.2 redundancy-group-id-list 2
306
set protocols iccp peer 203.0.113.2 liveness-detection minimum-interval 10000 set protocols iccp peer 203.0.113.2 liveness-detection multiplier 3
PE1: EVPN-MPLS Configuration
set interfaces lo0 unit 0 family inet address 198.51.100.1/32 primary set interfaces xe-2/0/0 unit 0 family inet address 192.0.2.2/24 set interfaces xe-2/0/0 unit 0 family mpls set interfaces xe-2/0/2 unit 0 family inet address 192.0.2.111/24 set interfaces xe-2/0/2 unit 0 family mpls set interfaces irb unit 1 family inet address 10.2.1.1/24 virtual-gateway-address 10.2.1.254 set interfaces irb unit 2 family inet address 10.2.2.1/24 virtual-gateway-address 10.2.2.254 set interfaces irb unit 3 family inet address 10.2.3.1/24 virtual-gateway-address 10.2.3.254 set routing-options router-id 198.51.100.1 set routing-options autonomous-system 65000 set routing-options forwarding-table export evpn-pplb set protocols mpls interface xe-2/0/0.0 set protocols mpls interface xe-2/0/2.0 set protocols bgp group evpn type internal set protocols bgp group evpn local-address 198.51.100.1 set protocols bgp group evpn family evpn signaling set protocols bgp group evpn local-as 65000 set protocols bgp group evpn neighbor 198.51.100.2 set protocols bgp group evpn neighbor 198.51.100.3 set protocols ospf area 0.0.0.0 interface lo0.0 set protocols ospf area 0.0.0.0 interface xe-2/0/0.0 set protocols ospf area 0.0.0.0 interface xe-2/0/2.0 set protocols ldp interface xe-2/0/0.0 set protocols ldp interface xe-2/0/2.0 set protocols ldp interface lo0.0 set policy-options policy-statement evpn-pplb from protocol evpn set policy-options policy-statement evpn-pplb then load-balance per-packet set routing-instances evpn1 instance-type virtual-switch set routing-instances evpn1 interface xe-2/0/6.1 set routing-instances evpn1 interface ae0.1 set routing-instances evpn1 interface ae1.1 set routing-instances evpn1 route-distinguisher 1:10 set routing-instances evpn1 vrf-target target:1:5 set routing-instances evpn1 protocols evpn extended-vlan-list 1 set routing-instances evpn1 protocols evpn mclag bgp-peer 198.51.100.2
307
set routing-instances evpn1 switch-options service-id 1 set routing-instances evpn1 vlans v1 vlan-id 1 set routing-instances evpn1 vlans v1 l3-interface irb.1 set routing-instances evpn1 vlans v1 no-arp-suppression set routing-instances evpn2 instance-type virtual-switch set routing-instances evpn2 interface xe-2/0/6.2 set routing-instances evpn2 interface ae0.2 set routing-instances evpn2 interface ae1.2 set routing-instances evpn2 route-distinguisher 1:20 set routing-instances evpn2 vrf-target target:1:6 set routing-instances evpn2 protocols evpn extended-vlan-list 2 set routing-instances evpn2 protocols evpn mclag bgp-peer 198.51.100.2 set routing-instances evpn2 switch-options service-id 2 set routing-instances evpn2 vlans v1 vlan-id 2 set routing-instances evpn2 vlans v1 l3-interface irb.2 set routing-instances evpn2 vlans v1 no-arp-suppression set routing-instances evpn3 instance-type virtual-switch set routing-instances evpn3 interface xe-2/0/6.3 set routing-instances evpn3 interface ae0.3 set routing-instances evpn3 interface ae1.3 set routing-instances evpn3 route-distinguisher 1:30 set routing-instances evpn3 vrf-target target:1:7 set routing-instances evpn3 protocols evpn extended-vlan-list 3 set routing-instances evpn3 protocols evpn mclag bgp-peer 198.51.100.2 set routing-instances evpn3 switch-options service-id 3 set routing-instances evpn3 vlans v1 vlan-id 3 set routing-instances evpn3 vlans v1 l3-interface irb.3 set routing-instances evpn3 vlans v1 no-arp-suppression
PE2: MC-LAG Configuration
set chassis aggregated-devices ethernet device-count 3 set interfaces xe-2/0/1 gigether-options 802.3ad ae0 set interfaces xe-2/0/6 enable set interfaces xe-2/0/6 flexible-vlan-tagging set interfaces xe-2/0/6 encapsulation flexible-ethernet-services set interfaces xe-2/0/6 unit 1 family ethernet-switching interface-mode trunk set interfaces xe-2/0/6 unit 1 family ethernet-switching vlan members 1 set interfaces xe-2/0/6 unit 2 family ethernet-switching interface-mode trunk set interfaces xe-2/0/6 unit 2 family ethernet-switching vlan members 2
308
set interfaces xe-2/0/6 unit 3 family ethernet-switching interface-mode trunk set interfaces xe-2/0/6 unit 3 family ethernet-switching vlan members 3 set interfaces xe-2/1/0 unit 0 family inet address 203.0.113.2/24 set interfaces xe-2/1/1 gigether-options 802.3ad ae1 set interfaces xe-2/1/2 gigether-options 802.3ad ae1 set interfaces ae0 flexible-vlan-tagging set interfaces ae0 encapsulation flexible-ethernet-services set interfaces ae0 aggregated-ether-options lacp active set interfaces ae0 aggregated-ether-options lacp periodic fast set interfaces ae0 aggregated-ether-options lacp system-id 00:00:11:11:11:11 set interfaces ae0 aggregated-ether-options lacp admin-key 1 set interfaces ae0 aggregated-ether-options mc-ae mc-ae-id 1 set interfaces ae0 aggregated-ether-options mc-ae redundancy-group 2 set interfaces ae0 aggregated-ether-options mc-ae chassis-id 1 set interfaces ae0 aggregated-ether-options mc-ae mode active-active set interfaces ae0 aggregated-ether-options mc-ae status-control standby set interfaces ae0 unit 1 esi 00:11:22:33:44:55:66:77:88:99 set interfaces ae0 unit 1 esi all-active set interfaces ae0 unit 1 family ethernet-switching interface-mode trunk set interfaces ae0 unit 1 family ethernet-switching vlan members 1 set interfaces ae0 unit 2 esi 00:11:11:11:11:11:11:11:11:11 set interfaces ae0 unit 2 esi all-active set interfaces ae0 unit 2 family ethernet-switching interface-mode trunk set interfaces ae0 unit 2 family ethernet-switching vlan members 2 set interfaces ae0 unit 3 esi 00:11:22:22:22:22:22:22:22:22 set interfaces ae0 unit 3 esi all-active set interfaces ae0 unit 3 family ethernet-switching interface-mode trunk set interfaces ae0 unit 3 family ethernet-switching vlan members 3 set interfaces ae1 flexible-vlan-tagging set interfaces ae1 encapsulation flexible-ethernet-services set interfaces ae1 aggregated-ether-options lacp active set interfaces ae1 unit 1 family ethernet-switching interface-mode trunk set interfaces ae1 unit 1 family ethernet-switching vlan members 1 set interfaces ae1 unit 2 family ethernet-switching interface-mode trunk set interfaces ae1 unit 2 family ethernet-switching vlan members 2 set interfaces ae1 unit 3 family ethernet-switching interface-mode trunk set interfaces ae1 unit 3 family ethernet-switching vlan members 3 set multi-chassis multi-chassis-protection 203.0.113.1 interface ae1 set protocols iccp local-ip-addr 203.0.113.2 set protocols iccp peer 203.0.113.1 session-establishment-hold-time 600
309
set protocols iccp peer 203.0.113.1 redundancy-group-id-list 2 set protocols iccp peer 203.0.113.1 liveness-detection minimum-interval 10000 set protocols iccp peer 203.0.113.1 liveness-detection multiplier 3
PE2: EVPN-MPLS Configuration
set interfaces xe-2/0/0 unit 0 family inet address 192.0.2.222/24 set interfaces xe-2/0/0 unit 0 family mpls set interfaces xe-2/0/2 unit 0 family inet address 192.0.2.22/24 set interfaces xe-2/0/2 unit 0 family mpls set interfaces lo0 unit 0 family inet address 198.51.100.2/32 primary set interfaces irb unit 1 family inet address 10.2.1.2/24 virtual-gateway-address 10.2.1.254 set interfaces irb unit 2 family inet address 10.2.2.2/24 virtual-gateway-address 10.2.2.254 set interfaces irb unit 3 family inet address 10.2.3.2/24 virtual-gateway-address 10.2.3.254 set routing-options router-id 198.51.100.2 set routing-options autonomous-system 65000 set routing-options forwarding-table export evpn-pplb set protocols mpls interface xe-2/0/2.0 set protocols mpls interface xe-2/0/0.0 set protocols bgp group evpn type internal set protocols bgp group evpn local-address 198.51.100.2 set protocols bgp group evpn family evpn signaling set protocols bgp group evpn local-as 65000 set protocols bgp group evpn neighbor 198.51.100.1 set protocols bgp group evpn neighbor 198.51.100.3 set protocols ospf area 0.0.0.0 interface lo0.0 set protocols ospf area 0.0.0.0 interface xe-2/0/0.0 set protocols ospf area 0.0.0.0 interface xe-2/0/2.0 set protocols ldp interface xe-2/0/0.0 set protocols ldp interface xe-2/0/2.0 set protocols ldp interface lo0.0 set policy-options policy-statement evpn-pplb from protocol evpn set policy-options policy-statement evpn-pplb then load-balance per-packet set routing-instances evpn1 instance-type virtual-switch set routing-instances evpn1 interface xe-2/0/6.1 set routing-instances evpn1 interface ae0.1 set routing-instances evpn1 interface ae1.1 set routing-instances evpn1 route-distinguisher 1:11 set routing-instances evpn1 vrf-target target:1:5 set routing-instances evpn1 protocols evpn extended-vlan-list 1
310
set routing-instances evpn1 protocols evpn mclag bgp-peer 198.51.100.1 set routing-instances evpn1 switch-options service-id 1 set routing-instances evpn1 vlans v1 vlan-id 1 set routing-instances evpn1 vlans v1 l3-interface irb.1 set routing-instances evpn1 vlans v1 no-arp-suppression set routing-instances evpn2 instance-type virtual-switch set routing-instances evpn2 interface xe-2/0/6.2 set routing-instances evpn2 interface ae0.2 set routing-instances evpn2 interface ae1.2 set routing-instances evpn2 route-distinguisher 1:21 set routing-instances evpn2 vrf-target target:1:6 set routing-instances evpn2 protocols evpn extended-vlan-list 2 set routing-instances evpn2 protocols evpn mclag bgp-peer 198.51.100.1 set routing-instances evpn2 switch-options service-id 2 set routing-instances evpn2 vlans v1 vlan-id 2 set routing-instances evpn2 vlans v1 l3-interface irb.2 set routing-instances evpn2 vlans v1 no-arp-suppression set routing-instances evpn3 instance-type virtual-switch set routing-instances evpn3 interface xe-2/0/6.3 set routing-instances evpn3 interface ae0.3 set routing-instances evpn3 interface ae1.3 set routing-instances evpn3 route-distinguisher 1:31 set routing-instances evpn3 vrf-target target:1:7 set routing-instances evpn3 protocols evpn extended-vlan-list 3 set routing-instances evpn3 protocols evpn mclag bgp-peer 198.51.100.1 set routing-instances evpn3 switch-options service-id 3 set routing-instances evpn3 vlans v1 vlan-id 3 set routing-instances evpn3 vlans v1 l3-interface irb.3 set routing-instances evpn3 vlans v1 no-arp-suppression
PE1: Configuring MC-LAG
Step-by-Step Procedure
1. Set the number of aggregated Ethernet interfaces on PE1.
[edit] user@switch# set chassis aggregated-devices ethernet device-count 3
311
2. Configure aggregated Ethernet interface ae0 on interface xe-2/0/1, and configure LACP and MCLAG on ae0. Divide aggregated Ethernet interface ae0 into three logical interfaces (ae0.1, ae0.2, and ae0.3). For each logical interface, specify an ESI, place the logical interface is in MC-LAG activeactive mode, and map the logical interface to a VLAN.
[edit] user@switch# set interfaces xe-2/0/1 gigether-options 802.3ad ae0 user@switch# set interfaces ae0 flexible-vlan-tagging user@switch# set interfaces ae0 encapsulation flexible-ethernet-services user@switch# set interfaces ae0 aggregated-ether-options lacp active user@switch# set interfaces ae0 aggregated-ether-options lacp periodic fast user@switch# set interfaces ae0 aggregated-ether-options lacp system-id 00:00:11:11:11:11 user@switch# set interfaces ae0 aggregated-ether-options lacp admin-key 1 user@switch# set interfaces ae0 aggregated-ether-options mc-ae mc-ae-id 1 user@switch# set interfaces ae0 aggregated-ether-options mc-ae redundancy-group 2 user@switch# set interfaces ae0 aggregated-ether-options mc-ae chassis-id 0 user@switch# set interfaces ae0 aggregated-ether-options mc-ae mode active-active user@switch# set interfaces ae0 aggregated-ether-options mc-ae status-control active user@switch# set interfaces ae0 unit 1 esi 00:11:22:33:44:55:66:77:88:99 user@switch# set interfaces ae0 unit 1 esi all-active user@switch# set interfaces ae0 unit 1 family ethernet-switching interface-mode trunk user@switch# set interfaces ae0 unit 1 family ethernet-switching vlan members 1 user@switch# set interfaces ae0 unit 2 esi 00:11:11:11:11:11:11:11:11:11 user@switch# set interfaces ae0 unit 2 esi all-active user@switch# set interfaces ae0 unit 2 family ethernet-switching interface-mode trunk user@switch# set interfaces ae0 unit 2 family ethernet-switching vlan members 2 user@switch# set interfaces ae0 unit 3 esi 00:11:22:22:22:22:22:22:22:22 user@switch# set interfaces ae0 unit 3 esi all-active user@switch# set interfaces ae0 unit 3 family ethernet-switching interface-mode trunk user@switch# set interfaces ae0 unit 3 family ethernet-switching vlan members 3
3. Configure physical interface xe-2/0/6, and divide it into three logical interfaces (xe-2/0/6.1, xe-2/0/6.2, and xe-2/0/6.3). Map each logical interface to a VLAN.
[edit] user@switch# set interfaces xe-2/0/6 enable user@switch# set interfaces xe-2/0/6 flexible-vlan-tagging user@switch# set interfaces xe-2/0/6 encapsulation flexible-ethernet-services user@switch# set interfaces xe-2/0/6 unit 1 family ethernet-switching interface-mode trunk
312
user@switch# set interfaces xe-2/0/6 unit 1 family ethernet-switching vlan members 1 user@switch# set interfaces xe-2/0/6 unit 2 family ethernet-switching interface-mode trunk user@switch# set interfaces xe-2/0/6 unit 2 family ethernet-switching vlan members 2 user@switch# set interfaces xe-2/0/6 unit 3 family ethernet-switching interface-mode trunk user@switch# set interfaces xe-2/0/6 unit 3 family ethernet-switching vlan members 3
4. Configure physical interface xe-2/1/0 as a Layer 3 interface, on which you configure ICCP. Specify the interface with the IP address of 203.0.113.2 on PE2 as the ICCP peer to PE1.
[edit] user@switch# set interfaces xe-2/1/0 unit 0 family inet address 203.0.113.1/24 user@switch# set protocols iccp local-ip-addr 203.0.113.1 user@switch# set protocols iccp peer 203.0.113.2 session-establishment-hold-time 600 user@switch# set protocols iccp peer 203.0.113.2 redundancy-group-id-list 2 user@switch# set protocols iccp peer 203.0.113.2 liveness-detection minimum-interval 10000 user@switch# set protocols iccp peer 203.0.113.2 liveness-detection multiplier 3
5. Configure aggregated Ethernet interface ae1 on interfaces xe-2/1/1 and xe-2/1/2, and configure LACP on ae1. Divide aggregated Ethernet interface ae1 into three logical interfaces (ae1.1, ae1.2, and ae1.3), and map each logical interface to a VLAN. Specify ae1 as the multichassis protection link between PE1 and PE2.
[edit] user@switch# set interfaces xe-2/1/1 gigether-options 802.3ad ae1 user@switch# set interfaces xe-2/1/2 gigether-options 802.3ad ae1 user@switch# set interfaces ae1 flexible-vlan-tagging user@switch# set interfaces ae1 encapsulation flexible-ethernet-services user@switch# set interfaces ae1 aggregated-ether-options lacp active user@switch# set interfaces ae1 unit 1 family ethernet-switching interface-mode trunk user@switch# set interfaces ae1 unit 1 family ethernet-switching vlan members 1 user@switch# set interfaces ae1 unit 2 family ethernet-switching interface-mode trunk user@switch# set interfaces ae1 unit 2 family ethernet-switching vlan members 2 user@switch# set interfaces ae1 unit 3 family ethernet-switching interface-mode trunk user@switch# set interfaces ae1 unit 3 family ethernet-switching vlan members 3 user@switch# set multi-chassis multi-chassis-protection 203.0.113.2 interface ae1
313
PE1: Configuring EVPN-MPLS
Step-by-Step Procedure
1. Configure the loopback interface, and the interfaces connected to the other PE devices.
[edit] user@switch# set interfaces lo0 unit 0 family inet address 198.51.100.1/32 primary user@switch# set interfaces xe-2/0/0 unit 0 family inet address 192.0.2.2/24 user@switch# set interfaces xe-2/0/0 unit 0 family mpls user@switch# set interfaces xe-2/0/2 unit 0 family inet address 192.0.2.111/24 user@switch# set interfaces xe-2/0/2 unit 0 family mpls
2. Configure IRB interfaces irb.1, irb.2, and irb.3.
[edit] user@switch# set interfaces irb unit 1 family inet address 10.2.1.1/24 virtual-gateway-address 10.2.1.254 user@switch# set interfaces irb unit 2 family inet address 10.2.2.1/24 virtual-gateway-address 10.2.2.254 user@switch# set interfaces irb unit 3 family inet address 10.2.3.1/24 virtual-gateway-address 10.2.3.254
3. Assign a router ID and the autonomous system in which PE1, PE2, and PE3 reside.
[edit] user@switch# set routing-options router-id 198.51.100.1 user@switch# set routing-options autonomous-system 65000
4. Enable per-packet load-balancing for EVPN routes when EVPN multihoming active-active mode is used.
[edit] user@switch# set routing-options forwarding-table export evpn-pplb user@switch# set policy-options policy-statement evpn-pplb from protocol evpn user@switch# set policy-options policy-statement evpn-pplb then load-balance per-packet
314
5. Enable MPLS on interfaces xe-2/0/0.0 and xe-2/0/2.0.
[edit] user@switch# set protocols mpls interface xe-2/0/0.0 user@switch# set protocols mpls interface xe-2/0/2.0
6. Configure an IBGP overlay that includes PE1, PE2, and PE3.
[edit] user@switch# set protocols bgp group evpn type internal user@switch# set protocols bgp group evpn local-address 198.51.100.1 user@switch# set protocols bgp group evpn family evpn signaling user@switch# set protocols bgp group evpn local-as 65000 user@switch# set protocols bgp group evpn neighbor 198.51.100.2 user@switch# set protocols bgp group evpn neighbor 198.51.100.3
7. Configure OSPF as the internal routing protocol for EVPN by specifying an area ID and interfaces on which EVPN-MPLS is enabled.
[edit] user@switch# set protocols ospf area 0.0.0.0 interface lo0.0 user@switch# set protocols ospf area 0.0.0.0 interface xe-2/0/0.0 user@switch# set protocols ospf area 0.0.0.0 interface xe-2/0/2.0
8. Configure the Label Distribution Protocol (LDP) on the loopback interface and the interfaces on which EVPN-MPLS is enabled.
[edit] user@switch# set protocols ldp interface lo0.0 user@switch# set protocols ldp interface xe-2/0/0.0 user@switch# set protocols ldp interface xe-2/0/2.0
9. Configure virtual switch routing instances for VLAN v1, which is assigned VLAN IDs of 1, 2, and 3, and include the interfaces and other entities associated with the VLAN.
[edit] user@switch# set routing-instances evpn1 instance-type virtual-switch
315
user@switch# set routing-instances evpn1 interface xe-2/0/6.1 user@switch# set routing-instances evpn1 interface ae0.1 user@switch# set routing-instances evpn1 interface ae1.1 user@switch# set routing-instances evpn1 route-distinguisher 1:10 user@switch# set routing-instances evpn1 vrf-target target:1:5 user@switch# set routing-instances evpn1 protocols evpn extended-vlan-list 1 user@switch# set routing-instances evpn1 protocols evpn mclag bgp-peer 198.51.100.2 user@switch# set routing-instances evpn1 switch-options service-id 1 user@switch# set routing-instances evpn1 vlans v1 vlan-id 1 user@switch# set routing-instances evpn1 vlans v1 l3-interface irb.1 user@switch# set routing-instances evpn1 vlans v1 no-arp-suppression user@switch# set routing-instances evpn2 instance-type virtual-switch user@switch# set routing-instances evpn2 interface xe-2/0/6.2 user@switch# set routing-instances evpn2 interface ae0.2 user@switch# set routing-instances evpn2 interface ae1.2 user@switch# set routing-instances evpn2 route-distinguisher 1:20 user@switch# set routing-instances evpn2 vrf-target target:1:6 user@switch# set routing-instances evpn2 protocols evpn extended-vlan-list 2 user@switch# set routing-instances evpn2 protocols evpn mclag bgp-peer 198.51.100.2 user@switch# set routing-instances evpn2 switch-options service-id 2 user@switch# set routing-instances evpn2 vlans v1 vlan-id 2 user@switch# set routing-instances evpn2 vlans v1 l3-interface irb.2 user@switch# set routing-instances evpn2 vlans v1 no-arp-suppression user@switch# set routing-instances evpn3 instance-type virtual-switch user@switch# set routing-instances evpn3 interface xe-2/0/6.3 user@switch# set routing-instances evpn3 interface ae0.3 user@switch# set routing-instances evpn3 interface ae1.3 user@switch# set routing-instances evpn3 route-distinguisher 1:30 user@switch# set routing-instances evpn3 vrf-target target:1:7 user@switch# set routing-instances evpn3 protocols evpn extended-vlan-list 3 user@switch# set routing-instances evpn3 protocols evpn mclag bgp-peer 198.51.100.2 user@switch# set routing-instances evpn3 switch-options service-id 3 user@switch# set routing-instances evpn3 vlans v1 vlan-id 3 user@switch# set routing-instances evpn3 vlans v1 l3-interface irb.3 user@switch# set routing-instances evpn3 vlans v1 no-arp-suppression
316
PE2: Configuring MC-LAG
Step-by-Step Procedure
1. Set the number of aggregated Ethernet interfaces on PE2.
[edit] user@switch# set chassis aggregated-devices ethernet device-count 3
2. Configure aggregated Ethernet interface ae0 on interface xe-2/0/1, and configure LACP and MCLAG on ae0. Divide aggregated Ethernet interface ae0 into three logical interfaces (ae0.1, ae0.2, and ae0.3). For each logical interface, specify an ESI, place the logical interface is in MC-LAG activeactive mode, and map the logical interface to a VLAN.
[edit] user@switch# set interfaces xe-2/0/1 gigether-options 802.3ad ae0 user@switch# set interfaces ae0 flexible-vlan-tagging user@switch# set interfaces ae0 encapsulation flexible-ethernet-services user@switch# set interfaces ae0 aggregated-ether-options lacp active user@switch# set interfaces ae0 aggregated-ether-options lacp periodic fast user@switch# set interfaces ae0 aggregated-ether-options lacp system-id 00:00:11:11:11:11 user@switch# set interfaces ae0 aggregated-ether-options lacp admin-key 1 user@switch# set interfaces ae0 aggregated-ether-options mc-ae mc-ae-id 1 user@switch# set interfaces ae0 aggregated-ether-options mc-ae redundancy-group 2 user@switch# set interfaces ae0 aggregated-ether-options mc-ae chassis-id 1 user@switch# set interfaces ae0 aggregated-ether-options mc-ae mode active-active user@switch# set interfaces ae0 aggregated-ether-options mc-ae status-control standby user@switch# set interfaces ae0 unit 1 esi 00:11:22:33:44:55:66:77:88:99 user@switch# set interfaces ae0 unit 1 esi all-active user@switch# set interfaces ae0 unit 1 family ethernet-switching interface-mode trunk user@switch# set interfaces ae0 unit 1 family ethernet-switching vlan members 1 user@switch# set interfaces ae0 unit 2 esi 00:11:11:11:11:11:11:11:11:11 user@switch# set interfaces ae0 unit 2 esi all-active user@switch# set interfaces ae0 unit 2 family ethernet-switching interface-mode trunk user@switch# set interfaces ae0 unit 2 family ethernet-switching vlan members 2 user@switch# set interfaces ae0 unit 3 esi 00:11:22:22:22:22:22:22:22:22 user@switch# set interfaces ae0 unit 3 esi all-active user@switch# set interfaces ae0 unit 3 family ethernet-switching interface-mode trunk user@switch# set interfaces ae0 unit 3 family ethernet-switching vlan members 3
317
3. Configure physical interface xe-2/0/6, and divide it into three logical interfaces (xe-2/0/6.1, xe-2/0/6.2, and xe-2/0/6.3). Map each logical interface to a VLAN.
[edit] set interfaces xe-2/0/6 enable set interfaces xe-2/0/6 flexible-vlan-tagging set interfaces xe-2/0/6 encapsulation flexible-ethernet-services set interfaces xe-2/0/6 unit 1 family ethernet-switching interface-mode trunk set interfaces xe-2/0/6 unit 1 family ethernet-switching vlan members 1 set interfaces xe-2/0/6 unit 2 family ethernet-switching interface-mode trunk set interfaces xe-2/0/6 unit 2 family ethernet-switching vlan members 2 set interfaces xe-2/0/6 unit 3 family ethernet-switching interface-mode trunk set interfaces xe-2/0/6 unit 3 family ethernet-switching vlan members 3
4. Configure physical interface xe-2/1/0 as a Layer 3 interface, on which you configure ICCP. Specify the interface with the IP address of 203.0.113.1 on PE1 as the ICCP peer to PE2.
[edit] set interfaces xe-2/1/0 unit 0 family inet address 203.0.113.2/24 set protocols iccp local-ip-addr 203.0.113.2 set protocols iccp peer 203.0.113.1 session-establishment-hold-time 600 set protocols iccp peer 203.0.113.1 redundancy-group-id-list 2 set protocols iccp peer 203.0.113.1 liveness-detection minimum-interval 10000 set protocols iccp peer 203.0.113.1 liveness-detection multiplier 3
5. Configure aggregated Ethernet interface ae1 on interfaces xe-2/1/1 and xe-2/1/2, and configure LACP on ae1. Divide aggregated Ethernet interface ae1 into three logical interfaces (ae1.1, ae1.2, and ae1.3), and map each logical interface to a VLAN. Specify ae1 as the multichassis protection link between PE1 and PE2.
[edit] set interfaces xe-2/1/1 gigether-options 802.3ad ae1 set interfaces xe-2/1/2 gigether-options 802.3ad ae1 set interfaces ae1 flexible-vlan-tagging set interfaces ae1 encapsulation flexible-ethernet-services set interfaces ae1 aggregated-ether-options lacp active set interfaces ae1 unit 1 family ethernet-switching interface-mode trunk set interfaces ae1 unit 1 family ethernet-switching vlan members 1 set interfaces ae1 unit 2 family ethernet-switching interface-mode trunk
318
set interfaces ae1 unit 2 family ethernet-switching vlan members 2 set interfaces ae1 unit 3 family ethernet-switching interface-mode trunk set interfaces ae1 unit 3 family ethernet-switching vlan members 3 set multi-chassis multi-chassis-protection 203.0.113.1 interface ae1
PE2: Configuring EVPN-MPLS
Step-by-Step Procedure
1. Configure the loopback interface, and the interfaces connected to the other PE devices.
[edit] user@switch# set interfaces lo0 unit 0 family inet address 198.51.100.2/32 primary user@switch# set interfaces xe-2/0/0 unit 0 family inet address 192.0.2.222/24 user@switch# set interfaces xe-2/0/0 unit 0 family mpls user@switch# set interfaces xe-2/0/2 unit 0 family inet address 192.0.2.22/24 user@switch# set interfaces xe-2/0/2 unit 0 family mpls
2. Configure IRB interfaces irb.1, irb.2, and irb.3.
[edit] user@switch# set interfaces irb unit 1 family inet address 10.2.1.2/24 virtual-gateway-address 10.2.1.254 user@switch# set interfaces irb unit 2 family inet address 10.2.2.2/24 virtual-gateway-address 10.2.2.254 user@switch# set interfaces irb unit 3 family inet address 10.2.3.2/24 virtual-gateway-address 10.2.3.254
3. Assign a router ID and the autonomous system in which PE1, PE2, and PE3 reside.
[edit] user@switch# set routing-options router-id 198.51.100.2 user@switch# set routing-options autonomous-system 65000
319
4. Enable per-packet load-balancing for EVPN routes when EVPN multihoming active-active mode is used.
[edit] user@switch# set routing-options forwarding-table export evpn-pplb user@switch# set policy-options policy-statement evpn-pplb from protocol evpn user@switch# set policy-options policy-statement evpn-pplb then load-balance per-packet
5. Enable MPLS on interfaces xe-2/0/0.0 and xe-2/0/2.0.
[edit] user@switch# set protocols mpls interface xe-2/0/0.0 user@switch# set protocols mpls interface xe-2/0/2.0
6. Configure an IBGP overlay that includes PE1, PE2, and PE3.
[edit] user@switch# set protocols bgp group evpn type internal user@switch# set protocols bgp group evpn local-address 198.51.100.2 user@switch# set protocols bgp group evpn family evpn signaling user@switch# set protocols bgp group evpn local-as 65000 user@switch# set protocols bgp group evpn neighbor 198.51.100.1 user@switch# set protocols bgp group evpn neighbor 198.51.100.3
7. Configure OSPF as the internal routing protocol for EVPN by specifying an area ID and interfaces on which EVPN-MPLS is enabled.
[edit] user@switch# set protocols ospf area 0.0.0.0 interface lo0.0 user@switch# set protocols ospf area 0.0.0.0 interface xe-2/0/0.0 user@switch# set protocols ospf area 0.0.0.0 interface xe-2/0/2.0
8. Configure the Label Distribution Protocol (LDP) on the loopback interface and the interfaces on which EVPN-MPLS is enabled.
[edit] user@switch# set protocols ldp interface lo0.0
320
user@switch# set protocols ldp interface xe-2/0/0.0 user@switch# set protocols ldp interface xe-2/0/2.0
9. Configure virtual switch routing instances for VLAN v1, which is assigned VLAN IDs of 1, 2, and 3, and include the interfaces and other entities associated with the VLAN.
[edit] user@switch# set routing-instances evpn1 instance-type virtual-switch user@switch# set routing-instances evpn1 interface xe-2/0/6.1 user@switch# set routing-instances evpn1 interface ae0.1 user@switch# set routing-instances evpn1 interface ae1.1 user@switch# set routing-instances evpn1 route-distinguisher 1:11 user@switch# set routing-instances evpn1 vrf-target target:1:5 user@switch# set routing-instances evpn1 protocols evpn extended-vlan-list 1 user@switch# set routing-instances evpn1 protocols evpn mclag bgp-peer 198.51.100.1 user@switch# set routing-instances evpn1 switch-options service-id 1 user@switch# set routing-instances evpn1 vlans v1 vlan-id 1 user@switch# set routing-instances evpn1 vlans v1 l3-interface irb.1 user@switch# set routing-instances evpn1 vlans v1 no-arp-suppression user@switch# set routing-instances evpn2 instance-type virtual-switch user@switch# set routing-instances evpn2 interface xe-2/0/6.2 user@switch# set routing-instances evpn2 interface ae0.2 user@switch# set routing-instances evpn2 interface ae1.2 user@switch# set routing-instances evpn2 route-distinguisher 1:21 user@switch# set routing-instances evpn2 vrf-target target:1:6 user@switch# set routing-instances evpn2 protocols evpn extended-vlan-list 2 user@switch# set routing-instances evpn2 protocols evpn mclag bgp-peer 198.51.100.1 user@switch# set routing-instances evpn2 switch-options service-id 2 user@switch# set routing-instances evpn2 vlans v1 vlan-id 2 user@switch# set routing-instances evpn2 vlans v1 l3-interface irb.2 user@switch# set routing-instances evpn2 vlans v1 no-arp-suppression user@switch# set routing-instances evpn3 instance-type virtual-switch user@switch# set routing-instances evpn3 interface xe-2/0/6.3 user@switch# set routing-instances evpn3 interface ae0.3 user@switch# set routing-instances evpn3 interface ae1.3 user@switch# set routing-instances evpn3 route-distinguisher 1:31 user@switch# set routing-instances evpn3 vrf-target target:1:7 user@switch# set routing-instances evpn3 protocols evpn extended-vlan-list 3 user@switch# set routing-instances evpn3 protocols evpn mclag bgp-peer 198.51.100.1 user@switch# set routing-instances evpn3 switch-options service-id 3
321
user@switch# set routing-instances evpn3 vlans v1 vlan-id 3 user@switch# set routing-instances evpn3 vlans v1 l3-interface irb.3 user@switch# set routing-instances evpn3 vlans v1 no-arp-suppression
PE3 Configuration
IN THIS SECTION CLI Quick Configuration | 321 PE3: Configuring EVPN-MPLS | 323
CLI Quick Configuration
PE3: EVPN-MPLS Configuration
set interfaces lo0 unit 0 family inet address 198.51.100.3/32 primary set interfaces xe-2/0/2 unit 0 family inet address 192.0.2.1/24 set interfaces xe-2/0/2 unit 0 family mpls set interfaces xe-2/0/3 unit 0 family inet address 192.0.2.11/24 set interfaces xe-2/0/3 unit 0 family mpls set interfaces xe-2/0/6 enable set interfaces xe-2/0/6 flexible-vlan-tagging set interfaces xe-2/0/6 encapsulation flexible-ethernet-services set interfaces xe-2/0/6 unit 1 family ethernet-switching interface-mode trunk set interfaces xe-2/0/6 unit 1 family ethernet-switching vlan members 1 set interfaces xe-2/0/6 unit 2 family ethernet-switching interface-mode trunk set interfaces xe-2/0/6 unit 2 family ethernet-switching vlan members 2 set interfaces xe-2/0/6 unit 3 family ethernet-switching interface-mode trunk set interfaces xe-2/0/6 unit 3 family ethernet-switching vlan members 3 set interfaces irb unit 1 family inet address 10.2.1.3/24 virtual-gateway-address 10.2.1.254 set interfaces irb unit 2 family inet address 10.2.2.3/24 virtual-gateway-address 10.2.2.254 set interfaces irb unit 3 family inet address 10.2.3.3/24 virtual-gateway-address 10.2.3.254 set routing-options router-id 198.51.100.3 set routing-options autonomous-system 65000 set routing-options forwarding-table export evpn-pplb set protocols mpls interface xe-2/0/2.0 set protocols mpls interface xe-2/0/3.0
322
set protocols bgp group evpn type internal set protocols bgp group evpn local-address 198.51.100.3 set protocols bgp group evpn family evpn signaling set protocols bgp group evpn local-as 65000 set protocols bgp group evpn neighbor 198.51.100.1 set protocols bgp group evpn neighbor 198.51.100.2 set protocols ospf area 0.0.0.0 interface lo0.0 set protocols ospf area 0.0.0.0 interface xe-2/0/2.0 set protocols ospf area 0.0.0.0 interface xe-2/0/3.0 set protocols ldp interface lo0.0 set protocols ldp interface xe-2/0/2.0 set protocols ldp interface xe-2/0/3.0 set policy-options policy-statement evpn-pplb from protocol evpn set policy-options policy-statement evpn-pplb then load-balance per-packet set routing-instances evpn1 instance-type virtual-switch set routing-instances evpn1 interface xe-2/0/6.1 set routing-instances evpn1 route-distinguisher 1:12 set routing-instances evpn1 vrf-target target:1:5 set routing-instances evpn1 protocols evpn extended-vlan-list 1 set routing-instances evpn1 switch-options service-id 1 set routing-instances evpn1 vlans v1 vlan-id 1 set routing-instances evpn1 vlans v1 l3-interface irb.1 set routing-instances evpn1 vlans v1 no-arp-suppression set routing-instances evpn2 instance-type virtual-switch set routing-instances evpn2 interface xe-2/0/6.2 set routing-instances evpn2 route-distinguisher 1:22 set routing-instances evpn2 vrf-target target:1:6 set routing-instances evpn2 protocols evpn extended-vlan-list 2 set routing-instances evpn2 switch-options service-id 2 set routing-instances evpn2 vlans v1 vlan-id 2 set routing-instances evpn2 vlans v1 l3-interface irb.2 set routing-instances evpn2 vlans v1 no-arp-suppression set routing-instances evpn3 instance-type virtual-switch set routing-instances evpn3 interface xe-2/0/6.3 set routing-instances evpn3 route-distinguisher 1:32 set routing-instances evpn3 vrf-target target:1:7 set routing-instances evpn3 protocols evpn extended-vlan-list 3 set routing-instances evpn3 switch-options service-id 3 set routing-instances evpn3 vlans v1 vlan-id 3
323
set routing-instances evpn3 vlans v1 l3-interface irb.3 set routing-instances evpn3 vlans v1 no-arp-suppression
PE3: Configuring EVPN-MPLS
Step-by-Step Procedure
1. Configure the loopback interface, and the interfaces connected to the other PE devices.
[edit] user@switch# set interfaces lo0 unit 0 family inet address 198.51.100.3/32 primary user@switch# set interfaces xe-2/0/2 unit 0 family inet address 192.0.2.1/24 user@switch# set interfaces xe-2/0/2 unit 0 family mpls user@switch# set interfaces xe-2/0/3 unit 0 family inet address 192.0.2.11/24 user@switch# set interfaces xe-2/0/3 unit 0 family mpls
2. Configure interface xe-2/0/6, which is connected to the host.
[edit] user@switch# set interfaces xe-2/0/6 enable user@switch# set interfaces xe-2/0/6 flexible-vlan-tagging user@switch# set interfaces xe-2/0/6 encapsulation flexible-ethernet-services user@switch# set interfaces xe-2/0/6 unit 1 family ethernet-switching interface-mode trunk user@switch# set interfaces xe-2/0/6 unit 1 family ethernet-switching vlan members 1 user@switch# set interfaces xe-2/0/6 unit 2 family ethernet-switching interface-mode trunk user@switch# set interfaces xe-2/0/6 unit 2 family ethernet-switching vlan members 2 user@switch# set interfaces xe-2/0/6 unit 3 family ethernet-switching interface-mode trunk user@switch# set interfaces xe-2/0/6 unit 3 family ethernet-switching vlan members 3
3. Configure IRB interfaces irb.1, irb.2, and irb.3.
[edit] user@switch# set interfaces irb unit 1 family inet address 10.2.1.3/24 virtual-gateway-address 10.2.1.254 user@switch# set interfaces irb unit 2 family inet address 10.2.2.3/24 virtual-gateway-address 10.2.2.254
324
user@switch# set interfaces irb unit 3 family inet address 10.2.3.3/24 virtual-gateway-address 10.2.3.254
4. Assign a router ID and the autonomous system in which PE1, PE2, and PE3 reside.
[edit] user@switch# set routing-options router-id 198.51.100.3 user@switch# set routing-options autonomous-system 65000
5. Enable per-packet load-balancing for EVPN routes when EVPN multihoming active-active mode is used.
[edit] user@switch# set routing-options forwarding-table export evpn-pplb user@switch# set policy-options policy-statement evpn-pplb from protocol evpn user@switch# set policy-options policy-statement evpn-pplb then load-balance per-packet
6. Enable MPLS on interfaces xe-2/0/2.0 and xe-2/0/3.0.
[edit] user@switch# set protocols mpls interface xe-2/0/2.0 user@switch# set protocols mpls interface xe-2/0/3.0
7. Configure an IBGP overlay that includes PE1, PE2, and PE3.
[edit] user@switch# set protocols bgp group evpn type internal user@switch# set protocols bgp group evpn local-address 198.51.100.3 user@switch# set protocols bgp group evpn family evpn signaling user@switch# set protocols bgp group evpn local-as 65000 user@switch# set protocols bgp group evpn neighbor 198.51.100.1 user@switch# set protocols bgp group evpn neighbor 198.51.100.2
325
8. Configure OSPF as the internal routing protocol for EVPN by specifying an area ID and interfaces on which EVPN-MPLS is enabled.
[edit] user@switch# set protocols ospf area 0.0.0.0 interface lo0.0 user@switch# set protocols ospf area 0.0.0.0 interface xe-2/0/2.0 user@switch# set protocols ospf area 0.0.0.0 interface xe-2/0/3.0
9. Configure the LDP on the loopback interface and the interfaces on which EVPN-MPLS is enabled.
[edit] user@switch# set protocols ldp interface lo0.0 user@switch# set protocols ldp interface xe-2/0/2.0 user@switch# set protocols ldp interface xe-2/0/3.0
10. Configure virtual switch routing instances for VLAN v1, which is assigned VLAN IDs of 1, 2, and 3, and include the interfaces and other entities associated with the VLAN.
[edit] user@switch# set routing-instances evpn1 instance-type virtual-switch user@switch# set routing-instances evpn1 interface xe-2/0/6.1 user@switch# set routing-instances evpn1 route-distinguisher 1:12 user@switch# set routing-instances evpn1 vrf-target target:1:5 user@switch# set routing-instances evpn1 protocols evpn extended-vlan-list 1 user@switch# set routing-instances evpn1 switch-options service-id 1 user@switch# set routing-instances evpn1 vlans v1 vlan-id 1 user@switch# set routing-instances evpn1 vlans v1 l3-interface irb.1 user@switch# set routing-instances evpn1 vlans v1 no-arp-suppression user@switch# set routing-instances evpn2 instance-type virtual-switch user@switch# set routing-instances evpn2 interface xe-2/0/6.2 user@switch# set routing-instances evpn2 route-distinguisher 1:22 user@switch# set routing-instances evpn2 vrf-target target:1:6 user@switch# set routing-instances evpn2 protocols evpn extended-vlan-list 2 user@switch# set routing-instances evpn2 switch-options service-id 2 user@switch# set routing-instances evpn2 vlans v1 vlan-id 2 user@switch# set routing-instances evpn2 vlans v1 l3-interface irb.2 user@switch# set routing-instances evpn2 vlans v1 no-arp-suppression user@switch# set routing-instances evpn3 instance-type virtual-switch user@switch# set routing-instances evpn3 interface xe-2/0/6.3
326
user@switch# set routing-instances evpn3 route-distinguisher 1:32 user@switch# set routing-instances evpn3 vrf-target target:1:7 user@switch# set routing-instances evpn3 protocols evpn extended-vlan-list 3 user@switch# set routing-instances evpn3 switch-options service-id 3 user@switch# set routing-instances evpn3 vlans v1 vlan-id 3 user@switch# set routing-instances evpn3 vlans v1 l3-interface irb.3 user@switch# set routing-instances evpn3 vlans v1 no-arp-suppression
SEE ALSO Understanding EVPN-MPLS Interworking with Junos Fusion Enterprise and MC-LAG | 0
3 CHAPTER
Other MC-LAG Configurations
Other MC-LAG Configurations | 328
328
Other MC-LAG Configurations
IN THIS SECTION Configuring Active-Active Bridging and VRRP over IRB in Multichassis Link Aggregation on MX Series Routers | 328 Configuring IGMP Snooping in MC-LAG Active-Active Mode | 334 Configuring Manual and Automatic Link Switchover for MC-LAG Interfaces on MX Series Routers | 335 Forcing MC-LAG Links or Interfaces with Limited LACP Capability to Be Up | 337 Increasing ARP and Network Discovery Protocol Entries for Enhanced MC-LAG and Layer 3 VXLAN Topologies | 338 Synchronizing and Committing Configurations | 348
Configuring Active-Active Bridging and VRRP over IRB in Multichassis Link Aggregation on MX Series Routers
IN THIS SECTION Configuring MC-LAG | 329 Configuring the Interchassis Link-Protection Link | 330 Configuring Multiple Chassis | 330 Configuring the Service ID | 331 Configuring IGMP Snooping for Active-Active MC-LAG | 333
The following sections describe the configuration of active-active bridging and VRRP over IRB in a multichassis link aggregation (MC-LAG) :
329
Configuring MC-LAG
An MC-LAG is composed of logical link aggregation groups (LAGs) and is configured under the [edit interfaces aeX] hierarchy, as follows:
[edit] interfaces {
ae0 { encapsulation ethernet-bridge; multi-chassis-protection { peer 10.10.10.10 { interface ge-0/0/0; } } aggregated-ether-options { mc-ae { mode active-active; # see note below } }
} }
NOTE: The mode active-active statement is valid only if encapsulation is an ethernet-bridge or extended-vlan-bridge.
Use the mode statement to specify if an MC-LAG is active-standby or active-active. If the ICCP connection is UP and ICL comes UP, the router configured as standby brings up the multichassis aggregated Ethernet interfaces shared with the peer.
Using multi-chassis-protection at the physical interface level is a way to reduce the configuration at the logical interface level.
If there are n+1 logical interfaces under ae0, from ae0.0 through ae0.n, there are n+1 logical interfaces under ge-0/0/0 as well, from ge-0/0/0.0 through ge-0/0/0.n, each ge-0/0/0 logical interface is a protection link for the ae0 logical interface.
NOTE: A bridge domain cannot have multichassis aggregated Ethernet logical interfaces that belong to different redundancy groups.
330
Configuring the Interchassis Link-Protection Link
The interchassis link-protection link (ICL-PL) provides redundancy when a link failure (for example, an MC-LAG trunk failure) occurs on one of the active links. The ICL-PL is an aggregated Ethernet interface. You can configure only one ICL-PL between the two peers, although you can configure multiple MCLAGs between them.
The ICL-PL assumes that interface ge-0/0/0.0 is used to protect interface ae0.0 of MC-LAG-1:
[edit] interfaces {
ae0 { .... unit 0 { multi-chassis-protection { peer 10.10.10.10 { interface ge-0/0/0.0; } .... } ... }
} }
The protection interface can be an Ethernet type interface such as ge or xe, or an aggregated Ethernet (ae) interface.
Configuring Multiple Chassis
A top-level hierarchy is used to specify a multichassis-related configuration, as follows:
[edit] multi-chassis {
multi-chassis-protection { peer 10.10.10.10 { interface ge-0/0/0; }
} }
331
This example specifies interface ge-0/0/0 as the multichassis protection interface for all the multichassis aggregated Ethernet interfaces which are also part of the peer. This can be overridden by specifying protection at the physical interface level and the logical interface level.
Configuring the Service ID
You must configure the same unique network-wide configuration for a service in the set of PE routers providing the service. You can configure the service IDs under the level of the hierarchies shown in the following examples:
Global Configuration (Default Logical System)
switch-options { service-id 10;
} bridge-domains {
bd0 { service-id 2;
} } routing-instances {
r1 { switch-options { service-id 10; } bridge-domains { bd0 { service-id 2; } }
} }
Logical Systems
ls1 { switch-options { service-id 10; } routing-instances { r1 { switch-options {
332
service-id 10; } } } }
NOTE: Using a service name per bridge domain is not supported.
The bridge-level service ID is required to link related bridge domains across peers, and should be configured with the same value. The service-id values share the name space across all bridging and routing instances, and across peers. Thus, duplicate values for service IDs are not permitted across these entities. The service ID at the bridge domain level is mandatory for type non-single VLAN bridge domains. The service ID is optional for bridge domains with a VLAN identifier (VID) defined. If no service ID is defined in the latter case, it is picked up from the service ID configuration for that routing instance.
NOTE: When this default routing instance (or any other routing instance) which contains a bridge domain containing a multichassis aggregated Ethernet interface is configured, you must configure a global-level switch-options service-id number, irrespective of whether the contained bridge domains have specific service IDs configured.
In the sample illustration shown in Figure 13 on page 332, network routing instances N1 and N2, both for the same service ID, are configured with same service ID in both N1 and N2. Use of a name string instead of a number is not supported.
Figure 13: N1 and N2 for the Same Service with Same Service ID
333
The following configuration restrictions apply: � The service ID must be configured when the multichassis aggregated Ethernet interface is configured
and a multichassis aggregated Ethernet logical interface is part of a bridge domain. This requirement is enforced. � A single bridge domain cannot correspond to two redundancy group IDs. In Figure 14 on page 333, it is possible to configure a bridge domain consisting of logical interfaces from two multichassis aggregated Ethernet interfaces and map them to a separate redundancy group ID, which is not supported. A service must be mapped one-to-one with the redundancy group providing the service. This requirement is enforced.
Figure 14: Bridge Domain with Logical Interfaces from Two Multichassis Aggregated Ethernet Interfaces
To display the multichassis aggregated Ethernet configuration, use the show interfaces mc-ae command. For more information, see the CLI Explorer.
Configuring IGMP Snooping for Active-Active MC-LAG
For the multicast solution to work, the following must be configured: � The multichassis protection link must be configured as a router-facing interface.
[edit bridge-domain bd-name] protocols {
igmp-snooping { interface ge-0/0/0.0 { multicast-router-interface;
334
} } }
In this example, ge-0/0/0.0 is an ICL interface. � The multichassis-lag-replicate-state statement options must be configured under the
multicast-snooping-options statement for that bridge domain.
NOTE: Snooping with active-active MC-LAG is only supported in non-proxy mode.
Configuring IGMP Snooping in MC-LAG Active-Active Mode
You can use the bridge-domain statement's service-id option to specify the multichassis aggregated Ethernet configuration on MX240 routers, MX480 routers, MX960 routers and QFX Series switches. � The service-id statement is mandatory for non-single VLAN type bridge domains (none, all, or vlan-
id-tags:dual). � The statement is optional for bridge domains with a VID defined. � The bridge-level service-id is required to link related bridge domains across peers, and should be
configured with the same value. � The service-id values share the name space across all bridging and routing instances, and across
peers. Thus, duplicate service-id values are not permitted across these entities. � A change of bridge service-id is considered catastrophic, and the bridge domain is changed. This procedure allows you to enable or disable the replication feature. To configure IGMP snooping in MC-LAG active-active mode : 1. Use the multichassis-lag-replicate-state statement at the [edit multicast-snooping-options]
hierarchy level in the master instance.
multicast-snooping-options { ... multichassis-lag-replicate-state; # REQUIRED
}
335
2. Use the interface icl-intf-name statement at the [edit protocols igmp-snooping] hierarchy level, as shown in the following example:
protocols { igmp-snooping { interface icl-intf-name { multicast-router-interface; } }
}
NOTE: For QFX use the following configuration:
protocols { igmp-snooping { vlan vlan_name{ } interface icl-intf-name { multicast-router-interface; } }
}
The interchassis link, interface icl-intf-name, of the learning domain should be a router-facing interface.
Configuring Manual and Automatic Link Switchover for MC-LAG Interfaces on MX Series Routers
In a multichassis link aggregation (MC-LAG) topology with active-standby mode, a link switchover happens only if the active node goes down. You can override this default behavior by configuring an MC-LAG interface in active-standby mode to automatically revert to a preferred node. With this configuration, you can trigger a link switchover to a preferred node even when the active node is available. For example, consider two nodes, PE1 and PE2. PE1 is configured in active mode making it a preferred node, and PE2 is configured in active-standby mode. In case of any failure at PE1, PE2 becomes the active node. However, as soon as PE1 is available again, an automatic link switchover is triggered and the control is switched back to PE1 even though PE2 is active.
336
You can configure the link switchover in two modes: revertive and nonrevertive. In revertive mode, the link switchover is triggered automatically by using the request interface mc-ae switchover operational mode command. In nonrevertive mode, the link switchover must be triggered manually by the user. You can also configure a revert time that triggers an automatic or manual switchover when the specified timer expires.
NOTE:
� If two MC-LAG devices configured in an active-standby setup using Inter-Chassis Control Protocol (ICCP) and nonrevertive switchcover mode is configured on the aggregated Ethernet interfaces of both the MC-LAGs and when both mc-ae interfaces are linked together with a Layer 2 circuit local-switching configuration, we recommend that you perform switchover by entering the request interface mc-ae switchover (immediate mcae-id mcae-id | mcae-id mcae-id) operational mode command on only one of the aggregated Ethernet interfaces of an MC-LAG device. This command can be issued only on MC-LAG devices that are configured as active nodes (by using the status-control active statement at the [edit interfaces aeX aggregated-ether-options mc-ae] hierarchy level).
� In nonrevertive switchover mode, when an MC-LAG interface transitions to the standby state because of an MC-LAG member link failure and another MC-LAG interface moves to the active state, the MC-LAG in standby state remains in that state until the MC-LAG in active state encounters a failure and returns to the active state.
� If you perform a switchover on both the aggregated Ethernet interfaces in the MC-LAG, because of Layer 2 circuit local-switching configuration, a switchover on one aggregated Ethernet interface triggers a switchover on the other aggregated Ethernet interface. In such a scenario, both the aggregated Ethernet interfaces move to the standby state and then transition back to the active state. Therefore, you must not perform switchover on both the aggregated Ethernet interfaces in an MC-LAG at the same time.
� Layer 2 circuit configuration and VPLS functionalities are not supported if you configure an MC-LAG interface to be in revertive switchover mode. You can configure the revertive or nonrevertive switchover capability only if two MC-LAG devices are configured in an activestandby setup (one device set as an active node by using the status-control standby statement and the other device set as a standby node by using the status-control active statement at the [edit interfaces aeX aggregated-ether-options mc-ae] hierarchy level. You can perform a switchover by entering the request interface mc-ae switchover (immediate mcae-id mcae-id | mcae-id mcae-id) operational mode command only on MC-LAG devices configured as active nodes.
To configure the link switchover mechanism on an MC-LAG interface:
337
1. Configure the link switchover in revertive mode.
[edit interfaces aeX aggregated-ether-options mc-ae] user@host# set switchover-mode revertive 2. (Optional) Configure the link switchover in nonrevertive mode.
[edit interfaces aeX aggregated-ether-options mc-ae] user@host# set switchover-mode non-revertive 3. Configure the revert time.
[edit interfaces aeX aggregated-ether-options mc-ae] user@host# set revert-time revert-time 4. Trigger manual switchover.
[edit request interface mc-ae] user@host# set switchover < immediate> mcae-id mcae-id
You can use the show interfaces mc-ae revertive-info command to view the switchover configuration information.
Forcing MC-LAG Links or Interfaces with Limited LACP Capability to Be Up
In an MC-LAG network, an MC-LAG client link without Link Access Control Protocol (LACP) configuration remains down and cannot be accessed by the MC-LAG switches. To ensure that the client device with limited LACP capability is up and accessible on the MC-LAG network, configure one of the aggregated Ethernet links or interfaces on a MC-LAG switch to be up by using the force-up statement at the appropriate hierarchy level on your device: � [edit interfaces interface-name aggregated-ether-options lacp] � [edit interfaces interface-name ether-options 802.3ad lacp]
338
You can configure the force-up feature on the MC-LAG switches in either active mode or standby mode. However, in order to prevent duplicate traffic and packet drops, you configure the force-up feature only on one aggregated Ethernet link of the MC-LAG switches . If multiple aggregated Ethernet links are up on the MC-LAG switches with force-up feature configured, then the device selects the link based on the LACP port ID and port priority. The port with the lowest priority is given preference. In case of two ports with the same priority, the one with the lowest port ID is given preference.
NOTE: The force-up option is not supported on QFX10002 switches.
NOTE: On the QFX5100 switch, you can configure the force-up feature in Link Aggregation Control Protocol (LACP) on the MC-LAG switches starting with Junos OS Release 14.1X53-D10.
NOTE: � If LACP comes up partially in the MC-LAG network--that is, it comes up on one of the MC-
LAG switches and does not comes up on other MC-LAG switches--the force-up feature is disabled.
Increasing ARP and Network Discovery Protocol Entries for Enhanced MC-LAG and Layer 3 VXLAN Topologies
IN THIS SECTION Understanding the Need for an Increase in ARP and Network Discovery Protocol (NDP) Entries | 339 Increasing ARP and Network Discovery Protocol Entries for Enhanced MC-LAG Using IPv4 Transport | 339 Increasing ARP and Network Discovery Protocol Entries for Enhanced MC-LAG Using IPv6 Transport | 341 Increasing ARP for EVPN-VXLAN Gateway for Border-Leaf in Edge Routed Bridge (ERB) or Spine in Centrally Routed Bridge (CRB) for IPv4 Tenant Traffic | 343 Increasing ARP and Network Discovery Protocol Entries for EVPN-VXLAN gateway for Border-Leaf in Edge Routed Bridge (ERB) or Spine in Centrally Routed Bridge (CRB) for IPv6 Tenant Traffic | 345
339
Understanding the Need for an Increase in ARP and Network Discovery Protocol (NDP) Entries
The number of ARP and NDP entries has increased to 256,000 to improve enhanced MC-LAG and Layer 3 VXLAN scenarios. Here are some enhanced MC-LAG and Layer 3 VXLAN scenarios in which an increase in ARP and NDP entries is needed: � Enhanced MC-LAG topology with a large number of MC-AE interfaces that contain a large number of
members per chassis. � Non-collapsed spine-leaf topology, in which the leaf devices operate as Layer 2 gateways and handle
traffic within the VXLAN, and the spine devices operate as Layer 3 gateways and handle traffic between the VXLANs using IRB interfaces. In this scenario, the increase in ARP and NDP entries is needed at the spine level. � Leaf devices that operate as both Layer 2 and Layer 3 gateways. In this scenario, the transit spine devices provide Layer 3 routing functioning only, and the increased number of ARP and NDP entries in needed only at the leaf level.
Increasing ARP and Network Discovery Protocol Entries for Enhanced MC-LAG Using IPv4 Transport
To increase the number of ARP and NDP entries using IPv4 transport, follow these steps. We recommend that you use the values provided in this procedure for optimal performance: 1. Enable the arp-enhanced-scale statement:
[edit system] user@switch# set arp-enhanced-scale
2. Configure the maximum number of routes to be stored in the ARP cache.
[edit system] user@switch# set arp-system-cache-limit number
For example:
[edit system] user@switch# set arp-system-cache-limit 2000000
340
3. Configure the amount of time between ARP updates.
[edit system] user@switch# set arp aging-timer minutes For example:
[edit system] user@switch# set arp aging-timer 20 4. Enable enhanced convergence on the MC-AE interface:
[edit interfaces] user@switch# set interface-name aggregated-ether-options mc-ae enhanced-convergence 5. Enable enhanced convergence on the IRB interface that you have configured as part of an MC-AE.
[edit interfaces] user@switch# set irb unit number enhanced-convergence 6. Specify the amount of time that elapses before the MAC table entries are timed out and entries are deleted from the table.
[edit protocols l2-learning] user@switch# set global-mac-table-aging-time seconds For example:
[edit protocols l2-learning] user@switch# set global-mac-table-aging-time 3600 7. Specify the amount time that elapses before the entries in the MAC-IP bindings database are timed out and deleted.
[edit protocols l2-learning] user@switch# set global-mac-ip-table-aging-timeseconds
341
For example:
[edit protocols l2-learning] user@switch# set global-mac-ip-table-aging-time 1200 8. Reboot the device in order for these changes to take effect.
user@switch# request system reboot
Increasing ARP and Network Discovery Protocol Entries for Enhanced MC-LAG Using IPv6 Transport
To increase the number of ARP and Network Discovery Protocol entries using IPv6 transport. We recommend that you use the values provided in this procedure for optimal performance: 1. Enable the arp-enhanced-scale statement:
[edit system] user@switch# set arp-enhanced-scale 2. Specify the maximum system cache size for IPv6 next-hop addresses.
[edit system] user@switch# set nd-system-cache-limitnumber For example:
[edit system] user@switch# set nd-system-cache-limit 2000000 3. Set the stale timer for IPv6 neighbor reachability confirmation.
[edit interfaces] user@switch# set irb unit 1 family inet6 nd6-stale-timeseconds
342
For example:
[edit interfaces] user@switch# set irb unit 1 family inet6 nd6-stale-time 1200 4. Enable enhanced convergence on the MC-AE interface:
[edit interfaces] user@switch# set interface-name aggregated-ether-options mc-ae enhanced-convergence 5. Enable enhanced convergence on the IRB interface that you have configured as part of an MC-AE.
[edit interfaces] user@switch# set irb unit number enhanced-convergence 6. Specify the amount of time that elapses before the MAC table entries are timed out and entries are deleted from the table.
[edit protocols l2-learning] user@switch# set global-mac-table-aging-time seconds For example:
[edit protocols l2-learning] user@switch# set global-mac-table-aging-time 3600 7. Specify the amount time that elapses before the entries in the MAC-IP bindings database are timed out and deleted.
[edit protocols l2-learning] user@switch# set global-mac-ip-table-aging-timeseconds For example:
[edit protocols l2-learning] user@switch# set global-mac-ip-table-aging-time 1200
343
8. Reboot the device in order for these changes to take effect.
user@switch# request system reboot
Increasing ARP for EVPN-VXLAN Gateway for Border-Leaf in Edge Routed Bridge (ERB) or Spine in Centrally Routed Bridge (CRB) for IPv4 Tenant Traffic
To increase the number of ARP entries using IPv4 tenant traffic, follow these steps. We recommend that you use the values provided in this procedure for optimal performance: 1. Enable the arp-enhanced-scale statement:
[edit system] user@switch# set arp-enhanced-scale 2. Configure the maximum number of routes to be stored in the ARP cache.
[edit system] user@switch# set arp-system-cache-limit number For example:
[edit system] user@switch# set arp-system-cache-limit 2000000 3. Configure the amount of time between ARP updates.
[edit system] user@switch# set arp aging-timer minutes For example:
[edit system] user@switch# set arp aging-timer 20
344
4. On QFX10002-60C devices, configure the amount of time between ARP updates.
[edit system] user@switch# set arp aging-timer minutes For example:
[edit system] user@switch# set arp aging-timer 900 5. Specify the amount of time that elapses before the MAC table entries are timed out and entries are deleted from the table.
[edit protocols l2-learning] user@switch# set global-mac-table-aging-time seconds For example:
[edit protocols l2-learning] user@switch# set global-mac-table-aging-time 3600 6. Specify the amount time that elapses before the entries in the MAC-IP bindings database are timed out and deleted.
[edit protocols l2-learning] user@switch# set global-mac-ip-table-aging-timeseconds For example:
[edit protocols l2-learning] user@switch# set global-mac-ip-table-aging-time 1200 7. On QFX10002-60C devices, specify the amount time that elapses before the entries in the MAC-IP bindings database are timed out and deleted.
[edit protocols l2-learning] user@switch# set global-mac-ip-table-aging-timeseconds
345
For example:
[edit protocols l2-learning] user@switch# set global-mac-ip-table-aging-time 900 8. For each leaf device, specify the amount of time that elapses before the MAC table entries are timed out and entries are deleted from the table.
[edit protocols l2-learning] user@switch# set global-mac-table-aging-time seconds
For example:
[edit protocols l2-learning] user@switch# set global-mac-table-aging-time 3600 9. On QFX10002-60C devices, for each leaf device, specify the amount of time that elapses before the MAC table entries are timed out and entries are deleted from the table.
[edit protocols l2-learning] user@switch# set global-mac-table-aging-time seconds
For example:
[edit protocols l2-learning] user@switch# set global-mac-table-aging-time 1200 10. Reboot the device in order for these changes to take effect.
user@switch# request system reboot
Increasing ARP and Network Discovery Protocol Entries for EVPN-VXLAN gateway for Border-Leaf in Edge Routed Bridge (ERB) or Spine in Centrally Routed Bridge (CRB) for IPv6 Tenant Traffic
To increase the number of ARP and Network Discovery Protocol entries using IPv4 and IPv6 tenant traffic, follow these steps. We recommend that you use the values provided in this procedure for optimal performance:
346
1. Enable the arp-enhanced-scale statement:
[edit system] user@switch# set arp-enhanced-scale 2. Specify the maximum system cache size for IPv6 next-hop addresses.
[edit system] user@switch# set nd-system-cache-limitnumber For example:
[edit system] user@switch# set nd-system-cache-limit 2000000 3. Set the stale timer for IPv6 neighbor reachability confirmation.
[edit interfaces] user@switch# set irb unit 1 family inet6 nd6-stale-timeseconds For example:
[edit interfaces] user@switch# set irb unit 1 family inet6 nd6-stale-time 1200 4. Specify the amount of time that elapses before the MAC table entries are timed out and entries are deleted from the table.
[edit protocols l2-learning] user@switch# set global-mac-table-aging-time seconds For example:
[edit protocols l2-learning] user@switch# set global-mac-table-aging-time 3600
347
5. Specify the amount time that elapses before the entries in the MAC-IP bindings database are timed out and deleted.
[edit protocols l2-learning] user@switch# set global-mac-ip-table-aging-timeseconds For example:
[edit protocols l2-learning] user@switch# set global-mac-ip-table-aging-time 1200 6. For each leaf device, specify the amount of time that elapses before the MAC table entries are timed out and entries are deleted from the table.
[edit protocols l2-learning] user@switch# set global-mac-table-aging-time seconds For example:
[edit protocols l2-learning] user@switch# set global-mac-table-aging-time 3600 7. For each leaf device, specify the amount of time that elapses before the MAC table entries are timed out and entries are deleted from the table.
[edit protocols l2-learning] user@switch# set global-mac-table-aging-time seconds For example:
[edit protocols l2-learning] user@switch# set global-mac-table-aging-time 1200 8. Reboot the device in order for these changes to take effect.
user@switch# request system reboot
348
Synchronizing and Committing Configurations
IN THIS SECTION Configure Devices for Configuration Synchronization | 348 Create a Global Configuration Group | 351 Create a Local Configuration Group | 354 Create a Remote Configuration Group | 357 Create Apply Groups for the Local, Remote, and Global Configurations | 359 Synchronizing and Committing Configurations | 360 Troubleshooting Remote Device Connections | 360
To propagate, synchronize, and commit configuration changes from one device (Junos Fusion Provider Edge, Junos Fusion Enterprise, EX Series switches, and MX Series routers) to another, perform following tasks:
Configure Devices for Configuration Synchronization
Configure the hostnames or IP addresses for the devices that will be synchronizing their configurations as well as the usernames and authentication details for the users administering configuration synchronization. Additionally, enable a NETCONF connection so that the devices can synchronize their configurations. Secure Copy Protocol (SCP) copies the configurations securely between the devices. For example, if you have a local device named Switch A and want to synchronize a configuration with remote devices named Switch B, Switch C, and Switch D, you need to configure the details for Switch B, Switch C, and Switch D on Switch A. To specify the configuration details: 1. On the local device, specify the configuration details for the remote device.
[edit system commit] user@switch# set peers hostname user username authentication password string
349
For example, if the local device is Switch A, and the remote devices are Switch B, Switch C, and Switch D:
[edit system commit] user@Switch A# set peers Switch B user admin-SwitchB authentication "$ABC123" user@Switch A# set peers Switch C user admin-SwitchC authentication "$ABC123" user@Switch A# set peers Switch D user admin-SwitchD authentication "$ABC123"
The password string is stored as an authenticated password string.
The output for Switch A is as follows:
[edit system commit] peers { Switch B{ user admin-SwitchB; authentication "$ABC123"; } Switch C{ user admin-SwitchC; authentication "$ABC123"; } Switch D{ user admin-SwitchD; authentication "$ABC123"; }
}
2. Statically map Switch A to Switch B, Switch C, and Switch D. For example:
[edit system ] user@Switch A# set static-host-mapping Switch A inet 10.92.76.2 user@Switch A# set static-host-mapping Switch B inet 10.92.76.4 user@Switch A# set static-host-mapping Switch C inet 10.92.76.6 user@Switch A# set static-host-mapping Switch D inet 10.92.76.8
350
The output is as follows:
[edit system] static-host-mapping [ SwitchA{ inet [ 10.92.76.2 ]; } SwitchB{ inet [ 10.92.76.4 ]; } SwitchC{ inet [ 10.92.76.6 ]; } SwitchD{ inet [ 10.92.76.8 ]; }
} }
3. Enable a NETCONF connection using SSH between all devices (Switch A, Switch B, Switch C, and Switch D). For example:
[edit] user@Switch A# set system services netconf ssh
[edit] user@Switch B# set system services netconf ssh
[edit] user@Switch C# set system services netconf ssh
[edit] user@Switch D# set system services netconf ssh
351
Create a Global Configuration Group
Create a global configuration group the local and remote devices.
To create a global configuration group:
1. Specify the devices that will receive the configuration:
[edit] user@switch# set groups <name of group> when peers [<name of local peer> <name of remote peer>]
For example:
[edit] user@switch# set groups global when peers [Switch A Switch B Switch C Switch D]
2. Create the global configuration that will be shared between the devices. For example:
interfaces { ge-0/0/0 { unit 0 { family inet { address 10.1.1.1/8; } } } ge-0/0/1 { ether-options { 802.3ad ae0; } } ge-0/0/2 { ether-options { 802.3ad ae1; } } ae0 { aggregated-ether-options { lacp { active; }
352
} unit 0 {
family ethernet-switching { interface-mode trunk; vlan { members v1; }
} } } ae1 { aggregated-ether-options {
lacp { active; system-id 00:01:02:03:04:05; admin-key 3;
} mc-ae {
mc-ae-id 1; redundancy-group 1; mode active-active; } } unit 0 { family ethernet-switching { interface-mode access; vlan {
members v1; } } } } } switch-options { service-id 1; } vlans { v1 { vlan-id 100; l3-interface irb.100; } }
353
The output for the configuration is as follows:
groups { global { when { peers [ Switch A Switch B Switch C Switch D ]; } interfaces { ge-0/0/0 { unit 0 { family inet { address 10.1.1.1/8; } } } ge-0/0/1 { ether-options { 802.3ad ae0; } } ge-0/0/2 { ether-options { 802.3ad ae1; } } ae0 { aggregated-ether-options { lacp { active; } } unit 0 { family ethernet-switching { interface-mode trunk; vlan { members v1; } } } } ae1 { aggregated-ether-options {
354
lacp { active; system-id 00:01:02:03:04:05; admin-key 3;
} mc-ae {
mc-ae-id 1; redundancy-group 1; mode active-active; } } unit 0 { family ethernet-switching { interface-mode access; vlan {
members v1; } } } } } switch-options { service-id 1; } vlans { v1 { vlan-id 100; l3-interface irb.100; } } } }
Create a Local Configuration Group
Create a local configuration group for the local device.
To create a local configuration group:
355
1. Specify the local configuration group name.
[edit] user@switch# set groups name of group when peers [name of local peer]
For example:
[edit] user@switch# set groups local when peers [Switch A]
2. Include the local configuration that will be used by the local device. For example:
interfaces { ae1 { aggregated-ether-options { mc-ae { chassis-id 0; status-control active; events { iccp-peer-down { prefer-status-control-active; } } } } } irb { unit 100 { family inet { address 10.10.10.3/8 { arp 10.10.10.2 l2-interface ae0.0 mac 00:00:5E:00:53:00; } } } }
} multi-chassis { multi-chassis-protection 10.1.1.1 { interface ae0;
356
} } } }
The output for the configuration is as follows:
groups { local { when { peers Switch A; } interfaces { ae1 { aggregated-ether-options { mc-ae { chassis-id 0; status-control active; events { iccp-peer-down { prefer-status-control-active; } } } } } irb { unit 100 { family inet { address 10.10.10.3/8 { arp 10.10.10.2 l2-interface ae0.0 mac
00:00:5E:00:53:00; }
} } } } multi-chassis { multi-chassis-protection 10.1.1.1 { interface ae0; } }
357
} }
Create a Remote Configuration Group
Create a remote configuration group for remote devices. To create a remote configuration group: 1. Specify the remote configuration group name.
[edit] user@switch# set groups name of group when peers [names of remote peers]
For example:
[edit] user@switch# set groups remote when peers [Switch B Switch C Switch D]
2. Include the remote configuration that will be used by the remote devices. For example:
interfaces { ae1 { aggregated-ether-options { mc-ae { chassis-id 1; status-control standby; events { iccp-peer-down { prefer-status-control-active; } } } } } irb { unit 100 { family inet { address 10.10.10.3/8 { arp 10.10.10.2 l2-interface ae0.0 mac 00:00:5E:00:53:00;
358
} } } } } multi-chassis { multi-chassis-protection 10.1.1.1 { interface ae0; } } }
The output for the configuration is as follows:
groups { remote { when { peers Switch B Switch C Switch D } interfaces { ae1 { aggregated-ether-options { mc-ae { chassis-id 1; status-control standby; events { iccp-peer-down { prefer-status-control-active; } } } } } irb { unit 100 { family inet { address 10.10.10.3/8 { arp 10.10.10.2 l2-interface ae0.0 mac
00:00:5E:00:53:00; }
} }
359
} } multi-chassis {
multi-chassis-protection 10.1.1.1 { interface ae0;
} } } }
Create Apply Groups for the Local, Remote, and Global Configurations
Create apply groups so changes in the configuration are inherited by local, remote, and global configuration groups. List the configuration groups in order of inheritance, where the configuration data in the first configuration group takes priority over the data in subsequent configuration groups. When you apply the configuration groups and issue the commit peers-synchronize command, changes are committed on both the local and remote devices. If there is an error on any of the devices, an error message is issued, and the commit is terminated. To apply the configuration groups: Specify the names of the configuration groups.
[edit] user@switch# set apply-groups [<name of global configuration group> <name of local configuration group> <name of remote configuration group>]
For example:
[edit] user@switch# set apply-groups [ global local remote ]
The output for the configuration is as follows:
apply-groups [ global local remote ];
360
Synchronizing and Committing Configurations
NOTE: The commit at <"string"> command is not supported when performing configuration synchronization.
You can enable the peers-synchronize statement on the local (or requesting) device to copy and load its configuration to the remote (or responding) device by default. You can alternatively issue the commit peers-synchronize command. � Configure the commit command on the local (or requesting) to automatically perform a peers-
synchronize action between devices.
[edit] user@switch# set system commit peers-synchronize
The output for the configuration is as follows:
system { commit { peers-synchronize; }
}
� Issue the commit peers-synchronize command on the local (or requesting) device.
[edit] user@switch# commit peers-synchronize
Troubleshooting Remote Device Connections
IN THIS SECTION Problem | 361 Resolution | 361
361
Problem
Description
When you issue the commit command, the system issues the following error message:
root@Switch A# commit error: netconf: could not read hello error: did not receive hello packet from server error: Setting up sessions for peer: 'Switch B' failed warning: Cannot connect to remote peers, ignoring it
The error message shows that there is a NETCONF connection issue between the local device and remote device.
Resolution
1. Verify that the SSH connection to the remote device (Switch B) is working.
root@Switch A# ssh root@Switch B @@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@ @@@@ @ WARNING: REMOTE HOST IDENTIFICATION HAS CHANGED! @ @@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@@ @@@@ IT IS POSSIBLE THAT SOMEONE IS DOING SOMETHING NASTY! Someone could be eavesdropping on you right now (man-in-the-middle attack)! It is also possible that a host key has just been changed. The fingerprint for the ECDSA key sent by the remote host is 21:e8:5a:58:bb:29:8b:96:a4:eb:cc:8a:32:95:53:c0. Please contact your system administrator. Add correct host key in /root/.ssh/known_hosts to get rid of this message. Offending ECDSA key in /root/.ssh/ known_hosts:1 ECDSA host key for Switch A has changed and you have requested strict checking. Host key verification failed.
The error message shows that the SSH connection is not working. 2. Delete the key entry in the /root/.ssh/known_hosts:1 directory and try to connect to Switch B again.
root@Switch A# ssh root@Switch B The authenticity of host 'Switch B (10.92.76.235)' can't be established. ECDSA key fingerprint is 21:e8:5a:58:bb:29:8b:96:a4:eb:cc:8a:32:95:53:c0. Are you sure you want to continue connecting (yes/ no)? yes Warning: Permanently added 'Switch A,10.92.76.235' (ECDSA) to the list of known hosts. Password: Last login: Wed Apr 13 15:29:58 2016 from 192.168.61.129 - JUNOS 15.1I20160412_0929_dc-builder Kernel 64-bit FLEX JNPR-10.1-20160217.114153_fbsd-
362
builder_stable_10 At least one package installed on this device has limited support. Run 'file show /etc/ notices/unsupported.txt' for details.
Connection to Switch B was successful. 3. Log out of Switch B.
root@Switch B# exit logout Connection to Switch B closed.
4. Verify that NETCONF over SSH is working.
root@Switch A# ssh root@Switch B -s netconf logout Connection to st-72q-01 closed. Password: <hello xmlns="urn:ietf:params:xml:ns:netconf:base:1.0"> <capabilities> <capability>urn:ietf:params:netconf:base:1.0</capability> <capability>urn:ietf:params:netconf:capability:candidate:1.0</capability>
The log message shows that the NETCONF over SSH was successful. If the error message showed that NETCONF over SSH was not successful, enable NETCONF over SSH by issuing the set system services netconf ssh command. 5. Create configuration groups to synchronize if you have not done so already. You can issue the show | compare command to see if any configuration groups have been created.
root@Switch A# show | compare
6. Issue the commit command.
root@Switch A# commit [edit chassis]
configuration check succeeds commit complete {master:0}[edit]
363 The log message shows that the commit was successful.
4 CHAPTER
MC-LAG Upgrade Guidelines
MC-LAG Upgrade Guidelines | 365
365
MC-LAG Upgrade Guidelines
IN THIS SECTION Upgrade Guidelines | 365
Upgrade Guidelines
Upgrade the MC-LAG peers according to the following guidelines.
NOTE: Upgrade both MC-LAG nodes to the same software version in order to achieve no loss during stable and failover conditions. The protocol states, data forwarding, and redundancy are guaranteed only after both nodes are upgraded to the same software version successfully.
NOTE: After a reboot, the multichassis aggregated Ethernet interfaces come up immediately and might start receiving packets from the server. If routing protocols are enabled, and the routing adjacencies have not been formed, packets might be dropped.
To prevent this scenario, issue the set interfaces interface-name aggregated-ether-options mcae init-delay-time time command to set a time by which the routing adjacencies are formed.
NOTE: On QFX and EX Series switches, the default session establishment hold time is 300 seconds. However, the session establishment time must be at least 100 seconds higher than the init delay time. You can optionally update the session establishment time to be 340 seconds and the init delay time to be 240 seconds.
1. Make sure that both of the MC-LAG peers (node1 and node2) are in the active-active state by using the following command on any one of the MC-LAG peers:
user@switch> show interfaces mc-ae id 1
Member Link
: ae0
Current State Machine's State: mcae active state
366
Local Status Local State Peer Status Peer State
Logical Interface Topology Type Local State Peer State Peer Ip/MCP/State
: active<<<<<<< : up : active<<<<<<< : up : ae0.0 : bridge : up : up : 10.1.1.2 ae2.0 up
2. Upgrade node1 of the MC-LAG.
When node1 is upgraded, it is rebooted, and all traffic is sent across the available LAG interfaces of node2, which is still up. The amount of traffic lost depends on how quickly the neighbor devices detect the link loss and rehash the flows of the LAG.
3. Verify that node1 is running the software you just installed by issuing the show version command.
4. Make sure that both nodes of the MC-LAG (node1 and node2) are in the active-active state after the reboot of node1.
5. Upgrade node2 of the MC-LAG.
Repeat Step 1 through Step 3 to upgrade node2.
5 CHAPTER
Best Practices and Usage Notes
Best Practices and Usage Notes | 368
368
Best Practices and Usage Notes
IN THIS SECTION ICCP and ICL | 368 Failure Handling | 370 Redundancy Groups | 372 Init Delay Time | 373 Status Control | 373 VLANs | 373 IGMP Snooping on an Active-Active MC-LAG | 374 VRRP Active-Standby Support | 374 Address Resolution Protocol Active-Active MC-LAG Support Methodology | 375 DHCP Relay with Option 82 | 375 Virtual Router Redundancy Protocol (VRRP) over IRB and MAC Address Synchronization | 376 Miswiring Detection Guidelines | 377
ICCP and ICL
BEST PRACTICE: We recommend that you use separate ports and choose different Flexible PIC Concentrators (FPCs) for the interchassis link (ICL) and Inter-Chassis Control Protocol (ICCP) interfaces. Although you can use a single link for the ICCP interface, an aggregated Ethernet interface is preferred. When configuring ICCP and ICL, we recommend that you: � Configure an aggregated Ethernet interface to be used for the ICL interface. � Configure an aggregated Ethernet interface to be used for the ICCP interface. � Configure the IP address for the management port (fxp0).
369
When you configure backup liveness detection, this out-of-band channel is established between the peers through the management network
� Use the peer loopback address to establish ICCP peering. Doing so avoids any direct link failure between MC-LAG peers. As long as the logical connection between the peers remains up, ICCP stays up.
� Configure the ICCP liveness-detection interval (the Bidirectional Forwarding Detection (BFD) timer) to be at least 8 seconds if you have configured ICCP connectivity through an IRB interface. A liveness-detection interval of 8 seconds or more allows for graceful Routing Engine switchover (GRES) to work seamlessly. By default, ICCP liveness detection uses multihop BFD, which runs in centralized mode.
This recommendation does not apply if you configured ICCP connectivity through a dedicated physical interface. In this case, you can configure single-hop BFD.
� Configure a session establishment hold time for ICCP. Doing this results in faster ICCP connection between the MC-LAG peers and also prevents any delay during convergence.
NOTE: On QFX Series switches, the default session establishment hold time is 300 seconds. However, the session establishment time must be at least 100 seconds higher than the init delay time. You can optionally update the session establishment time to be 340 seconds and the init delay time to be 240 seconds.
� Configure a hold-down timer on the ICL member links that is greater than the configured BFD timer for the ICCP interface. This prevents the ICL from being advertised as being down before the ICCP link is down. If the ICL goes down before the ICCP link, this causes a flap of the MC-LAG interface on the status-control standby node, which leads to a delay in convergence.
� Starting with Junos OS Release 15.1 on MX Series routers, configure the backup liveness detection feature to implement faster failover of data traffic during an MC-LAG peer reboot. Configure the backup-liveness-detectionstatement on the management interface (fxp0) only.
NOTE: DHCP snooping, dynamic ARP inspection (DAI), and IP source guard are not supported on the ICL or MC-LAG interfaces. Consequently, incoming address resolution protocol replies on the ICL are discarded. However, ARP entries can be populated on the ICL interface through ICCP exchanges from a remote MC-LAG peer.
370
Failure Handling
Table 9 on page 370 describes the different ICCP failure scenarios for EX9200 switches. The dash means that the item is not applicable.
Table 9: ICCP Failure Scenarios for EX9200 Switches
ICCP Connection Status
ICL Status
Backup Liveness Peer Status
Action on Multichassis Aggregated Ethernet Interface with Status Set to Standby
Action on Multichassis Aggregated Ethernet Interface with Status Set to Standby and Prefer Status Control Set to Active
Down
Down or Up
Not configured
LACP system ID is changed to default value.
Not applicable. Liveness detection must be configured.
Down
Down or Up Active
LACP system ID is
No change in LACP
changed to default value. system ID.
Down
Down or Up Inactive
No change in LACP system ID.
No change in LACP system ID.
Up
Down
�
LACP state is set to standby. MUX state moves to waiting state.
LACP status is set to standby. MUX state moves to waiting status.
Table 10 on page 371 describes the different ICCP failure scenarios for QFX Series switches. The dash means that the item is not applicable.
371
Table 10: ICCP Failure Scenarios for QFX Series Switches
ICCP Connection ICL Status Status
Backup Liveness Peer Status
Action on Multichassis Aggregated Ethernet Interface with Status Set to Standby
Down
Down or Up
Not configured
LACP system ID is changed to default value.
Down
Down or Up
Active
LACP system ID is changed to default value.
Down
Down or Up
Inactive
No change in LACP system ID.
Up
Down
�
LACP state is set to standby. MUX state moves to waiting state.
Configure the master-only statement on the IP address of the fxp0 interface for backup liveness detection on both the primary and backup Routing Engines. This ensures that the connection is not reset during GRES in the remote peer.
For example, on the primary Routing Engine:
user@switch-re1 > show configuration interfaces fxp0 | display inheritance no-comments unit 0 {
family inet { address 10.8.2.31/8; address 10.8.2.33/8 { master-only; }
} }
For example, on the backup Routing Engine:
user@switch1-re1 > show configuration interfaces fxp0 | display inheritance no-comments unit 0 {
family inet { address 10.8.2.32/8;
372
address 10.8.2.33/8 { master-only;
} } }
The primary Routing Engine services both 10.8.2.31 and 10.8.2.33. Configure 10.8.2.33 in a backupliveness-detection configuration on the peer node.
For example, on the backup Routing Engine:
user@switch2 > show configuration protocols iccp local-ip-addr 10.2.2.2; peer 10.1.1.1 {
session-establishment-hold-time 340; redundancy-group-id-list 1; backup-liveness-detection {
backup-peer-ip 10.8.2.33; } liveness-detection {
minimum-interval 500; multiplier 3; single-hop; } }
Redundancy Groups
BEST PRACTICE: We recommend that you configure only one redundancy group between MCLAG nodes. The redundancy group represents the domain of high availability between the MCLAG nodes. One redundancy group is sufficient between a pair of MC-LAG nodes. If you are using logical systems, then configure one redundancy group between MC-LAG nodes in each logical system.
373
Init Delay Time
On QFX and EX Series switches, the default session establishment hold time is 300 seconds. However, the session establishment time must be at least 100 seconds higher than the init delay time. You can optionally update the session establishment time to be 340 seconds and the init delay time to be 240 seconds.
Status Control
BEST PRACTICE: You can configure prefer-status-control-active statement with the statuscontrol standby configuration to prevent the LACP mc-ae system ID from reverting to the LACP default system ID during an ICCP failure. You should only configure this option if ICCP will never go down unless the remote peer goes down. In the event that the peer configured with status-control active goes down abruptly, such as during a power off, we recommended that you configure the hold-time interval for the interchassis control link configured as status-control standby with a value greater than the ICCP BFD timeout. Doing this will prevent momentary traffic loss on the peer configured as statuscontrol standby. Without the hold-time interval configuration on the ICL, the MC-AE interface on the peer configured as status-control standby will momentarily move to standby during a power-off of the remote peer.
VLANs
BEST PRACTICE: We recommend that you limit the scope of VLANs and configure them only where they are necessary. Configure the MC-AE trunk interfaces with only the VLANs that are necessary for the access layer. On the QFX Series, the all option at the [edit interfaces name unit number ethernet-switching vlan] hierarchy is not supported on multichassis aggregated Ethernet (MC-AE), aggregated Ethernet (AE), Gigabit Ethernet (GE), 10-Gigabit Ethernet (XE), 40-Gigabit Ethernet (ET), and 100Gigabit Ethernet (ET) Layer 2 Ethernet interfaces. Instead, specify a range of VLAN IDs or VLAN names. VLAN names or VLAN IDs for ICCP purposes are not supported on MC-AE, single-homed AE, GE, XE, and ET interfaces connected to servers or other network devices. VLAN names or VLAN IDs used for ICCP purposes are not supported on MC-AE multi-homed access and trunk
374
Layer 2 interfaces, single-homed AE, GE, XE, and ET Layer 2 Ethernet access or trunk interfaces. When you configure VLANs on an MC-AE or other revenue interfaces on the device, the VLAN range is supported but without the ICCP-dedicated VLAN.
IGMP Snooping on an Active-Active MC-LAG
You must enable Protocol Independent Multicast (PIM) on the IRB interface to avoid multicast duplication. You must configure the ICL interface as a router-facing interface (by configuring the multicast-routerinterface statement) for multicast forwarding to work in an MC-LAG environment. For the scenario in which traffic arrives by way of a Layer 3 interface, PIM and IGMP must be enabled on the IRB or RVI interface configured on the MC-LAG peers. You must enable PIM on the IRB or RVI interface to avoid multicast duplication.
VRRP Active-Standby Support
You must configure VRRP on both MC-LAG peers for both the active and standby members to accept and route packets. Additionally, you must configure the VRRP backup device to send and receive ARP requests. If you are using the VRRP over IRB or RVI method to enable Layer 3 functionality, you must configure static ARP entries for the IRB or RVI interface of the remote MC-LAG peer to allow routing protocols to run over the IRB or RVI interfaces. Starting in Junos OS Release 15.2R1, you do not need to configure a static ARP or ND entry for the remote IRB IP address. If you have already manually configured a static ARP or ND entry and upgrade to a later release, the static entry is deleted when ICCP goes down. If you configured ICCP on the IRB static entry, then ICCP might not come up. As a workaround, you can disable the automatic creation of static ARP and ND entries by issuing the following command: set protocols l2-learning no-mclag-ifasync
375
Address Resolution Protocol Active-Active MC-LAG Support Methodology
ARP and MAC address tables normally stay synchronized in MC-LAG configurations, but might get out of sync under certain network conditions (such as link flapping). To ensure these tables remain in sync while those conditions are being resolved, we recommend enabling the arp-l2-validate statement on IRB interfaces in an MC-LAG configuration. This option turns on validation of ARP and MAC table entries, automatically applying updates if they become out of sync. � In some cases, ARP messages received by one MC-LAG peer are replicated to the other MC-LAG
peer through ICCP. This optimization feature is applicable only for ARP replies, not ARP requests, received by the MC-LAG peers. � Dynamic ARP resolution over the ICL interface is not supported. Consequently, incoming ARP replies on the ICL are discarded. However, ARP entries can be populated on the ICL interface through ICCP exchanges from a remote MC-LAG peer. � During graceful Routing Engine switchover (GRES), ARP entries that were learned remotely are purged and then learned again.
DHCP Relay with Option 82
NOTE: DHCP relay is not supported with MAC address synchronization. If DHCP relay is required, configure VRRP over IRB or RVI for Layer 3 functionality.
BEST PRACTICE: In an MC-LAG active-active environment, we recommend that you use the bootp relay agent by configuring the DHCP relay agent with the forwarding options helpers bootp command to avoid stale session information issues that might arise for clients when the router is using the extended DHCP relay agent (jdhcp) process.
376
Virtual Router Redundancy Protocol (VRRP) over IRB and MAC Address Synchronization
NOTE: On EX9200 and QFX Series switches, routing protocols are not supported on the downstream clients.
BEST PRACTICE: On EX9200 and QFX Series switches, we recommend that you use MAC address synchronization for the downstream clients. For the upstream routers, we recommend that you use VRRP over IRB or RVI method.
NOTE: On EX9200 and QFX Series switches, you cannot configure both VRRP over IRB and MAC synchronization, because processing MAC addresses might not work.
NOTE: Use MAC synchronization if you require more than 1,000 VRRP instances.
NOTE: Here are some caveats with configuring MAC address synchronization: � Use MAC address synchronization if you are not planning to run routing protocols on the IRB
interfaces. MAC address synchronization does not support routing protocols on IRB interfaces, and routing protocols are not supported with downstream MC-LAG clients. If you need routing capability, configure both VRRP and routing protocols on each MC-LAG peer. Routing protocols are supported on upstream routers. � DHCP relay is not supported with MAC address synchronization. If you need to configure DHCP relay, configure VRRP over IRB. � Gratuitous ARP requests are not sent when the MAC address on the IRB interface changes.
377
Miswiring Detection Guidelines
You can use STP to detect miswiring loops within the peer or across MC-LAG peers. An example of miswiring is when a port of a network element is accidentally connected to another port of the same network element. Using STP to detect loops on MC-LAG interfaces, however, is not supported.
NOTE: Do not use Multiple Spanning Tree Protocol (MSTP) or VLAN Spanning Tree Protocol (VSTP). There could be a loop if MSTP or VSTP is enabled in an MC-AE topology without enabling MSTP or VSTP on the MC-AE logical interfaces. Also, there could be a loop if an alternate path exists from access nodes to MC-AE nodes.
BEST PRACTICE: To detect miswirings, we recommend that you do the following: � Configure STP globally so that STP can detect local miswiring within and across MC-LAG
peers. � Disable STP on ICL links, however, because STP might block ICL interfaces and disable
protection. � Disable STP on interfaces that are connected to aggregation switches. � Configure MC-LAG interfaces as edge ports. � Enable bridge protocol data unit (BPDU) block on edge. � Do not enable BPDU block on interfaces connected to aggregation switches. Configuration Guidelines and Caveats � Configure the IP address on the active MC-LAG peer with a high IP address or a high DR
priority. To ensure that the active MC-LAG peer retains the DR membership designation if PIM neighborship with the peer goes down. � Using Bidirectional Forwarding Detection (BFD) and RVI or IRB MAC synchronization together is not supported because ARP fails. � When using RVI or IRB MAC synchronization, make sure that you configure the primary IP address on both MC-LAG peers. Doing this ensures that both MC-LAG peers cannot become assert winners.
378
� The number of BFD sessions on RVIs or IRBs with PIM enabled is restricted to 100. Also, If you have more than 100 RVIs or IRBs configured, do not configure BFD, and make sure that the hello interval is 2 seconds.
Release History Table Release Description
15.1
Starting with Junos OS Release 15.1 on MX Series routers, configure the backup liveness detection
feature to implement faster failover of data traffic during an MC-LAG peer reboot.
6 CHAPTER
Troubleshooting Multichassis Link Aggregation
Troubleshooting Multichassis Link Aggregation | 380 Configuring Interface Diagnostics Tools to Test the Physical Layer Connections |
396
380
Troubleshooting Multichassis Link Aggregation
IN THIS SECTION MAC Addresses Learned on Multichassis Aggregated Ethernet Interfaces Are Not Removed from the MAC Address Table | 381 MC-LAG Peer Does Not Go into Standby Mode | 382 Secondary MC-LAG Peer with Status Control Set to Standby Becomes Inactive | 383 Redirect Filters Take Priority over User-Defined Filters | 383 Operational Command Output Is Wrong | 384 ICCP Connection Might Take Up to 60 Seconds to Become Active | 385 MAC Address Age Learned on a Multichassis Aggregated Ethernet Interface Is Reset to Zero | 386 MAC Address Is Not Learned Remotely in a Default VLAN | 387 Snooping Entries Learned on Multichassis Aggregated Ethernet Interfaces Are Not Removed | 387 ICCP Does Not Come Up After You Add or Delete an Authentication Key | 388 Local Status Is Standby When It Should Be Active | 389 Packets Loop on the Server When ICCP Fails | 389 Both MC-LAG Peers Use the Default System ID After a Reboot or an ICCP Configuration Change | 390 No Commit Checks Are Done for ICL-PL Interfaces | 391 Double Failover Scenario | 391 Multicast Traffic Floods the VLAN When the ICL-PL Interface Goes Down and Up | 392 Layer 3 Traffic Sent to the Standby MC-LAG Peer Is Not Redirected to Active MC-LAG Peer | 393 Aggregated Ethernet Interfaces Go Down | 393 Flooding of Upstream Traffic | 394 ARP and MAC Table Entries Become Out of Sync in an MC-LAG Configuration | 395
Use the following information to troubleshoot multichassis link aggregation configuration issues:
381
MAC Addresses Learned on Multichassis Aggregated Ethernet Interfaces Are Not Removed from the MAC Address Table
IN THIS SECTION Problem | 381 Solution | 382
Problem
Description
When both of the mulitchassis aggregated Ethernet interfaces on both connected multichassis link aggregation group (MC-LAG) peers are down, the MAC addresses learned on the multichassis aggregated Ethernet interfaces are not removed from the MAC address table.
For example, if you disable the multichassis aggregated Ethernet interface (ae0) on both MC-LAG peers by issuing the set interfaces ae0 disable command and commit the configuration, the MAC table still shows the MAC addresses as being learned on the multichassis aggregated Ethernet interfaces of both MC-LAG peers.
user@switchA> show ethernet-switching table
Ethernet-switching table: 6 entries, 2 learned, 0 persistent entries
VLAN
MAC address
Type
Age Interfaces
v10
*
Flood
- All-members
v10
00:00:5E:00:53:00 Learn(L)
3:55 ae0.0 (MCAE)
v10
00:00:5E:00:53:01 Learn(R)
0 xe-0/0/9.0
v20
*
Flood
- All-members
v30
*
Flood
- All-members
v30
00:00:5E:00:53:03 Static
- Router
user@switchB> show ethernet-switching table
Ethernet-switching table: 6 entries, 2 learned, 0 persistent entries
VLAN
MAC address
Type
Age Interfaces
v10
*
Flood
- All-members
382
v10
00:00:5E:00:53:04 Learn(R)
0 ae0.0 (MCAE)
v10
00:00:5E:00:53:05 Learn
40 xe-0/0/10.0
v20
*
Flood
- All-members
v30
*
Flood
- All-members
v30
00:00:5E:00:53:06 Static
- Router
Solution
This is expected behavior.
MC-LAG Peer Does Not Go into Standby Mode
IN THIS SECTION Problem | 382 Solution | 382
Problem
Description
A multichassis link aggregation group (MC-LAG) peer does not go into standby mode if the MC-LAG peer IP address specified in the Inter-Chassis Control Protocol (ICCP) configuration and the IP address specified in the multichassis protection configuration are different.
Solution
To prevent failure to enter standby mode, make sure that the peer IP address in the ICCP configurations and the IP address in multichassis protection configurations are the same.
383
Secondary MC-LAG Peer with Status Control Set to Standby Becomes Inactive
IN THIS SECTION Problem | 383 Solution | 383
Problem Description
When the interchassis control link-protection link (ICL-PL) and multichassis aggregated Ethernet interfaces go down on the primary multichassis link aggregation group (MC-LAG) peer, the secondary MC-LAG peer's multichassis aggregated Ethernet interfaces with status control set to standby become inactive instead of active.
Solution
This is expected behavior.
Redirect Filters Take Priority over User-Defined Filters
IN THIS SECTION Problem | 384 Solution | 384
384
Problem Description
Multichassis link aggregation group (MC-LAG) implicit failover redirection filters take precedence over user-configured explicit filters.
Solution
This is expected behavior.
Operational Command Output Is Wrong
IN THIS SECTION Problem | 384 Solution | 385
Problem Description
After you deactivate Inter-Chassis Control Protocol (ICCP), the show iccp operational command output still shows registered client daemons, such as mcsnoopd, lacpd, and eswd. For example:
user@switch> show iccp Client Application: MCSNOOPD
Redundancy Group IDs Joined: None Client Application: lacpd
Redundancy Group IDs Joined: 1
385
Client Application: eswd Redundancy Group IDs Joined: 1
The show iccp command output always shows registered modules regardless of whether or not ICCP peers are configured.
Solution
This is expected behavior.
ICCP Connection Might Take Up to 60 Seconds to Become Active
IN THIS SECTION Problem | 385 Solution | 385
Problem Description
When the Inter-Chassis Control Protocol (ICCP) configuration and the routed VLAN interface (RVI) configuration are committed together, the ICCP connection might take up to 60 seconds to become active.
Solution
This is expected behavior.
386
MAC Address Age Learned on a Multichassis Aggregated Ethernet Interface Is Reset to Zero
IN THIS SECTION Problem | 386 Solution | 386
Problem
Description
When you activate and then deactivate an interchassis link-protection link (ICL-PL), the MAC address age learned on the multichassis aggregated Ethernet interface is reset to zero. The next-hop interface changes trigger MAC address updates in the hardware, which then triggers aging updates in the Packet Forwarding Engine. The result is that the MAC address age is updated to zero.
For example, the ICL-PL has been deactivated, and the show ethernet-switching table command output shows that the MAC addresses have an age of 0.
user@switch> show ethernet-switching table
Ethernet-switching table: 3 entries, 2 learned, 0 persistent entries
VLAN
MAC address
Type
Age Interfaces
v100
*
Flood
- All-members
v100
00:10:00:00:00:01 Learn(L)
0 ae0.0 (MCAE)
v100
00:10:00:00:00:02 Learn(L)
0 ae0.0 (MCAE)
Solution
This is expected behavior.
387
MAC Address Is Not Learned Remotely in a Default VLAN
IN THIS SECTION Problem | 387 Solution | 387
Problem Description
On a QFX3500 switch running Junos OS Release 12.3 or earlier, if a multichassis link aggregation group (MC-LAG) peer learns a MAC address in the default VLAN, Inter-Chassis Control Protocol (ICCP) does not synchronize the MAC address with the MAC address of the other MC-LAG peer.
Solution
This is expected behavior.
Snooping Entries Learned on Multichassis Aggregated Ethernet Interfaces Are Not Removed
IN THIS SECTION Problem | 388 Solution | 388
388
Problem Description
When multichassis aggregated Ethernet interfaces are configured on a VLAN that is enabled for multicast snooping, the membership entries learned on the multichassis aggregated Ethernet interfaces on the VLAN are not cleared when the multichassis aggregated Ethernet interfaces go down. This is done to speed up convergence time when the interfaces come up, or come up and go down.
Solution
This is expected behavior.
ICCP Does Not Come Up After You Add or Delete an Authentication Key
IN THIS SECTION Problem | 388 Solution | 388
Problem Description
The Inter-Chassis Control Protocol (ICCP) connection is not established when you add an authentication key and then delete it only at the global ICCP level. However, authentication works correctly at the ICCP peer level.
Solution
Delete the ICCP configuration, and then add the ICCP configuration.
389
Local Status Is Standby When It Should Be Active
IN THIS SECTION Problem | 389 Solution | 389
Problem Description
If the multichassis aggregated Ethernet interface is down when the state machine is in a synchronized state, the multichassis link aggregation group (MC-LAG) peer local status is standby. If the multichassis aggregated Ethernet interface goes down after the state machine is in an active state, then the local status remains active, and the local state indicates that the interface is down.
Solution
This is expected behavior.
Packets Loop on the Server When ICCP Fails
IN THIS SECTION Problem | 390 Solution | 390
390
Problem Description
When you enable backup liveness detection for a multichassis link aggregation group (MC-LAG), and the backup liveness detection packets are lost because of a temporary failure on the MC-LAG, then both of the peers in the MC-LAG remain active. If this happens, both of the MC-LAG peers send packets to the connected server.
Solution
This is expected behavior.
Both MC-LAG Peers Use the Default System ID After a Reboot or an ICCP Configuration Change
IN THIS SECTION Problem | 390 Solution | 390
Problem Description
After a reboot or after a new Inter-Chassis Control Protocol (ICCP) configuration has been committed, and the ICCP connection does not become active, the Link Aggregation Control Protocol (LACP) messages transmitted over the multichassis aggregated Ethernet interfaces use the default system ID. The configured system ID is used instead of the default system ID only after the MC-LAG peers synchronize with each other.
Solution
This is expected behavior.
391
No Commit Checks Are Done for ICL-PL Interfaces
IN THIS SECTION Problem | 391 Solution | 391
Problem Description
There are no commit checks on the interface being configured as an interchassis link-protection link (ICL-PL), so you must provide a valid interface name for the ICL-PL.
Solution
This is expected behavior.
Double Failover Scenario
IN THIS SECTION Problem | 391 Solution | 392
Problem Description
If the following events happen in this exact order--Inter-Chassis Control Protocol (ICCP) goes down, and the multichassis aggregated Ethernet interface on the multichassis link aggregation group (MC-LAG) peer in active mode goes down--a double failover occurs. In this scenario, the MC-LAG peer in standby
392
mode does not detect what happens on the active MC-LAG peer. The MC-LAG peer in standby mode operates as if the multichassis aggregated Ethernet interface on the MC-LAG in active mode were up and blocks the interchassis link-protection link (ICL-PL) traffic. The ICL-PL traffic is not forwarded.
Solution
This is expected behavior.
Multicast Traffic Floods the VLAN When the ICL-PL Interface Goes Down and Up
IN THIS SECTION Problem | 392 Solution | 392
Problem Description
When interchassis link-protection link (ICL-PL) goes down and comes up, multicast traffic is flooded to all of the interfaces in the VLAN. The Packet Forwarding Engine flag Ip4McastFloodMode for the VLAN is changed to MCAST_FLOOD_ALL. This problem only occurs when a multichassis link aggregation group (MC-LAG) is configured for Layer 2.
Solution
This is expected behavior.
393
Layer 3 Traffic Sent to the Standby MC-LAG Peer Is Not Redirected to Active MC-LAG Peer
IN THIS SECTION Problem | 393 Solution | 393
Problem Description
When Inter-chassis Control Protocol (ICCP) is down, the status of a remote MC-LAG peer is unknown. Even if the MC-LAG peer is configured as standby, the traffic is not redirected to this peer because it is assumed that this peer is down.
Solution
This is expected behavior.
Aggregated Ethernet Interfaces Go Down
IN THIS SECTION Problem | 394 Solution | 394
394
Problem
Description When a multichassis aggregated Ethernet interface is converted to an aggregated Ethernet interface, it retains some multichassis aggregated Ethernet interface properties. For example, the aggregated Ethernet interface might retain the administrative key of the multichassis aggregated Ethernet interface. When this happens, the aggregated Ethernet interface goes down.
Solution
Restart Link Aggregation Control Protocol (LACP) on the multichassis link aggregation group (MC-LAG) peer hosting the aggregated Ethernet interface to bring up the aggregated Ethernet interface. Restarting LACP removes the multichassis aggregated Ethernet properties of the aggregated Ethernet interface.
Flooding of Upstream Traffic
IN THIS SECTION Problem | 394 Solution | 395
Problem
Description When MAC synchronization is enabled, the multichassis link aggregation group (MC-LAG) peer can resolve Address Resolution Protocol (ARP) entries for the MC-LAG routed VLAN interface (RVI) with either of the MC-LAG peer MAC addresses. If the downstream traffic is sent with one MAC address (MAC1) but the peer has resolved the MAC address with a different MAC address (MAC2), the MAC2 address might not be learned by any of the access layer switches. Flooding of the upstream traffic for the MAC2 address might then occur.
395
Solution
Make sure that downstream traffic is sent from the MC-LAG peers periodically to prevent the MAC addresses from aging out.
ARP and MAC Table Entries Become Out of Sync in an MC-LAG Configuration
IN THIS SECTION Problem | 395 Solution | 395
Problem
Description The ARP and MAC address tables in an MC-LAG configuration normally stay synchronized, but updates might be lost in extreme situations when table updates are happening very frequently, such as when link flapping occurs in an MC-LAG group. Solution To avoid ARP and MAC entries becoming out of sync in an MC-LAG configuration, you can configure the arp-l2-validate option on the switch's IRB interface, as follows:
user@switch> set interfaces irb arp-l2-validate The arp-l2-validate option is available only on QFX Series switches and EX4300 switches starting with Junos OS Release 15.1R4, and EX9200 switches starting with Junos OS Release 13.2R4. This option turns on validation of ARP and MAC table entries, automatically applying updates if they become out of sync. You might want to enable this option as a workaround when the network is experiencing other issues that also cause loss of ARP and MAC synchronization, but disable it during normal operation because this option might impact performance in scale configurations.
396
Configuring Interface Diagnostics Tools to Test the Physical Layer Connections
IN THIS SECTION Configuring Loopback Testing | 396 Configuring BERT Testing | 399 Starting and Stopping a BERT Test | 403
Configuring Loopback Testing
Loopback testing allows you to verify the connectivity of a circuit. You can configure any of the following interfaces to execute a loopback test: aggregated Ethernet, Fast Ethernet, Gigabit Ethernet, E1, E3, NxDS0, serial, SONET/SDH, T1, and T3. The physical path of a network data circuit usually consists of segments interconnected by devices that repeat and regenerate the transmission signal. The transmit path on one device connects to the receive path on the next device. If a circuit fault occurs in the form of a line break or a signal corruption, you can isolate the problem by using a loopback test. Loopback tests allow you to isolate segments of the circuit and test them separately. To do this, configure a line loopback on one of the routers. Instead of transmitting the signal toward the far-end device, the line loopback sends the signal back to the originating router. If the originating router receives back its own Data Link Layer packets, you have verified that the problem is beyond the originating router. Next, configure a line loopback farther away from the local router. If this originating router does not receive its own Data Link Layer packets, you can assume that the problem is on one of the segments between the local router and the remote router's interface card. In this case, the next troubleshooting step is to configure a line loopback closer to the local router to find the source of the problem. The following types of loopback testing are supported by Junos OS: � DCE local--Loops packets back on the local data circuit-terminating equipment (DCE). � DCE remote--Loops packets back on the remote DCE.
397
� Local--Useful for troubleshooting physical PIC errors. Configuring local loopback on an interface allows transmission of packets to the channel service unit (CSU) and then to the circuit toward the far-end device. The interface receives its own transmission, which includes data and timing information, on the local router's PIC. The data received from the CSU is ignored. To test a local loopback, issue the show interfaces interface-name command. If PPP keepalives transmitted on the interface are received by the PIC, the Device Flags field contains the output Loop-Detected.
� Payload--Useful for troubleshooting the physical circuit problems between the local router and the remote router. A payload loopback loops data only (without clocking information) on the remote router's PIC. With payload loopback, overhead is recalculated.
� Remote--Useful for troubleshooting the physical circuit problems between the local router and the remote router. A remote loopback loops packets, including both data and timing information, back on the remote router's interface card. A router at one end of the circuit initiates a remote loopback toward its remote partner. When you configure a remote loopback, the packets received from the physical circuit and CSU are received by the interface. Those packets are then retransmitted by the PIC back toward the CSU and the circuit. This loopback tests all the intermediate transmission segments.
Table 11 on page 397 shows the loopback modes supported on the various interface types.
Table 11: Loopback Modes by Interface Type
Interface
Loopback Modes
Usage Guidelines
Aggregated Ethernet, Fast Ethernet, Gigabit Ethernet
Local
Configuring Ethernet Loopback Capability
Circuit Emulation E1
Local and remote
Configuring E1 Loopback Capability
Circuit Emulation T1
Local and remote
Configuring T1 Loopback Capability
E1 and E3
Local and remote
Configuring E1 Loopback Capability and Configuring E3 Loopback Capability
398
Table 11: Loopback Modes by Interface Type (Continued)
Interface
Loopback Modes
Usage Guidelines
NxDS0
Payload
Configuring NxDS0 IQ and IQE Interfaces, Configuring T1 and NxDS0 Interfaces, Configuring Channelized OC12/STM4 IQ and IQE Interfaces (SONET Mode), Configuring Fractional E1 IQ and IQE Interfaces, and Configuring Channelized T3 IQ Interfaces
Serial (V.35 and X.21) Local and remote
Configuring Serial Loopback Capability
Serial (EIA-530)
DCE local, DCE remote, local, and remote
Configuring Serial Loopback Capability
SONET/SDH
Local and remote
Configuring SONET/SDH Loopback Capability to Identify a Problem as Internal or External
T1 and T3
Local, payload, and remote
Configuring T1 Loopback Capability and Configuring T3 Loopback Capability
See also Configuring the T1 Remote Loopback Response
To configure loopback testing, include the loopback statement:
user@host# loopback mode;
You can include this statement at the following hierarchy levels: � [edit interfaces interface-name aggregated-ether-options] � [edit interfaces interface-name ds0-options] � [edit interfaces interface-name e1-options] � [edit interfaces interface-name e3-options] � [edit interfaces interface-name fastether-options]
399
� [edit interfaces interface-name gigether-options] � [edit interfaces interface-name serial-options] � [edit interfaces interface-name sonet-options] � [edit interfaces interface-name t1-options] � [edit interfaces interface-name t3-options]
Configuring BERT Testing
To configure BERT: � Configure the duration of the test.
[edit interfaces interface-name interface-type-options] user@host#bert-period seconds; You can configure the BERT period to last from 1 through 239 seconds on some PICs and from 1 through 240 seconds on other PICs. By default, the BERT period is 10 seconds. � Configure the error rate to monitor when the inbound pattern is received.
[edit interfaces interface-name interface-type-options] user@host#bert-error-rate rate;
rate is the bit error rate. This can be an integer from 0 through 7, which corresponds to a bit error rate from 10�0 (1 error per bit) to 10�7 (1 error per 10 million bits). � Configure the bit pattern to send on the transmit path.
[edit interfaces interface-name interface-type-options] user@host#bert-algorithm algorithm;
algorithm is the pattern to send in the bit stream. For a list of supported algorithms, enter a ? after the bert-algorithm statement; for example:
[edit interfaces t1-0/0/0 t1-options] user@host# set bert-algorithm ?
400
Possible completions: pseudo-2e11-o152 pseudo-2e15-o151 pseudo-2e20-o151 pseudo-2e20-o153 ...
Pattern is 2^11 -1 (per O.152 standard) Pattern is 2^15 - 1 (per O.152 standard) Pattern is 2^20 - 1 (per O.151 standard) Pattern is 2^20 - 1 (per O.153 standard)
For specific hierarchy information, see the individual interface types.
NOTE: The four-port E1 PIC supports only the following algorithms:
pseudo-2e11-o152 pseudo-2e15-o151 pseudo-2e20-o151 pseudo-2e23-o151
Pattern is 2^11 -1 (per O.152 standard) Pattern is 2^15 - 1 (per O.151 standard) Pattern is 2^20 - 1 (per O.151 standard) Pattern is 2^23 (per O.151 standard)
When you issue the help command from the CLI, all BERT algorithm options are displayed, regardless of the PIC type, and no commit check is available. Unsupported patterns for a PIC type can be viewed in system log messages.
NOTE: The 12-port T1/E1 Circuit Emulation (CE) PIC supports only the following algorithms:
all-ones-repeating Repeating one bits
all-zeros-repeating Repeating zero bits
alternating-double-ones-zeros Alternating pairs of ones and zeros
alternating-ones-zeros Alternating ones and zeros
pseudo-2e11-o152
Pattern is 2^11 -1 (per O.152 standard)
pseudo-2e15-o151
Pattern is 2^15 - 1 (per O.151 standard)
pseudo-2e20-o151
Pattern is 2^20 - 1 (per O.151 standard)
pseudo-2e7
Pattern is 2^7 - 1
pseudo-2e9-o153
Pattern is 2^9 - 1 (per O.153 standard)
repeating-1-in-4
1 bit in 4 is set
repeating-1-in-8
1 bit in 8 is set
repeating-3-in-24 3 bits in 24 are set
When you issue the help command from the CLI, all BERT algorithm options are displayed, regardless of the PIC type, and no commit check is available. Unsupported patterns for a PIC type can be viewed in system log messages.
401
NOTE: The IQE PICs support only the following algorithms:
all-ones-repeating Repeating one bits
all-zeros-repeating Repeating zero bits
alternating-double-ones-zeros Alternating pairs of ones and zeros
alternating-ones-zeros Alternating ones and zeros
pseudo-2e9-o153
Pattern is 2^9 -1 (per O.153 (511 type)
standard)
pseudo-2e11-o152
Pattern is 2^11 -1 (per O.152 and O.153 (2047
type) standards)
pseudo-2e15-o151
Pattern is 2^15 -1 (per O.151 standard)
pseudo-2e20-o151
Pattern is 2^20 -1 (per O.151 standard)
pseudo-2e20-o153
Pattern is 2^20 -1 (per O.153 standard)
pseudo-2e23-o151
Pattern is 2^23 -1 (per O.151 standard)
repeating-1-in-4
1 bit in 4 is set
repeating-1-in-8
1 bit in 8 is set
repeating-3-in-24 3 bits in 24 are set
When you issue the help command from the CLI, all BERT algorithm options are displayed, regardless of the PIC type, and no commit check is available. Unsupported patterns for a PIC type can be viewed in system log messages.
NOTE: BERT is supported on the PDH interfaces of the Channelized SONET/SDH OC3/STM1 (Multi-Rate) MIC with SFP and the DS3/E3 MIC. The following BERT algorithms are supported:
all-ones-repeating
Repeating one bits
all-zeros-repeating
Repeating zero bits
alternating-double-ones-zeros Alternating pairs of ones and zeros
alternating-ones-zeros
Alternating ones and zeros
repeating-1-in-4
1 bit in 4 is set
repeating-1-in-8
1 bit in 8 is set
repeating-3-in-24
3 bits in 24 are set
pseudo-2e9-o153
Pattern is 2^9 - 1 (per O.153 standard)
pseudo-2e11-o152
Pattern is 2^11 - 1 (per O.152 standard)
pseudo-2e15-o151
Pattern is 2^15 - 1 (per O.151 standard)
pseudo-2e20-o151
Pattern is 2^20 - 1 (per O.151 standard)
pseudo-2e20-o153
Pattern is 2^20 - 1 (per O.153 standard)
pseudo-2e23-o151
Pattern is 2^23 (per O.151 standard)
402
Table 12 on page 402 shows the BERT capabilities for various interface types. Table 12: BERT Capabilities by Interface Type
Interface
T1 BERT
T3 BERT
Comments
12-port T1/E1
Yes (ports 0�11) --
Circuit Emulation
� Limited algorithms
4-port
Yes (port 0�3)
--
Channelized
OC3/STM1
Circuit Emulation
� Limited algorithms
E1 or T1
Yes (port 0�3)
Yes (port 0�3)
� Single port at a time � Limited algorithms
E3 or T3
Yes (port 0�3)
Yes (port 0�3)
� Single port at a time
Channelized
--
OC12
Yes (channel 0� 11)
� Single channel at a time � Limited algorithms � No bit count
Channelized STM1
Yes (channel 0� -- 62)
� Multiple channels � Only one algorithm � No error insert � No bit count
403
Table 12: BERT Capabilities by Interface Type (Continued)
Interface
T1 BERT
T3 BERT
Comments
Channelized T3 and Multichannel T3
Yes (channel 0� 27)
Yes (port 0�3 on channel 0)
� Multiple ports and channels � Limited algorithms for T1 � No error insert for T1 � No bit count for T1
These limitations do not apply to channelized IQ interfaces. For information about BERT capabilities on channelized IQ interfaces, see Channelized IQ and IQE Interfaces Properties.
Starting and Stopping a BERT Test
Before you can start the BERT test, you must disable the interface. To do this, include the disable statement at the [edit interfaces interface-name] hierarchy level:
[edit interfaces interface-name] disable; After you configure the BERT properties and commit the configuration, begin the test by issuing the test
interface interface-name interface-type-bert-start operational mode command:
user@host> test interface interface-name interface-type-bert-start The test runs for the duration you specify with the bert-period statement. If you want to terminate the
test sooner, issue the test interface interface-name interface-type-bert-stop command:
user@host> test interface interface-name interface-type-bert-stop For example:
user@host> test interface t3-1/2/0 t3-bert-start user@host> test interface t3-1/2/0 t3-bert-stop
404
To view the results of the BERT test, issue the show interfaces extensive | find BERT command:
user@host> show interfaces interface-name extensive | find BERT For more information about running and evaluating the results of the BERT procedure, see the CLI Explorer.
NOTE: To exchange BERT patterns between a local router and a remote router, include the loopback remote statement in the interface configuration at the remote end of the link. From the local router, issue the test interface command.
RELATED DOCUMENTATION show interfaces diagnostics optics (Gigabit Ethernet, 10-Gigabit Ethernet, 40-Gigabit Ethernet, 100Gigabit Ethernet, and Virtual Chassis Port)
7 CHAPTER
Configuration Statements
apply-groups | 407 arp-enhanced-scale | 408 arp-l2-validate | 410 authentication-key (ICCP) | 411 backup-liveness-detection | 413 backup-peer-ip | 415 bgp-peer | 416 chassis-id | 417 detection-time (Liveness Detection) | 419 enhanced-convergence | 420 groups | 422 iccp | 426 iccp | 428 interface (Multichassis Protection) | 430 local-ip-addr (ICCP) | 432 mc-ae | 433 mc-ae-id | 439 mclag | 441 mclag-arp-nd-sync | 442 mclag-arpreq-sync | 444
minimum-interval (Liveness Detection) | 445 minimum-receive-interval (Liveness Detection) | 447 mode (QFX Series) | 448 multiplier (Liveness Detection) | 450 multi-chassis | 451 multi-chassis-protection | 453 multi-chassis-protection | 454 no-adaptation (Liveness Detection) | 456 peer (ICCP) | 457 peer (Multichassis) | 459 peer | 460 peers (Commit) | 462 peers-synchronize | 464 status-control | 465 session-establishment-hold-time | 467 threshold (Detection Time) | 468 transmit-interval (Liveness Detection) | 470 version (Liveness Detection) | 471
407
apply-groups
IN THIS SECTION Syntax | 407 Hierarchy Level | 407 Description | 407 Options | 408 Required Privilege Level | 408 Release Information | 408
Syntax
apply-groups [ group-names ];
Hierarchy Level
All hierarchy levels
Description
Apply a configuration group to a specific hierarchy level in a configuration, to have a configuration inherit the statements in the configuration group. You can specify more than one group name. You must list them in order of inheritance priority. The configuration data in the first group takes priority over the data in subsequent groups.
408
Options
group-names
One or more names specified in the groups statement.
Required Privilege Level
configure--To enter configuration mode, but other required privilege levels depend on where the statement is located in the configuration hierarchy.
Release Information
Statement introduced before Junos OS Release 7.4.
RELATED DOCUMENTATION Applying a Configuration Group groups
arp-enhanced-scale
IN THIS SECTION
Syntax | 409 Hierarchy Level | 409 Description | 409 Required Privilege Level | 409 Release Information | 410
409
Syntax
arp-enhanced-scale;
Hierarchy Level
[edit system]
Description
Increases the number of ARP and neighbor discovery entries for MC-LAG configured with enhanced convergence and Layer 3 VXLAN deployments.
NOTE: To increase the ARP and discovery entries for MC-LAG with enhanced convergence, you also need to enable the enhanced-convergence statement at the [edit system] hierarchy. For information on how to configure enhanced convergence, see "Understanding Multichassis Link Aggregation Groups" on page 2.
NOTE: This statement is enabled by default on QFX10002-60C devices.
Required Privilege Level
interface--To view this statement in the configuration. interface-control--To add this statement to the configuration.
410
Release Information
Statement introduced in Junos OS Release 19.1R1.
RELATED DOCUMENTATION enhanced-convergence | 420 Understanding Multichassis Link Aggregation Groups | 2
arp-l2-validate
IN THIS SECTION Syntax | 410 Hierarchy Level | 410 Description | 411 Required Privilege Level | 411 Release Information | 411
Syntax
arp-l2-validate
Hierarchy Level
[edit interfaces irb]
411
Description
Enables periodic checking of ARP Layer 3 addressing and MAC Layer 2 addressing tables, and fixes entries if they become out of sync. Normally, the ARP and MAC address tables stay synchronized. However, you can configure this option on the irb interface of the switch to help avoid traffic loss in network conditions that might cause unresolved inconsistencies to occur between the ARP and MAC address tables, such as: � When link flapping occurs in a multichassis link aggregation (MC-LAG) group, and the network is
attempting to achieve convergence. In this case, frequent MAC table updates are happening, and occasionally a corresponding ARP table update might be lost.
Required Privilege Level
interface--To view this statement in the configuration. interface-control--To add this statement to the configuration.
Release Information
Statement introduced in Junos OS Release 13.2R4.
authentication-key (ICCP)
IN THIS SECTION Syntax | 412 Hierarchy Level | 412 Description | 412 Options | 412 Required Privilege Level | 412
412
Release Information | 413
Syntax
authentication-key key;
Hierarchy Level
[edit protocols iccp], [edit protocols iccp peer peer-IP-address]
Description
Specify the authentication key (password). The QFX3500 and MX Series devices use this password to verify the authenticity of packets sent from the peers hosting a multichassis link aggregation group (MCLAG). Peer-level authentication takes precedence over global-level authentication. Inter-Chassis Control Protocol (ICCP) uses MD5 authentication.
Options
key--Authentication password. It can be 1 through 16 contiguous digits or letters. Separate decimal digits with periods. Separate hexadecimal digits with periods and precede the string with 0x. If you include spaces in the password, enclose the entire password in quotation marks (" ").
Required Privilege Level
routing--To view this statement in the configuration.
413 routing-control--To add this statement to the configuration.
Release Information
Statement introduced in Junos OS Release 10.0.
backup-liveness-detection
IN THIS SECTION Syntax | 413 Hierarchy Level | 413 Description | 414 Required Privilege Level | 414 Release Information | 414
Syntax
backup-liveness-detection { backup-peer-ip ipv4-address;
}
Hierarchy Level
[edit protocols iccp peer]
414
Description
Determine whether a peer is up or down by exchanging keepalive messages over the management link between the two Inter-Chassis Control Protocol (ICCP) peers. When an ICCP connection is operationally down, the status of the peers hosting a multichassis link aggregation group (MC-LAG) is detected by sending liveness detection requests to each other. Peers must respond to liveness detection requests within a specified amount of time. If the responses are not received within that time for a given number of consecutive attempts, the liveness detection check fails, and a failure action is implemented. Backup liveness detection must be configured on both peers hosting the MC-LAG. For more information on the ICCP failure scenarios and handling the failures, refer to ICCP Failure Scenarios for EX9200 Switches. The remaining statement is explained separately. See CLI Explorer.
NOTE: If backup liveness detection is configured, the peer status is always up when either the ICCP TCP Connection is established, or Bidirectional Forwarding Protocol (BFD) is configured and the peer is up. The backup liveness check is only performed when the ICCP connection is down.
Required Privilege Level
routing--To view this statement in the configuration. routing-control--To add this statement to the configuration.
Release Information
Statement introduced in Junos OS Release 12.2.
RELATED DOCUMENTATION Configuring Multichassis Link Aggregation on MX Series Routers
415
backup-peer-ip
IN THIS SECTION Syntax | 415 Hierarchy Level | 415 Description | 415 Required Privilege Level | 415 Release Information | 416
Syntax
backup-peer-ip ipv4-address;
Hierarchy Level
[edit protocols iccp peer backup-liveness-detection]
Description
Specify the IP address of the peer being used as a backup peer in the Bidirectional Forwarding Detection (BFD) configuration.
Required Privilege Level
routing--To view this statement in the configuration.
416 routing-control--To add this statement to the configuration.
Release Information
Statement introduced in Junos OS Release 12.2.
bgp-peer
IN THIS SECTION Syntax | 416 Hierarchy Level | 416 Description | 417 Options | 417 Required Privilege Level | 417 Release Information | 417
Syntax
bgp-peer ip-address;
Hierarchy Level
[edit routing-instances name protocols evpn mclag]
417
Description
Configure an aggregation device in a Junos Fusion Enterprise or a multichassis link aggregation group (MC-LAG) topology to interwork with an Ethernet VPN-MPLS (EVPN-MPLS) device.
Options
ip-address IP address of the BGP peer. Typically, a BGP peer is identified by the IP address of the device's loopback interface.
Required Privilege Level
routing--To view this statement in the configuration. routing-control--To add this statement to the configuration.
Release Information
Statement introduced in Junos OS Release 17.4R1.
RELATED DOCUMENTATION Understanding EVPN-MPLS Interworking with Junos Fusion Enterprise and MC-LAG
chassis-id
IN THIS SECTION Syntax | 418
418
Hierarchy Level | 418 Description | 418 Required Privilege Level | 418 Release Information | 419
Syntax
chassis-id chassis-id;
Hierarchy Level
[editinterfaces aggregated-ether-options mc-ae]
Description
Specify the chassis ID of the multichassis aggregated Ethernet interface device. LACP uses the chassis ID to calculate the port number of the multichassis link aggregation group (MC-LAG) physical member links.
Required Privilege Level
interface--To view this statement in the configuration. interface-control--To add this statement to the configuration.
419
Release Information
Statement introduced in Junos OS Release 12.2.
detection-time (Liveness Detection)
IN THIS SECTION Syntax | 419 Hierarchy Level | 419 Description | 420 Required Privilege Level | 420 Release Information | 420
Syntax
detection-time { threshold milliseconds;
}
Hierarchy Level
[edit protocols iccp peer liveness-detection]
420
Description
The Bidirectional Forwarding Detection (BFD) timers are adaptive and can be adjusted to be faster or slower. The remaining statement is explained separately. See CLI Explorer.
Required Privilege Level
routing--To view this statement in the configuration. routing-control--To add this statement to the configuration.
Release Information
Statement introduced in Junos OS Release 10.0.
enhanced-convergence
IN THIS SECTION Syntax | 421 Hierarchy Level | 421 Description | 421 Required Privilege Level | 421 Release Information | 422
421
Syntax
enhanced-convergence;
Hierarchy Level
[edit interfaces aeX aggregated-ether-options mc-ae] [edit interfaces irb unit unit-number]
Description
NOTE: On EX9200 and QFX10000 switches, enhanced convergence is applicable for unicast traffic only--for example, when a MAC address is learned over an MC-AE interface, or an ARP entry is resolved over an MC-AE interface.
NOTE: Enhanced convergence is not supported on QFX5100, QFX5110, QFX5120, QFX5200-48Y, QFX5200-32C, and QFX5210-64C switches.
Improves Layer 2 and Layer 3 convergence time when a multichassis aggregated Ethernet (MC-AE) link goes down or comes up in a bridge domain or VLAN. Convergence time is improved because the traffic on the MC-AE interface is switched to the interchassis link (ICL) without waiting for a MAC address update. If you have configured an IRB interface over an MC-AE interface that has enhanced convergences enabled, then you must configure enhanced convergence on the IRB interface as well. Enhanced convergence must be enabled for both Layer 2 and Layer 3 interfaces.
Required Privilege Level
interface--To view this statement in the configuration.
422
interface-control--To add this statement to the configuration.
Release Information
Statement introduced in Junos OS Release 15.1R1.
groups
IN THIS SECTION Syntax | 422 Hierarchy Level | 423 Description | 423 Options | 423 Required Privilege Level | 425 Release Information | 425
Syntax
groups { group-name { configuration-data; when { chassis chassis-id; member member-id; model model-id; node node-id; peers [ names-of-peers ] routing-engine routing-engine-id; time <start-time> [to <end-time>]; }
423
conditional-data; } lccn-re0 {
configuration-data; } lccn-re1 {
configuration-data; } }
Hierarchy Level
[edit]
Description
Create a configuration group.
NOTE: Junos OS does not support configuring statements corresponding to third-party YANG data models, for example, OpenConfig or custom data models, under the [edit groups] hierarchy.
Options
group-name configurationdata when
Name of the configuration group. To configure multiple groups, specify more than one group name.
The configuration statements that are to be applied elsewhere in the configuration with the apply-groups statement, to have the target configuration inherit the statements in the group.
Define conditions under which the configuration group should be applied. Conditions include the type of chassis, model, or Routing Engine, virtual chassis member, cluster
424
node, and start and optional end time of day. If you specify multiple conditions in a single configuration group, all conditions must be met before the configuration group is applied.
� chassis chassis-id--Specify the chassis type of the router. Valid types include SCC0, SCC1, LCC0, LCC1 ... LCC3.
� member member-id--Specify the name of the member of the virtual chassis.
� model model-id--Specify the model name of the router, such as m7i or tx100.
� node node-id--Specify the cluster node.
� peers names-of-peers--Specify the names of the MC-LAG peers participating in commit synchronization.
� routing-engine routing-engine-id--Specify the type of Routing Engine, re0 or re1.
� time start-time [to end-time]--Specify the start time or time duration for this configuration group to be applied. If only the start time is specified, the configuration group is applied at the specified time and remains in effect until the time is changed. If the end time is specified, then on each day, the applied configuration group is started and stopped at the specified times. The syntax for specifying the time uses the format yyyy-mm-dd.hh:mm, hh:mm, or hh.
conditional-data
Option introduced in Junos 11.3. The conditional statements that are to be applied when this configuration group is applied. On routers that support multiple Routing Engines, you can also specify two special group names:
� re0--Configuration statements that are to be applied to the Routing Engine in slot 0.
� re1--Configuration statements that are to be applied to the Routing Engine in slot 1.
On routers that support multiple Routing Engines, you can also specify two special group names:
The configuration specified in group re0 is applied only if the current Routing Engine is in slot 0; likewise, the configuration specified in group re1 is applied only if the current Routing Engine is in slot 1. Therefore, both Routing Engines can use the same configuration file, each using only the configuration statements that apply to it. Each re0 or re1 group contains at a minimum the configuration for the hostname and the management interface (fxp0). If each Routing Engine uses a different management interface, the group also should contain the configuration for the backup router and static routes.
425
(Routing matrix only) The TX Matrix router supports group names for the Routing Engines in each connected T640 router in the following formats:
NOTE: The management Ethernet interface used for the TX Matrix Plus router, T1600 routers in a routing matrix, and PTX Series Packet Transport Routers, is em0. Junos OS automatically creates the router's management Ethernet interface, em0.
� lccn-re0--Configuration statements applied to the Routing Engine in slot 0 of the specified T640 router that is connected to a TX Matrix router.
� lccn-re1--Configuration statements applied to the specified to the Routing Engine in slot 1 of the specified T640 router that is connected to a TX Matrix router. n identifies the T640 router and can be from 0 through 3.
Required Privilege Level
configure--To enter configuration mode.
Release Information
Statement introduced before Junos OS Release 7.4.
RELATED DOCUMENTATION Creating a Configuration Group apply-groups apply-groups-except
426
iccp
IN THIS SECTION Syntax | 426 Hierarchy Level | 427 Description | 427 Required Privilege Level | 427 Release Information | 428
Syntax
iccp { authentication-key string; local-ip-addr local-ip-addr; peer ip-address{ authentication-key string; backup-liveness-detection { backup-peer-ip ip-address; } liveness-detection { detection-time { threshold milliseconds; } minimum-interval milliseconds; minimum-receive-interval milliseconds; multiplier number; no-adaptation; transmit-interval { minimum-interval milliseconds; threshold milliseconds; } version (1 | automatic); } local-ip-addr ipv4-address;
427
session-establishment-hold-time seconds; } session-establishment-hold-time seconds; traceoptions {
file <filename> <files number> <match regular-expression> <microsecondstamp> <size size> <world-readable | no-world-readable>;
flag flag; no-remote-trace; } }
Hierarchy Level
[edit protocols]
Description
Configure Inter-Chassis Control Protocol (ICCP) between the multichassis link aggregation group (MCLAG) peers. ICCP replicates forwarding information, validates configurations, and propagates the operational state of the MC-LAG members.
NOTE: Backup liveness detection is not supported on MX Series routers.
The remaining statements are explained separately. See CLI Explorer.
Required Privilege Level
routing--To view this statement in the configuration. routing-control--To add this statement to the configuration.
428
Release Information
Statement introduced in Junos OS Release 10.0.
iccp
IN THIS SECTION Syntax | 428 Hierarchy Level | 429 Description | 429 Default | 429 Options | 429 Required Privilege Level | 430 Release Information | 430
Syntax
iccp { traceoptions; { file <filename> <files number> <match regular-expression> <microsecond-
stamp> <size size> <world-readable | no-world-readable>; flag flag; no-remote-trace;
} local-ip-address ip address; session-establishment-hold-time value; authentication-key string; peer ip-address {
local-ip-address ip address; session-establishment-hold-time value; authentication-key string;
429
redundancy-group-id-list redundancy-group-id-list; liveness-detection; } }
Hierarchy Level
[edit protocols iccp] [edit logical-systems logical-system-name protocols iccp]
Description
Configure Interchassis Control Protocol (ICCP) between the multichassis link aggregation group (MCLAG) peers. ICCP replicates forwarding information, validates configurations, and propagates the operational state of the MC-LAG members.
Default
If you do not include this statement, no ICCP protocol tracing operations are performed.
Options
traceoptions--Set Interchassis Control Protocol (ICCP) tracing options. local-ip-address--Specify the source address where the ICCP packet is routed. session-establishment-hold-time--Specify if the chassis takes over as the primary at the ICCP session. authentication-key --Specify TCP Message Digest 5 (MD5) option for an ICCP TCP session. peer ip-address--Specify the IP address of the peer that hosts an MC-LAG. You must configure ICCP for both peers that host the MC-LAG.
430
redundancy-group-id-list--Specify the redundancy groups between two ICCP peers. The value you assign to this option must match the value you assign to the redundancy-group-id option that you configure on the MC-AE interface. If the value differs, when you commit the changes, the system reports a commit check error. liveness-detection--Specify Bidirectional Forwarding Detection (BFD) protocol options.
Required Privilege Level
interface--To view this statement in the configuration. interface-control--To add this statement to the configuration.
Release Information
Statement introduced in Junos OS Release 10.0. Support for logical systems introduced in Junos OS Release 14.1.
RELATED DOCUMENTATION Configuring ICCP for MC-LAG | 78
interface (Multichassis Protection)
IN THIS SECTION Syntax | 431 Hierarchy Level | 431 Description | 431 Required Privilege Level | 431 Release Information | 431
431
Syntax
interface interface-name;
Hierarchy Level
[edit multi-chassis multi-chassis-protection peer]
Description
Specify the name of the interface that is being used as an interchassis link-protection link (ICL-PL). The two switches hosting a multichassis link aggregation group (MC-LAG) use this link to pass Inter-Chassis Control Protocol (ICCP) and data traffic.
Required Privilege Level
interface--To view this statement in the configuration. interface-control--To add this statement to the configuration.
Release Information
Statement introduced in Junos OS Release 9.6.
432
local-ip-addr (ICCP)
IN THIS SECTION Syntax | 432 Hierarchy Level | 432 Description | 432 Options | 433 Required Privilege Level | 433 Release Information | 433
Syntax
local-ip-addr local-ip-address;
Hierarchy Level
[edit protocols iccp], [edit protocols iccp peer peer-IP-address]
Description
Specify the local IP address of the interchassis link (ICL) interface that Inter-Chassis Control Protocol (ICCP) uses to communicate to the peers that host a multichassis link aggregation group (MC-LAG).
433
Options
local-ip-address--Default local IP address to be used by all peers.
Required Privilege Level
routing--To view this statement in the configuration. routing-control--To add this statement to the configuration.
Release Information
Statement introduced in Junos OS Release 10.0.
mc-ae
IN THIS SECTION Syntax | 433 Hierarchy Level | 434 Description | 434 Options | 434 Required Privilege Level | 439 Release Information | 439
Syntax
mc-ae { chassis-id chassis-id;
434
events { iccp-peer-down; force-icl-down; prefer-status-control-active; } init-delay-time seconds; mc-ae-id mc-ae-id; mode (active-active | active-standby); redundancy-group group-id; revert-time revert-time; status-control (active | standby); switchover-mode (non-revertive |revertive);
}
Hierarchy Level
[edit interfaces aeX aggregated-ether-options], [edit logical-systems logical-system-name interfaces aeX aggregated-etheroptions]
Description
Enable multichassis link aggregation groups (MC-LAG), which enables one device to form a logical LAG interface with two or more other devices.
Options
chassis-id events
Specify the chassis ID for Link Aggregation Control Protocol (LACP) to calculate the port number of MC-LAG physical member links. Each MC-LAG peer should have a unique chassis ID.
� Values: 0 or 1
Specify an action if a specific MC-LAG event occurs.
435
iccp-peerdown
force-icldown
Specify an action if the ICCP peer of this node goes down.
If the node's ICCP peer goes down, bring down the interchassis-link logical interface.
preferstatuscontrolactive
Specify that the node configured as status-control active become the active node if the peer of this node goes down.
When ICCP goes down, you can use this keyword to make a mc-lag PE to become the active PE. For example, if you want mc-lag PE1 to be Active on ICCP down, then configure this keyword in PE1. It is not recommended to configure this keyword in both the mc-lag PEs.
NOTE: The prefer-status-control-active statement can be configured with the status-control standby configuration to prevent the LACP MC-LAG system ID from reverting to the default LACP system ID on ICCP failure. Use this configuration only if you can ensure that ICCP will not go down unless the router or switch is down. You must also configure the hold-time down value (at the [edit interfaces interface-name] hierarchy level) for the interchassis link with the status-control standby configuration to be higher than the ICCP BFD timeout. This configuration prevents data traffic loss by ensuring that when the router or switch with the status-control active configuration goes down, the router or switch with the status-control standby configuration does not go into standby mode.
To make the prefer-status-control-active configuration work with the status-control standby configuration when an interchassis-link logical interface is configured on aggregate Ethernet interface, you must either configure the lacp periodic interval statement at the [edit interface interface-name aggregated-ether-options] hierarchy level as slow or configure the detection-time threshold statement at the [edit protocols iccp peer liveness-detection] hierarchy level as less than 3 seconds.
init-delay-time seconds
To minimize traffic loss, specify the number of seconds in which to delay bringing the multichassis aggregated Ethernet interface back to the up state when you reboot an MC-LAG peer. By delaying the startup of the interface until after protocol convergence, you can prevent packet loss during the recovery of failed links and devices.
436
NOTE: On QFX and EX Series switches, the default session establishment hold time is 300 seconds. However, the session establishment time must be at least 100 seconds higher than the init delay time. You can optionally update the session establishment time to be 340 seconds and the init delay time to be 240 seconds.
mc-ae-id mcae-id
Specify the identification number of the MC-LAG device. The two MC-LAG network devices that manage a given MC-LAG must have the same identification number.
� Range: 1 through 65,535
mode (activeactive | activestandby)
Specify whether the MC-LAG is in active-active or active-standby mode. Chassis that are in the same group must be in the same mode.
NOTE: You can configure IPv4 (inet) and IPv6 (inet6) addresses on mc-ae interfaces when the active-standby mode is configured.
In active-active mode, all member links are active on the MC-LAG. In this mode, media access control (MAC) addresses learned on one MC-LAG peer are propagated to the other MC-LAG peer. Active-active mode is a simple and deterministic design and is easier to troubleshoot than active-standby mode.
NOTE: Active-active mode is not supported on Dense Port Concentrator (DPC) line cards. Instead, use active-standby mode.
In active-active MC-LAG topologies, network interfaces are categorized into three interface types, as follows: � S-Link--Single-homed link (S-Link) terminating on an MC-LAG peer device
� MC-Link--MC-LAG link
� ICL--Inter-chassis link
� Mode Indicates whether an MC-LAG is in active-standby mode or active-active mode. Chassis that are in the same group must be in the same mode.
437
In active-active mode, all member links are active on the MC-LAG. In this mode, media access control (MAC) addresses learned on one MC-LAG peer are propagated to the other MC-LAG peer. Active-active mode is a simple and deterministic design and is easier to troubleshoot than active-standby mode.
NOTE: Active-active mode is not supported on Dense Port Concentrator (DPC) line cards. Instead, use active-standby mode.
Depending on the incoming and outgoing interface types, some constraints are added to the Layer 2 forwarding rules for MC-LAG configurations. The following data traffic forwarding rules apply.
NOTE: If only one MC-LAG member link is in the up state, it is considered an S-Link.
� When an MC-LAG network receives a packet from a local MC-Link or S-Link, the packet is forwarded to other local interfaces, including S-Links and MCLinks based on the normal Layer 2 forwarding rules and on the configuration of the mesh-group and no-local-switching statements. If MC-Links and S-Links are in the same mesh group and their no-local-switching statements are enabled, the received packets are only forwarded upstream and not sent to MC-Links and S-Links.
� The following circumstances determine whether or not an ICL receives a packet from a local MC-Link or S-Link:
� If the peer MC-LAG network device has S-Links or MC-LAGs that do not reside on the local MC-LAG network device
� Whether or not interfaces on two peering MC-LAG network devices are allowed to talk to each other
� When an MC-LAG network receives a packet from the ICL, the packet is forwarded to all local S-Links and active MC-LAGs that do not exist in the MCLAG network from which the packet was sent.
In active-standby mode, only one of the MC-LAG peers is active at any given time. The other MC-LAG peer is in backup (standby) mode. The active MC-LAG peer uses Link Aggregation Control Protocol (LACP) to advertise to client devices that
438
its child link is available for forwarding data traffic. Active-standby mode should be used if you are interested in redundancy only. If you require both redundancy and load sharing across member links, use active-active mode.
NOTE: Active-standby mode is not supported on EX4300 and QFX Series switches.
redundancygroup group-id
Specify the redundancy group identification number. The Inter-Chassis Control Protocol (ICCP) uses the redundancy group ID to associate multiple chassis that perform similar redundancy functions. The value you assign to this option must match the value you assign to the redundancy-group-id-list option that you configure on the ICCP peer. If the value differs, when you commit the changes, the system reports a commit check error.
BEST PRACTICE: We recommend that you configure only one redundancy group between MC-LAG nodes. The redundancy group represents the domain of high availability between the MC-LAG nodes. One redundancy group is sufficient between a pair of MC-LAG nodes. If you are using logical systems, then configure one redundancy group between MC-LAG nodes in each logical system.
� Range: 1 through 4,294,967,294
revert-time
Wait interval (in minutes) before the switchover to the preferred node is performed when the switchover-mode is configured as revertive.
� Range: 1 through 10
status-control (active | standby)
Specify whether the chassis becomes active or remains in standby mode when an interchassis link failure occurs.
� Events ICCP-Peer-Down Force-ICL-Down
Forces the ICL to be down if the peer of this node goes down.
� Events ICCP-Peer-Down Prefer-Status-Control-Active
Allows the LACP system ID to be retained during a reboot, which provides better convergence after a failover.
switchovermode (non-
Specify whether Junos OS should trigger a link switchover to the preferred node when the active node is available.
revertive | revertive)
439
NOTE: For revertive mode to automatically switch over to the preferred node, the status-control statement should be configured as active.
Required Privilege Level
interface--To view this statement in the configuration. interface-control--To add this statement to the configuration.
Release Information
Statement introduced in Junos OS Release 9.6. events statement introduced in Junos OS Release 11.4R4 for MX Series routers. prefer-status-control-active statement introduced in Junos OS Release 13.2R1 for EX Series switches. init-delay-time seconds statement introduced in Junos OS Release 13.2R3 for EX Series switches. switchover-mode and revert-time statements introduced in Junos OS Release 13.3. Support for logical systems introduced in Junos OS Release 14.1.
mc-ae-id
IN THIS SECTION Syntax | 440 Hierarchy Level | 440 Description | 440 Options | 440
440
Required Privilege Level | 440 Release Information | 441
Syntax
mc-ae-id mc-ae-id;
Hierarchy Level
[edit interfaces aggregated-ether-options mc-ae]
Description
Specify the multichassis aggregated Ethernet (MC-AE) identification number of the MC-AE that a given aggregated Ethernet interface belongs to. The two peers that host a given multichassis link aggregation group (MC-LAG) must have the same multichassis aggregated Ethernet ID.
Options
� Range: 1 through 65535.
Required Privilege Level
interface--To view this statement in the configuration. interface-control--To add this statement to the configuration.
441
Release Information
Statement introduced in Junos OS Release 12.2.
mclag
IN THIS SECTION Syntax | 441 Hierarchy Level | 441 Description | 442 Required Privilege Level | 442 Release Information | 442
Syntax
mclag { bgp-peer ip-address;
}
Hierarchy Level
[edit routing-instances name protocols evpn]
442
Description
Configure parameters that enable the interworking of Ethernet VPN-MPLS (EVPN-MPLS) with a Junos Fusion Enterprise or a multichassis link aggregation group (MC-LAG) topology. The remaining statements are explained separately. See CLI Explorer.
Required Privilege Level
routing--To view this statement in the configuration. routing-control--To add this statement to the configuration.
Release Information
Statement introduced in Junos OS Release 17.4R1.
RELATED DOCUMENTATION Understanding EVPN-MPLS Interworking with Junos Fusion Enterprise and MC-LAG
mclag-arp-nd-sync
IN THIS SECTION Syntax | 443 Hierarchy Level | 443 Description | 443 Required Privilege Level | 443 Release Information | 443
443
Syntax
mclag-arp-nd-sync;
Hierarchy Level
[edit logical-systems name protocols l2-learning], [edit protocols l2-learning]
Description
When MC-LAG peers power up or reboot, Address Resolution Protocol (ARP) and Neighbor Discovery (ND) entries are learned and synchronized by the peers. Because the MC-LAG peers synchronize and learn each other's ARP and ND entries, relearning these entries is not needed on the device. Only the ARP and ND entries that are pointing to either an MC-AE or corresponding ICL are synchronized. This same behavior is applicable when an IRB comes up and goes down. In this case, only those ARP and ND entries corresponding to an IRB that is part of an MC-LAG (for example, bridge domain, or VLAN) are synchronized by the peers.
Required Privilege Level
routing
Release Information
Statement introduced in Junos OS Release 14.2.
444 RELATED DOCUMENTATION
Understanding Multichassis Link Aggregation Groups | 2
mclag-arpreq-sync
IN THIS SECTION Syntax | 444 Hierarchy Level | 444 Description | 444 Required Privilege Level | 445 Release Information | 445
Syntax
mclag-arpreq-sync;
Hierarchy Level
[edit logical-systems name protocols l2-learning], [edit protocols l2-learning]
Description
In an active-active MC-LAG configuration, Address Resolution Protocol (ARP) requests are synchronized between the MC-LAG peers.
445
Required Privilege Level
routing
Release Information
Statement introduced in Junos OS Release 12.3.
RELATED DOCUMENTATION Understanding Multichassis Link Aggregation Groups | 2
minimum-interval (Liveness Detection)
IN THIS SECTION Syntax | 445 Hierarchy Level | 446 Description | 446 Options | 446 Required Privilege Level | 446 Release Information | 446
Syntax
minimum-interval milliseconds;
446
Hierarchy Level
[edit protocols iccp peer liveness-detection]
Description
Configure simultaneously the minimum interval at which the peer transmits liveness detection requests and the minimum interval at which the peer expects to receive a reply from a peer with which it has established a Bidirectional Forwarding Detection (BFD) session. Optionally, instead of using this statement, you can specify the minimum transmit and receive intervals separately by using the transmitinterval minimal-interval and minimum-receive-interval statements, respectively.
Options
milliseconds--Specify the minimum interval value for Bidirectional Forwarding Detection (BFD). � Range: 1 through 255,000
Required Privilege Level
routing--To view this statement in the configuration. routing-control--To add this statement to the configuration.
Release Information
Statement introduced in Junos OS Release 10.0.
447
minimum-receive-interval (Liveness Detection)
IN THIS SECTION Syntax | 447 Hierarchy Level | 447 Description | 447 Options | 448 Required Privilege Level | 448 Release Information | 448
Syntax
minimum-receive-interval milliseconds;
Hierarchy Level
[edit protocols iccp peer liveness-detection]
Description
Configure the minimum interval at which the peer must receive a reply from a peer with which it has established a Bidirectional Forwarding Detection (BFD) session.
448
Options
milliseconds--Specify the minimum interval value. � Range: 1 through 255,000
Required Privilege Level
routing--To view this statement in the configuration. routing-control--To add this statement to the configuration.
Release Information
Statement introduced in Junos OS Release 10.0.
mode (QFX Series)
IN THIS SECTION Syntax | 449 Hierarchy Level | 449 Description | 449 Options | 449 Required Privilege Level | 449 Release Information | 449
449
Syntax
mode active-active ;
Hierarchy Level
[edit interfaces aggregated-ether-options mc-ae]
Description
Configure the multichassis link aggregation group (MC-LAG) to be in active-active mode. In active-active mode, all of the members of the MC-LAG will be active on both routing or switching devices. Only active-active mode is supported at this time.
Options
active-active Specify that all of the members of the MC-LAG will be active on both routing or switching devices.
Required Privilege Level
interface--To view this statement in the configuration. interface-control--To add this statement to the configuration.
Release Information
Statement introduced in Junos OS Release 12.2.
450
multiplier (Liveness Detection)
IN THIS SECTION Syntax | 450 Hierarchy Level | 450 Description | 450 Options | 451 Required Privilege Level | 451 Release Information | 451
Syntax
multiplier number;
Hierarchy Level
[edit protocols iccp peer liveness-detection]
Description
Configure the number of liveness detection requests not received by the peer before Bidirectional Forwarding Detection (BFD) declares the peer is down.
451
Options
number Maximum allowable number of liveness detection requests missed by the peer. � Range: 1 through 255 � Default: 3
Required Privilege Level
routing--To view this statement in the configuration. routing-control--To add this statement to the configuration.
Release Information
Statement introduced in Junos OS Release 12.2.
multi-chassis
IN THIS SECTION Syntax | 452 Hierarchy Level | 452 Description | 452 Required Privilege Level | 452 Release Information | 452
452
Syntax
multi-chassis { multi-chassis-protection peer-ip-address { interface interface-name; } mc-lag consistency-check;
}
Hierarchy Level
[edit]
Description
Configure an interchassis link-protection link (ICL-PL) between the two peers that host a multichassis link aggregation group (MC-LAG). You can configure either an aggregated Ethernet interface or a 10Gigabit Ethernet interface to be an ICL-PL. The remaining statements are explained separately. See CLI Explorer.
Required Privilege Level
interface--To view this statement in the configuration. interface-control--To add this statement to the configuration.
Release Information
Statement introduced in Junos OS Release 9.6.
453
multi-chassis-protection
IN THIS SECTION Syntax | 453 Hierarchy Level | 453 Description | 453 Required Privilege Level | 454 Release Information | 454
Syntax
multi-chassis-protection peer-ip-address { interface interface-name;
}
Hierarchy Level
[edit multi-chassis]
Description
Configure multichassis link protection between the two peers that host a multichassis link aggregation group (MC-LAG). If the Interchassis Control Protocol (ICCP) connection is up and the interchassis link (ICL) comes up, the peer configured as standby brings up the multichassis aggregated Ethernet interfaces shared with the peer. Multichassis protection must be configured on one interface for each peer. The remaining statement is explained separately. See CLI Explorer.
454
Required Privilege Level
interface--To view this statement in the configuration. interface-control--To add this statement to the configuration.
Release Information
Statement introduced in Junos OS Release 9.6.
multi-chassis-protection
IN THIS SECTION Syntax | 454 Hierarchy Level | 455 Description | 455 Options | 455 Required Privilege Level | 455 Release Information | 456
Syntax
multi-chassis-protection { peer a.b.c.d { interface interface-name; } }
455
Hierarchy Level
[edit interfaces interface-name]
Description
For MX Series routers with multichassis aggregated Ethernet (MC-AE) interfaces, you can use this statement under the physical interface level to reduce the configuration at the logical interface level if the following assumption exists: If there are n +1 logical interfaces under ae0, from ae0.0 through ae0.n, there will be n + 1 logical interfaces under ge-0/0/0 as well, from ge-0/0/0.0 through ge-0/0/0.n, and each ge-0/0/0 logical interface will be a protection link for the ae0 logical interface.
NOTE: A bridge domain cannot have MC-AE logical interfaces which belong to different redundancy groups.
If the Inter-Chassis Control Protocol (ICCP) connection is UP and the interchassis data link (ICL) comes UP, the router configured as standby will bring up the MC-AE interfaces shared with the peer. The remaining statements are explained separately. See CLI Explorer.
Options
interface interface-name
Specify the interface: interface interface-name-fpc/pic/port
Required Privilege Level
interface--To view this statement in the configuration. interface-control--To add this statement to the configuration.
456
Release Information
Statement introduced in Junos OS Release 11.1.
RELATED DOCUMENTATION Configuring Active-Active Bridging and VRRP over IRB in Multichassis Link Aggregation on MX Series Routers and QFX Series Switches Configuring Aggregated Ethernet Link Protection Example: Configuring Aggregated Ethernet Link Protection peer | 460
no-adaptation (Liveness Detection)
IN THIS SECTION Syntax | 456 Hierarchy Level | 457 Description | 457 Required Privilege Level | 457 Release Information | 457
Syntax
no-adaptation;
457
Hierarchy Level
[edit protocols iccp peer liveness-detection]
Description
Configure Bidirectional Forwarding Detection (BFD) sessions to not adapt to changing network conditions.
Required Privilege Level
routing--To view this statement in the configuration. routing-control--To add this statement to the configuration.
Release Information
Statement introduced in Junos OS Release 10.0.
peer (ICCP)
IN THIS SECTION Syntax | 458 Hierarchy Level | 458 Description | 458 Required Privilege Level | 459 Release Information | 459
458
Syntax
peer ip-address { authentication-key string; backup-liveness-detection { backup-peer-ip ip-address; } liveness-detection { detection-time { threshold milliseconds; } minimum-intervalmilliseconds; minimum-receive-interval milliseconds; multiplier number; no-adaptation; transmit-interval { minimum-interval milliseconds; threshold milliseconds; } version (1 | automatic); } local-ip-addr ipv4-address; session-establishment-hold-time seconds;
}
Hierarchy Level
[edit protocols iccp]
Description
Configure the peers that host a multichassis link aggregation group (MC-LAG). You must configure InterChassis Control Protocol (ICCP) for both peers that host the MC-LAG. The remaining statements are explained separately. See CLI Explorer.
459
Required Privilege Level
routing--To view this statement in the configuration. routing-control--To add this statement to the configuration.
Release Information
Statement introduced in Junos OS Release 10.0.
peer (Multichassis)
IN THIS SECTION Syntax | 459 Hierarchy Level | 460 Description | 460 Required Privilege Level | 460 Release Information | 460
Syntax
peer ip-address { interface interface-name;
}
460
Hierarchy Level
[edit multi-chassis]
Description
Configure the IP address of the peer that is part of the interchassis link-protection link (ICL-PL). If InterChassis Control Protocol (ICCP) is up and the interchassis link (ICL) comes up, the peer configured as standby will bring up the multichassis aggregated Ethernet interfaces shared with the active peer specified by the peer statement. You must specify the physical interface of the peer. The remaining statement is explained separately. See CLI Explorer.
Required Privilege Level
interface--To view this statement in the configuration. interface-control--To add this statement to the configuration.
Release Information
Statement introduced in Junos OS Release 9.6.
peer
IN THIS SECTION Syntax | 461 Hierarchy Level | 461
461
Description | 461 Options | 461 Required Privilege Level | 462 Release Information | 462
Syntax
peer a.b.c.d { interface interface-name;
}
Hierarchy Level
[edit interfaces interface-name multi-chassis-protection]
Description
For MX Series routers with multichassis aggregated Ethernet (MC-AE) interfaces, use the multi-chassisprotection statement under the physical interface level to reduce the configuration at the logical interface level. If the interchassis control protocol connection (ICCP) is UP and the interchassis data link (ICL) comes UP, the router configured as standby will bring up the MC-AE interfaces shared with the peer active-active node specified by the peer statement. You must also specify the peer's physical interface.
Options
a.b.c.d
Specify the IP address of the peer.
462
interface interface-name Specify the peer's physical interface: interface interface-name-fpc/pic/port
Required Privilege Level
interface--To view this statement in the configuration. interface-control--To add this statement to the configuration.
Release Information
Statement introduced in Junos OS Release 11.1.
RELATED DOCUMENTATION Configuring Active-Active Bridging and VRRP over IRB in Multichassis Link Aggregation on MX Series Routers and QFX Series Switches Configuring Aggregated Ethernet Link Protection Example: Configuring Aggregated Ethernet Link Protection multi-chassis-protection | 454
peers (Commit)
IN THIS SECTION Syntax | 463 Hierarchy Level | 463 Description | 463 Options | 463 Required Privilege Level | 463 Release Information | 464
463
Syntax
peers { name of peer { user name of user; authentication string; }
}
Hierarchy Level
[edit system commit]
Description
Configure options for the peers participating in commit synchronization.
Options
name of peer user authentication
Hostname or IP address of the peer participating in commit synchronization. Name of administrator configuring commit synchronization. Plain-text password string that is stored as an encrypted password string.
Required Privilege Level
maintenance--To view this statement in the configuration. maintenance-control--To add this statement to the configuration.
464
Release Information
Statement introduced in Junos OS Release 14.2R6.
peers-synchronize
IN THIS SECTION Syntax | 464 Hierarchy Level | 464 Description | 464 Required Privilege Level | 465 Release Information | 465
Syntax
peers-synchronize;
Hierarchy Level
[edit system commit]
Description
Configure the commit command to automatically perform a peers-synchronize action between peers. The local peer (or requesting peer) on which you enable the peers-synchronize statement copies and loads its configuration to the remote (or responding) peer. Each peer then performs a syntax check on
465
the configuration file being committed. If no errors are found, the configuration is activated and becomes the current operational configuration on both peers.
Required Privilege Level
system--To view this statement in the configuration. system-control--To add this statement to the configuration.
Release Information
Statement introduced in Junos OS Release 14.2R6.
RELATED DOCUMENTATION server synchronize
status-control
IN THIS SECTION Syntax | 466 Hierarchy Level | 466 Description | 466 Required Privilege Level | 466 Release Information | 466
466
Syntax
status-control (active | standby);
Hierarchy Level
[edit interfaces aggregated-ether-options mc-ae]
Description
Specify whether a peer hosting a multichassis link aggregation group (MC-LAG) is primary or secondary. Primary is considered active, and secondary is considered standby.
Required Privilege Level
interface--To view this statement in the configuration. interface-control--To add this statement to the configuration.
Release Information
Statement introduced in Junos OS Release 12.2.
467
session-establishment-hold-time
IN THIS SECTION Syntax | 467 Hierarchy Level | 467 Description | 467 Options | 468 Required Privilege Level | 468 Release Information | 468
Syntax
session-establishment-hold-time seconds;
Hierarchy Level
[edit protocols iccp], [edit protocols iccp peer]
Description
Specify the time during which an Inter-Chassis Control Protocol (ICCP) connection must be established after IP route reachability between MC-LAG peers is up. When an MC-LAG peer detects IP route reachability to the MC-LAG peer, it tries to connect to it during the session-establishment-hold-time.
468
NOTE: On QFX and EX Series switches, the default session establishment hold time is 300 seconds. However, the session establishment time must be at least 100 seconds higher than the init delay time. You can optionally update the session establishment time to be 340 seconds and the init delay time to be 240 seconds.
Options
seconds Time (in seconds) within which a successful ICCP connection must be established.
Required Privilege Level
routing--To view this statement in the configuration. routing-control--To add this statement to the configuration.
Release Information
Statement introduced in Junos OS Release 10.0.
threshold (Detection Time)
IN THIS SECTION Syntax | 469 Hierarchy Level | 469 Description | 469 Options | 469
469
Required Privilege Level | 470 Release Information | 470
Syntax
threshold milliseconds;
Hierarchy Level
[edit protocols iccp peer liveness-detection detection-time]
Description
Specify the threshold for the adaptation of the detection time for a Bidirectional Forwarding Detection (BFD) session. When the detection time adapts to a value equal to or greater than the threshold, a single trap and a single system log message are sent.
NOTE: The threshold time must be greater than or equal to the minimum-interval or the minimum-receive-interval values.
Options
milliseconds-- Value for the detection time adaptation threshold. � Range: 1 through 255,000
470
Required Privilege Level
routing--To view this statement in the configuration. routing-control--To add this statement to the configuration.
Release Information
Statement introduced in Junos OS Release 10.0.
transmit-interval (Liveness Detection)
IN THIS SECTION Syntax | 470 Hierarchy Level | 471 Description | 471 Required Privilege Level | 471 Release Information | 471
Syntax
transmit-interval { minimum-interval milliseconds; threshold milliseconds;
}
471
Hierarchy Level
[edit protocols iccp peer liveness-detection]
Description
Configure the Bidirectional Forwarding Detection (BFD) transmit interval. The negotiated transmit interval for a peer is the interval between the sending of BFD liveness detection requests to peers. The receive interval for a peer is the minimum interval between receiving packets sent from its peer; the receive interval is not negotiated between peers. To determine the transmit interval, each peer compares its configured minimum transmit interval with its peer's minimum receive interval. The larger of the two numbers is accepted as the transmit interval for that peer. The remaining statements are explained separately. See CLI Explorer.
Required Privilege Level
routing--To view this statement in the configuration. routing-control--To add this statement to the configuration.
Release Information
Statement introduced in Junos OS Release 10.0.
version (Liveness Detection)
IN THIS SECTION Syntax | 472
472
Hierarchy Level | 472 Description | 472 Options | 472 Required Privilege Level | 473 Release Information | 473
Syntax
version (1 | automatic);
Hierarchy Level
[edit protocols iccp peer liveness-detection]
Description
Configure the Bidirectional Forwarding Detection (BFD) protocol version to detect.
Options
1 automatic
Use BFD protocol version 1. Autodetect the BFD protocol version.
473
Required Privilege Level
routing--To view this statement in the configuration. routing-control--To add this statement to the configuration.
Release Information
Statement introduced in Junos OS Release 10.0.
8 CHAPTER
Operational Commands
request interface mc-ae switchover (Multichassis Link Aggregation) | 475 request interface (revert | switchover) (Aggregated Ethernet Link Protection) |
477 request lacp link-switchover | 479 show iccp | 481 show interfaces mc-ae | 484 show l2-learning redundancy-groups | 488 show multi-chassis mc-lag configuration-consistency list-of-parameters | 495 show multi-chassis mc-lag configuration-consistency | 510 show multi-chassis mc-lag configuration-consistency global-config | 517 show multi-chassis mc-lag configuration-consistency icl-config | 520 show multi-chassis mc-lag configuration-consistency mcae-config | 523 show multi-chassis mc-lag configuration-consistency vlan-config | 528 show multi-chassis mc-lag configuration-consistency vrrp-config | 532
475
request interface mc-ae switchover (Multichassis Link Aggregation)
IN THIS SECTION Syntax | 475 Description | 475 Options | 476 Required Privilege Level | 476 Output Fields | 476 Sample Output | 476 Sample Output | 477 Release Information | 477
Syntax
request interface mc-ae switchover <immediate> mcae-id mcae-id; mcae-id mcae-id;
Description
Manually revert egress traffic from the active node to the designated preferred node of a multichassis aggregated Ethernet interface. You can use this command to manually switch over traffic to the preferred node when the switchover-mode statement for the multichassis aggregated Ethernet interface is configured as non-revertive at the [edit interfaces aeX mc-ae] hierarchy level.
476
NOTE: To run this command successfully, the status-control statement should be configured as active at the [edit interfaces aeX mc-ae] hierarchy level.
Options
immediate
(Optional) Trigger immediate switchover to the preferred node. If this option is not configured, Junos OS waits for the timer configured using the revert-time statement at the [edit interfaces aeX mc-ae] hierarchy level to expire before it triggers the switchover.
mcae-id mcae-id Triggers switchover for the specified mc-ae interface.
Required Privilege Level
view
Output Fields
When you enter this command, you are provided feedback on the status of your request.
Sample Output
request interface mc-ae switchover immediate mcae-id
user@host >request interface mc-ae switchover immediate mcae-id 2 MCAE: Switchover Done
477
Sample Output
request interface mc-ae switchover mcae-id
user@host >request interface mc-ae switchover mcae-id 2 Switchover In Progress: Please check after 1 minutes, Use "show interfaces mc-ae revertive-info" to check for the status
Release Information
Command introduced in Junos OS Release 13.3.
RELATED DOCUMENTATION Forcing MC-LAG Links or Interfaces with Limited LACP Capability to Be Up Configuring Manual and Automatic Link Switchover for MC-LAG Interfaces on MX Series Routers
request interface (revert | switchover) (Aggregated Ethernet Link Protection)
IN THIS SECTION Syntax | 478 Description | 478 Options | 478 Required Privilege Level | 479 Output Fields | 479 Sample Output | 479 Release Information | 479
478
Syntax
request interface (revert | switchover) aex
Description
Manually revert egress traffic from the designated backup link to the designated primary link of an aggregated Ethernet interface for which link protection is enabled, or manually switch egress traffic from the primary link to the backup link. This traffic includes transit traffic and local traffic originated on the router itself.
NOTE: When link protection is enabled on an aggregated Ethernet interface, if the primary link fails, the router automatically routes egress traffic to the backup link. However, the router does not automatically route egress traffic back to the primary link when the primary link is subsequently reestablished. Instead, you manually control when to have traffic diverted back to the primary link by issuing the request interface (revert | switchover) (Aggregated Ethernet Link Protection) operational command and specifying the revert keyword.
On M Series and T Series routers, use the request interface (revert | switchover) (Adaptive Services) operational command to manually revert to the primary adaptive services interface or link services interface, or to switch from the primary to the secondary interface. For information about this command, see request interface (revert | switchover) (Adaptive Services).
Options
revert switchover aex
Restores egress traffic processing to the primary link. Transfers egress traffic processing to the secondary (backup) link. Aggregated Ethernet logical interface number: 0 through 15.
479
Required Privilege Level
view
Output Fields
When you enter this command, you are provided feedback on the status of your request.
Sample Output
request interface revert
user@host >request interface revert ae1
Release Information
Command introduced in Junos OS Release 8.3.
request lacp link-switchover
IN THIS SECTION Syntax | 480 Description | 480 Options | 480 Required Privilege Level | 480 Output Fields | 481 Sample Output | 481
480 Release Information | 481
Syntax
request lacp link-switchover aex
Description
Manually switch aggregated Ethernet active or standby LACP links.
NOTE: Because this command overrides LACP priority calculations, we strongly recommend that you use this command only when the actor (in this case, the Juniper Networks router) is controlling the active or standby link and the partner (peer) is following. This scenario occurs when you configure only the actor for link protection.
Options
aex
Aggregated Ethernet logical interface number: 0 through 15.
Required Privilege Level
view
481
Output Fields
When you enter this command, you are provided feedback on the status of your request. To view the switchover, use the show lacp interfaces command.
Sample Output
request lacp link-switchover aeX
user@host >request lacp link-switchover ae0ae0: Request succeeded
Release Information
Command introduced in Junos OS Release 9.3.
show iccp
IN THIS SECTION Syntax | 482 Description | 482 Options | 482 Required Privilege Level | 482 Output Fields | 482 Sample Output | 483 Release Information | 484
482
Syntax
show iccp <brief | detail> logical-system [system-name | all]
Description
Display Inter-Chassis Control Protocol (ICCP) information about the multichassis link aggregation group (MC-LAG) peers, including the state of the TCP connection, Bidirectional Forwarding Detection (BFD) protocol, backup liveness peer status, and MCSNOOPD, LACPD, and ESWD applications.
Options
none--Display ICCP information about the MC-LAG peers, including the state of the TCP connection and BFD protocol, and MCSNOOPD, LACP, and ESWD applications. brief--Display brief ICCP information about the MC-LAG peers, including the state of the TCP connection and BFD protocol, and MCSNOOPD, LACP, and ESWD applications. detail--Display detailed ICCP information about the MC-LAG peers, including the state of the TCP connection and BFD protocol, and MCSNOOPD, LACP, and ESWD applications. logical-system [system-name | all]--(Optional) Display information for a specified logical system or all systems.
Required Privilege Level
view
Output Fields
Table 13 on page 483 lists the output fields for the show iccp command. Output fields are listed in the approximate order in which they appear.
483
Table 13: show iccp Output Fields
Field Name
Field Description
Redundancy Group Information for peer
Aggregated Ethernet interface name.
TCP Connection
Specifies if the TCP connection between the peers hosting the MC-LAG is up or down.
Liveness Detection
Specifies if liveness detection, also known as Bidirectional Forwarding Detection (BFD), is up or down.
Client Application Specifies information regarding the state of the MCSNOOPD and client applications.
Sample Output
show iccp (QFX Series)
user@switch> show iccp
Redundancy Group Information for peer 10.3.3.2
TCP Connection
: Established
Liveliness Detection : Up
Client Application: MCSNOOPD
Client Application: eswd
show iccp (MX Series)
user@host> show iccp Logical system :LS1
484
Redundancy Group Information for peer 10.1.1.1
TCP Connection
: Established
Liveliness Detection : Up
Redundancy Group ID
Status
1
Up
2
Up
Client Application: lacpd Redundancy Group IDs Joined: 1 Redundancy Group IDs Joined: 2
Client Application: l2ald_iccpd_client Redundancy Group IDs Joined: 1 Redundancy Group IDs Joined: 2
Release Information
Command introduced in Junos OS Release 10.0. Support for logical systems added in Junos OS Release 14.1 for MX Series routers.
RELATED DOCUMENTATION iccp | 426
show interfaces mc-ae
IN THIS SECTION
Syntax | 485 Description | 485 Options | 485 Required Privilege Level | 485
485
Output Fields | 486 Sample Output | 487 Release Information | 488
Syntax
show interfaces mc-ae id identifier unit number
Description
On peers with multichassis aggregated Ethernet (mc-aeX) interfaces, use this command to display information about the multichassis aggregated Ethernet interfaces.
NOTE: In Junos OS Release 17.4R1, this command is not supported on EX4300, EX9200, PTX10000, QFX10002, and QFX10008 devices.
Options
id identifier unit number
(Optional) Specify the name of the multichassis aggregated Ethernet interface. (Optional) Specify the logical interface by unit number.
Required Privilege Level
view
486
Output Fields
Table 14 on page 486 lists the output fields for the show interfaces mc-ae command. Output fields are listed in the approximate order in which they appear.
Table 14: show interfaces mc-ae Output Fields
Output Field Name
Field Description
Current State Machine's State
Specifies the state of the MC-LAG initialization state machine.
Configuration Consistency Check
Specifies the status of the MC-LAG configuration consistency check feature. The status is either Passed or Failed. If the status is Failed, the system will display the name of the parameter that failed consistency check. If there are multiple inconsistencies, only the first inconsistency is shown. If the enforcement level for the MC-LAG parameter was mandatory, and you did not configure that parameter correctly, the command will show that the MC-LAG interface is down.
Member Link
Specifies the identifiers of the configured multichassis link aggregated interface members.
Local Status
Specifies the status of the local link: active or standby.
Peer Status
Specifies the status of the peer link: active or standby.
Peer State
Specifies the status of the local and peer links in an active/ active MC-LAG configuration.
Logical Interface
Specifies the identifier and unit of the AE interface.
Topology Type
Specifies the bridge configured on the AE.
Local State
Specifies if the local device is up or down.
487
Table 14: show interfaces mc-ae Output Fields (Continued)
Output Field Name
Field Description
Peer State
Specifies if the peer device is up or down.
Peer Ip/MCP/State
Specifies the multichassis protection (MCP) link or the interchassis link-protection link (ICL-PL) for all of the multichassis aggregated Ethernet interfaces that are part of the peer.
Sample Output
show interfaces mc-ae (EX Series )
user@switch> show interfaces mc-ae ae1 512
Member Link
: ae1
Current State Machine's State: mcae active state
Configuration Consistency Check : Failed (redundancy group id mismatch)
Local Status
: active
Local State
: up
Peer Status
: standby
Peer State
: up
Logical Interface
: ae1.0
Topology Type
: bridge
Local State
: up
Peer State
: up
Peer Ip/MCP/State
: 10.1.1.1 ae0.0 up
show interfaces mc-ae (MX Series)
user@host> show interfaces mc-ae ae0 unit 512
Member Links : ae0
Local Status : active
Peer Status : active
Logical Interface
: ae0.512
488
Core Facing Interface : Label Ethernet Interface
ICL-PL
: Label Ethernet Interface
show interfaces mc-ae (Active/Active Bridging and VRRP over IRB on MX Series)
user@host# show interfaces mc-ae ge-0/0/0.0
Member Link
: ae0
Current State Machine's State: active
Local Status
: active
Local State
: up
Peer Status
: active
Peer State
: up
Logical Interface
: ae0.0
Topology Type
: bridge
Local State
: up
Peer State
: up
Peer Ip/ICL-PL/State
: 192.168.100.10 ge-0/0/0.0 up
Release Information
Command introduced in Junos OS Release 9.6. Configuration Consistency Check output field added in Junos OS Release 15.1X53-D60 for the QFX Series.
show l2-learning redundancy-groups
IN THIS SECTION
Syntax | 489 Description | 489 Options | 489 Required Privilege Level | 490
489
Output Fields | 490 Sample Output | 492 Release Information | 495
Syntax
show l2-learning redundancy-groups logical-system [system-name | all] <redundancy-group-id [0 to 4294967294]> arp-statistics nd-statistics remote-macs
Description
(MX Series routers only) Display ARP statistics, Neighbor Discovery statistics, or remote MAC addresses for the Multi-Chassis Aggregated Ethernet (MC-AE) nodes for all or specified redundancy groups on a router or switch or logical systems on a router or switch. Note that the Redundancy Group ID is inherited by the bridging domain or VLAN from member AE interfaces.
Options
logical-system [systemname | all] redundancy-group-id
(Optional) Display information for a specified logical system or all systems.
(Optional) The redundancy group identification number. The Inter-Chassis Control Protocol (ICCP) uses the redundancy group ID to associate the routing or switching devices contained in a redundancy group.
arp-statistics
(Optional) Count of ARP packets sent and received by the two MC-AE nodes.
nd-statistics
(Optional) Count of Neighbor Discovery packets sent and received by the two MC-AE nodes.
remote-macs
490
(Optional) List of remote MAC addresses in the "Installed" state, as learned from the remote MC-AE node.
Required Privilege Level
view
Output Fields
Output fields are listed in the approximate order in which they appear. Table 15: show l2-learning redundancy-groups arp-statistics Output Fields
Field Name
Field Description
Redundancy Group ID
Redundancy Group to which the following details apply.
MCLAG ARP
ARP statistics for this Multichassis Link Aggregation Group (MC-LAG) instance.
Statistics Group ID
ARP Rx Count From Line
Total number of ARPs received from the Line.
ARP Tx Count To Peer
Total number of ARPs sent to the peer.
ARP Rx Count From Peer
Total number of ARPs received from the peer.
ARP Drop Count Total number of ARPs sent by the peer that were received. received from line
491
Table 15: show l2-learning redundancy-groups arp-statistics Output Fields (Continued)
Field Name
Field Description
ARP Drop Count Total number of ARPs sent by the peer that were dropped received from peer
Service-id
Service ID (configured at the routing instance level).
Table 16: show l2-learning redundancy-groups nd-statistics Output Fields
Field Name
Field Description
Redundancy Group ID
Redundancy Group to which the following details apply.
MCLAG ND
Neighbor Discovery statistics for this Multichassis Link Aggregation Group (MC-
Statistics Group ID LAG) instance.
ND Rx Count From Total number of Neighbor Discovery packets received from the Line. Line
ND Tx Count To Peer
Total number of Neighbor Discovery packets sent to the peer.
ND Rx Count From Total number of Neighbor Discovery packets received from the peer. Peer
ND Drop Count
Total number of Neighbor Discovery packets sent by the peer that were received.
received from line
ND Drop Count
Total number of Neighbor Discovery packets sent by the peer that were dropped
received from peer
Service-id
Service ID (configured at the routing instance level).
492
Table 17: show l2-learning redundancy-groups remote-macs Output Fields
Field Name
Field Description
Redundancy Group ID
Redundancy Group to which the following details apply.
Peer-Addr
IP address of the remote peer.
VLAN
Virtual LAN identifier associated with the redundancy group.
MAC
Hardware media access control address associated with the redundancy group.
MCAE-ID
ID number of the MC-AE used by the redundancy group.
Flags
Connection state: local connect or Remote connect. If no flag is shown, the redundancy group may not be connected.
Status
Installation state: Installed or Not Installed.
Sample Output
show l2-learning redundancy-groups arp-statistics
user@host> show l2-learning redundancy-groups arp-statistics
Logical System : default
Redundancy Group ID : 1
Flags : Local Connect, Remote Connect
MCLAG ARP Statistics Group ID ARP Rx Count From Line ARP Tx Count To Peer ARP Rx Count From Peer ARP Install Count
: 1 : 52 : 15 : 39 : 34
493
ARP Drop Count received from line ARP Drop Count received from peer
: 37 : 5
show l2-learning redundancy-groups nd-statistics
user@host> show l2-learning redundancy-groups nd-statistics
Logical System : default
Redundancy Group ID : 1
Flags : Local Connect, Remote Connect
MCLAG ND Statistics Group ID ND Rx Count From Line ND Tx Count To Peer ND Rx Count From Peer ND Install Count ND Drop Count received from line ND Drop Count received from peer
: 1 : 52 : 15 : 39 : 34 : 37 : 5
show l2-learning redundancy-groups remote-macs
user@host> show l2-learning redundancy-groups <redundancy-group-id> remote-macs
Redundancy Group ID : 1
Flags : Local Connect, Remote Connect
Service-id Peer-Addr
Flags Status
10
10.1.1.2
0
Installed
VLAN
MAC
MCAE-ID Subunit Opcode
100 64:87:88:6a:df:f0
1
0
1
show l2-learning redundancy-groups logical-system arp-statistics (for Logical Systems)
user@host> show l2-learning redundancy-groups logical-system LS1 arp-statistics
Redundancy Group ID : 1
Flags : Local Connect, Remote Connect
MCLAG ARP Statistics Group ID ARP Rx Count From Line
: 1 : 52
494
ARP Tx Count To Peer ARP Rx Count From Peer ARP Install Count ARP Drop Count received from line ARP Drop Count received from peer
: 15 : 39 : 34 : 37 : 5
show l2-learning redundancy-groups logical-system nd-statistics (for Logical Systems)
user@host> show l2-learning redundancy-groups logical-system LS1 nd-statistics
Redundancy Group ID : 1
Flags : Local Connect, Remote Connect
MCLAG ND Statistics Group ID ND Rx Count From Line ND Tx Count To Peer ND Rx Count From Peer ND Install Count ND Drop Count received from line ND Drop Count received from peer
: 1 : 52 : 15 : 39 : 34 : 37 : 5
show l2-learning redundancy-groups group-id
user@host> show l2-learning redundancy-groups 1
Redundancy Group ID : 1
Flags : Local Connect,Remote Connect
show l2-learning redundancy-groups logical-system
user@host> show l2-learning redundancy-groups logical-system ls1
Redundancy Group ID : 2
Flags : Local Connect,Remote Connect
495
Release Information
Command introduced in Junos OS Release 13.2. Support for logical systems added in Junos OS Release 14.1.
RELATED DOCUMENTATION Forcing MC-LAG Links or Interfaces with Limited LACP Capability to Be Up show interfaces mc-ae Configuring Active-Active Bridging and VRRP over IRB in Multichassis Link Aggregation on MX Series Routers and QFX Series Switches Forcing MC-LAG Links or Interfaces with Limited LACP Capability to Be Up
show multi-chassis mc-lag configurationconsistency list-of-parameters
IN THIS SECTION Syntax | 495 Description | 496 Options | 497 Required Privilege Level | 497 Output Fields | 497 Sample Output | 506 Release Information | 509
Syntax
show multichassis configuration-check list-of-parameters
496
Description
Displays the list of MC-LAG parameters (referred to as configuration knobs in the CLI) that are checked for consistency across MC-LAG peers. There are certain parameters that must identical and others that must be unique on both peers. Enforcement of the consistency check for the parameters is either mandatory or desired. If the enforcement is mandatory, and you have not configured the parameter correctly, the multichassis aggregated Ethernet interface (MC-AE) interface will not come up. If the enforcement is desired, and you have not configured the parameter correctly, the MC-AE interface will come up, but performance might be sub-optimal. In this situation, the system will issue a syslog message. The following list provides the hierarchies in which the MC-LAG parameters are configured: � ICL ifd
Specifies configuration parameters related to the interchassis control link � ICCP Peer
Specifies configuration parameters related to ICCP functionality � IRB Interface
Specifies configuration parameters related to the integrated routing and bridging interface � MCAE IFBD
Specifies configuration parameters related to the VLAN membership of a given MC-AE interface � MCAE ifd
Specifies configuration parameters related to a given MC-AE interface � MCAE ifl
Specifies configuration parameters related to a given MC-AE logical interface � VLAN
Specifies configuration parameters related to a given VLAN � VRRP Group
Specifies configuration parameters related to a VRRP session
Options
There are no options for this command.
Required Privilege Level
view
Output Fields
Table 18 on page 497 lists the output fields for the show multi-chassis mc-lag configurationconsistency list-of-parameters command.
Table 18: show multi-chassis mc-lag configuration-consistency list-of-parameters Output Fields
Configuration Knob
Hierarchy
session-establishment-hold-time
Specify the time during which an Inter-Chassis Control Protocol (ICCP) connection must be established between peers.
Global, ICCP Peer
mac-limit
Global
Specify the maximum number of MAC addresses to be associated with a VLAN--the default is unlimited, which can leave the network vulnerable to flooding.
mac-aging-timer
Specify how long MAC addresses remain in the Ethernet switching table.
Global
497
Consistency Identical Identical Identical
498
Table 18: show multi-chassis mc-lag configuration-consistency list-of-parameters Output Fields (Continued)
Configuration Knob
Hierarchy
Consistency
arp-aging-timer
Global
Specify the ARP aging timer in minutes for a logical interface of inet.
Identical
rstp-system-identifier
Specify different bridge identifiers for different RSTP routing instances.
Global
Identical
mstp-system-identifier
Specify different bridge identifiers for different MSTP routing instances.
Global
Identical
rstp-bridge-priority
Global
Determine which bridge is elected as the root bridge for RSTP. If two bridges have the same path cost to the root bridge, the bridge priority determines which bridge becomes the designated bridge for a LAN segment.
Identical
mstp-bridge-priority
Determine which bridge is elected as the root bridge for MSTP. If two bridges have the same path cost to the root bridge, the bridge priority determines which bridge becomes the designated bridge for a LAN segment.
Global
Identical
rstp-bpdu-block-on-edge
Configure bridge protocol data unit (BPDU) protection on all edge ports of a switch for RSTP.
Global
Identical
499
Table 18: show multi-chassis mc-lag configuration-consistency list-of-parameters Output Fields (Continued)
Configuration Knob
Hierarchy
Consistency
vstp-bpdu-block-on-edge
Configure bridge protocol data unit (BPDU) protection on all edge ports of a switch for VSTP.
Global
Identical
mstp-bpdu-block-on-edge
Configure bridge protocol data unit (BPDU) protection on all edge ports of a switch for MSTP.
Global
Identical
service-id
Specify a service identifier for each multichassis aggregated Ethernet interface that belongs to a link aggregation group (LAG).
Global
Identical
bfd minimum-interval
Configure the minimum interval after which the local routing device transmits hello packets and then expects to receive a reply from a neighbor with which it has established a BFD session.
ICCP Peer
Identical
iccp/minimum-transmit-interval
Specify the minimum interval at which the local routing device transmits hello packets to a neighbor with which it has established a BFD session.
ICCP Peer
Identical
iccp/minimum-receive-interval
ICCP Peer
Specify the minimum interval after which the local routing device must receive a reply from a neighbor with which it has established a BFD session.
Identical
500
Table 18: show multi-chassis mc-lag configuration-consistency list-of-parameters Output Fields (Continued)
Configuration Knob
Hierarchy
Consistency
iccp/bfd multiplier
ICCP Peer
Configure the number of hello packets not received by a neighbor that causes the originating interface to be declared down.
Identical
iccp single-hop Configure single hop BFD sessions.
ICCP Peer
Identical
iccp/authentication-key
Specify the authentication key password to verify the authenticity of packets sent from the peers hosting an MC-LAG.
ICCP Peer
Identical
redundancy-group-id-list
ICCP Peer
Specify the redundancy group identification number. The Inter-Chassis Control Protocol (ICCP) uses the redundancy group ID to associate multiple chassis that perform similar redundancy functions.
Identical
backup-liveness-detection
Determine whether a peer is up or down by exchanging keepalive messages over the management link between the two Inter-Chassis Control Protocol (ICCP) peers.
ICCP Peer
Unique
mc-ae-id
Specify the identification number of the MC-LAG device.
MCAE ifd
Identical
501
Table 18: show multi-chassis mc-lag configuration-consistency list-of-parameters Output Fields (Continued)
Configuration Knob
Hierarchy
Consistency
mcae redundancy-group
MCAE ifd
Used by ICCP to associate multiple chassis that perform similar redundancy functions and to establish a communication channel so that applications on peering chassis can send messages to each other.
Identical
mcae chassis-id
Used by LACP for calculating the port number of the MC-LAG's physical member links.
MCAE ifd
Unique
mcae deployment mode
MCAE ifd
Indicates whether an MC-LAG is in active-standby mode or active-active mode.
Identical
mcae status-control
MCAE ifd
Specify whether the chassis becomes active or remains in standby mode when an interchassis link failure occurs.
Unique
force-icl-down
Specify that if the node's ICCP peer goes down, the system brings down the interchassis-link logical interface.
MCAE ifd
Unique
prefer-status-control-active
MCAE ifd
Specify that the node configured as status-control active becomes the active node if the peer of this node goes down.
Unique
502
Table 18: show multi-chassis mc-lag configuration-consistency list-of-parameters Output Fields (Continued)
Configuration Knob
Hierarchy
Consistency
lacp mode Specify LACP is active or passive.
MCAE ifd
Identical
lacp periodic
Specify the interval for periodic transmission of LACP packets.
MCAE ifd
Identical
lacp system-id
Define the LACP system identifier at the aggregated Ethernet interface level.
MCAE ifd
Identical
lacp admin-key
Specify an administrative key for the router or switch.
MCAE ifd
Identical
native-vlan-id
Configure mixed tagging support for untagged packets on a port.
MCAE ifd
Identical
mcae-mac-synchronize
VLAN
Synchronize the MAC addresses for the Layer 3 interfaces of the switches participating in the MCLAG.
Identical
Interface mac Limit
VLAN
Configure a limit to the number of MAC addresses that can be learned from a bridge domain, VLAN, virtual switch, or set of bridge domains or VLANs.
Identical
503
Table 18: show multi-chassis mc-lag configuration-consistency list-of-parameters Output Fields (Continued)
Configuration Knob
Hierarchy
Consistency
l3-interface Associate a Layer 3 interface with the VLAN.
VLAN
Identical
igmp-snooping
VLAN
Enable IGMP snooping. A Layer 2 device monitors the IGMP join and leave messages sent from each connected host to a multicast router. This enables the Layer 2 device to keep track of the multicast groups and associated member ports. The Layer 2 device uses this information to make intelligent decisions and to forward multicast traffic to only the intended destination hosts.
Identical
family
Specify the protocol family configured on the logical interface.
IRB Interface
Identical
ipv4 address Specify an IPv4 address for the IRB interface.
IRB Interface
Unique
ipv6 address Specify an IPv6 address for the IRB interface.
IRB Interface
Unique
vrrp-group id Specify a VRRP group identifier.
IRB Interface
Identical
504
Table 18: show multi-chassis mc-lag configuration-consistency list-of-parameters Output Fields (Continued)
Configuration Knob
Hierarchy
Consistency
proxy-arp-type
For Ethernet interfaces only, configure the router or switch to respond to any ARP request, as long as the router or switch has an active route to the ARP request's target address.
IRB Interface
Identical
vrrp-group priority
VRRP Group
Configure a Virtual Router Redundancy Protocol (VRRP) router's priority for becoming the primary default router. The router with the highest priority within the group becomes the primary.
Unique
vrrp-group authentication-key
Configure a Virtual Router Redundancy Protocol (VRRP) IPv4 authentication key. You also must specify a VRRP authentication scheme by including the authentication-type statement.
VRRP Group
Identical
vrrp-group authentication-type
VRRP Group
Enable Virtual Router Redundancy Protocol (VRRP) IPv4 authentication and specify the authentication scheme for the VRRP group.
Identical
vrrp-group virtual-address
Configure the addresses of the virtual routers in a Virtual Router Redundancy Protocol (VRRP) IPv4 or IPv6 group.
VRRP Group
Identical
encapsulation Configure a logical link-layer encapsulation type.
MCAE ifd
Identical
505
Table 18: show multi-chassis mc-lag configuration-consistency list-of-parameters Output Fields (Continued)
Configuration Knob
Hierarchy
Consistency
flexible-vlan-tagging
Support simultaneous transmission of 802.1Q VLAN single-tag and dual-tag frames on logical interfaces on the same Ethernet port, and on pseudowire logical interfaces.
MCAE ifd
Identical
vlan-tagging
For Fast Ethernet and Gigabit Ethernet interfaces, aggregated Ethernet interfaces configured for VPLS, and pseudowire subscriber interfaces, enable the reception and transmission of 802.1Q VLAN-tagged frames on the interface.
MCAE ifd
Identical
mtu
MCAE ifd, ICL ifd
Specify the maximum transmission unit (MTU) size for the media or protocol.
Identical
interface-mode
MCAE ifl
Determine whether the logical interface accepts or discards packets based on VLAN tags.
Identical
vlan membership
Specify the name of the VLAN that belongs to an interface.
MCAE ifl
Identical
506
Sample Output
show multi-chassis mc-lag configuration-consistency list-of-parameters
user@host> show multi-chassis mc-lag configuration-consistency list-of-parameters
Possible completions:
configuration-consistency Show all configuration consistency information
regress@liki-pe2_re0> show multi-chassis mc-lag configuration-consistency list-
of-parameters
#Item Configuration Knob
Hierarchy
Consistency
Requirement Enforcement
------ -----------------
---------
---------------------- -----------
0
local-ip-addr
Global
Unique
Mandatory
1
session-establishment-hold-time
Global
Identical
Mandatory
2
local-ip-addr
ICCP Peer
Unique
Mandatory
3
session-establishment-hold-time
ICCP Peer
Identical
Mandatory
5
bfd minimum-interval
ICCP Peer
Identical
Mandatory
6
iccp/minimum-transmit-interval
ICCP Peer
Identical
Mandatory
7
iccp/minimum-receive-interval
ICCP Peer
Identical
Mandatory
8
iccp/bfd multiplier
ICCP Peer
Identical
Mandatory
9
iccp single-hop
ICCP Peer
Identical
Mandatory
11
iccp/authentication-key
ICCP Peer
Identical
Mandatory
4
redundancy-group-id-list
ICCP Peer
Identical
Mandatory
12
backup-liveness-detection
ICCP Peer
Unique
Mandatory
13
service-id
Global
Identical
Mandatory
14
mac-limit
Global
Identical
Desired
507
15
mac-ageing-timer
Identical
Desired
16
arp-ageing-timer
Identical
Desired
17
rstp-bpdu-block-on-edge
Identical
Desired
18
rstp-bridge-priority
Identical
Desired
19
rstp-system-identifier
Identical
Desired
20
vstp-bpdu-block-on-edge
Identical
Desired
21
mstp-bpdu-block-on-edge
Identical
Desired
22
mstp-bridge-priority
Identical
Desired
23
mstp-system-identifier
Identical
Desired
24
mc-ae-id
Identical
Mandatory
25
mcae redundancy-group
Identical
Mandatory
26
mcae chassis-id
Unique
Mandatory
27
mcae deployment mode
Identical
Mandatory
28
mcae status-control
Unique
Mandatory
29
force-icl-down
Unique
Mandatory
30
prefer-status-control-active
Unique
Desired
31
lacp mode
Identical
Mandatory
32
lacp periodic
Identical
Mandatory
33
lacp system-id
Identical
Mandatory
34
lacp admin-key
Identical
Mandatory
59
vlan id list
Identical
Mandatory
60
vlan-ids
Global Global Global Global Global Global Global Global Global MCAE ifd MCAE ifd MCAE ifd MCAE ifd MCAE ifd MCAE ifd MCAE ifd MCAE ifd MCAE ifd MCAE ifd MCAE ifd VLAN VLAN
508
Identical
Mandatory
62
Interface mac Limit
Identical
Desired
58
service-id
Identical
Mandatory
64
igmp-snooping-enabled
Identical
Mandatory
61
mcae-mac-synchronize
Identical
Mandatory
45
l3-interface
Identical
Desired
47
ipv4 address
Unique
Mandatory
48
ipv6 address
Unique
Mandatory
49
vrrp-group id
Identical
Mandatory
53
vrrp-group priority
Unique
Mandatory
51
vrrp-group authentication-key
Identical
Mandatory
52
vrrp-group authentication-type
Identical
Mandatory
50
vrrp-group virtual-address
Identical
Mandatory
54
proxy-arp-type
Identical
Mandatory
35
encapsulation
Identical
Mandatory
36
flexible-vlan-tagging
Identical
Mandatory
37
vlan-tagging
Identical
Mandatory
38
mtu
Identical
Mandatory
39
native-vlan-id
Identical
Mandatory
40
family
Identical
Mandatory
42
interface-mode
Identical
Mandatory
43
vlans
Identical
Mandatory
VLAN VLAN VLAN VLAN VLAN IRB Interface IRB Interface IRB Interface VRRP Group VRRP Group VRRP Group VRRP Group IRB Interface MCAE ifd MCAE ifd MCAE ifd MCAE ifd MCAE ifd MCAE ifl MCAE ifl MCAE ifl
509
44
vlan membership
Identical
Mandatory
65
ICL interface
Identical
Mandatory
65
ICL interface
Identical
Mandatory
65
ICL interface
Identical
Mandatory
68
encapsulation
Identical
Mandatory
69
flexible-vlan-tagging
Identical
Mandatory
71
vlan-tagging
Identical
Mandatory
70
mtu
Identical
Mandatory
72
native-vlan-id
Identical
Mandatory
73
family
Identical
Mandatory
75
interface-mode
Identical
Mandatory
76
vlans
Identical
Mandatory
77
vlan membership
Identical
Mandatory
MCAE ifl ICL ifd ICL ifd ICL ifd ICL ifd ICL ifd ICL ifd ICL ifd ICL ifd ICL ifl ICL ifl ICL ifl ICL ifl
Release Information
Command introduced in Junos OS Release 16.1R1.
510
show multi-chassis mc-lag configurationconsistency
IN THIS SECTION Syntax | 510 Description | 510 Options | 510 Required Privilege Level | 511 Output Fields | 511 Sample Output | 512 Release Information | 516
Syntax
show multi-chassis mc-lag configuration-consistency (brief | detail)
Description
Displays configuration consistency check status for various MC-LAG parameters . NOTE: This command only displays MC-LAG parameters that are committed.
Options
none Display configuration consistency check status for various MC-LAG parameters.
511
Required Privilege Level
view
Output Fields
Table 19 on page 511 lists the output fields for the show multi-chassis mc-lag configurationconsistency command. Output fields are listed in the approximate order in which they appear.
Table 19: show multi-chassis mc-lag configuration-consistency Output Fields
Output Field Name
Field Description
Configuration Item
Name of the committed MC-LAG parameter.
Local Physical Interface
Name of the physical interface configured on the local MCLAG peer.
Peer Physical Interface
Name of the physical interface configured on the remote MCLAG peer.
Local Logical Interface
Name of the logical interface configured on the local MC-LAG peer.
Peer Logical Interface
Name of the logical interface configured on the remote MCLAG peer.
Local IRB
Name of the integrated routing and bridging (IRB) interface configured on the local MC-LAG peer.
Peer IRB
Name of the integrated routing and bridging (IRB) interface configured on the remote MC-LAG peer.
Local VLAN
Name of the VLAN configured on the local MC-LAG peer.
512
Table 19: show multi-chassis mc-lag configuration-consistency Output Fields (Continued)
Output Field Name
Field Description
Peer VLAN
Name of the VLAN configured on the remote MC-LAG peer.
Enforcement Level
Enforcement level for the MC-LAG parameter is Mandatory or Desirable.
Local Value
Value of the committed MC-LAG parameter for the local MCLAG peer.
Peer Value
Value of the committed MC-LAG parameter for the remote MC-LAG peer.
Result
Result of the configuration consistency check of the MC-LAG parameter is PASS or FAIL.
Sample Output
show multi-chassis mc-lag configuration-consistency
user@host> show multi-chassis mc-lag configuration-consistency
Configuration Item
Enforcement Level
Peer Value
Result
------------------
-----------------
----------
-------
service-id
Mandatory
1
PASS
session-establishment-hold-time
Mandatory
300
PASS
local-ip-addr
Mandatory
10.1.1.2
PASS
iccp/bfd multiplier
Mandatory
3
PASS
iccp/minimum-transmit-interval
Mandatory
Local Value ----------1 300 10.1.1.1 3 60
513
60 bfd minimum-interval 1000
PASS PASS
Local Physical Interface:ae0
Peer Physical Interface :ae0
Configuration Item
Peer Value
Result
------------------
----------
-------
lacp admin-key
21
PASS
lacp system-id
00:00:00:00:00:01
PASS
lacp mode
0
PASS
prefer-status-control-active
TRUE
FAIL
mcae status-control
active
PASS
mcae deployment mode
active-active
PASS
mcae chassis-id
1
PASS
mcae redundancy-group
101
PASS
force-icl-down
TRUE
PASS
Local Logical Interface:ae0.0
Peer Logical Interface :ae0.0
Configuration Item
Peer Value
Result
------------------
----------
-------
vlan membership
501-502
PASS
interface-mode
trunk
PASS
Local Physical Interface:ae1 Peer Physical Interface :ae1 Configuration Item
Mandatory
1000
Enforcement Level Local Value
----------------- -----------
Mandatory
21
Mandatory
00:00:00:00:00:01
Mandatory
0
Desirable
TRUE
Mandatory
standby
Mandatory
active-active
Mandatory
0
Mandatory
101
Mandatory
--
Enforcement Level Local Value
----------------- -----------
Mandatory
501-502
Mandatory
trunk
Enforcement Level Local Value
514
Peer Value
Result
------------------
----------
-------
lacp admin-key
22
PASS
lacp system-id
00:00:00:00:00:03
PASS
lacp mode
0
PASS
prefer-status-control-active
TRUE
FAIL
mcae status-control
active
PASS
mcae deployment mode
active-active
PASS
mcae chassis-id
1
PASS
mcae redundancy-group
101
PASS
force-icl-down
TRUE
PASS
Local Logical Interface:ae1.0
Peer Logical Interface :ae1.0
Configuration Item
Peer Value
Result
------------------
----------
-------
vlan membership
601-602
PASS
interface-mode
trunk
PASS
Local Physical Interface:ae5 Peer Physical Interface :ae5
Local Logical Interface:ae5.0
Peer Logical Interface :ae5.0
Configuration Item
Peer Value
Result
------------------
----------
-------
vlan membership
----------------- -----------
Mandatory
22
Mandatory
00:00:00:00:00:03
Mandatory
0
Desirable
TRUE
Mandatory
standby
Mandatory
active-active
Mandatory
0
Mandatory
101
Mandatory
--
Enforcement Level Local Value
----------------- -----------
Mandatory
601-602
Mandatory
trunk
Enforcement Level Local Value
----------------- -----------
Mandatory
501-502,601-602
515
501-502,601-602 interface-mode trunk
PASS PASS
Local VLAN:client-vlan-1
Peer VLAN :client-vlan-1
Configuration Item
Peer Value
Result
------------------
----------
-------
mcae-mac-synchronize
TRUE
PASS
Local IRB:irb.501 Peer IRB :irb.501 Configuration Item Peer Value --------------------------IPv4 Addresses 10.1.1.2/24
Result ------FAIL
Local VLAN:client-vlan-2
Peer VLAN :client-vlan-2
Configuration Item
Peer Value
Result
------------------
----------
-------
mcae-mac-synchronize
TRUE
PASS
Local IRB:irb.502 Peer IRB :irb.502 Configuration Item Peer Value --------------------------IPv4 Addresses 10.1.1.2/24
Result ------FAIL
Local VLAN:server-vlan-1 Peer VLAN :server-vlan-1 Configuration Item
Mandatory
trunk
Enforcement Level Local Value
----------------- -----------
Mandatory
TRUE
Enforcement Level Local Value
----------------- -----------
Mandatory
10.1.1.1/24
Enforcement Level Local Value
----------------- -----------
Mandatory
TRUE
Enforcement Level Local Value
----------------- -----------
Mandatory
10.1.1.1/24
Enforcement Level Local Value
516
Peer Value --------------------------mcae-mac-synchronize TRUE
Result ------PASS
Local IRB:irb.601 Peer IRB :irb.601 Configuration Item Peer Value --------------------------IPv4 Addresses 10.2.1.2/24
Result ------FAIL
Local VLAN:server-vlan-2
Peer VLAN :server-vlan-2
Configuration Item
Peer Value
Result
------------------
----------
-------
mcae-mac-synchronize
TRUE
PASS
Local IRB:irb.602 Peer IRB :irb.602 Configuration Item Peer Value --------------------------IPv4 Addresses 10.3.1.2/24
Result ------FAIL
----------------- -----------
Mandatory
TRUE
Enforcement Level Local Value
----------------- -----------
Mandatory
10.2.1.1/24
Enforcement Level Local Value
----------------- -----------
Mandatory
TRUE
Enforcement Level Local Value
----------------- -----------
Mandatory
10.3.1.1/24
Release Information
Command introduced in Junos OS Release 16.1R1.
517
show multi-chassis mc-lag configurationconsistency global-config
IN THIS SECTION Syntax | 517 Description | 517 Options | 518 Required Privilege Level | 518 Output Fields | 518 Sample Output | 519 Release Information | 520
Syntax
show multi-chassis mc-lag configuration-consistency global-config (brief | detail)
Description
View configuration consistency check status for all committed global configuration related to MC-LAG functionality, the consistency requirement (identical or unique), the enforcement level (mandatory or desired), and the result of the configuration consistency check. The results are either pass or fail. This command shows only a subset of what is shown in the show multi-chassis mc-lag configurationconsistency command. The following parameters related to the global configuration are checked for consistency. � ICL interface � RSTP bridge priority
518
� service ID � session establishment hold time � local IP address of the ICCP interface � backup liveness detection peer IP address � ICCP/BFD multiplier
NOTE: This command only displays MC-LAG parameters that are committed.
Options
none Display configuration consistency check status for all global configuration related to MC-LAG functionality.
Required Privilege Level
view
Output Fields
Table 20 on page 518 lists the output fields for the show multi-chassis mc-lag configurationconsistency global-config command. Output fields are listed in the approximate order in which they appear.
Table 20: show multi-chassis mc-lag configuration-consistency global-config Output Fields
Output Field Name
Field Description
Configuration Item
Name of the committed MC-LAG parameter.
519
Table 20: show multi-chassis mc-lag configuration-consistency global-config Output Fields (Continued)
Output Field Name
Field Description
Enforcement Level
Enforcement level for the MC-LAG parameter is Mandatory or Desirable.
Local Value
Value of the committed MC-LAG parameter on the local peer.
Peer Value
Value of the committed MC-LAG parameter on the remote peer.
Result
Result of the configuration consistency check of the MC-LAG parameter is PASS or FAIL.
Sample Output
show multi-chassis mc-lag configuration-consistency global-config
user@host> show multi-chassis mc-lag configuration-consistency global-config
Configuration Item
Enforcement Level Local Value
Peer Value
Result
------------------
----------------- -----------
----------
-------
service-id
Mandatory
1
1
PASS
session-establishment-hold-time
Mandatory
300
300
PASS
local-ip-addr
Mandatory
10.1.1.1
10.1.1.2
PASS
iccp/bfd multiplier
Mandatory
3
3
PASS
iccp/minimum-transmit-interval
Mandatory
60
60
PASS
bfd minimum-interval
Mandatory
1000
1000
PASS
520
Release Information
Command introduced in Junos OS Release 15.1X53-D60.
show multi-chassis mc-lag configurationconsistency icl-config
IN THIS SECTION Syntax | 520 Description | 520 Options | 521 Required Privilege Level | 521 Output Fields | 521 Sample Output | 522 Release Information | 523
Syntax
show multi-chassis mc-lag configuration-consistency icl-config (brief | detail)
Description
View configuration consistency check status for parameters related to the ICL, the consistency requirement (identical or unique), the enforcement level (mandatory or desired), and the result of the configuration consistency check. The results are either pass or fail. Some example of parameters related to the ICL interface are the interface mode and which VLAN the interface belongs to.
521
This command shows only a subset of what is shown in the show multi-chassis mc-lag configurationconsistency command. The following parameters related to the ICL configuration are checked for consistency check: � VLAN membership � interface mode
NOTE: This command only displays MC-LAG parameters that are committed.
Options
none Display configuration consistency check status for MC-LAG parameters related to the interchassis control link.
Required Privilege Level
view
Output Fields
Table 21 on page 521 lists the output fields for the show multi-chassis mc-lag configurationconsistency icl-config command. Output fields are listed in the approximate order in which they appear.
Table 21: show multi-chassis mc-lag configuration-consistency icl-config Output Fields
Output Field Name
Field Description
Configuration Item
Name of the committed MC-LAG parameter.
Local Physical Interface
Name of the physical interface configured on the local MCLAG peer.
522
Table 21: show multi-chassis mc-lag configuration-consistency icl-config Output Fields (Continued)
Output Field Name
Field Description
Peer Physical Interface
Name of the physical interface configured on the remote MCLAG peer.
Local Logical Interface
Name of the logical interface configured on the local MC-LAG peer.
Peer Logical Interface
Name of the logical interface configured on the remote MCLAG peer.
Enforcement Level
Enforcement level for the MC-LAG parameter is Mandatory or Desirable.
Local Value
Value of the committed MC-LAG parameter on the local peer.
Peer Value
Value of the committed MC-LAG parameter on the remote peer.
Result
Result of the configuration consistency check of the MC-LAG parameter is PASS or FAIL.
Sample Output
show multi-chassis mc-lag configuration-consistency icl-config
user@host> show multi-chassis mc-lag configuration-consistency icl-config Local Physical Interface:ae5 Peer Physical Interface :ae5
Local Logical Interface:ae5.0 Peer Logical Interface :ae5.0 Configuration Item
Enforcement Level Local Value
523
Peer Value --------------------------vlan membership 501-502,601-602 interface-mode trunk
Result ------PASS PASS
----------------- -----------
Mandatory
501-502,601-602
Mandatory
trunk
Release Information
Command introduced in Junos OS Release 15.1X53-D60.
show multi-chassis mc-lag configurationconsistency mcae-config
IN THIS SECTION
Syntax | 523 Description | 524 Options | 524 Required Privilege Level | 525 Output Fields | 525 Sample Output | 526 Release Information | 528
Syntax
show multi-chassis mc-lag configuration-consistency mcae-config (brief | detail)
524
Description
View configuration consistency check status for committed parameters related to the multichassis aggregated Ethernet interfaces, the consistency requirement (identical or unique), the enforcement level (mandatory or desired), and the result of the configuration consistency check. The results are either pass or fail. This command shows only a subset of what is shown in the show multi-chassis mc-lag configurationconsistency command. The following parameters related to the MC-AE interfaces are checked for consistency: � LACP administrative key � LACP system ID � LACP periodic interval � prefer status control setting � status control setting � mode � chassis ID � redundancy group ID � VLAN membership of the ICL � interface mode of the ICL
NOTE: This command only displays MC-LAG parameters that are committed.
Options
none Display configuration consistency check status for MC-LAG parameters related to the multichassis aggregated Ethernet interface.
525
Required Privilege Level
view
Output Fields
Table 22 on page 525 lists the output fields for the show multi-chassis mc-lag configurationconsistency mcae-config command. Output fields are listed in the approximate order in which they appear.
Table 22: show multi-chassis mc-lag configuration-consistency mcae-config Output Fields
Output Field Name
Field Description
Configuration Item
Name of the committed MC-LAG parameter.
Local Physical Interface
Name of the physical interface configured on the local MCLAG peer.
Peer Physical Interface
Name of the physical interface configured on the remote MCLAG peer.
Local Logical Interface
Name of the logical interface configured on the local MC-LAG peer.
Peer Logical Interface
Name of the logical interface configured on the remote MCLAG peer.
Enforcement Level
Enforcement level for the MC-LAG parameter is Mandatory or Desirable.
Local Value
Value of the committed MC-LAG parameter on the local peer.
Peer Value
Value of the committed MC-LAG parameter on the remote peer.
526
Table 22: show multi-chassis mc-lag configuration-consistency mcae-config Output Fields (Continued)
Output Field Name
Field Description
Result
Result of the configuration consistency check of the MC-LAG parameter is PASS or FAIL.
Sample Output
show multi-chassis mc-lag configuration-consistency mcae-config
user@host> show multi-chassis mc-lag configuration-consistency mcae-config
Local Physical Interface:ae0
Peer Physical Interface :ae0
Configuration Item
Enforcement Level Local Value
Peer Value
Result
------------------
----------------- -----------
----------
-------
lacp admin-key
Mandatory
21
21
PASS
lacp system-id
Mandatory
00:00:00:00:00:01
00:00:00:00:00:01
PASS
lacp mode
Mandatory
0
0
PASS
prefer-status-control-active
Desirable
TRUE
TRUE
FAIL
mcae status-control
Mandatory
standby
active
PASS
mcae deployment mode
Mandatory
active-active
active-active
PASS
mcae chassis-id
Mandatory
0
1
PASS
mcae redundancy-group
Mandatory
101
101
PASS
force-icl-down
Mandatory
--
TRUE
PASS
Local Logical Interface:ae0.0
527
Peer Logical Interface :ae0.0
Configuration Item
Peer Value
Result
------------------
----------
-------
vlan membership
501-502
PASS
interface-mode
trunk
PASS
Local Physical Interface:ae1
Peer Physical Interface :ae1
Configuration Item
Peer Value
Result
------------------
----------
-------
lacp admin-key
22
PASS
lacp system-id
00:00:00:00:00:03
PASS
lacp mode
0
PASS
prefer-status-control-active
TRUE
FAIL
mcae status-control
active
PASS
mcae deployment mode
active-active
PASS
mcae chassis-id
1
PASS
mcae redundancy-group
101
PASS
force-icl-down
TRUE
PASS
Local Logical Interface:ae1.0
Peer Logical Interface :ae1.0
Configuration Item
Peer Value
Result
------------------
----------
-------
vlan membership
601-602
PASS
Enforcement Level Local Value
----------------- -----------
Mandatory
501-502
Mandatory
trunk
Enforcement Level Local Value
----------------- -----------
Mandatory
22
Mandatory
00:00:00:00:00:03
Mandatory
0
Desirable
TRUE
Mandatory
standby
Mandatory
active-active
Mandatory
0
Mandatory
101
Mandatory
--
Enforcement Level Local Value
----------------- -----------
Mandatory
601-602
528
interface-mode trunk
PASS
Mandatory
trunk
Release Information
Command introduced in Junos OS Release 15.1X53-D60.
show multi-chassis mc-lag configurationconsistency vlan-config
IN THIS SECTION
Syntax | 528 Description | 529 Options | 529 Required Privilege Level | 529 Output Fields | 529 Sample Output | 531 Release Information | 532
Syntax
show multi-chassis mc-lag configuration-consistency vlan-config (brief | detail)
529
Description
View configuration consistency check status for committed parameters related to MC-LAG VLAN configuration, the consistency requirement (identical or unique), the enforcement level (mandatory or desired), and the result of the configuration consistency check. The results are either pass or fail. This command shows only a subset of what is shown in the show multi-chassis mc-lag configurationconsistency command. The following parameters related to the VLAN and IRB configuration are checked for consistency: � VRRP group ID � IP address of IRB interface
NOTE: This command only displays MC-LAG parameters that are committed.
Options
none Display configuration consistency check status for MC-LAG parameters related to VLAN configuration.
Required Privilege Level
view
Output Fields
Table 23 on page 530 lists the output fields for the show multi-chassis mc-lag configurationconsistency vlan-config command. Output fields are listed in the approximate order in which they appear.
530
Table 23: show multi-chassis mc-lag configuration-consistency vlan-config Output Fields
Output Field Name
Field Description
Configuration Item
Name of the committed MC-LAG parameter.
Local Physical Interface
Name of the physical interface configured on the local MCLAG peer.
Peer Physical Interface
Name of the physical interface configured on the remote MCLAG peer.
Local Logical Interface
Name of the logical interface configured on the local MC-LAG peer.
Peer Logical Interface
Name of the logical interface configured on the remote MCLAG peer.
Local IRB
Name of the integrated routing and bridging (IRB) interface configured on the local MC-LAG peer.
Peer IRB
Name of the integrated routing and bridging (IRB) interface configured on the remote MC-LAG peer.
Local VLAN
Name of the VLAN configured on the local MC-LAG peer.
Peer VLAN
Name of the VLAN configured on the remote MC-LAG peer.
Enforcement Level
Enforcement level for the MC-LAG parameter is Mandatory or Desirable.
Local Value
Value of the committed MC-LAG parameter on the local peer.
Peer Value
Value of the committed MC-LAG parameter on the remote peer.
531
Table 23: show multi-chassis mc-lag configuration-consistency vlan-config Output Fields (Continued)
Output Field Name
Field Description
Result
Result of the configuration consistency check of the MC-LAG parameter is PASS or FAIL.
Sample Output
show multi-chassis mc-lag configuration-consistency vlan-config
user@host> show multi-chassis mc-lag configuration-consistency vlan-config Local VLAN:client-vlan-1 Peer VLAN :client-vlan-1
Local IRB:irb.501 Peer IRB :irb.501 Configuration Item Peer Value --------------------------vrrp-group id 11 IPv4 Addresses 10.1.1.1/8
Result ------PASS PASS
Enforcement Level Local Value
----------------- -----------
Mandatory
11
Mandatory
10.1.1.2/8
Local VLAN:client-vlan-2 Peer VLAN :client-vlan-2
Local IRB:irb.502 Peer IRB :irb.502 Configuration Item Peer Value --------------------------vrrp-group id 12
Result ------PASS
Enforcement Level Local Value
----------------- -----------
Mandatory
12
532
IPv4 Addresses 10.0.1.1/8
PASS
Mandatory
10.0.1.2/8
Release Information
Command introduced in Junos OS Release 15.1X53-D60.
show multi-chassis mc-lag configurationconsistency vrrp-config
IN THIS SECTION
Syntax | 532 Description | 533 Options | 533 Required Privilege Level | 533 Output Fields | 533 Sample Output | 535 Release Information | 536
Syntax
show multi-chassis mc-lag configuration-consistency vrrp-config
533
Description
View configuration consistency check status for committed parameters related to VRRP configuration, the consistency requirement (identical or unique), the enforcement level (mandatory or desired), and the result of the configuration consistency check. The results are either pass or fail. This command shows only a subset of what is shown in the show multi-chassis mc-lag configurationconsistency command. The following parameters related to the VRRP configuration are checked for consistency: VRRP group virtual IP address and VRRP group priority value.
NOTE: This command only displays MC-LAG parameters that are committed.
Options
none Displays configuration consistency check status for MC-LAG parameters related to Virtual Router Redundancy Protocol (VRRP) configuration.
Required Privilege Level
view
Output Fields
Table 24 on page 533 lists the output fields for the show multi-chassis mc-lag configurationconsistency vrrp-config command. Output fields are listed in the approximate order in which they appear.
Table 24: show multi-chassis mc-lag configuration-consistency vrrp-config Output Fields
Output Field Name
Field Description
Configuration Item
Name of the committed MC-LAG parameter.
534
Table 24: show multi-chassis mc-lag configuration-consistency vrrp-config Output Fields (Continued)
Output Field Name
Field Description
Local Physical Interface
Name of the physical interface configured on the local MCLAG peer.
Peer Physical Interface
Name of the physical interface configured on the remote MCLAG peer.
Local Logical Interface
Name of the logical interface configured on the local MC-LAG peer.
Peer Logical Interface
Name of the logical interface configured on the remote MCLAG peer.
Local IRB
Name of the integrated routing and bridging (IRB) interface configured on the local MC-LAG peer.
Peer IRB
Name of the integrated routing and bridging (IRB) interface configured on the remote MC-LAG peer.
Local VLAN
Name of the VLAN configured on the local MC-LAG peer.
Peer VLAN
Name of the VLAN configured on the remote MC-LAG peer.
Enforcement Level
Enforcement level for the MC-LAG parameter is Mandatory or Desirable.
Local Value
Value of the committed MC-LAG parameter on the local peer.
Peer Value
Value of the committed MC-LAG parameter on the remote peer.
535
Table 24: show multi-chassis mc-lag configuration-consistency vrrp-config Output Fields (Continued)
Output Field Name
Field Description
Result
Result of the configuration consistency check of the MC-LAG parameter is PASS or FAIL.
Sample Output
show multi-chassis mc-lag configuration-consistency vrrp-config
user@host> show multi-chassis mc-lag configuration-consistency vrrp-config Lcal VRRP Group:11
Peer VRRP Group :11
Configuration Item
Peer Value
Result
------------------
----------
-------
vrrp-group virtual-address
010.001.001.010
PASS
vrrp-group priority
201
PASS
Enforcement Level Local Value
----------------- -----------
Mandatory
010.001.001.010
Mandatory
202
Local VRRP Group:12
Peer VRRP Group :12
Configuration Item
Peer Value
Result
------------------
----------
-------
vrrp-group virtual-address
011.001.001.010
PASS
vrrp-group priority
201
PASS
Enforcement Level Local Value
----------------- -----------
Mandatory
011.001.001.010
Mandatory
202
536
Release Information
Command introduced in Junos OS Release 15.1X53-D60.