Brocade DCX 8510 4 Backbone Hardware Installation Guide Docu35006
User Manual: Brocade Backbone DCX 8510-4
Open the PDF directly: View PDF 
.
Page Count: 171
53-1002177-13
14 January 2016
Brocade DCX 8510-4
Backbone
Hardware Installation Guide
© 2016, Brocade Communications Systems, Inc. All Rights Reserved.
Brocade, Brocade Assurance, the B-wing symbol, ClearLink, DCX, Fabric OS, HyperEdge, ICX, MLX, MyBrocade, OpenScript, VCS, VDX,
Vplane, and Vyatta are registered trademarks, and Fabric Vision is a trademark of Brocade Communications Systems, Inc., in the United
States and/or in other countries. Other brands, products, or service names mentioned may be trademarks of others.
Notice: This document is for informational purposes only and does not set forth any warranty, expressed or implied, concerning any
equipment, equipment feature, or service offered or to be offered by Brocade. Brocade reserves the right to make changes to this document
at any time, without notice, and assumes no responsibility for its use. This informational document describes features that may not be
currently available. Contact a Brocade sales office for information on feature and product availability. Export of technical data contained in
this document may require an export license from the United States government.
The authors and Brocade Communications Systems, Inc. assume no liability or responsibility to any person or entity with respect to the
accuracy of this document or any loss, cost, liability, or damages arising from the information contained herein or the computer programs that
accompany it.
The product described by this document may contain open source software covered by the GNU General Public License or other open
source license agreements. To find out which open source software is included in Brocade products, view the licensing terms applicable to
the open source software, and obtain a copy of the programming source code, please visit http://www.brocade.com/support/oscd.
Contents
Preface..................................................................................................................................... 7
Document conventions......................................................................................7
Text formatting conventions.................................................................. 7
Command syntax conventions.............................................................. 7
Notes, cautions, and warnings.............................................................. 8
Brocade resources............................................................................................ 9
Contacting Brocade Technical Support.............................................................9
Document feedback........................................................................................ 10
About This Document.............................................................................................................. 11
Supported hardware and software.................................................................. 11
What’s new in this document.......................................................................... 11
Product Overview.................................................................................................................... 13
Product features..............................................................................................13
Hardware components.................................................................................... 14
Port side view of the device ............................................................... 15
Nonport side view of the device ......................................................... 16
Supported blades............................................................................................ 17
Chassis slots numbering................................................................................. 19
Port numbering................................................................................................19
High availability............................................................................................... 20
Reliability.........................................................................................................21
Serviceability................................................................................................... 21
Software features............................................................................................ 22
Security........................................................................................................... 22
Network manageability....................................................................................23
Device Installation.................................................................................................................. 25
Time and items required................................................................................. 25
Preparing for the installation........................................................................... 26
Unpacking and installing the device................................................................27
Items included with the device........................................................................ 28
Providing power to the device......................................................................... 29
Cable management.........................................................................................29
High-density cabling for the FC8-64 port blade...................................30
Qualified cables for the FC8-64 port blade......................................... 31
Cable types supported on the FC16-64 port blade............................. 32
Installing inter-chassis links (ICLs) .....................................................33
Rack installation options.........................................................................................................41
Initial Configuration................................................................................................................ 43
Configuring the device.................................................................................... 43
Establishing a serial connection to the device................................................ 44
Brocade DCX 8510-4 Backbone Hardware Installation Guide
53-1002177-13
3
Logging in to the serial console port............................................................. 45
Configuring the IP addresses........................................................................46
Logging off the serial console port and disconnecting the serial cable......... 47
Establishing an Ethernet connection to the device....................................... 47
Customizing a switch name.......................................................................... 48
Customizing a chassis name........................................................................ 48
Setting the domain ID....................................................................................48
Setting the date and time.............................................................................. 49
Setting the date.................................................................................49
Setting the time zone........................................................................ 49
Synchronizing local time................................................................... 50
Verifying the PID mode................................................................................. 50
Determining installed software licenses........................................................ 51
Installing transceivers and attaching cables................................................. 51
Installing SFP+ and mSFP transceivers and cables......................... 51
Qualified transceivers for the FC16-64 and CR16-x blades............. 52
Installing QSFP transceivers and cables.......................................... 53
Managing cables...........................................................................................54
Verifying correct operation and backing up the configuration....................... 55
Powering off the chassis............................................................................... 56
System Monitoring................................................................................................................57
Monitoring overview...................................................................................... 57
Determining the status of a port, application, or extension blade................. 60
FC8-32E port blade LEDs................................................................. 60
FC8-48E port blade LEDs................................................................. 61
FC8-64 port blade LEDs................................................................... 61
FC16-32 port blade LEDs................................................................. 62
FC16-48 port blade LEDs................................................................. 62
FC16-64 port blade LEDs................................................................. 63
FS8-18 encryption blade LEDs......................................................... 63
FX8-24 extension blade LEDs.......................................................... 64
Port, application, and extension blade power LED description......... 64
Port blade status LED description.....................................................64
FC ports status LED description....................................................... 65
GbE and 10-GbE ports status LED description................................ 66
Determining the status of a control processor blade (CP8).......................... 67
Determining the status of a core switch blade (CR16-4).............................. 68
Determining the status of a power supply..................................................... 70
Determining the status of a blower assembly............................................... 71
Determining the status of a WWN card.........................................................72
Removal and Replacement Procedures................................................................................. 75
Introduction................................................................................................... 75
ESD precautions........................................................................................... 75
Chassis door removal and replacement....................................................... 76
Time and items required................................................................... 76
Removing a chassis door..................................................................76
Replacing a chassis door.................................................................. 76
Vertical cable management fingers removal and replacement..................... 77
Time and items required................................................................... 77
Removing a cable management finger assembly............................. 77
Replacing a cable management finger assembly............................. 78
Port and application blade removal and replacement................................... 78
Time and items required................................................................... 79
Removing a blade............................................................................. 79
4
Brocade DCX 8510-4 Backbone Hardware Installation Guide
53-1002177-13
Replacing a blade............................................................................... 81
Blade filler panel removal and replacement........................................ 82
Blade filler panel removal and replacement.................................................... 82
Removing a filler panel........................................................................82
Replacing a filler panel........................................................................83
Control processor blade (CP8) removal and replacement.............................. 83
Time and items required..................................................................... 84
Faulty CP blade indicators.................................................................. 84
Recording critical device information.................................................. 85
Power-up procedure............................................................................86
Power-down procedure....................................................................... 88
Verifying operation of the new CP blade.............................................89
Completing the replacement............................................................... 92
Core switch blade (CR16-x) removal and replacement.................................. 93
Time and items required..................................................................... 93
Faulty core switch blade indicators..................................................... 93
Removing a core switch blade (CR16-x).............................................94
Replacing a core switch blade (CR16-x).............................................95
Power supply removal and replacement......................................................... 96
Time and items required..................................................................... 96
Identifying power supplies...................................................................96
Removing a power supply...................................................................97
Replacing a power supply................................................................... 97
Blower assembly removal and replacement................................................... 98
Time and items required..................................................................... 98
Removing a blower assembly ............................................................ 98
Replacing a blower assembly............................................................. 99
WWN card removal and replacement............................................................. 99
Time and items required................................................................... 100
Using the wwnrecover utility..............................................................100
Verifying the need for replacement................................................... 101
Preparing for WWN card replacement.............................................. 102
Hot-swap replacement...................................................................... 102
Power-down replacement................................................................. 103
Removing the WWN card and WWN bezel (logo plate)....................105
Transceiver and fiber optic cable removal and replacement.........................107
Time and items required................................................................... 108
Items required................................................................................... 108
Removing an SFP+ transceiver........................................................ 108
Replacing an SFP+ transceiver.........................................................109
Removing and replacing an mSFP optical transceiver and cable.....110
Removing and replacing a QSFP and cable..................................... 111
Chassis removal and replacement................................................................113
Time and items required................................................................... 113
Faulty chassis indicators................................................................... 114
Recording critical device and SAN information................................. 114
Disconnecting from network and fabric............................................. 118
Removing components from the chassis.......................................... 118
Installing the replacement chassis.................................................... 119
Installing components into the chassis..............................................119
Downloading the configuration..........................................................120
Verifying correct operation of system................................................121
Reconnecting the system to the network and fabric......................... 122
Verifying correct configuration of the fabric.......................................122
Cable routing table............................................................................ 123
Application and Encryption Blades........................................................................................127
Brocade DCX 8510-4 Backbone Hardware Installation Guide
53-1002177-13
5
Introduction................................................................................................. 127
FS8-18 blade...............................................................................................127
FX8-24 blade...............................................................................................127
Port Numbering Templates..................................................................................................131
CR16-4 core blade port numbering.............................................................131
FC8-32E port blade port numbering........................................................... 133
FC8-48E port blade port numbering........................................................... 133
FC8-64 port blade port numbering..............................................................134
FC16-32 port blade port numbering............................................................134
FC16-48 port blade port numbering............................................................135
FC16-64 port blade port numbering............................................................135
FS8-18 encryption blade port numbering....................................................135
FX8-24 extension blade port numbering.....................................................136
Diagnostics and Troubleshooting........................................................................................ 137
Introduction................................................................................................. 137
Obtaining chassis and component status................................................... 137
Interpreting POST and boot results............................................................ 138
POST.............................................................................................. 138
Boot.................................................................................................139
Diagnostics..................................................................................................139
Troubleshooting.......................................................................................... 139
Regulatory Statements....................................................................................................... 143
BSMI statement (Taiwan)............................................................................143
Canadian requirements...............................................................................143
CE statement.............................................................................................. 143
China ROHS............................................................................................... 144
FCC warning (US only)............................................................................... 144
Germany statement.....................................................................................144
KCC statement (Republic of Korea)............................................................144
VCCI statement...........................................................................................145
Brocade DCX 8510 Technical Specifications....................................................................... 147
Caution and Danger Notices................................................................................................161
Cautions......................................................................................................161
Danger Notices........................................................................................... 162
Index.................................................................................................................................. 167
6
Brocade DCX 8510-4 Backbone Hardware Installation Guide
53-1002177-13
Preface
● Document conventions......................................................................................................7
● Brocade resources............................................................................................................ 9
● Contacting Brocade Technical Support.............................................................................9
● Document feedback........................................................................................................ 10
Document conventions
The document conventions describe text formatting conventions, command syntax conventions, and
important notice formats used in Brocade technical documentation.
Text formatting conventions
Text formatting conventions such as boldface, italic, or Courier font may be used in the flow of the text
to highlight specific words or phrases.
Format
Description
bold text
Identifies command names
Identifies keywords and operands
Identifies the names of user-manipulated GUI elements
Identifies text to enter at the GUI
italic text
Identifies emphasis
Identifies variables
Identifies document titles
Courier font
Identifies CLI output
Identifies command syntax examples
Command syntax conventions
Bold and italic text identify command syntax components. Delimiters and operators define groupings of
parameters and their logical relationships.
Convention
Description
bold text
Identifies command names, keywords, and command options.
italic text
Identifies a variable.
value
In Fibre Channel products, a fixed value provided as input to a command
option is printed in plain text, for example, --show WWN.
Brocade DCX 8510-4 Backbone Hardware Installation Guide
53-1002177-13
7
Notes, cautions, and warnings
Convention
Description
[]
Syntax components displayed within square brackets are optional.
Default responses to system prompts are enclosed in square brackets.
{x|y|z}
A choice of required parameters is enclosed in curly brackets separated by
vertical bars. You must select one of the options.
In Fibre Channel products, square brackets may be used instead for this
purpose.
x|y
A vertical bar separates mutually exclusive elements.
<>
Nonprinting characters, for example, passwords, are enclosed in angle
brackets.
...
Repeat the previous element, for example, member[member...].
\
Indicates a “soft” line break in command examples. If a backslash separates
two lines of a command input, enter the entire command at the prompt without
the backslash.
Notes, cautions, and warnings
Notes, cautions, and warning statements may be used in this document. They are listed in the order of
increasing severity of potential hazards.
NOTE
A Note provides a tip, guidance, or advice, emphasizes important information, or provides a reference
to related information.
ATTENTION
An Attention statement indicates a stronger note, for example, to alert you when traffic might be
interrupted or the device might reboot.
CAUTION
A Caution statement alerts you to situations that can be potentially hazardous to you or cause
damage to hardware, firmware, software, or data.
DANGER
A Danger statement indicates conditions or situations that can be potentially lethal or
extremely hazardous to you. Safety labels are also attached directly to products to warn of
these conditions or situations.
8
Brocade DCX 8510-4 Backbone Hardware Installation Guide
53-1002177-13
Brocade resources
Brocade resources
Visit the Brocade website to locate related documentation for your product and additional Brocade
resources.
You can download additional publications supporting your product at www.brocade.com. Select the
Brocade Products tab to locate your product, then click the Brocade product name or image to open the
individual product page. The user manuals are available in the resources module at the bottom of the
page under the Documentation category.
To get up-to-the-minute information on Brocade products and resources, go to MyBrocade. You can
register at no cost to obtain a user ID and password.
Release notes are available on MyBrocade under Product Downloads.
White papers, online demonstrations, and data sheets are available through the Brocade website.
Contacting Brocade Technical Support
As a Brocade customer, you can contact Brocade Technical Support 24x7 online, by telephone, or by email. Brocade OEM customers contact their OEM/Solutions provider.
Brocade customers
For product support information and the latest information on contacting the Technical Assistance
Center, go to http://www.brocade.com/services-support/index.html.
If you have purchased Brocade product support directly from Brocade, use one of the following methods
to contact the Brocade Technical Assistance Center 24x7.
Online
Telephone
E-mail
Preferred method of contact for nonurgent issues:
Required for Sev 1-Critical and Sev
2-High issues:
support@brocade.com
•
My Cases through MyBrocade
• Continental US: 1-800-752-8061
•
Software downloads and licensing •
tools
•
Knowledge Base
Europe, Middle East, Africa, and
Asia Pacific: +800-AT FIBREE
(+800 28 34 27 33)
•
For areas unable to access toll
free number: +1-408-333-6061
•
Toll-free numbers are available in
many countries.
Please include:
•
Problem summary
•
Serial number
•
Installation details
•
Environment description
Brocade OEM customers
If you have purchased Brocade product support from a Brocade OEM/Solution Provider, contact your
OEM/Solution Provider for all of your product support needs.
• OEM/Solution Providers are trained and certified by Brocade to support Brocade® products.
• Brocade provides backline support for issues that cannot be resolved by the OEM/Solution Provider.
Brocade DCX 8510-4 Backbone Hardware Installation Guide
53-1002177-13
9
Document feedback
• Brocade Supplemental Support augments your existing OEM support contract, providing direct
access to Brocade expertise. For more information, contact Brocade or your OEM.
• For questions regarding service levels and response times, contact your OEM/Solution Provider.
Document feedback
To send feedback and report errors in the documentation you can use the feedback form posted with
the document or you can e-mail the documentation team.
Quality is our first concern at Brocade and we have made every effort to ensure the accuracy and
completeness of this document. However, if you find an error or an omission, or you think that a topic
needs further development, we want to hear from you. You can provide feedback in two ways:
• Through the online feedback form in the HTML documents posted on www.brocade.com.
• By sending your feedback to documentation@brocade.com.
Provide the publication title, part number, and as much detail as possible, including the topic heading
and page number if applicable, as well as your suggestions for improvement.
10
Brocade DCX 8510-4 Backbone Hardware Installation Guide
53-1002177-13
About This Document
● Supported hardware and software.................................................................................. 11
● What’s new in this document.......................................................................................... 11
Supported hardware and software
This document includes information specific to the Brocade DCX 8510-4 running Brocade Fabric OS
version 7.4.0 and later.
What’s new in this document
The following changes have been made:
• Added step to record WWN, SKU, and serial number from chassis label on defective chassis to
Installing components into the chassis on page 119.
• Added information to Using the wwnrecover utility on page 100 and Hot-swap replacement on page
102 about RASlog message that generates when WWN card is removed.
• Added steps for removing configuration on FX8-25 blade as part of blade removal procedure in Port
and application blade removal and replacement on page 78.
Brocade DCX 8510-4 Backbone Hardware Installation Guide
53-1002177-13
11
What’s new in this document
12
Brocade DCX 8510-4 Backbone Hardware Installation Guide
53-1002177-13
Product Overview
● Product features..............................................................................................................13
● Hardware components.................................................................................................... 14
● Supported blades............................................................................................................ 17
● Chassis slots numbering................................................................................................. 19
● Port numbering................................................................................................................19
● High availability............................................................................................................... 20
● Reliability.........................................................................................................................21
● Serviceability................................................................................................................... 21
● Software features............................................................................................................ 22
● Security........................................................................................................................... 22
● Network manageability....................................................................................................23
Product features
Key product features include the following:
• Up to 256 16-Gbps external ports in a single chassis , enabling high density SAN configurations with
reduced footprint.
• Support for 2, 4, 8, and 16-Gbps autosensing Fibre Channel ports. Trunking technology groups up to
eight ports to create high performance 128-Gbps ISL trunks between switches.
• 10-Gbps FC-type SFPs in 32/48-port 16-Gbps port blades, and 10-GbE SFPs in the FX8-24
application blades. The two types of SFPs are not interchangeable.
• The 10-Gbps ports can be manually configured on only the first eight ports of the 32- and 48-port 16Gbps port blades.
• Support for many of the application, port blade, and control processor (CP) blades supported in the
Brocade DCX family of backbones (with the exception of the Core Switch Blade), thereby providing
flexible system configurations and fewer types of new blades.
• Beginning with Fabric OS v7.0.1, up to nine chassis can be connected with the use of 4x16-Gbps
quad SFP (QSFP) inter-chassis links (ICLs). Fabric OS v7.0.0 permits up to six chassis to be linked.
• Support for high-performance port blades running at 2, 4, 8, 10, or 16-Gbps, enabling flexible system
configuration.
• Redundant and hot-swappable control processor and core switch blades, power supplies, blower
assemblies, and WWN cards that enable a high availability platform and enable nondisruptive
software upgrades for mission-critical SAN applications.
• Universal ports that self-configure as E_Ports, F_Ports, EX_Ports and M_Ports (mirror ports). 10Gbps ports are E_Ports only.
• Diagnostic port (D_Port) functionality.
• In-flight data cryptographic (encryption/decryption) and data compression capabilities through the 16Gbps port blades when configured as ISLs.
• Fibre Channel over IP (FCIP) functionality through the FX8-24 blade.
Brocade DCX 8510-4 Backbone Hardware Installation Guide
53-1002177-13
13
Hardware components
Hardware components
The device has a modular and scalable mechanical construction that allows a wide range of flexibility
in installation, fabric design, and maintenance. The chassis can be mounted with the cables facing the
front of the equipment rack or to the rear, and consists of the following:
• Up to four hot-swappable port blade assemblies that can be configured in a single chassis,
delivering up to 256 16-Gbps Fibre Channel ports .
• Two slots for control processor blades (CP8):
‐ A single active CP8 blade can control all the ports in the chassis.
‐ The standby CP8 blade assumes control of the chassis if the active CP fails.
• Two slots for core switch blades (CR16-4):
‐ CR16-4 blade interconnects all port blades.
‐ Inter-chassis link (ICL) connectors to connect to as many as nine neighboring chassis using
Fabric OS v7.0.1 or later. Only six chassis can be connected using Fabric OS v7.0.0.
‐ Both CR16-4 blades are active.
• Modular, hot-swappable port blades:
‐ 32-port, 8-Gbps blades (FC8-32E)
‐ 48-port, 8-Gbps blades (FC8-48E)
‐ 64-port, 8-Gbps blades (FC8-64)
‐ 32-port, 16-Gbps blades (FC16-32)
‐ 48-port, 16-Gbps blades (FC16-48)
‐ 64-port, 16-Gbps blades (FC16-64)
• Modular, hot-swappable application blades:
‐ FX8-24: 24-port (12 FC, 10 1-GbE, and 2 10-GbE) FCIP extension blade enabling long distance
communication over existing IP infrastructure.
• Modular, hot-swappable encryption blades:
‐ FS8-18: 16-port, up to 4 blades per chassis, supporting in-flight data cryptographic (encryption/
decryption) and data-compression capabilities.
• Modular, hot-swappable field-replaceable units (FRUs):
‐ Two blower assemblies.
‐ Two power supplies (100-240 VAC autosensing).
‐ At 110 VAC (nominal): A minimum of two power supplies is required, regardless of the number
of port or application blades. This configuration does not support high availability.
‐ 220 VAC (nominal) is recommended for efficiency. A second power supply is required to
support high availability.
‐ Redundant AC primary power connections ensure high availability. Each power supply has its
own connector, so the number of primary power connections is two for optimum efficiency and
redundancy.
‐ Two WWN cards.
‐ Blades use small form-factor pluggable (SFP+, mSFP, and QSFP) optical transceivers.
‐ The 8-Gbps SFP+s and mSFPs auto-negotiate at 2, 4, and 8 Gbps.
‐ The 10-Gbps speed must be manually set and requires special 10-Gbps FC SFP+
transceivers.
‐ The 16-Gbps SFP+ transceivers support speeds of 2, 4, 8, 10, and 16 Gbps.
‐ The 16-Gbps QSFPs supported on FC16-64 port blade auto-negotiate at 4, 8, and 16 Gbps.
‐ The 16-Gbps QSFPs based inter-chassis link (ICL) on the core blades run at 64-Gbps (four
fixed 16-Gbps clustered in a single quad connector and cable).
14
Brocade DCX 8510-4 Backbone Hardware Installation Guide
53-1002177-13
Port side view of the device
• Blades are serviced from the port side of the chassis. Blowers, power supplies, and power cables are
serviced from the nonport side.
• World Wide Name (WWN) cards on the nonport side, with WWN status LEDs located under the
bezel.
• Two vertical cable management finger assemblies and a redesigned chassis door for improved cable
management.
Port side view of the device
FIGURE 1 Port side view of the Brocade DCX 8510-4 (sample configuration)
1.
2.
3.
4.
Port blade (FC16-32)
Core switch blade (CR16-4)
Control processor blade (CP8)
Exhaust vent
NOTE
Airflow is from the nonport side to the port side and out the exhaust vents. If you use the Port Side
Exhaust Kit, the air vents are all on the port side of the chassis.
Brocade DCX 8510-4 Backbone Hardware Installation Guide
53-1002177-13
15
Nonport side view of the device
FIGURE 2 Port side view of the Brocade DCX 8510-4 with the Port Side Exhaust Kit installed (sample
configuration)
Nonport side view of the device
The following figure shows a sample configuration of the nonport side view of the Brocade DCX
8510-4.
16
Brocade DCX 8510-4 Backbone Hardware Installation Guide
53-1002177-13
Supported blades
FIGURE 3 Nonport side view of the Brocade DCX 8510-4 (sample configuration)
1.
2.
3.
4.
WWN card bezel (logo plate)
Power supply
Blower assembly
Label with serial number and WWN
Supported blades
The following table summarizes the port, application, control processor, and core switch blades that are
supported in the device.
TABLE 1 Blades available for the device
Description
Name
Function
Control processor
blade
CP8
The CP8 blade contains the control plane for the chassis. There are
two CP8 blades for redundancy. This control processor blade is
compatible with the Brocade DCX 8510-8, Brocade DCX 8510-4,
Brocade DCX-4S, and Brocade DCX platforms.
Brocade DCX 8510-4 Backbone Hardware Installation Guide
53-1002177-13
17
Product Overview
TABLE 1 Blades available for the device (Continued)
18
Description
Name
Function
Core switch blade
CR16-4
The CR16-4 blade contains the ASICs for switching between port
blades. Every port blade connects to each core switch blade. There
can be up to 256 16-Gbps or 8-Gbps total ports for port blades.
Each core switch blade connects to 128 backplane ports. Core
switch blades have additional front port connectivity to connect
multiple chassis and backplane connections for the storage server
blade. This core switch blade is compatible only with the Brocade
DCX 8510-4 and requires specific type of QSFP transceivers.
32-port 8-Gbps port
blade
FC8-32E
A 32-port Brocade port blade supporting 2, 4, and 8 Gbps Fibre
Channel port speeds. This port blade is compatible with the Brocade
Brocade DCX 8510-8 and Brocade DCX 8510-4 This blade requires
Fabric OS v7.0.1 or later to run in this chassis.
48-port 8-Gbps port
blade
FC8-48E
A 48-port Brocade port blade supporting 2, 4, and 8 Gbps Fibre
Channel port speeds. This port blade is compatible with the Brocade
DCX 8510-8 and Brocade DCX 8510-4. This blade requires Fabric
OS v7.0.1 or later to run in this chassis.
64-port 8-Gbps port
blade
FC8-64
A 64-port Brocade port blade supporting 2, 4, and 8 Gbps port
speeds with mSFPs. This port blade is compatible with the Brocade
DCX 8510-8, Brocade DCX 8510-4, Brocade DCX-4S, and Brocade
DCX platforms.
32-port 16-Gbps port
blade
FC16-32
A 32-port Brocade port blade supporting 2, 4, 8, 10, and 16 Gbps
Fibre Channel port speeds. The blade also supports port-based inflight encryption/decryption and compression/decompression. This
port blade is compatible with the Brocade DCX 8510-8 and Brocade
DCX 8510-4 and requires Fabric OS v7.0.0 or later to run in this
chassis.
48-port 16-Gbps port
blade
FC16-48
A 48-port Brocade port blade supporting 2, 4, 8, 10, and 16 Gbps
Fibre Channel port speeds. The blade also supports port-based inflight encryption/decryption and compression/decompression. This
port blade is compatible with the Brocade DCX 8510-8 and Brocade
DCX 8510-4 and requires Fabric OS v7.0.0 or later to run in this
chassis.
64-port 16-Gbps port
blade
FC16-64
A 64-port Brocade port blade supporting 4, 8, and 16-Gbps Fibre
Channel port speeds. The blade also supports port-based in-flight
encryption/decryption and compression/decompression. This port
blade is compatible with the Brocade DCX 8510-8 and Brocade
DCX 8510-4 and requires Fabric OS v7.3.0 or later to run in this
chassis. Requires specific type of QSFP transceivers and those are
not the same as used in the core blades.
Storage encryption
blade
FS8-18
The FS8-18 blade enables data cryptographic (encryption/
decryption) and data-compression capabilities for data-at-rest. It has
16 Fibre Channel optical SFP ports. This application blade is
compatible with the Brocade DCX 8510-8, Brocade DCX 8510-4,
Brocade DCX-4S, and Brocade DCX platforms and requires Fabric
OS v7.0.0 or later to run in the 8510-4 and 8510-8 chassis.
Brocade DCX 8510-4 Backbone Hardware Installation Guide
53-1002177-13
Chassis slots numbering
TABLE 1 Blades available for the device (Continued)
Description
Name
FCIP extension blade FX8-24
Function
The FX8-24 blade enables FCIP functionality over existing IP
infrastructure. It has 12 FC ports, 10 1-GbE ports, and two 10-GbE
ports available. This application blade is compatible with the
Brocade DCX 8510-8, Brocade DCX 8510-4, Brocade DCX-4S, and
Brocade DCX platforms and requires Fabric OS v7.0.0 or later to
run in the DCX 8510-4 and DCX 8510-8 chassis.
Chassis slots numbering
The chassis slots are numbered and used for the following purpose.
•
•
•
•
•
Numbered 1 through 8, from bottom to top when facing the port side of the Brocade DCX 8510-4.
Slots 4 and 5 can be used only to install the control processor blades (CP8).
Slots 3 and 6 can be used only to install the core switch blades (CR16-4).
Slots 1-2 and 7-8 can be filled with port, application, or encryption blades.
Unused slots must be filled with blade filler panels to maintain adequate cooling.
Port numbering
The device uses the following port numbering method.
TABLE 2 Port numbering and trunking port groups
Blade
Port numbering
Trunking port groups
CR16-4 core
blade
0 through 7 from right to left.
•
•
Trunk group 0: QSFP ports 0-3
Trunk group 1: QSFP ports 4-7
Each connector is a group of four 16Gbps ports. For supported QSFPs, refer
to Qualified transceivers for the FC16-64
and CR16-x blades on page 52
NOTE
Individual FC ports within the same QSFP
port cannot form a trunk. A trunk has to
comprise of individual FC ports from
different consecutive QSFP ports. Only
four FC ports from consecutive QSFP
ports can form a trunk in Brocade DCX
8510-4
FC8-32E port
blade
•
0 through 15 from right to left on the lower set
of ports
• 16 through 31 from right to left on the upper
set of ports.
Brocade DCX 8510-4 Backbone Hardware Installation Guide
53-1002177-13
Trunk groups: 0-7, 8-15, 16-23, and 24-31.
19
High availability
TABLE 2 Port numbering and trunking port groups (Continued)
Blade
Port numbering
Trunking port groups
FC8-48E port
blade
•
0 through 23 from right to left on the lower set
of ports
• 24 through 47 from right to left on the upper
set of ports.
Trunk groups: 0-7, 8-15, 16-23, 24-31,
32-39, and 40-47.
FC8-64 port
blade
•
0 through 31 from right to left on the lower set
of ports.
• 32 through 63 from right to left on the upper
set of ports.
Trunk groups: 0-7, 8-15, 16-23, 24-31,
32-39, 40-47, 48-55, and 56-63.
FC16-32 port
blade
•
0 through 15 from right to left on the lower set
of ports.
• 16 through 31 from right to left on the upper
set of ports.
Trunk groups: 0-7, 8-15, 16-23, and 24-31.
FC16-48 port
blade
•
0 through 23 from right to left on the lower set
of ports.
• 24 through 47 from right to left on the upper
set of ports.
Trunk groups: 0-7, 8-15, 16-23, 24-31,
32-39, and 40-47.
FC16-64 port
blade
•
Trunk groups: 0-7, 8-15, 16-23, 24-31,
32-39, 40-47, 48-55, and 56-63.
0 through 63 from right to left.
These are QSFP ports 0-15. For supported
QSFPs, refer to Qualified transceivers for
the FC16-64 and CR16-x blades on page
52.
FS8-18 blade
• 16 FC ports: 0 through 15 from right to left.
• Two 10/100/1000 BaseT ports: GE0 and GE1
from right to left.
•
•
FX8-24 blade
•
• Trunk group 0: FC ports 0-1
• Trunk group 1: FC ports 6-7
• Trunk group 2: FC ports 2-5 and 8-11
FC ports labeled FC on the front panel: 0
through 11 in two horizontal rows of six ports
starting from the lower right and upper right in
the right group of 12 ports.
• Two 10-GbE ports labeled 10GE on the front
panel: 0 and 1 in the lower row to the left of
the FC ports.
• 1-GbE ports labeled GE on the front panel: 0
through 9 in both rows to the left of the FC
and 10GE ports.
Trunk group 0: FC ports 0-7
Trunk group 1: FC ports 8-15
High availability
The following features contribute to the high availability the device:
•
•
•
•
•
20
Redundant, hot-swappable FRUs, including blades, power supplies, blowers, and WWN cards
Enhanced data integrity on all data paths
Fabric Shortest Path First (FSPF) rerouting around failed links
Integration with Simple Network Management Protocol (SNMP) managers
Automatic control processor failover
Brocade DCX 8510-4 Backbone Hardware Installation Guide
53-1002177-13
Reliability
• Nondisruptive "hot" software code loads and activation
• Easy configuration, save, and restore
The high availability software architecture provides a common framework for all applications that reside
on the system, allowing global and local states to be maintained through any component failure. High
availability elements consist of the High Availability Manager, the heartbeat, the fault/health framework,
the replicated database, initialization, and software upgrade.
The High Availability Manager controls access to the standby control processor, facilitates software
upgrades, prevents extraneous CP failover activity, closes and flushes streams, provides flow control
and message buffering, and supports a centralized active and standby state.
Reliability
The device uses the following error detection and correction mechanisms to ensure reliability of data:
• Error Detection and Correction over main control processor memory.
• Error Detection and Correction mechanism, which checks for encoder errors and fault isolation
(EDFI), such as cyclic redundancy checking (CRC), parity checking, checksum, and illegal address
checking.
• Power-on self-test (POST).
• Dual control processors that enable hot, nondisruptive fast firmware upgrades.
• One serial port and two Ethernet ports (on each control processor) for management and for service.
Offline control processor diagnostics and remote diagnostics simplify troubleshooting. The standby
control processor monitors diagnostics to ensure the system is operational should a failover be
necessary.
• Bus monitoring and control of blades and other field-replaceable units (FRUs).
Serviceability
The device provides the following features to enhance and ensure serviceability:
• Modular design with hot-swappable components.
• Flash memory that stores two firmware images per control processor.
• USB port on control processor blades for most tasks that formerly required an FTP/SCP server,
including software and firmware upgrades.
• Nonvolatile random-access memory (NVRAM), containing the OEM serial number, Brocade serial
number, revision information, and part number information.
• Background health-check daemon.
• Memory scrubber, self test, and bus ping to determine if a bus is not functioning.
• RASlog messages.
• SMI-S compliant.
• Hardware and software watchdog timers.
• Status LEDs.
• Predictive diagnostics analysis through Fabric Watch.
• SNMP (including version 3) integration with higher-layer managers.
Brocade DCX 8510-4 Backbone Hardware Installation Guide
53-1002177-13
21
Software features
Software features
The Fabric OS allows any Fibre Channel-compliant device to attach to the switches as long as it
conforms to the device login, name service, and related Fibre Channel standards. Each operating
environment requires that a Fibre Channel host bus adapter (HBA) be available with a standardscompliant driver for correct interface to the fabric.
Fabric OS consists of a set of embedded applications running on top of an embedded Linux operating
system kernel. Some of these applications include:
•
•
•
•
•
•
•
•
•
Name server
Alias server
Zone server
Simple Network Management Protocol (SNMP) agent
SMI-S compliant API
Syslog auditing
Reliable Commit Service (RCS)
NTP
Tasks to manage address assignment, routing, link initialization, fabric initialization, link shutdown,
the device shutdown, and the user interface
Security
The following list highlights some of the key security features available in the device and in other
Brocade enterprise-class products running Fabric OS 7.0.1 or later. For details, contact your device
supplier and refer to the Brocade White Paper, "The Growing Need for Security in Storage Area
Networks."
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
22
DH-CHAP
SSHv2 (using AES, 3DES, RSA)
HTTPS (using AES)
SNMPv3
FC-SP
Secure RPC
Secure file copy (SCP)
Telnet disable
Telnet timeout
IP filters (block listeners)
Secure passwords (centralized control through RADIUS/CHAP)
Multiple user accounts (MUAs) (Up to 255)
Role-based access controls (RBACs)
Administrative domains/Virtual fabrics
Boot PROM password reset
Password hardening policies
Up front login in Web Tools
Login banner
Monitoring of attempted security breaches (through audit logging)
Monitoring of attempted security breaches (through Fabric Watch Security Class)
Fibre Channel security policies: DCC and SCC
Trusted Switch (FCS) for central security management
Brocade DCX 8510-4 Backbone Hardware Installation Guide
53-1002177-13
Network manageability
•
•
•
•
•
•
•
•
•
•
•
•
Management access controls (SNMPv3, Telnet, FTP, serial port, front panel)
Hardware-enforced zoning by WWN, domain/port ID, or both
Default zoning
RSCN suppression and aggregation
Configurable RSCN suppression by port
NTPv3 (to synchronize timestamps)
Event auditing
Change tracking
Firmware change alerts in Fabric Manager
Persistent port disable
Persistent domain ID
E_Port disable
Network manageability
The device has a single domain and is managed as a single element with Brocade Network Advisor.
The device responds to its own IP address and appears as a separate entity to the Telnet protocol and
SNMP.
All management interfaces, such as Telnet, Web Tools, standards-compliant SMI-S, and Management
Server, support a "port N within blade M" naming scheme.
The device supports SNMPv1 and SNMPv3. When SNMP devices send SNMP messages to a
management console running SAN management software, the information is stored in a management
information base (MIB). Fabric OS v7.0.0 and later supports the latest Fibre Alliance Fibre Channel
Management (FCMGMT) and Storage Management Initiative (SMI) MIBs, which allow common
information necessary for management software to provide information to a SAN administrator. Refer to
the Fabric OS MIB Reference for additional MIB information.
Brocade DCX 8510-4 Backbone Hardware Installation Guide
53-1002177-13
23
Network manageability
24
Brocade DCX 8510-4 Backbone Hardware Installation Guide
53-1002177-13
Device Installation
● Time and items required................................................................................................. 25
● Preparing for the installation........................................................................................... 26
● Unpacking and installing the device................................................................................27
● Items included with the device........................................................................................ 28
● Providing power to the device......................................................................................... 29
● Cable management.........................................................................................................29
Time and items required
You can set up and install the device in the following ways:
• As a standalone unit on a flat surface.
• In a 19-inch Electronic Industries Association (EIA) cabinet, using a Brocade DCX 8510-4, Brocade
DCX-4S Rack Mount Kit either a 27-31 inch or 18-24 inch kit depending on the rack used.
• In a chassis with the Port Side Exhaust Kit that is provided with the device in an approved rack.
• In a mid-mount telecommunications (Telco) rack, using the Mid-Mount Rack Kit available from your
device supplier.
This chapter describes how to set up the device as a standalone unit. For rack-mount installation
instructions, refer to the appropriate manual as described in the following table.
The following table describes the main installation and setup tasks, the estimated time required for
each, and the items required to complete the task for a device that is fully populated with FC16-64 port
blades. Configurations with fewer blades or ports require less time. These time estimates assume a
prepared installation site and appropriate power and network connectivity.
TABLE 3 Installation tasks, time, and items required
Installation task
Time estimate
Items required
Site preparation and unpacking
the device
30 minutes
1/2-in. socket wrench (to remove pallet bolts).
Pallet jack.
Hydraulic lift or assisted lift, able to raise to a minimum of
140 cm (55 in.), with a minimum capacity of 115 kg (254 lb).
To know the weight of your device fully populated with the
required port blades, refer to the Brocade DCX 8510
Technical Specifications on page 147.
Installing rack mount kit or Port
Side Exhaust Kit
30 minutes
Refer to the one or more of the following documents:
Mounting and securing the
device in rack
30 minutes
• Port Side Exhaust Kit Installation Procedure
• Mid-Mount Rack Kit (Backbone) Installation Procedure
• 27-31 Inch Rail Rack Mount (Backbone) Kit Installation
Procedure
Brocade DCX 8510-4 Backbone Hardware Installation Guide
53-1002177-13
25
Preparing for the installation
TABLE 3 Installation tasks, time, and items required (Continued)
Installation task
Time estimate
Items required
Installing power cables and
powering on the device
20 minutes
Power cables (provided in the device accessories kit).
Establishing serial connection,
logging in to the device, and
configuring IP addresses
20 minutes
Serial cable (provided in the accessory kit).
Workstation computer with a serial port or terminal server
port and a terminal emulator application (such as
HyperTerminal).
Ethernet IP addresses for the device and for both control
processor blades: total three addresses.
Installing an Ethernet cable,
opening a Telnet session, and
configuring the device domain
ID, date and time, and additional
system parameters. Verify and
back up configuration.
20 minutes
Ethernet cabling (optional) for Telnet access.
Refer to the Fabric OS Administrator's Guide.
Installing transceivers as needed 20-30 minutes or SFP+, mSFP, and QSFP optical transceivers as needed.
longer if you are
using high-density
port blades.
Attaching fiber-optic cables,
cable ties, and cable guides
2-3 hours
Fiber-optic cables and cable ties.
Preparing for the installation
Read the following sections before preparing to install the device.
• Caution and Danger Notices on page 161.
• Brocade DCX 8510 Technical Specifications on page 147; power supply specifications section and
plan for meeting the power supply standards based on your device configuration.
• Managing cables on page 54 and plan for cable management.
The following steps are required to ensure correct installation and operation.
1. Ensure that the following amount of space is available in the rack.
•
•
•
•
9 rack units (9U) high.
8 rack units (8U) high, if you do not use the Port Side Exhaust Kit.
61.29 cm (24.09 inch) deep.
43.74 cm (17.22 inch) wide.
1U is equal to 4.45 cm (1.75 inches).
Plan to install the device with the nonport side facing the air-intake aisle. The device can be
installed facing either direction, if serviceability and cooling requirements are met.
2. Ensure that dedicated electrical branch circuits with the following characteristics are available:
• 200 - 240 VAC, 50-60 Hz, two branch circuits are recommended for high availability and
maximum blade usage when configured with 192 or more 16-Gbps ports.
• Two cables for 200 - 240 VAC service
26
Brocade DCX 8510-4 Backbone Hardware Installation Guide
53-1002177-13
Unpacking and installing the device
•
•
•
•
Protected by a circuit breaker in accordance with local electrical codes
Supply circuit, line fusing, and wire size adequate to the electrical rating on the chassis nameplate
Location close to the chassis and easily accessible
Grounded outlets installed by a licensed electrician and compatible with the power cords
CAUTION
Use a separate branch circuit for each power cord, which provides redundancy in case one of
the circuits fails.
3. Plan for cable management before installing the chassis.
Cables can be managed in a variety of ways, such as by routing cables below the chassis, to either
side of the chassis, through cable channels on the sides of the cabinet, or by using patch panels.
4. Ensure that the following is available for configuration of the device:
•
•
•
•
Workstation with an installed terminal emulator, such as HyperTerminal
Serial cable (provided)
Three Ethernet cables (including one spare)
Access to an FTP server for backing up the switch configuration or collecting supportsave output
data (optional)
• A Brocade USB stick for collecting supportsave output data (optional)
• Transceivers (copper and optical) and compatible cables
5. Ensure that the air intake and exhaust vents have a minimum of 5.1 cm (2 in.) of airspace.
6. Ensure that the air temperature on the air intake side is less than 40°C (104°F) during operation.
Unpacking and installing the device
Use the following procedure to unpack and install your device.
DANGER
A fully populated chassis (four FC16-64 port cards, 256 ports) weighs approximately 69.5 kg (153
lbs) and requires a hydraulic or assisted lift to install it.
1. Unpack the device.
a) Cut the bands that encircle the packaging.
b) Remove the lid and the kits and foam from the top of the chassis.
c) Lift the cardboard box off the chassis and remove the plastic bag from around the chassis.Save
the packing materials for use when returning the old chassis.
d) Leave the chassis on top of the plastic shipping tray if the chassis must be transported to the
installation location.
NOTE
The device packaging does not incorporate a wood pallet and pallet brackets. The chassis sits on
top of a plastic shipping tray.
2. Use a pallet jack or other assisted lift to transport the new chassis to the installation area. Doorways
must be wider than 36 in. (91 cm) to accommodate the chassis.
3. Remove the following items from the chassis and set aside.
• Brocade DCX 8510-4 Port Side Exhaust Kit (if ordered)
• Accessory kit
Brocade DCX 8510-4 Backbone Hardware Installation Guide
53-1002177-13
27
Items included with the device
• Packing foam
• Antistatic plastic
4. Remove the chassis door from the device.
5. Remove the vertical cable management fingers.
6. Use a lift to raise the chassis to the correct level. If installing the chassis in a cabinet, follow the
instructions provided by the rack kit manufacturer.
7. If applicable, lock the wheels of the lift.
8. Gently slide the chassis onto the final installation surface, ensuring that it remains supported during
the transfer.
9. Ensure that the chassis is oriented so that the nonport side has access to intake air (cool).
10.Reinstall the vertical cable management fingers.
11.Reinstall the door. The door must be installed to meet EMI compliance.
Items included with the device
The device ships with the following:
• The chassis, populated with:
‐ Control processor blades (CP8)
‐ Core switch blades (CR16-4)
‐ Port blades, application blades, and encryption blades (included based on customer
specification)
‐ Blade slot filler panels (for slots not filled by blades)
‐ Port Side Exhaust Kit (included based on customer specification)
‐ WWN cards
‐ WWN bezel (logo plate)
‐ Power supplies
‐ Power supply filler panel (included if there is only one power supply)
‐ Blower assemblies
‐ Cable management finger assemblies
‐ Chassis door
• Accessory kit containing the following items:
‐
‐
‐
‐
A QuickStart Guide
ESD grounding strap
USB device
RS-232 serial cable. The RS-232 cable has an adapter at one end that can be removed to
provide an RJ-45 style connector.
• Rack mount kit (as ordered) with instructions
Order the Brocade-branded optical transceivers (SFP+, mSFP, and QSFP). The device supports SWL,
LWL, and ELWL transceivers. The mSFPs and QSFPs are SWL transceivers only.
NOTE
For information about the SFP+, mSFP, and QSFP transceivers that are qualified for the device, refer
to Transceiver and fiber optic cable removal and replacement on page 107.
28
Brocade DCX 8510-4 Backbone Hardware Installation Guide
53-1002177-13
Providing power to the device
Providing power to the device
For this procedure, refer to the power supply specifications section in the Brocade DCX 8510 Technical
Specifications on page 147 for power supply requirements of your chassis.
Complete the following steps to provide power to the chassis.
DANGER
Make sure that the power source circuits are properly grounded, then use the power cord
supplied with the device to connect it to the power source.
1. Connect the two AC power cords to the two power supplies.
2. Connect the power cords to a power source with voltage of 200 to 240 VAC, 47 to 63 Hz or optionally
to a power source with voltage of 110 to 120 VAC, 47 to 63 Hz. If using any application blades in the
chassis, the 200 to 240 VAC option is necessary to achieve power supply redundancy.
NOTE
Use of the high-voltage line (200 to 240 VAC) is highly recommended because of better powerconversion efficiency. For a fully-loaded Brocade DCX 8510-4, 200 to 240 VAC is required for high
availability (ability to hot swap a failed power supply without affecting system operation).
3. Switch the AC power switches on the power supplies to I. The AC power switches light green when
switched on and power is supplied.
The device performs a power-on self-test (POST) each time it is powered on. POST takes
approximately 10 minutes and is complete when the indicator light activity displays the operational
state. You can bypass POST by using the fastBoot command. You can also disable POST for
successive reboots on the device using the diagDisablePost command.
NOTE
Do not connect the switch to the network until the IP addresses are configured.
For information about LED patterns, refer to System Monitoring on page 57.
Cable management
The cable management finger assemblies are attached to the chassis on either side of the port side of
the chassis and allow for simple cable management. The cable management finger assemblies can be
installed without service disruption.
Route the cables across in front of the blades to keep LEDs visible. Leave at least one meter of slack
for each fiber-optic cable to provide room to remove and replace blades.
NOTE
The minimum radius to which a 50 micron cable can be bent under full tensile load is 5.1 cm (2 in.). For
a cable under no tensile load, that minimum is 3.0 cm (1.2 in.).
Brocade DCX 8510-4 Backbone Hardware Installation Guide
53-1002177-13
29
High-density cabling for the FC8-64 port blade
CAUTION
Before plugging a cable into any port, be sure to discharge the voltage stored on the cable by
touching the electrical contacts to ground surface.
Cables can be organized and managed in a variety of ways, for example, using cable channels on the
sides of the cabinet or patch panels to minimize cable management. Following is a list of
recommendations:
NOTE
You should not use tie wraps with optical cables because they are easily overtightened and can
damage the optic fibers.
• Plan for rack space required for cable management before installing the switch.
• Leave at least 1 m (3.28 ft) of slack for each port cable. This provides room to remove and replace
the switch, allows for inadvertent movement of the rack, and helps prevent the cables from being
bent to less than the minimum bend radius.
• If you are using Brocade ISL Trunking, consider grouping cables by trunking groups. The cables
used in trunking groups must meet specific requirements, as described in the Fabric OS
Administrator’s Guide .
• For easier maintenance, label the fiber-optic cables and record the devices to which they are
connected.
• Keep LEDs visible by routing port cables and other cables away from the LEDs.
• Use Velcro ® type straps to secure and organize fiber-optic cables.
NOTE
Do not route the cables in front of the air exhaust vent, which is located at the top of the port side of
the chassis.
If you are using the Port Side Exhaust Kit with your Brocade DCX 8510-4, there is also an exhaust
vent at the bottom of the port side of the chassis. Use the cable management finger assemblies to
keep the cables away from this exhaust vent as well.
High-density cabling for the FC8-64 port blade
The FC8-64 high density port blade cannot use the standard LC cables because the pitch between
optics in the new mini-SFP (mSFP) transceiver is smaller than in standard SFPs. Patch cables and
panels can be used to attach standard size cabling to the blade if necessary. The following figure
illustrates the mSFP to SFP patch cable. Refer to "Best Practices Guide: High Density Cable
Management Solutions" (available at http://www.brocade.com ) for cable management guidelines for
high-density port solutions, and cable and patch panel part numbers.
30
Brocade DCX 8510-4 Backbone Hardware Installation Guide
53-1002177-13
Qualified cables for the FC8-64 port blade
FIGURE 4 Cable design for the mSFP patch cables for the FC8-64 high density port blade
1.
2.
3.
4.
mSFP connector
Duplex clip (black)
6 mm cable
SFP connector
Note that the duplex clip on the mSFP end of the cable is black for easier recognition. For a listing of the
qualified mSFP optical cables for the FC8-64 port blade, refer to Qualified cables for the FC8-64 port
blade on page 31.
If ISL Trunking is in use, group the cables by trunking group. The ports are color-coded to indicate
which ports can be used in the same ISL Trunking group: eight ports marked with solid black ovals
alternate with eight ports marked with oval outlines.
Qualified cables for the FC8-64 port blade
The following table lists the third-party cables that have been qualified for use with the mSFP
transceivers in the FC8-64 high density port blade.
TABLE 4 Qualified cables for mSFP connections for the FC8-64 high density port blade
Description
Length Corning part number
Patch cables - mSFP to LC
Molex part
number
S50502S5120XXXM (XXX
= length)
Amphenol part
number
943-99865-1XXXX
(XXXX = length)
mSFP LC - standard LC,
duplex, multi-mode, OM3,
50/125
1m
S50502S5120001M
106273-0525
943-99865-10001
mSFP LC - standard LC,
duplex, multi-mode, OM3,
50/125
2m
S50502S5120002M
106273-0526
943-99865-10002
mSFP LC - standard LC,
duplex, multi-mode, OM3,
50/125
3m
S50502S5120003M
106273-0527
943-99865-10003
mSFP LC - standard LC,
duplex, multi-mode, OM3,
50/125
5m
S50502S5120005M
106273-0528
943-99865-10005
Brocade DCX 8510-4 Backbone Hardware Installation Guide
53-1002177-13
31
Cable types supported on the FC16-64 port blade
TABLE 4 Qualified cables for mSFP connections for the FC8-64 high density port blade (Continued)
Description
Length Corning part number
Molex part
number
Amphenol part
number
mSFP LC - standard LC,
duplex, multi-mode, OM3,
50/125
10 m
106273-0529
943-99865-10010
Patch cables - mSFP to mSFP
S50502S5120010M
S5S502S5120XXXM (XXX
= length)
943-99866-1XXXX
(XXXX = length)
mSFP LC - mSFP LC, duplex,
multi-mode, OM3, 50/125
1m
S5S502S5120001M
106273-0560
943-99866-10001
mSFP LC - mSFP LC, duplex,
multi-mode, OM3, 50/125
2m
S5S502S5120002M
106273-0561
943-99866-10002
mSFP LC - mSFP LC, duplex,
multi-mode, OM3, 50/125
3m
S5S502S5120003M
106273-0562
943-99866-10003
mSFP LC - mSFP LC, duplex,
multi-mode, OM3, 50/125
5m
S5S502S5120005M
106273-0563
943-99866-10005
mSFP LC - mSFP LC, duplex,
multi-mode, OM3, 50/125
10 m
S5S502S5120010M
106273-0564
943-99866-10010
Trunk cables - mSFP to MTP
tbd
mSFP LC - MTP-female, 12
fiber, 12" breakout, OM3,
50/125
H93S5TE9-BMU-XXXM
(XXX = length)
943-99867-1XXXX
(XXXX = length)
mSFP LC - MTP-female, 12
fiber, 6" breakout, OM3,
50/125
2m
106272-0327
mSFP LC - MTP-female, 24
fiber, 12" breakout, OM3,
50/125
2m
106272-0328
Bag of clips (quantity 64)
TRIGGER-BP-NP
n/a
n/a
Cable types supported on the FC16-64 port blade
The FC16-64 port blade supports simplified cable management using QSFP cables. Each QSFP cable
has four links internally that run at 16-Gbps speed and the cables come in specific predetermined fixed
lengths.
The FC16-64 port blade supports the following types of cables:
• QSFP to QSFP standard cables
• QSFP-SFP/LC Break-out/Split-out cables
32
Brocade DCX 8510-4 Backbone Hardware Installation Guide
53-1002177-13
Installing inter-chassis links (ICLs)
FIGURE 5 QSFP to QSFP standard cables
1. QSFP MTP connector
FIGURE 6 QSFP-SFP/LC Break-out/Split-out cables
1. QSFP MTP connector
2. SFP+ LC connectors
With the support for breakout cables, each port can be in a different mode. Inside the single physical
QSFP port, individual ports can be configured as an E_Port, F_Port or EX_Port. Also, each internal port
inside a single physical QSFP can be part of different Logical Switches.
With the support for breakout cables, trunking can be enabled on ports in a QSFP port group, with ports
connected through breakout cables at the other end.
Installing inter-chassis links (ICLs)
Follow these guidelines when installing ICLs using fiber optic cables and transceivers. Refer to the
Fabric OS Administrator's Guide for the configuration procedure and requirements. Refer to "Removing
and replacing a QSFP and cable" in this hardware installation guide to install cables and transceivers.
• The QSFP ports on the core switch blades can be used only with an inter-chassis link (ICL) license.
After the addition or removal of a license, the license enforcement is performed on the ports only
when the portdisable and portenable commands are issued on the ports. An ICL license must be
installed on all Brocade Backbones forming the ICL connection. Up to nine neighboring Brocade
DCX 8510 series chassis can be connected with the MTP cables.
• An off-the-shelf MTP cable up to 100 meters can be used as an ICL cable when using the standard
SWL optics. The Brocade 2 km QSFP with LWL optics has an integrated 3 meter single-mode pigtail
with a male MTP connector for connectivity to a patch panel or female terminated MTP patch cable to
achieve up to 2 km distances. Refer to Using Brocade 2 km LWL QSFPs on page 38 for more
information.
• Brocade supports fully populating a switch with ICL connections using a mixture of 50 and 100 meter
SWL optics and 2 km LWL optics.
• Following are examples of maximum ICL port connections in a DCX 8510 when using 2 km LWL
QSFPs. Note that limits are based on the number of buffers. If using ICLs for shorter distances, more
Brocade DCX 8510-4 Backbone Hardware Installation Guide
53-1002177-13
33
Device Installation
ICL ports can be connected. There are no limitations on number of ICL ports if all ICL distances are
a few hundred meters.
‐ Up to 10 ICL ports can be used for 2 km distances when 16 buffer credits are configured per
virtual channel.
‐ Up to 16 ICL ports can be used for 1,375 meter distances when 11 buffer credits are configured
per virtual channel.
The following table describes the connector port LED patterns and the recommended actions for those
patterns.
TABLE 5 ICL QSFP connector port LEDs
LED purpose
Color
Status
Recommended action
QSFP connector
status
No light (LED is No QSFP module, all four QSFP
off)
ports are disabled.
No action is required if QSFP not
present or verify that the QSFP is fully
inserted.
Steady amber
QSFP module is in, all four ports
have no signal/no sync.
No action required if QSFP only is
installed or ensure that the cable is
properly connected. If the LED
remains amber, consult the device
supplier.
Blinking amber
Port is disabled or faulted, FC link
activity, segmented, loopback
mode, also during transition
between MTP cable insertion and
confirmation.
Check for console messages or wait
for all four ports to come online.
Steady green
Both ends of MTP cable are in and
all ports are online. Full link is
established.
No action required.
The following figures illustrate types of MTP cables and transceivers:
• Separate MTP cable and transceiver. The transceiver is inserted into the blade port connector and
the cable plugs into a QSFP on the other end of the ICL.
34
Brocade DCX 8510-4 Backbone Hardware Installation Guide
53-1002177-13
Possible ICL configurations
1
2
MTP cable
Transceiver
FIGURE 7 MTP cable and transceiver
NOTE
If the fiber optic cables are not connected to transceivers, make sure the rubber gaskets are plugged
into the transceivers.
• Brocade 2 km LWL QSFP transceiver with integrated MTP cable. The transceiver is inserted into the
blade port connector and integrated cable plugs into a QSFP on the other end of the ICL, a patch
panel, or a patch cable.
1
2
3
MTP 1x12 fiber male connector
Integrated 3 meter MTP cable
Transceiver with pull-tab
FIGURE 8 2 km QSFP with integrated cable
• A third type of transceiver has a pull-tab to aid in removing the transceiver from the port connector
(like shown in previous illustration), but has a separate MTP cable that plugs into the transceiver.
The QSFP connectors on the core blades are labeled by trunk group (trunking is optional) for ease of
installation.
Possible ICL configurations
The following figures show acceptable cabling configurations for the ICL feature. The recommended
topology is the parallel type where there are four QSFP cables connected between any pair of Brocade
DCX 8510 series chassis. The full-mesh configuration is also supported. Each of two cores in one
chassis should be interconnected with each of two cores in the second chassis. This provides for interchassis link (ICL) trunking between chassis, ensuring redundancy. Parallel connections between core
blades are recommended.
Brocade DCX 8510-4 Backbone Hardware Installation Guide
53-1002177-13
35
Device Installation
FIGURE 9 QSFP cable connections for Brocade DCX 8510 chassis (sample configuration)
1. Chassis 1 - DCX 8510-8
2. Chassis 2 - DCX 8510-4
The DCX 8510 chassis can be connected in a core/edge configuration. The following figure shows two
core and four edge chassis. Although DCX 8510-8 chassis are shown in the figure, the chassis can be
either DCX 8510-4 or DCX 8510-8. The cabling scheme should follow the parallel example shown in
the previous figure. Each line in the example actually represents four cables running between the
chassis.
36
Brocade DCX 8510-4 Backbone Hardware Installation Guide
53-1002177-13
Device Installation
FIGURE 10 DCX 8510 core/edge ICL topology
The DCX 8510 chassis can also be connected in a full mesh configuration as shown in the following
figure. Although DCX 8510-8 chassis are shown in the figure, the chassis can be either DCX 8510-4 or
DCX 8510-8. In this example, the trunk groups are shown in color.
Brocade DCX 8510-4 Backbone Hardware Installation Guide
53-1002177-13
37
Using Brocade 2 km LWL QSFPs
FIGURE 11 DCX 8510 full mesh ICL topology
Using Brocade 2 km LWL QSFPs
Up to 10 ICL ports using the 2km ICL QSFP are supported in a DCX 8510 backbone switch at the two
km distance, which requires configuring 16 buffer credit per virtual channel. The 10 ICL limit is based
on the number of buffers. If the 2km QSFPs are used at shorter distances, then more ICLs can be
used.
The Brocade 2 km LWL QSFP, is a hot-swappable, low-voltage (3.3 V) digital diagnostic optical
transceiver that supports high-speed serial links over parallel single-mode optical fibers at signaling
rates up to 4×14.025 Gbps. The QSFP is integrated with a 3-meter ribbon fiber cable with a male MTP
1 x 12 connector. The QSFP supports 2 km link length on parallel single-mode fiber.
38
Brocade DCX 8510-4 Backbone Hardware Installation Guide
53-1002177-13
Device Installation
1
2
3
MTP 1 x 12 fiber male connector
Integrated 3 meter MTP cable
Transceiver with pull-tab
FIGURE 12 2 km LWL QSFP transceiver with integrated cable
Following are cabling options and recommendations:
• Connect the 3 meter integrated single mode transceiver cable directly to a female-terminated
connector in a patch panel or patch cable using a key-up/key-down MPO/MTP coupler.
• Use female-to-female patch cable with the following specifications:
‐
‐
‐
‐
Single-mode (not OM3 MMF or OMM MMF)
MTP/MPO 1 x 12 fiber
MTP female angled polished connector (APC)
Key-up/key-down connectors for polarity
FIGURE 13 Female-to-female patch cable for QFSP connections
Brocade DCX 8510-4 Backbone Hardware Installation Guide
53-1002177-13
39
Using Brocade 2 km LWL QSFPs
40
Brocade DCX 8510-4 Backbone Hardware Installation Guide
53-1002177-13
Rack installation options
The following rack mount kits can be used for the Brocade DCX 8510-4.
• Mid-Mount Rack Kit (Backbone) - XBR-DCX4S-0126
• Port Side Exhaust Kit (27-31 inch) - XBR-DCX4S-0121
• Port Side Exhaust Kit (18-24 inch) - XBR-DCX4S-0130
When installing this device in a rack, observe the following requirements:
• Ensure that the air intake and exhaust vents have a minimum of 5.1 cm (2 in.) of airspace.
• Ensure that the air temperature on the air intake side is less than 40°C (104°F) during operation.
Brocade DCX 8510-4 Backbone Hardware Installation Guide
53-1002177-13
41
Rack installation options
42
Brocade DCX 8510-4 Backbone Hardware Installation Guide
53-1002177-13
Initial Configuration
● Configuring the device.................................................................................................... 43
● Establishing a serial connection to the device................................................................ 44
● Logging in to the serial console port............................................................................... 45
● Configuring the IP addresses..........................................................................................46
● Logging off the serial console port and disconnecting the serial cable........................... 47
● Establishing an Ethernet connection to the device......................................................... 47
● Customizing a switch name............................................................................................ 48
● Customizing a chassis name.......................................................................................... 48
● Setting the domain ID......................................................................................................48
● Setting the date and time................................................................................................ 49
● Verifying the PID mode................................................................................................... 50
● Determining installed software licenses.......................................................................... 51
● Installing transceivers and attaching cables....................................................................51
● Managing cables............................................................................................................. 54
● Verifying correct operation and backing up the configuration......................................... 55
● Powering off the chassis................................................................................................. 56
Configuring the device
The device must be configured before it is connected to the fabric, and all of the configuration
commands must be entered through the active CP blade. The device configuration includes the
following parameters:
• IP address and subnet mask for the chassis
• IP addresses, host names, subnet masks, and gateway addresses for both control processor (CP)
blades
• Switch name
• Domain ID for the device (optional)
• WWN for the device
The device WWN is initially set by the factory to match the license ID (which is based on the chassis
serial number). The WWN can be changed but the license ID cannot be modified.
The configuration information is mirrored to the standby CP blade, which allows the current
configuration to remain available even if the active CP blade fails. The configuration information for the
device is stored in the WWN cards and the flash memory of the CP blades. The configuration can be
backed up to a workstation (uploaded) and then downloaded to the active CP blade if necessary.
NOTE
If the Brocade FS8-18 encryption blade is installed, refer to the Fabric OS Encryption Administrator’s
Guide for the procedures to configure the encryption functions.
The following figure illustrates the flow of the basic configuration tasks.
Brocade DCX 8510-4 Backbone Hardware Installation Guide
53-1002177-13
43
Establishing a serial connection to the device
FIGURE 14 Configuration tasks
Establishing a serial connection to the device
To establish a serial connection to the console port on the device, complete the following steps.
1. Verify that the device is powered on and that POST is complete by verifying that all power LED
indicators on the port, control processor, and core switch blades display a steady green light.
2. Remove the shipping cap from the CONSOLE port on the active CP. Use the serial cable provided
with the device to connect the CONSOLE port on the active CP to a computer workstation. The
active CP blade is indicated by an illuminated (blue) LED.
NOTE
The CONSOLE port is intended primarily for the initial setting of the IP address and for service
purposes.
44
Brocade DCX 8510-4 Backbone Hardware Installation Guide
53-1002177-13
Logging in to the serial console port
3. Access the device using a terminal emulator application (such as HyperTerminal in a Windows
environment or tip in a UNIX environment).
4. Disable any serial communication programs running on the workstation (such as synchronization
programs).
5. Open a terminal emulator application (such as HyperTerminal on a PC, or term, tip, or kermit in a
UNIX environment), and configure the application as follows:
• In a Windows environment:
Parameter
Value
Bits per second
9600
Data bits
8
Parity
None
Stop bits
1
Flow control
None
NOTE
Flow control is not supported on the serial consoles when attached to remote terminal servers and
must be disabled to ensure proper operation.
• In a UNIX environment, enter the following string at the prompt:
tip /dev/ttyb -9600
If ttyb is already in use, use ttya instead and enter the following string at the prompt:
tip /dev/ttya -9600
When the terminal emulator application stops reporting information, press Enter. You receive the
following login prompt:
CP0 Console Login:
6. Proceed to the next task.
Logging in to the serial console port
To log in to the device through the serial connection, follow these steps.
1. Log in to the device as admin. The default password is password. At the initial login, you are
prompted to enter new admin and user passwords. Make sure to write down the new passwords and
keep this information in a secure location.
Fabric OS (swDir)
swDir login: admin
Password:
Please change your passwords now.
Use Control-C to exit or press 'Enter' key to proceed.
Brocade DCX 8510-4 Backbone Hardware Installation Guide
53-1002177-13
45
Configuring the IP addresses
swDir:admin>
2. (Optional) Modify passwords. To skip modifying the password, press Ctrl+C.
NOTE
Passwords can be 8 to 40 characters long. They must begin with an alphabetic character. They can
include numeric characters, the period (.), and the underscore (_) only. Passwords are casesensitive, and they are not displayed when you enter them on the command line. For more
information on passwords, refer to the Fabric OS Administrator's Guide.
Configuring the IP addresses
The device requires three IP addresses, which are configured using the ipAddrSet command. IP
addresses are required for both CP blades (CP0 and CP1) and for the chassis management IP
(shown as SWITCH under the ipAddrShow command) in the device.
NOTE
The default IP addresses and host names for the device are:
• 10.77.77.75 / CP0 (the CP blade in slot 4 at the time of configuration)
• 10.77.77.74 / CP1 (the CP blade in slot 5 at the time of configuration)
NOTE
Resetting an IP address while the device has active IP traffic or has management and monitoring tools
running, such as DCFM, Fabric Watch, and SNMP, can cause traffic to be interrupted or stopped.
Complete the following steps to set the IP addresses for the device.
1. Log in to the active CP as admin using the serial cable connection.
2. Set up the device IP address by entering the ipaddrset -chassis command:
swDir:admin> ipAddrSet -chassis
Enter the information at the prompts. Specify the -chassis IP address. The -sw 0 IP address is not
valid on this chassis.
NOTE
The addresses 10.0.0.0 through 10.0.0.255 are reserved and used internally by the device. External
IPs must not use these addresses.
3. Set up the CP0 IP address by entering the ipaddrset -cp 0 command:
swDir:admin> ipAddrSet -cp 0
Enter the information at the prompts.
4. Set up the CP1 IP address by entering the ipaddrset -cp 1 command:
swDir:admin> ipAddrSet -cp 1
Enter the information at the prompts.
46
Brocade DCX 8510-4 Backbone Hardware Installation Guide
53-1002177-13
Logging off the serial console port and disconnecting the serial cable
This is a sample IP configuration:
swDir:admin> ipaddrset -chassis
Ethernet IP Address [0.0.0.0]: 192.168.1.1
Ethernet Subnetmask [0.0.0.0]: 255.255.255.0
Fibre Channel IP Address [0.0.0.0]:
Fibre Channel Subnetmask [0.0.0.0]:
Issuing gratuitous ARP...Done.
Committing configuration...Done.
swDir:admin>
ipaddrset -cp 0
Host Name [cp0]:
Ethernet IP Address [10.77.77.75]: 192.168.1.2
Ethernet Subnetmask [0.0.0.0
]: 255.255.255.0
Gateway IP Address [0.0.0.0
]: 192.168.1.254
IP address is being changed...Done.
Committing configuration...Done.
swDir:admin> ipaddrset -cp 1
Host Name [cp1]:
Ethernet IP Address [10.77.77.74]: 192.168.1.3
Ethernet Subnetmask [0.0.0.0]: 255.255.255.0
Gateway IP Address [0.0.0.0]: 192.168.1.254
IP address of remote CP is being changed...Done.
Committing configuration...Done.
Logging off the serial console port and disconnecting the serial cable
You can use the serial port to monitor error messages through the serial connection. If the serial port is
no longer required, use the logout command to log out of the serial console, remove the serial cable,
and replace the plug in the serial port.
Establishing an Ethernet connection to the device
After using a serial connection to configure the IP addresses for the device, you can connect the active
CP blade to the local area network (LAN).
NOTE
Connecting the CP blades to a private network or VLAN is recommended.
By establishing an Ethernet connection, you can complete the device configuration using a serial
session, Telnet, or management applications, such as Web Tools or Brocade Network Advisor.
Perform the following steps to establish an Ethernet connection to the device.
1. Remove the shipping plug from the Ethernet port on the active CP blade.
2. Insert one end of an Ethernet cable into the Ethernet port.
3. Connect the other end to an Ethernet 10/100/1000 BaseT LAN.
The device can be accessed through a remote connection using the command line via Telnet or any
of the management tools, such as Web Tools or Brocade Network Advisor.
4. To complete any additional device configuration procedures through a Telnet session, log in to the
device by Telnet, using the admin login. The default password is password.
Brocade DCX 8510-4 Backbone Hardware Installation Guide
53-1002177-13
47
Customizing a switch name
Customizing a switch name
The switch name of the device can be up to 30 characters long and must begin with a letter. It can
include letters, numbers, hyphens, and underscore characters.
NOTE
Changing the name causes a domain address format RSCN to be issued.
1. Enter switchName followed by the new name in double quotes.
swDir:admin> switchName "swModularSwitch5"
Committing configuration...
Done.
swModularSwitch5:admin>
2. Record the new name for reference.
Customizing a chassis name
The chassis name of the device can be up to 15 characters long; can include letters, numbers,
hyphens, and underscore characters; and must begin with a letter.
1. Enter chassisName followed by the new name in double quotes.
switch:admin> chassisname
"DCX8510_chassis"
Committing configuration...
Done.
2. Enter chassisName by itself to show the name.
switch:admin> chassisname
DCX8510_chassis
3. Record the new name for reference.
Setting the domain ID
Each switch in the fabric must have a unique domain ID. The domain ID can be manually set through
the configure command or can be automatically set. The default domain ID for the device is 1. Use
the fabricShow command to view the already assigned domain IDs.
1. Enter switchDisable to disable the device.
2. Enter configure.
3. Enter y at the Fabric parameters prompt:
Fabric parameters (yes, y, no, n): [no] y
4. Enter a unique domain ID:
Domain: (1.239) [1] 3
5. Complete the remaining prompts or press Ctrl+D to accept the settings and exit.
6. Enter switchEnable to re-enable the device.
48
Brocade DCX 8510-4 Backbone Hardware Installation Guide
53-1002177-13
Setting the date and time
Setting the date and time
The date and time settings are used for logging events. Switch operation does not depend on the date
and time; a switch with an incorrect date and time value still functions properly. However, because the
date and time are used for logging, error detection, and troubleshooting, they should be set correctly.
Setting the date
To set the date, follow these steps.
1. If necessary, log on to the device by Telnet, using the admin account.
The default password is password.
2. Enter the date command, using the following syntax:
date "mmddHHMMyy"
The values are:
•
•
•
•
•
mm is the month; valid values are 01 through 12.
dd is the date; valid values are 01 through 31.
HH is the hour; valid values are 00 through 23.
MM is minutes; valid values are 00 through 59.
yy is the year; valid values are 00 through 99 (values greater than 69 are interpreted as 1970
through 1999, and values less than 70 are interpreted as 2000 through 2069).
switch:admin> date
Fri Sep 28 17:01:48 UTC 2010
switch:admin> date "0927123010"
Thu Sep 27 12:30:00 UTC 2010
switch:admin>
Setting the time zone
You must perform the procedure on all chassis for which the time zone must be set. Because the value
is written to nonvolatile memory, you only need to set the time zone once on each switch.
Use one of the two following procedures to set the time zone.
The following procedure describes how to set the current time zone using timezone_fmt mode to
Central Standard time.
1. Log in to the switch using the default password, which is password.
2. Enter the tsTimeZone command as follows:
switch:admin> tstimezone [--interactive]/ [, timezone_fmt]
Use timezone_fmt to set the time zone by Country/City or by time zone ID, such as PST.
The following example shows how to change the time zone to US/Central.
switch:admin> tstimezone
Time Zone : US/Pacific
switch:admin> tstimezone US/Central
switch:admin> tstimezone
Time Zone : US/Central
Brocade DCX 8510-4 Backbone Hardware Installation Guide
53-1002177-13
49
Synchronizing local time
The following procedure describes how to set the current time zone using interactive mode to Pacific
Standard Time.
1. Enter the tsTimeZone command as follows:
switch:admin> tstimezone --interactive
You are prompted to select a general location.
Please identify a location so that time zone rules can be set correctly.
2. Enter the appropriate number or Ctrl+D to quit.
3. At the prompt, select a country location.
4. At the prompt, enter the appropriate number to specify the time zone region or Ctrl+D to quit.
Synchronizing local time
To synchronize the local time of the principal or primary switch with that of an external NTP server,
follow these steps.
1. If necessary, log on to the switch by Telnet, using the admin account.
2. Enter the tsClockServer command:
switch:admin> tsclockserver
""
In this syntax, ntp1 is the IP address or DNS name of the first NTP server, which the switch must be
able to access. The variable ntp2 is the second NTP server and is optional. The operand
"" is optional; by default, this value is LOCL, which uses the local clock of the principal
or primary switch as the clock server.
The tsClockServer command accepts multiple server addresses in IPv4, IPv6, or DNS name
formats. When multiple NTP server addresses are passed, tsClockServer sets the first obtainable
address as the active NTP server. The rest will be stored as backup servers that can take over if the
active NTP server fails. The principal or primary FCS switch synchronizes its time with the NTP
server every 64 seconds.
switch:admin> tsclockserver
LOCL
switch:admin> tsclockserver "132.163.135.131"
switch:admin> tsclockserver
132.163.135.131
switch:admin>
The following example shows how to set up more than one NTP server using a DNS name:
switch:admin> tsclockserver "10.32.170.1;10.32.170.2;ntp.localdomain.net"
Updating Clock Server configuration...done.
Updated with the NTP servers
Changes to the clock server value on the principal or primary FCS switch are
propagated to all switches in the fabric
Verifying the PID mode
Before connecting the device to the fabric, verify that the WWN-based persistent port identifier (PID)
feature on the device matches the other switches in the fabric. This parameter must be identical for all
switches in the fabric and is set using the configure command as shown in the following example:
switch:admin>configure
50
Brocade DCX 8510-4 Backbone Hardware Installation Guide
53-1002177-13
Determining installed software licenses
Configure...
Fabric parameters (yes, y, no, n): [no] y
Domain: (1..239) [1]
Enable a 256 Area Limit
(0 = No,
1 = Zero Based Area Assignment,
2 = Port Based Area Assignment): (0..2) [0] 1
WWN Based persistent PID (yes, y, no, n): [no] yes
You can check the PID setting using the configshow command as in the following example. You can
use the | grep -i pid qualifier to pinpoint the PID information.
switch:admin> configshow | grep -i pid
fabric.ops.mode.pidFormat:1
fabric.wwnPidMode:1
The 1 indicates that the WWN-based persistent PID feature is enabled. The default value is 0 for
disabled.
Determining installed software licenses
Depending on the vendor agreement, certain licenses are factory installed on the device. To determine
which licenses are enabled, use the licenseShow command.
swDir:admin> licenseshow
AAbbccDDeeFFeeGG:
Web license
Zoning license
Extended Fabric license
Fabric Watch license
Performance Monitor license
Trunking license
Security license
In this example, the license key is AAbbccDDeeFFeeGG. Keep a copy of the license key for reference.
The 64-bit chassis ID is required to obtain and activate licenses for the device. The chassis ID is
available through the licenseIdShow command. The licenseShow and licenseIdShow commands
must be entered on the active CP blade. Refer to the Fabric OS Administrator's Guide for more
information.
Installing transceivers and attaching cables
The following two sets of steps cover the installation of transceivers and cables for most SFPs and for
QSFPs.
For a list of qualified transceivers for FC16-64 and CR16-x blades, refer to Qualified transceivers for
FC16-64 and CR16-x blades. on page 52
Installing SFP+ and mSFP transceivers and cables
Complete the following steps to install SFP-type optical transceivers.
Brocade DCX 8510-4 Backbone Hardware Installation Guide
53-1002177-13
51
Qualified transceivers for the FC16-64 and CR16-x blades
NOTE
mSFP transceivers are compatible only with the FC8-64 port blade. While they will fit in other blades,
this configuration is unsupported and will generate an error.
1. Add the optical transceivers and cables to the Fibre Channel ports.
The ports are color-coded to indicate which can be used in the same port group for trunking
(trunking port groups can be up to 8 ports). The ports and cables used in trunking groups must meet
specific requirements. Refer to the Fabric OS Administrator's Guide.
2. Position one of the optical transceivers so that the key is oriented correctly to the port. Insert the
transceiver into the port until it is firmly seated and the latching mechanism clicks.
Transceivers are keyed so that they can only be inserted with the correct orientation. If a transceiver
does not slide in easily, ensure that it is correctly oriented.
3. Position a cable so that the key (the ridge on one side of the cable connector) is aligned with the
slot in the transceiver. Insert the cable into the transceiver until the latching mechanism clicks.
Cables are keyed so that they can be inserted in only one way. If a cable does not slide in easily,
ensure that it is correctly oriented.
4. Repeat steps 1 through 3 for the remaining ports.
5. Organize the cables. Refer to Managing cables on page 54.
6. Verify the device and port status using the switchShow command.
7. Verify fabric connectivity using the fabricShow command.
Qualified transceivers for the FC16-64 and CR16-x blades
The following table shows the qualified transceivers for the FC16-64 port blade and the CR16-4/8 core
blades.
TABLE 6 Qualified transceivers for FC16-64 port blade and the CR16-x core blades
Brocade part
number
Part type
57-1000310-01
57-1000294-01
Cable length
Port speeds
Supported blades
QSFP transceiver Supports 2 km
with integrated 3
m optical cable
16 Gbps
CR16-4/8
QSFP transceiver 100 m OM4
Auto-negotiable 4-, 8-,
and 16-Gbps
FC16-64
See Note below.
See Note below.
57-1000267-01
QSFP transceiver 100 m OM4
Only fixed 16-Gbps
CR16-4/8
57-0000090-01
QSFP transceiver 50 m OM3
Only fixed 16-Gbps
CR16-4/8
NOTE
The QSFP transceivers supported on FC16-64 port blade are not interchangeable with QSFP
transceivers supported on the CR16-4/8 core blades.
52
Brocade DCX 8510-4 Backbone Hardware Installation Guide
53-1002177-13
Installing QSFP transceivers and cables
Installing QSFP transceivers and cables
Follow these steps to install the QSFPs and cables in the FC16-64 port blades and the 16-Gbps core
blades. In the core blades, these transceivers and cables are used to form the inter-chassis links (ICLs)
with neighboring Backbones. The transceivers should be installed in the blades before connecting the
cables. As each QSFP contains four 16-Gbps ports, be aware that any problems with one port could
affect all four ports in the quad if the QSFP must be replaced.
NOTE
Even though the installation and removal procedures are the same for QSFP ports in FC16-64 port
blades and the core blades, the physical QSFP transceivers designed for FC16-64 are not compatible
with the QSFP transceivers designed for the core blades, and are not interchangeable.
1. Position one of the QSFP transceivers so that the key is oriented correctly to the port. Insert the
transceiver into the port until it is firmly seated.
Transceivers are keyed so that they can only be inserted with the correct orientation. If a transceiver
does not slide in easily, ensure that it is correctly oriented.
When the transceiver is correctly seated, the status LED will flash amber several times and then turn
solid amber.
2. Remove the protective cap from the special QSFP cable and insert it into the transceiver until it is
firmly seated.
The cables are also keyed to fit into the transceivers correctly.
When the cable is correctly seated, the status LED will change from amber to green.
Repeat steps 1 and 2 for the remaining QSFP ports.
3. Organize the cables. Refer to information on managing cables in this installation guide.
4. Verify the device and connector and port status using the switchShow -qsfp command.
NOTE
The following example is from a DCX chassis with four slots for port blades and a core blade installed
in slot 3. Some details for a chassis with eight slots for ports blades will display differently, but the
reported information for the QSFPs will be similar.
QSFP 7 (ports 3/28-3/31, Index 748-751) in the following example shows the results for a connected
QSFP.
switch:FID128:admin> switchshow -qsfp
switchName:
switch name
switchType:
142.0
switchState:
Online
switchMode:
Native
switchRole:
Subordinate
switchDomain:
75
switchId:
fffc4b
switchWwn:
10:00:00:05:1e:4f:eb:00
zoning:
ON (zoning name
)
switchBeacon:
OFF
FC Router:
OFF
Allow XISL Use: OFF
LS Attributes: [FID: 128, Base Switch: No, Default Switch: Yes, Address Mode 0]
Index Slot Port QSFP Address Media Speed State
Proto
=============================================================
256
3
0
0
-----id
16G
No_SigDet
FC
257
3
1
0
-----id
16G
No_SigDet
FC
258
3
2
0
-----id
16G
No_SigDet
FC
259
3
3
0
-----id
16G
No_SigDet
FC
260
3
4
1
------16G
No_Module
FC
Brocade DCX 8510-4 Backbone Hardware Installation Guide
53-1002177-13
53
Managing cables
261
3
5
262
3
6
263
3
7
264
3
8
265
3
9
266
3
10
267
3
11
268
3
12
269
3
13
270
3
14
271
3
15
736
3
16
737
3
17
738
3
18
739
3
19
740
3
20
741
3
21
742
3
22
743
3
23
744
3
24
745
3
25
746
3
26
747
3
27
748
3
28
name
(Trunk master)
749
3
29
name
(Trunk master)
750
3
30
name
(Trunk master)
751
3
31
name
(Trunk master)
1
1
1
2
2
2
2
3
3
3
3
4
4
4
4
5
5
5
5
6
6
6
6
7
-------------------------------------------------------------------------------------------------------------------------
-----------------------id
16G
16G
16G
16G
16G
16G
16G
16G
16G
16G
16G
16G
16G
16G
16G
16G
16G
16G
16G
16G
16G
16G
16G
16G
No_Module
No_Module
No_Module
No_Module
No_Module
No_Module
No_Module
No_Module
No_Module
No_Module
No_Module
No_Module
No_Module
No_Module
No_Module
No_Module
No_Module
No_Module
No_Module
No_Module
No_Module
No_Module
No_Module
Online
FC
FC
FC
FC
FC
FC
FC
FC
FC
FC
FC
FC
FC
FC
FC
FC
FC
FC
FC
FC
FC
FC
FC
FC
E-Port
10:00:00:05:1e:39:e4:5a trunkmaster
7
------
id
16G
Online
FC
E-Port
10:00:00:05:1e:39:e4:5a trunkmaster
7
------
id
16G
Online
FC
E-Port
10:00:00:05:1e:39:e4:5a trunkmaster
7
------
id
16G
Online
FC
E-Port
10:00:00:05:1e:39:e4:5a trunkmaster
NOTE
The State reported for an unconnected QSFP (shown QSFP 0 and Ports 0-3 in the example) is
No_SigDet. This is different from the State of No_Synch that is reported for regular SFPs that are
unconnected.
Managing cables
Cables can be organized and managed in a variety of ways, for example, using cable channels on the
port sides of the cabinet or patch panels to minimize cable management.
With the horizontal orientation of the blades in the Brocade DCX 8510-4, a pair of vertical cable
management finger assemblies are provided to keep the cables from hanging down in front of other
blades.
Following is a list of recommendations:
• Leave at least 1 m (3.28 ft) of slack for each port cable. This provides room to remove and replace
the device, allows for inadvertent movement of the rack, and helps prevent the cables from being
bent to less than the minimum bend radius.
• The minimum bend radius should be no smaller than ten times the cable radius. The minimum
radius to which a 50 micron cable can be bent under full tensile load is 5.1 cm (2 in.). For a cable
under no tensile load, that minimum is 3.0 cm (1.2 in.).
• If ISL Trunking is in use, group the cables by trunking group. The ports are color-coded to indicate
which ports can be used in the same ISL Trunking group: eight ports marked with solid black ovals
alternate with eight ports marked with oval outlines.
54
Brocade DCX 8510-4 Backbone Hardware Installation Guide
53-1002177-13
Verifying correct operation and backing up the configuration
• Generally, Velcro ® type cable restraints are recommended to avoid creating sharp bends in the
cables. Do not use tie wraps with optical cables because they are easily overtightened and can
damage the optic fibers.
• For easier maintenance, label the fiber-optic cables and record the devices to which they are
connected.
• Do not route cables in front of the air exhaust vents.
• Keep LEDs visible by routing port cables and other cables away from the LEDs.
NOTE
Refer to "Cabling Best Practices" (available at http://www.brocade.com ) for cable management
guidelines.
For the procedure to install the ICL cables, refer to Installing inter-chassis links (ICLs) on page 33
Verifying correct operation and backing up the configuration
To verify correct operation and back up the device configuration, follow these steps. For information
about LED patterns, refer to information on determining the status of extension, application, or port
blades in the "System Monitoring" section.
Complete the following steps to back up the configuration for the device.
1. Check the LEDs to verify that all components are functional.
2. If necessary, log in to the switch by Telnet, using the admin account.
3. Verify the correct operation of the device by entering the switchShow command from the
workstation. This command provides information about switch and port status.
4. Verify the correct operation of the device in the fabric by entering the fabricShow command from the
workstation. This command provides general information about the fabric.
5. To back up the configuration, run the following two steps:
a) Enter the configupload -vf command. This command uploads the device's virtual fabric data.
b) Enter the configupload command. This command uploads the device configuration.
6. You can run the following commands to see additional configuration information that you can copy to
a file to save:
•
•
•
•
configShow
ipaddrShow
licenseShow
switchShow
Alternatively, you can save the configuration file to a Brocade USB device by using the usbstorage
command.
Observe the following notes about configuration data:
• Passwords are not saved in the configuration file, and are not uploaded during a configuration
upload.
• It is recommended that the configuration be backed up on a regular basis to ensure that a
complete configuration is available for downloading to a replacement chassis.
Brocade DCX 8510-4 Backbone Hardware Installation Guide
53-1002177-13
55
Powering off the chassis
Powering off the chassis
Perform the following steps to power off the chassis.
1. Shut down the chassis using the sysShutdown command.
switch::admin> sysshutdown
This command will shutdown the operating systems on your switch.
You are required to power-cycle the switch in order to restore operation.
Are you sure you want to shutdown the switch [y/n]?y
HA is disabled
Stopping blade 1
Shutting down the blade....
Stopping blade 2
Shutting down the blade....
Stopping blade 8
Shutting down the blade....
Broadcast message from root (pts/1) Tue Aug 23 14:23:06 2010...
The system is going down for system halt NOW !!
2. Power off the chassis by flipping the AC power switches on the power supplies to O (LEDs inside
AC power switches should turn off). To maintain the ground connections, leave power cords
connected to the power supplies and to the electrical outlets.
56
Brocade DCX 8510-4 Backbone Hardware Installation Guide
53-1002177-13
System Monitoring
● Monitoring overview........................................................................................................ 57
● Determining the status of a port, application, or extension blade................................... 60
● Determining the status of a control processor blade (CP8)............................................ 67
● Determining the status of a core switch blade (CR16-4).................................................68
● Determining the status of a power supply....................................................................... 70
● Determining the status of a blower assembly................................................................. 71
● Determining the status of a WWN card...........................................................................72
Monitoring overview
The Brocade DCX 8510-4 is engineered for reliability and requires no routine operational steps or
maintenance. This chapter provides information about determining the status of each component using
LEDs and CLI commands. Refer to the Web Tools Administrator's Guide and the Fabric OS
Administrator's Guide for additional information.
There are two commands that can be especially helpful in monitoring the health of the Brocade DCX
8510-4. These commands are switchShow and chassisShow.
Note in the switchShow command the new switchType for the Brocade DCX 8510-4 as well as the 16Gbps speed identification for capable ports. The output has been truncated to reduce information
duplication.
DCX-4_130:admin> switchshow
switchName:
DCX-4_130
switchType:
121.3
switchState:
Online
switchMode:
Native
switchRole:
Principal
switchDomain:
130
switchId:
fffc82
switchWwn:
10:00:00:05:33:03:2c:00
zoning:
ON (BB)
switchBeacon:
OFF
FC Router:
ON
FC Router BB Fabric ID: 10
Address Mode:
0
Index Slot Port Address Media Speed State
Proto
=======================================================
0
1
0
820000
id
N8
Online
FC F-Port
1
1
1
820100
id
N8
Online
FC F-Port
2
1
2
820200
id
N8
Online
FC F-Port
3
1
3
820300
id
N8
Online
FC F-Port
4
1
4
820400
id
N8
Online
FC F-Port
5
1
5
820500
id
N8
Online
FC F-Port
6
1
6
820600
id
N8
Online
FC F-Port
7
1
7
820700
id
N8
Online
FC F-Port
8
1
8
820800
id
N8
Online
FC F-Port
9
1
9
820900
id
N8
Online
FC F-Port
10
1
10
820a00
id
N8
Online
FC F-Port
11
1
11
820b00
id
N8
Online
FC F-Port
12
1
12
820c00
id
N8
Online
FC F-Port
13
1
13
820d00
id
N8
Online
FC F-Port
14
1
14
820e00
id
N8
Online
FC F-Port
15
1
15
820f00
id
N8
Online
FC F-Port
16
1
16
821000
id
N8
Online
FC F-Port
17
1
17
821100
id
N8
Online
FC F-Port
Brocade DCX 8510-4 Backbone Hardware Installation Guide
53-1002177-13
10:00:00:05:1e:f8:a0:b4
10:00:00:05:33:26:0e:65
10:00:00:05:33:48:5e:f5
10:00:00:05:1e:f8:a0:b3
10:00:00:05:33:26:10:15
10:00:00:05:1e:f8:a0:b1
10:00:00:05:33:48:5e:d0
10:00:00:05:33:26:df:6b
10:00:00:05:33:26:df:6a
10:00:00:05:33:48:6b:ea
10:00:00:05:33:26:10:28
10:00:00:05:33:26:10:73
10:00:00:05:33:48:5e:d1
10:00:00:05:33:26:10:29
10:00:00:05:1e:f9:72:47
10:00:00:05:33:26:0e:8a
10:00:00:05:33:26:0e:8b
10:00:00:05:33:48:6b:eb
57
System Monitoring
18
1
18
821200
19
1
19
821300
20
1
20
821400
21
1
21
821500
22
1
22
821600
23
1
23
821700
24
1
24
821800
25
1
25
821900
26
1
26
821a00
27
1
27
821b00
28
1
28
821c00
29
1
29
821d00
30
1
30
821e00
31
1
31
821f00
32
1
32
822000
33
1
33
822100
34
1
34
822200
35
1
35
822300
36
1
36
822400
37
1
37
822500
38
1
38
822600
39
1
39
822700
40
1
40
822800
41
1
41
822900
42
1
42
822a00
43
1
43
822b00
44
1
44
822c00
45
1
45
822d00
46
1
46
822e00
47
1
47
822f00
256
3
0
-----257
3
1
-----258
3
2
-----259
3
3
-----260
3
4
-----261
3
5
-----262
3
6
-----263
3
7
-----264
3
8
-----265
3
9
-----
Source Exif Data:
File Type : PDF
File Type Extension : pdf
MIME Type : application/pdf
Linearized : No
PDF Version : 1.4
Page Count : 171
XMP Toolkit : Adobe XMP Core 5.2-c001 63.139439, 2010/09/27-13:37:26
Create Date : 2016:01:08 10:45:30-08:00
Creator Tool : AH Formatter V5.3 MR3 (5,3,2011,1116) for Windows (x64)
Modify Date : 2016:01:14 13:44:15-08:00
Metadata Date : 2016:01:14 13:44:15-08:00
Producer : Antenna House PDF Output Library 2.6.0 (Windows (x64))
Trapped : False
Format : application/pdf
Title : Brocade DCX 8510-4 Backbone Hardware Installation Guide
Creator : Brocade Communication Systems, Inc
Document ID : uuid:6913cf51-b19f-4a2c-b112-c7afec040ef2
Instance ID : uuid:c735c702-d88f-4716-8785-375469708636
Author : Brocade Communication Systems, Inc
EXIF Metadata provided by EXIF.tools