MLNX OS Ethernet User Manual
User Manual:
Open the PDF directly: View PDF 
.
Page Count: 1135
Mellanox MLNX-OS® User Manual
for Ethernet
Rev 4.60
Software Version 3.6.2102
www.mellanox.com
Mellanox Technologies Confidential
Rev 4.60
2
Mellanox Technologies Confidential
Document Number: MLNX-15-1560-ETH
Mellanox Technologies Confidential
Rev 4.60
Table of Contents
Document Revision History . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14
About this Manual . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 30
Chapter 1 Introduction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 33
1.1
1.2
System Features . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 33
Ethernet Features . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 34
Chapter 2 Getting Started . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 36
2.1
Configuring the Switch for the First Time. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 36
2.1.1 Re-Running the Wizard. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 42
2.2
2.3
2.4
Starting the Command Line (CLI). . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 42
Starting the Web User Interface (WebUI) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 43
Licenses . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 45
2.4.1
2.4.2
2.4.3
2.4.4
Installing MLNX-OS® License (CLI) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Installing MLNX-OS License (Web) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Retrieving a Lost License Key . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Commands. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
46
46
49
50
Chapter 3 User Interfaces . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 55
3.1
Command Line Interface Overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 55
3.1.1
3.1.2
3.1.3
3.1.4
3.1.5
3.1.6
3.1.7
3.1.8
3.2
55
56
56
57
58
59
60
62
Web Interface Overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 63
3.2.1
3.2.2
3.2.3
3.2.4
3.2.5
3.2.6
3.2.7
3.3
CLI Modes . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Syntax Conventions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Getting Help . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Prompt and Response Conventions. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Using the “no” Form . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Parameter Key . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Command Output Filtering and Monitoring . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
CLI Shortcuts . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Setup Menu . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
System Menu. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Security Menu . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Ports Menu . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Status Menu. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
ETH Mgmt . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
IP Route. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
64
65
66
66
67
68
68
Secure Shell (SSH) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 69
3.3.1 Adding a Host and Providing an SSH Key . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 69
3.3.2 Retrieving Return Codes when Executing Remote Commands . . . . . . . . . . . . . . 69
3.4
3.5
Management Information Bases (MIBs) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 70
Commands . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 73
3.5.1 CLI Session . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 73
3.5.2 Banner . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 84
3.5.3 SSH . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 92
Mellanox Technologies Confidential
Mellanox Technologies Confidential
3
Rev 4.60
3.5.4 Remote Login . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 109
3.5.5 Web Interface . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 112
Chapter 4 System Management . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 127
4.1
Management Interface . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 127
4.1.1
4.1.2
4.1.3
4.1.4
4.1.5
4.1.6
4.1.7
4.2
Configuring Management Interfaces with Static IP Addresses . . . . . . . . . . . . .
Configuring IPv6 Address on the Management Interface. . . . . . . . . . . . . . . . . .
Dynamic Host Configuration Protocol (DHCP) . . . . . . . . . . . . . . . . . . . . . . . . .
Default Gateway . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
In-Band Management . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Configuring Hostname via DHCP (DHCP Client Option 12) . . . . . . . . . . . . . .
Commands. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
127
127
128
128
128
129
130
NTP, Clock & Time Zones . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 178
4.2.1 NTP Authenticate . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 178
4.2.2 NTP Authentication Key. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 178
4.2.3 Commands. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 179
4.3
Software Management . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 197
4.3.1
4.3.2
4.3.3
4.3.4
4.3.5
4.3.6
4.3.7
4.4
197
200
201
201
204
206
208
Configuration Management . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 219
4.4.1
4.4.2
4.4.3
4.4.4
4.4.5
4.5
Upgrading MLNX-OS Software . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Upgrading MLNX-OS HA Groups . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Deleting Unused Images . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Downgrading MLNX-OS Software . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Upgrading System Firmware . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Image Maintenance via Mellanox ONIE . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Commands. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Saving a Configuration File . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Loading a Configuration File . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Restoring Factory Default Configuration . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Managing Configuration Files . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Commands. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
219
219
219
219
222
Logging . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 250
4.5.1 Monitor . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 250
4.5.2 Remote Logging . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 250
4.5.3 Commands. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 251
4.6
Debugging . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 270
4.6.1 Commands. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 271
4.7
Event Notifications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 290
4.7.1
4.7.2
4.7.3
4.7.4
4.8
Supported Events . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Terminal Notifications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Email Notifications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Commands. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
290
291
292
294
User Management and Security . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 313
4.8.1
4.8.2
4.8.3
4.8.4
User Accounts . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Authentication, Authorization and Accounting (AAA) . . . . . . . . . . . . . . . . . . .
System Secure Mode. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Commands. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
313
313
315
317
Mellanox Technologies Confidential
Mellanox Technologies Confidential
4
Rev 4.60
4.9
Cryptographic (X.509, IPSec) and Encryption . . . . . . . . . . . . . . . . . . . . . . . . . 361
4.9.1 System File Encryption . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 361
4.9.2 Commands. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 362
4.10 Scheduled Jobs. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 376
4.10.1 Commands. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 376
4.11 Statistics and Alarms . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 386
4.11.1 Commands. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 386
4.12 Chassis Management . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 404
4.12.1
4.12.2
4.12.3
4.12.4
4.12.5
4.12.6
4.12.7
System Health Monitor . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Power Management. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Monitoring Environmental Conditions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
USB Access. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Unit Identification LED . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
System Reboot . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Commands. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
404
410
411
413
414
414
415
4.13 Network Management Interfaces. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 443
4.13.1 SNMP . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 443
4.13.2 XML API . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 453
4.13.3 Commands. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 454
4.14 Puppet Agent . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 470
4.14.1
4.14.2
4.14.3
4.14.4
4.14.5
4.14.6
4.14.7
4.14.8
Setting the Puppet Server . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Accepting the Switch Request . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Installing Modules on the Puppet Server . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Writing Configuration Classes . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Supported Configuration Capabilities. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Supported Resources for Each Type . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Troubleshooting . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Commands. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
470
470
471
471
473
477
478
479
4.15 Virtual Machine . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 486
4.15.1 Virtual Machine Configuration . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 486
4.15.2 Commands. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 489
4.16 IP Table Filtering . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 512
4.16.1
4.16.2
4.16.3
4.16.4
Configuring IP Table Filtering . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Modifying IP Table Filtering . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Rate-limit Rule Configuration. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Commands. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
512
513
514
515
Chapter 5 Ethernet Switching. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 520
5.1
Interface . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 520
5.1.1
5.1.2
5.1.3
5.1.4
5.1.5
5.1.6
5.2
Break-Out Cables . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
56GbE Link Speed . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Transceiver Information . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
High Power Transceivers . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Forward Error Correction . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Commands. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
520
522
523
524
524
525
Interface Isolation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 551
Mellanox Technologies Confidential
Mellanox Technologies Confidential
5
Rev 4.60
5.2.1 Configuring Isolated Interfaces. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 551
5.2.2 Commands. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 553
5.3
Link Aggregation Group (LAG) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 559
5.3.1 Configuring Static Link Aggregation Group (LAG) . . . . . . . . . . . . . . . . . . . . . 559
5.3.2 Configuring Link Aggregation Control Protocol (LACP) . . . . . . . . . . . . . . . . . 559
5.3.3 Commands. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 561
5.4
MLAG . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 581
5.4.1
5.4.2
5.4.3
5.4.4
5.4.5
5.4.6
5.4.7
5.5
583
583
583
584
584
584
589
VLANs. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 607
5.5.1
5.5.2
5.5.3
5.5.4
5.5.5
5.6
MLAG Keepalive and Failover. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Unicast and Multicast Sync. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
MLAG Port Sync . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
MLAG Virtual System-MAC . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Upgrading MLAG Pair . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Configuring MLAG . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Commands. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Configuring Access Mode and Assigning Port VLAN ID (PVID). . . . . . . . . . .
Configuring Hybrid Mode and Assigning Port VLAN ID (PVID). . . . . . . . . . .
Configuring Trunk Mode VLAN Membership. . . . . . . . . . . . . . . . . . . . . . . . . .
Configuring Hybrid Mode VLAN Membership . . . . . . . . . . . . . . . . . . . . . . . . .
Commands. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
607
608
608
609
610
Voice VLAN . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 620
5.6.1 Configuring Voice VLAN. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 621
5.6.2 Limitations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 624
5.7
QinQ. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 625
5.7.1 QinQ Operation Modes . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 625
5.7.2 Configuring QinQ . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 625
5.7.3 Commands. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 628
5.8
MAC Address Table . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 629
5.8.1 Configuring Unicast Static MAC Address . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 629
5.8.2 MAC Learning Considerations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 629
5.8.3 Commands. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 630
5.9
Spanning Tree . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 637
5.9.1
5.9.2
5.9.3
5.9.4
5.9.5
5.9.6
5.9.7
5.9.8
5.9.9
Port Priority and Cost . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Port Type . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
BPDU Filter . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
BPDU Guard . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Loop Guard . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Root Guard . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
MSTP . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
RPVST . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Commands. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
637
637
638
638
638
639
639
639
642
5.10 OpenFlow. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 671
5.10.1
5.10.2
5.10.3
5.10.4
Flow Table . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
OpenFlow 1.3 Spec Support . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Configuring OpenFlow . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Configuring Secure Connection to OpenFlow . . . . . . . . . . . . . . . . . . . . . . . . . .
671
672
676
676
Mellanox Technologies Confidential
Mellanox Technologies Confidential
6
Rev 4.60
5.10.5 Commands. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 680
5.11 IGMP Snooping . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 693
5.11.1
5.11.2
5.11.3
5.11.4
Configuring IGMP Snooping . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Defining a Multicast Router Port on a VLAN . . . . . . . . . . . . . . . . . . . . . . . . . .
IGMP Snooping Querier . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Commands. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
693
693
695
696
5.12 Link Layer Discovery Protocol (LLDP) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 715
5.12.1 Configuring LLDP . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 715
5.12.2 DCBX . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 716
5.12.3 Commands. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 717
5.13 Quality of Service (QoS) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 732
5.13.1
5.13.2
5.13.3
5.13.4
5.13.5
5.13.6
QoS Classification. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
QoS Rewrite . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Queuing and Scheduling (ETS) for SwitchX . . . . . . . . . . . . . . . . . . . . . . . . . . .
Queuing and Scheduling (ETS) for Spectrum . . . . . . . . . . . . . . . . . . . . . . . . . .
RED and ECN . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Commands. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
732
734
735
736
738
740
5.14 Access Control List . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 768
5.14.1 Configuring Access Control List . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 768
5.14.2 ACL Actions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 768
5.14.3 Commands. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 770
5.15 Port Mirroring . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 783
5.15.1
5.15.2
5.15.3
5.15.4
Mirroring Sessions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Configuring Mirroring Sessions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Verifying Mirroring Sessions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Commands. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
783
786
788
789
5.16 sFlow . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 798
5.16.1
5.16.2
5.16.3
5.16.4
5.16.5
5.16.6
5.16.7
Flow Samples . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Statistical Samples . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
sFlow Datagrams. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Sampled Interfaces . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Configuring sFlow . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Verifying sFlow . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Commands. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
798
798
799
799
799
800
801
5.17 Transport Applications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 813
5.17.1 RDMA over Converged Ethernet (RoCE) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 813
5.18 802.1x Protocol . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 817
5.18.1 802.1x Operating Modes . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 817
5.18.2 Configuring 802.1x . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 818
5.18.3 Commands. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 819
5.19 Priority Flow Control. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 835
5.19.1 Flow Control Threshold Configuration for Spectrum. . . . . . . . . . . . . . . . . . . . . 836
5.19.2 Commands. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 838
5.20 Shared Buffers . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 842
5.20.1 Packet Buffering Classification. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 842
Mellanox Technologies Confidential
Mellanox Technologies Confidential
7
Rev 4.60
5.20.2
5.20.3
5.20.4
5.20.5
5.20.6
Buffering Allocation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Pools . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Default Configurations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Configuration Example . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Commands. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
843
844
844
845
847
5.21 Ethernet Resource Scale . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 860
5.21.1 Commands. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 861
Chapter 6 IP Routing. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 863
6.1
General. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 863
6.1.1
6.1.2
6.1.3
6.1.4
6.2
Router ID. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
ECMP . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Configuring OSPF. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Verifying OSPF. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Commands. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
908
908
909
910
913
BGP . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 948
6.3.1
6.3.2
6.3.3
6.3.4
6.3.5
6.3.6
6.4
863
866
867
868
OSPF . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 908
6.2.1
6.2.2
6.2.3
6.2.4
6.2.5
6.3
IP Interfaces . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Equal Cost Multi-Path Routing (ECMP) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Virtual Routing and Forwarding . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Commands. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
State Machine . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 948
Configuring BGP . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 948
Verifying BGP . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 950
Commands. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 951
IP AS-Path Access-List. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1002
IP Community-List . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1004
Policy Rules . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1007
6.4.1 Route Map . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1007
6.4.2 IP Prefix-List . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1037
6.5
Multicast (IGMP and PIM) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1040
6.5.1
6.5.2
6.5.3
6.5.4
6.5.5
6.6
1040
1040
1041
1042
1044
VRRP . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1086
6.6.1
6.6.2
6.6.3
6.6.4
6.7
Bidirectional PIM . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
PIM Load-Sharing. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Bootstrap Router . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Configuring Multicast . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Commands. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Load Balancing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Configuring VRRP . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Verifying VRRP . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Commands. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
1086
1087
1088
1090
MAGP . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1101
6.7.1 Configuring MAGP. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1101
6.7.2 Commands. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1103
6.8
DHCP Relay . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1109
6.8.1 Commands. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1110
Mellanox Technologies Confidential
Mellanox Technologies Confidential
8
Rev 4.60
Appendix A Enhancing System Security According to NIST SP 800-131A . . . . . . 1118
A.1
A.2
A.3
A.4
A.5
A.6
A.7
Overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Web Certificate. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
SNMP . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
SSH. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
HTTPS . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
LDAP . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
Password Hashing. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
1118
1118
1119
1119
1120
1121
1123
Appendix B Mellanox NEO™ on Switch . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1125
B.1
B.2
Deploying Mellanox NEO™ on a MLNX-OS® Switch . . . . . . . . . . . . . . 1125
Getting Familiar with Mellanox NEO GUI . . . . . . . . . . . . . . . . . . . . . . . . 1126
B.3
B.4
B.5
B.6
Account Password, General Information, User Manual and Log-out Menu 1126
Network Notifications Icon . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1127
Main Tabs/Categories/Navigator Buttons . . . . . . . . . . . . . . . . . . . . . . . . . . 1127
Fabric Dashboard for On-Screen Status Monitoring . . . . . . . . . . . . . . . . . 1130
B.7 Last 24 Hours Events. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
6.8.2 Devices Heatmap . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
6.8.3 Fabric Utilization . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
6.8.4 Top Alerted Devices . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
6.8.5 Recent Activity . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
1131
1131
1133
1134
1135
Mellanox Technologies Confidential
Mellanox Technologies Confidential
9
Rev 4.60
List of Tables
Table 1 -Reference Documents . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 30
Table 2 -Glossary . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 30
Table 3 -General System Features . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 33
Table 4 -Ethernet Features . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 34
Table 5 -Serial Terminal Program Configuration for x86 Based Systems . . . . . . . . . . . . . . 37
Table 6 -Serial Terminal Program Configuration for PPC Based Systems . . . . . . . . . . . . . 37
Table 7 -Configuration Wizard Session - IP Configuration by DHCP . . . . . . . . . . . . . . . . . 38
Table 8 -Configuration Wizard Session - IP Zeroconf Configuration . . . . . . . . . . . . . . . . . 40
Table 9 -Configuration Wizard Session - Static IP Configuration . . . . . . . . . . . . . . . . . . . . 41
Table 10 -MLNX-OS Licenses . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 45
Table 11 -CLI Modes and Config Context . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 55
Table 12 -Syntax Conventions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 56
Table 13 -Angled Brackets Parameter Description . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 59
Table 14 -CLI Keyboard Shortcuts . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 62
Table 15 -WebUI Setup Submenus . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 64
Table 16 -WebUI System Submenus . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 65
Table 17 -WebUI Security Submenus . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 66
Table 18 -WebUI Ports Submenus . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 66
Table 19 -WebUI Status Submenus . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 67
Table 20 -WebUI ETH Mgmt Submenus . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 68
Table 21 -WebUI IP Route Submenus . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 68
Table 22 -Module Type . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 70
Table 23 -Device Type . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 70
Table 24 -Sensor Type . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 71
Table 25 -Supported Event Notifications and MIB Mapping . . . . . . . . . . . . . . . . . . . . . . . 290
Table 26 -User Roles (Accounts) and Default Passwords . . . . . . . . . . . . . . . . . . . . . . . . . 313
Table 27 -Chassis Manager Information . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 404
Table 28 -System Health Monitor Alerts Scenarios . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 405
Table 29 -LWR Configuration Behavior . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 411
Table 30 -Standard MIBs – Textual Conventions and Conformance MIBs . . . . . . . . . . . . 443
Table 31 -Standard MIBs – Chassis and Switch . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 443
Table 32 -Private MIBs Supported . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 445
Table 33 -SNMP Traps . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 445
Table 34 -Supported SET OIDs . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 449
Table 35 -Ethernet and Port-Channel Interface Capabilities . . . . . . . . . . . . . . . . . . . . . . . 473
Mellanox Technologies Confidential
Mellanox Technologies Confidential
10
Rev 4.60
Table 36 -VLAN Capabilities . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 474
Table 37 -L2 Ethernet and Port-Channel Interface Capabilities . . . . . . . . . . . . . . . . . . . . . 474
Table 38 -LAG Capabilities . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 474
Table 39 -L3 Interface Capabilities . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 474
Table 40 -OSPF Interface Capabilities . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 475
Table 41 -OSPF Area Capabilities . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 475
Table 42 -Router OSPF Capabilities . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 476
Table 43 -Protocol Enable/Disable Capabilities . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 476
Table 44 -Fetched Image Capabilities . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 476
Table 45 -Installed Image Capabilities . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 477
Table 46 -Fetched Image Capabilities . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 477
Table 47 -Supported VLANs by RPVST per Switch System . . . . . . . . . . . . . . . . . . . . . . . 640
Table 48 -Packet Classification Rules . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 732
Table 49 -Default QoS Configuration . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 733
Table 50 -Default Shaper Configuration . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 737
Table 51 -Mirroring Parameters . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 784
Table 52 -List of Statistical Counters . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 798
Table 53 -Navigator Tabs . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1127
Table 54 -Job States . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1129
Table 55 -Recent Activity Icon Description . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1135
Mellanox Technologies Confidential
Mellanox Technologies Confidential
11
Rev 4.60
List of Figures
Figure 1:
Managing an Ethernet Fabric Using MLNX-OS . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .35
Figure 2:
Console Ports SX10xx Systems . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .36
Figure 3:
MLNX-OS Login Window . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .43
Figure 4:
EULA Prompt . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .44
Figure 5:
Welcome Popup . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .44
Figure 6:
Display After Login . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .45
Figure 7:
No Licenses Installed . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .47
Figure 8:
Enter License Key(s) in Text Box . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .48
Figure 9:
Installed License . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .48
Figure 10: WebUI . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .64
Figure 11: Index Scheme . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .70
Figure 12: Accepting an Agent Request through the Console . . . . . . . . . . . . . . . . . . . . . . . . . . . . .471
Figure 13: Break-Out Cable . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .520
Figure 14: Interface Isolation Example . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .551
Figure 15: Basic MLAG Setup . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .581
Figure 16: Basic MLAG Topology . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .584
Figure 17: Tagging Voice Packets with a Different VLAN ID . . . . . . . . . . . . . . . . . . . . . . . . . . . .620
Figure 18: MAC Learning Disable Example Case . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .629
Figure 19: RPVST Network Config . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .639
Figure 20: RPVST and RSTP Cluster . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .640
Figure 21: OpenFlow 1.3 Pipeline . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .672
Figure 22: RED/ECN Drop Profiles . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .738
Figure 23: Overview of Mirroring Functionality . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .783
Figure 24: Mirror to Analyzer Mapping . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .783
Figure 25: Header Format Options . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .786
Figure 26: Mirroring Session . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .787
Figure 27: sFlow Functionality Overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .798
Figure 28: RoCEv2 and RoCE Frame Format Differences . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .813
Figure 29: RoCEv2 Protocol Stack . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .814
Figure 30: Xon/Xoff Configuration . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .837
Figure 31: ECMP . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .866
Figure 32: Multiple Hash Functions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .867
Figure 33: OSPF Basic Topology . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .909
Figure 34: Basic BGP Configuration . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .948
Figure 35: Common VRRP Configuration with Load Balancing . . . . . . . . . . . . . . . . . . . . . . . . .1086
Mellanox Technologies Confidential
Mellanox Technologies Confidential
12
Rev 4.60
Figure 36: NEO GUI . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .1127
Figure 37: NEO Jobs . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .1129
Figure 38: Fabric Dashboard . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .1131
Figure 39: 24-Hour View . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .1131
Figure 40: Device Heatmap . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .1132
Figure 41: Device Heatmap Dialog . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .1132
Figure 42: Device Heatmap Dialog Example . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .1133
Figure 43: Device Heatmap Example . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .1133
Figure 44: Device Heatmap Key . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .1133
Figure 45: NEO Fabric Utilization Display . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .1134
Figure 46: Fabric Utilization of Device per Category . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .1134
Figure 47: Top Alerted Devices . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .1134
Figure 48: Recent Activity Examples . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .1135
Mellanox Technologies Confidential
Mellanox Technologies Confidential
13
Rev 4.60
Document Revision History
Rev 4.60 – November 01, 2016
Added:
•
the command “show ip igmp snooping membership” on page 709
•
Section 5.10.2.1, “ACL Tables (0-249),” on page 673
•
Section 5.10.2.2, “FDB Table (250),” on page 675
•
Section 5.10.2.3, “Router Table (251),” on page 675
Updated:
•
the command “image options” on page 216 “serve all” parameter description
•
Section 4.4.4.2, “Text Configuration Files,” on page 220
•
the command “show running-config” on page 248
•
the command “fec-override” on page 535
•
Section 5.10.2, “OpenFlow 1.3 Spec Support,” on page 672
•
the command “ip igmp snooping static-group” on page 701
•
the command “ip igmp snooping version” on page 703
•
the command “openflow mode hybrid” on page 682
•
the command “show ip igmp snooping groups” on page 707
•
the command “show ip igmp snooping querier” on page 711
•
the command “show ip igmp snooping statistics” on page 713
Rev 4.50 – September 30, 2016
Added:
•
Section 3.1.7.2, ““watch” CLI Monitoring Option,” on page 61
•
the command “ntp server trusted-enable” on page 190
•
the command “logging port” on page 251
•
the command “install-from-usb” on page 495
•
the command “boot-delay” on page 526
•
the command “show interfaces ethernet rates” on page 543
•
the command “show interfaces ethernet transceiver diagnostics” on page 548
•
the command “show mac-address-table summary” on page 636
•
Section 5.10.2, “OpenFlow 1.3 Spec Support,” on page 672
•
Section 8.3, “Proxy-ARP Event Notifications,” on page 1433
•
Appendix B, “Mellanox NEO™ on Switch” on page 1125
Updated:
•
Section 1.2, “Ethernet Features,” on page 34 with Spectrum™ unicast addresses
•
Section 4.4.4.1, “BIN Configuration Files,” on page 220
•
Section 4.4.4.2, “Text Configuration Files,” on page 220
Mellanox Technologies Confidential
Mellanox Technologies Confidential
14
Rev 4.60
•
the command “reset factory” on page 227
•
the command “show running-config” on page 248
•
Section 4.5.2, “Remote Logging,” on page 250 with Step 3
•
the command “username” on page 317
•
Section 4.12.5, “Unit Identification LED,” on page 414
•
the command “led uid” on page 417
•
the command “show leds” on page 426
•
Section 4.13.1.2, “Private MIB,” on page 445
•
Section “Changing Configuration with SNMP” on page 451
•
Section 4.15.1, “Virtual Machine Configuration,” on page 486
•
the command “show interfaces ethernet” on page 537
•
Section 5.4.6, “Configuring MLAG,” on page 584
•
Section 5.9.7, “MSTP,” on page 639
•
Section 5.10.4, “Configuring Secure Connection to OpenFlow,” on page 676
•
the command “controller-ip (Spectrum)” on page 683
•
the command “controller-ip (SwitchX)” on page 684
•
Section 5.11, “IGMP Snooping,” on page 693 with IGMPv3 note
•
Section 5.14.2, “ACL Actions,” on page 768
•
the command “deny/permit (IPv4 TCP/UDP/ICMP ACL rule)” on page 774
•
the command “monitor session” on page 789
•
Section 6.7.1, “Configuring MAGP,” on page 1101
Rev 4.40 – June 28, 2016
Added:
•
Section 4.3.4.3, “Switching to Partition with Older Software Version,” on page 204 for
clarity
•
Section 4.4.4.1, “BIN Configuration Files,” on page 220
•
Section 4.9.1, “System File Encryption,” on page 361
•
Section 4.12.5, “Unit Identification LED,” on page 414
•
the command “crypto encrypt-data” on page 362
•
the command “show crypto encrypt-data” on page 374
•
the command “led uid” on page 417
•
the command “show leds” on page 426
•
the command “show protocols” on page 431
•
the command “show system capabilities” on page 433
•
Section 5.1.5, “Forward Error Correction,” on page 524
•
the command “show interfaces ethernet transceiver counters” on page 546
•
the command “show interfaces ethernet transceiver counters details” on page 547
Mellanox Technologies Confidential
Mellanox Technologies Confidential
15
Rev 4.60
•
the command “show interfaces ethernet transceiver raw” on page 550
•
Section 5.2, “Interface Isolation,” on page 551
•
the command “show interfaces port-channel counters” on page 577
•
“Enabling L3 Forwarding with User VRF” on page 588
•
the command “show interfaces mlag-port-channel counters” on page 604
•
the command “switchport voice” on page 618
•
Section 5.6, “Voice VLAN,” on page 620
•
the command “ip igmp snooping clear counters” on page 698
•
the command “ip igmp snooping version” on page 703
•
the command “show ip igmp snooping querier counters” on page 712
•
the command “lldp med-tlv-select” on page 724
•
Section 5.13.1, “QoS Classification,” on page 732
•
Section 5.13.2, “QoS Rewrite,” on page 734
•
Section 5.13.3, “Queuing and Scheduling (ETS) for SwitchX,” on page 735
•
Section 5.13.6.1, “QoS Classification,” on page 740
•
the command “no area” on page 925
•
the command “neighbor send-community” on page 984
Updated:
•
the command “ip arp timeout” on page 164
•
Section 4.3.6, “Image Maintenance via Mellanox ONIE,” on page 206
•
the command “image fetch” on page 213
•
the command “configuration switch-to” on page 240
•
“Changing Configuration with SNMP” on page 451 with BinaryDelete and TextDelete
commands
•
the command “show inventory” on page 425
•
the command “show interfaces ethernet” on page 537
•
the command “show interfaces ethernet counters” on page 540
•
the command “show interfaces port-channel” on page 575
•
the command “show interfaces mlag-port-channel” on page 603
•
Section 5.8.1, “Configuring Unicast Static MAC Address,” on page 629
•
the command “show openflow” on page 687
•
the command “show openflow detail (SwitchX)” on page 688
•
the command “show openflow flows” on page 689
•
the command “show openflow statistics (SwitchX)” on page 690
•
the command “ip igmp snooping static-group” on page 701
•
the command “show ip igmp snooping” on page 706
•
the command “show ip igmp snooping groups” on page 707
•
the command “show ip igmp snooping statistics” on page 713
Mellanox Technologies Confidential
Mellanox Technologies Confidential
16
Rev 4.60
•
Section 5.12.2, “DCBX,” on page 716
•
the command “show lldp interfaces” on page 727
•
Section 5.20, “Shared Buffers,” on page 842
•
the command “ip arp timeout” on page 900
•
the command “router ospf” on page 914
•
the command “area stub” on page 923
•
the command “show ip ospf” on page 940
•
the command “show ip ospf border-routers” on page 941
•
the command “show ip ospf database” on page 942
•
the command “show ip ospf interface” on page 943
•
the command “show ip ospf neighbors” on page 944
•
the command “neighbor peer-group” on page 979
•
the command “ip dhcp relay address” on page 1110
•
the command “ip dhcp relay always-on” on page 1112
•
the command “clear ip dhcp relay counters” on page 1113
•
the command “ip dhcp relay information option circuit-id” on page 1114
•
the command “show ip dhcp relay” on page 1116
•
the command “show ip dhcp relay counters” on page 1117
Removed “Security Vulnerabilities and Exposures” appendix and moved it to
www.mellanox.com/page/mlnx_os_security_vulnerabilities_and_exposures
Rev 4.30 – March 02, 2016
Added:
•
Section 3.1.8, “CLI Shortcuts,” on page 62
•
Section 3.4, “Management Information Bases (MIBs),” on page 70
•
the command “cli max-sessions” on page 76
•
the command “show cli max-sessions” on page 82
•
the command “show cli num-sessions” on page 83
•
the command “banner logout” on page 87
•
the command “banner logout-local” on page 88
•
the command “banner logout-remote” on page 89
•
the command “ssh server login attempts” on page 96
•
the command “ssh server login timeout” on page 97
•
Section 4.1.6, “Configuring Hostname via DHCP (DHCP Client Option 12),” on
page 129
•
the command “dhcp hostname” on page 141
•
Section 4.2.1, “NTP Authenticate,” on page 178
•
Section 4.2.2, “NTP Authentication Key,” on page 178
•
the command “ntp authenticate” on page 183
Mellanox Technologies Confidential
Mellanox Technologies Confidential
17
Rev 4.60
•
the command “ntp authentication-key” on page 184
•
the command “ntp peer disable” on page 185
•
the command “ntp peer keyID” on page 186
•
the command “ntp peer version” on page 187
•
the command “ntp server disable” on page 188
•
the command “ntp server keyID” on page 189
•
the command “ntp server version” on page 191
•
the command “ntp trusted-key” on page 192
•
the command “show ntp configured” on page 195
•
the command “show ntp keys” on page 196
•
Section 4.3.6, “Image Maintenance via Mellanox ONIE,” on page 206
•
Section 4.8.2.1, “User Re-authentication,” on page 314
•
the command “aaa authentication attempts fail-delay” on page 324
•
the command “show system type” on page 436
•
Section 4.16, “IP Table Filtering,” on page 512
•
the command “show interfaces ethernet counters” on page 540
•
Section 5.13.5, “RED and ECN,” on page 738
•
Section 5.13.6.4, “RED & ECN,” on page 766
•
Section 5.21, “Ethernet Resource Scale,” on page 860
•
the command “ip multicast filter” on page 1475
•
the command “show ip multicast interface proxy-arp” on page 1491
•
the command “show ip multicast interface proxy-arp count” on page 1492
•
the command “show ip multicast filter interface proxy-arp” on page 1494
Updated:
•
the command “show banner” on page 91
•
the command “ssh server login attempts” on page 96
•
the command “ssh server security strict” on page 100
•
the command “show ssh server” on page 108
•
Section 4.1, “Management Interface,” on page 127
•
the command “show interface configured” on page 152
•
the command “show ntp” on page 194
•
the command “show aaa authentication attempts” on page 335
•
Table 28, “System Health Monitor Alerts Scenarios,” on page 405
•
the command “show inventory” on page 425
•
the command “show power” on page 429
•
the command “show power consumers” on page 430
•
Table 31, “Standard MIBs – Chassis and Switch,” on page 443
•
Section 5.1.1, “Break-Out Cables,” on page 520
Mellanox Technologies Confidential
Mellanox Technologies Confidential
18
Rev 4.60
•
Section 5.1.2, “56GbE Link Speed,” on page 522
•
Section 5.1.5, “Forward Error Correction,” on page 524
•
the command “speed” on page 532
•
the command “deny/permit (MAC ACL rule)” on page 772
•
the command “deny/permit (IPv4 ACL rule)” on page 773
•
the command “deny/permit (IPv4 TCP/UDP/ICMP ACL rule)” on page 774
•
Section 5.15.1.2, “Destination Interface,” on page 784
•
the command “add source interface” on page 792
•
the command “header-format” on page 793
•
the command “show monitor session” on page 796
•
Section 5.20, “Shared Buffers,” on page 842
•
the command “ip load-sharing” on page 895
•
the command “ip arp timeout” on page 900
•
the command “bgp listen range” on page 959
•
the command “show ip mroute” on page 1071
•
the command “vrrp” on page 1091
•
Section A.6.1, “Upgrading Software on the MEX6200,” on page 481
•
Section A.4, “SSH,” on page 1119
Rev 4.20 – August 16, 2015
Added:
•
Section 4.3.6, “Image Maintenance via Mellanox ONIE,” on page 206
•
Section 4.8.3, “System Secure Mode,” on page 315
•
the command “system secure-mode enable” on page 359
•
the command “show system secure-mode” on page 360
•
the command “switchport dot1q-tunnel qos-mode” on page 615
•
Section 5.7, “QinQ,” on page 625
•
the command “dot1x host-mode” on page 822
•
the command “show ip route” on page 896
•
the command “vlan-pop” on page 778
•
the command “vlan-push” on page 779
Updated:
•
Table 7, “Configuration Wizard Session - IP Configuration by DHCP,” on page 38
•
Section 2.4, “Licenses,” on page 45
•
the command “ssh server host-key” on page 93
•
notes of the command “aaa authorization” on page 332
•
Table 28, “System Health Monitor Alerts Scenarios,” on page 405
•
the command “show module” on page 428
Mellanox Technologies Confidential
Mellanox Technologies Confidential
19
Rev 4.60
•
the command “snmp-server user” on page 464
•
Section 5.1.2, “56GbE Link Speed,” on page 522
•
the command “switchport mode” on page 613
•
the command “ip ospf authentication-key” on page 937
•
the command “neighbor password” on page 978
•
the command “neighbor peer-group” on page 979
Rev 4.10 – June 11, 2015
Added:
•
Section 2.1, “Configuring the Switch for the First Time,” on page 36 with MLNX-OS®
Boot Menu step
•
the command “ssh server security strict” on page 100
•
the command “ssh server tcp-forwarding enable” on page 101
•
Section 4.1.5, “In-Band Management,” on page 128
This feature can now be enabled with IP Routing. Also updated the flow of setting an
in-band management channel.
•
the command “show module” on page 428
•
Section 5.1.1, “Break-Out Cables,” on page 520
•
the command “ip address dhcp” on page 534
•
the command “ip address dhcp” on page 568
•
Section 5.4.4, “MLAG Virtual System-MAC,” on page 584
•
Section 5.4.5, “Upgrading MLAG Pair,” on page 584
•
Section 5.18, “802.1x Protocol,” on page 817
•
Section 6.1.3, “Virtual Routing and Forwarding,” on page 867
•
the command “ip l3” on page 868
•
the command “vrf definition” on page 869
•
the command “routing-context vrf” on page 870
•
the command “description” on page 872
•
the command “rd” on page 873
•
the command “vrf forwarding” on page 874
•
the command “show routing-context vrf” on page 876
•
the command “show vrf” on page 877
•
the command “ip address dhcp” on page 882
•
Section 6.2, “IPv6,” on page 990 commands by adding loopback interface configuration
mode to the commands
•
Section 6.5.2, “PIM Load-Sharing,” on page 1040
•
the command “ip pim multipath rp” on page 1058
Updated:
•
the command “tcpdump” on page 177
Mellanox Technologies Confidential
Mellanox Technologies Confidential
20
Rev 4.60
•
Section 4.3.1, “Upgrading MLNX-OS Software,” on page 197 with HA group note
•
Section 4.3.2, “Upgrading MLNX-OS HA Groups,” on page 200
•
the command “show inventory” on page 425
•
the command “show asic-version” on page 420
•
Section 5.4.1, “MLAG Keepalive and Failover,” on page 583
•
Step 10 in Section 5.4.6, “Configuring MLAG,” on page 584
•
the example of the command “upgrade-timeout” on page 600
•
the command “ip routing” on page 871
•
the command “show ip routing” on page 875
•
the command “show ip interface” on page 889
•
the command “interface loopback” on page 890 “id” parameter range
•
the command “ip route” on page 894
•
the command “show ip route” on page 896
•
the command “clear ip arp” on page 901
•
the command “show ip arp” on page 902
•
the command “ping” on page 903
•
the command “traceroute” on page 904
•
the command “tcpdump” on page 906
Removed:
•
the command “interface vlan create” from Section 4.1.7, “Commands,” on page 130
•
the command “ipv6 dhcp client”
Split:
•
the command “ipv6 dhcp”
Rev 3.70 – March 19, 2015
Updated:
•
the command “speed” on page 433
•
the command “show interfaces ib” on page 437
•
the command “show interfaces ib status” on page 438
Rev 3.70 – March 19, 2015
No changes
Rev 3.60 – March 05, 2015
Added:
•
MLAG configuration Step 10
•
the command “system-mac” on page 599
•
the command “upgrade-timeout” on page 600
Mellanox Technologies Confidential
Mellanox Technologies Confidential
21
Rev 4.60
•
Section 5.9.4, “BPDU Guard,” on page 638
Updated:
•
MLAG configuration verification Step 1 with system MAC and upgrade timeout
•
the command “show mlag” on page 601
•
Table 47, “Supported VLANs by RPVST per Switch System,” on page 640
Rev 3.60 – March 05, 2015
No changes
Rev 3.50 – February 24, 2015
Added:
•
the command “show version concise” on page 440
Updated:
•
the command “show uboot” on page 438
Rev 3.40 – February 11, 2015
Added:
•
“List of Tables” and “List of Figures” Sections
•
Updated Section 2.4, “Licenses,” on page 45
•
the command “license delete” on page 52
•
the command “license install” on page 53
•
the command “telnet” on page 109
•
the command “terminal” on page 79
•
the command “web cache-enable” on page 113
•
the command “ip default-gateway” on page 132
•
the command “boot system” on page 210
•
the command “configuration write” on page 245
•
the command “logging trap” on page 267
•
the command “email autosupport enable” on page 294
•
the command “email autosupport event” on page 295
•
the command “crypto ipsec ike” on page 363
•
the command “lacp-individual enable” on page 567
•
the command “show interfaces port-channel” on page 575
•
the command “show interfaces port-channel compatibility-parameters” on page 578
•
the command “show interfaces port-channel load-balance” on page 579
•
the command “show interfaces port-channel summary” on page 580
•
Section 5.9.8, “RPVST,” on page 639
•
the command “spanning-tree vlan forward-time” on page 661
Mellanox Technologies Confidential
Mellanox Technologies Confidential
22
Rev 4.60
•
the command “spanning-tree vlan hello-time” on page 662
•
the command “spanning-tree vlan max-age” on page 663
•
the command “spanning-tree vlan priority” on page 664
•
the command “show spanning-tree vlan” on page 670
•
Section 6.2, “IPv6,” on page 990
•
the command “auto-cost reference-bandwidth” on page 917
•
•
the command “show ip multicast interface proxy-arp” on page 1491
Updated:
•
Section 2.3, “Starting the Web User Interface (WebUI),” on page 43
•
the command “image options” on page 216
•
the command “reload” on page 226
•
Section 4.5.2, “Remote Logging,” on page 250
•
the command “logging debug-files” on page 254
•
Section 4.6.1, “Commands,” on page 271
•
Section 4.8.1, “User Accounts,” on page 313
•
the command “username” on page 317
•
the command “aaa authentication attempts fail-delay” on page 324
•
the command “radius-server host” on page 337
•
the command “tacacs-server host” on page 341
•
Table 28, “System Health Monitor Alerts Scenarios,” on page 405
•
the command “snmp-server auto-refresh” on page 454
•
the command “snmp-server user” on page 464
•
the command “show interfaces ethernet description” on page 542
•
the command “show interfaces ethernet status” on page 544
•
the command “show interfaces port-channel summary” on page 580
•
the command “show interfaces mlag-port-channel summary” on page 605
•
the command “spanning-tree mode” on page 643
•
the command “show spanning-tree” on page 665
•
the command “show spanning-tree detail” on page 666
•
the command “show spanning-tree interface” on page 667
•
the command “show spanning-tree mst” on page 668
•
the command “show spanning-tree root” on page 669
•
Section 5.11.2, “Defining a Multicast Router Port on a VLAN,” on page 693
•
the command “dcb application-priority” on page 725
•
the command “dcb priority-flow-control enable” on page 838
•
Section 5.16.1, “Flow Samples,” on page 798
•
the command “ip arp timeout” on page 900
Mellanox Technologies Confidential
Mellanox Technologies Confidential
23
Rev 4.60
•
the command “redistribute” on page 919
Rev 3.30 – November 19, 2014
Added:
•
Section 5.1.4, “High Power Transceivers,” on page 524
Updated:
•
the command “web https” on page 120
•
the command “show interfaces ethernet” on page 537
•
the command “show interfaces ethernet transceiver” on page 545
•
the command “dcb application-priority” on page 725
•
Section A.5, “HTTPS,” on page 1120
•
Section A.7, “Password Hashing,” on page 1123
Rev 3.20 – November 09, 2014
Added:
•
Section 4.15, “Virtual Machine,” on page 486
•
Section 5.8.2, “MAC Learning Considerations,” on page 629
•
the command “mac-learning disable” on page 632
•
Appendix A,“Enhancing System Security According to NIST SP 800-131A,” on page
1118
Updated:
•
Section 1.2, “Ethernet Features,” on page 34
•
Section 3.2, “Web Interface Overview,” on page 63
•
the command “reset factory” on page 227
•
Section 4.13.1.7, “SNMP SET Operations,” on page 448
•
the command “interface port-channel” on page 561
•
the command “show lacp interfaces neighbor” on page 571
•
Section 5.4, “MLAG,” on page 581
•
the command “mlag-channel-group mode” on page 596
•
the command “show mlag statistics” on page 606
•
the command “ip icmp redirect” on page 888
•
Section 6.3, “BGP,” on page 948
•
Section 6.6.2, “Configuring VRRP,” on page 1087
Replaced:
•
the command “show lacp interfaces port-channel” with the command “show lacp” on
page 573
•
the command “show lacp system-identifier” with the command “show lacp interfaces
system-identifier” on page 574
Mellanox Technologies Confidential
Mellanox Technologies Confidential
24
Rev 4.60
Rev 3.10 – July 20, 2014
Added:
•
Section 5.17, “Transport Applications,” on page 813
•
Section 6.1.1, “IP Interfaces,” on page 863
•
Section 6.3, “BGP,” on page 948
•
the command “show ip pim upstream joins” on page 1067
Updated:
•
Chapter 1, “Introduction” on page 33
•
Section 4.13.1.8, “IF-MIB and Interface Information,” on page 452
•
Section 4.13.2, “XML API,” on page 453
•
MAC addresses note in Section 5.4, “MLAG,” on page 581
•
Chapter 6, “IP Routing” on page 863 with the appropriate configuration modes for the
new configuration contexts and commands added
•
the command “route-map” on page 1008
•
the command “continue ” on page 1009
•
the command “abort” on page 1010
•
the command “exit” on page 1011
•
Section 6.5, “Multicast (IGMP and PIM),” on page 1040
•
the command “ip pim join-prune-interval” on page 1055
•
the command “show ip pim bsr” on page 1061
•
the command “show ip mroute” on page 1071
Rev 3.00 – June 05, 2014
Updated:
•
Section 6.5, “Multicast (IGMP and PIM),” on page 1040
•
Section 6.6.3, “Verifying VRRP,” on page 1088
Rev 2.90 – 19 May, 2014
Added:
•
Section 6.5, “Multicast (IGMP and PIM),” on page 1040
Updated:
•
the command “show configuration” on page 247
•
the command “show uboot” on page 438
•
the command “show voltage” on page 441
•
Section 5.4, “MLAG,” on page 581
•
the command “show mlag” on page 601
•
Section 6.1.4.2, “IP Interfaces,” on page 878
•
Section 6.1.4.4, “Loopback Interface,” on page 890
Mellanox Technologies Confidential
Mellanox Technologies Confidential
25
Rev 4.60
Rev 2.80 – May 08, 2014
Added:
•
supported versions note in Section 5.11, “IGMP Snooping,” on page 693
•
Section 6.6, “VRRP,” on page 1086
•
Section 6.7, “MAGP,” on page 1101
•
Section 6.8, “DHCP Relay,” on page 1109
Rev 2.70 – April 30, 2014
Added:
•
Appendix A,“Enhancing System Security According to NIST SP 800-131A,” on page
1118
•
supported versions note in Section 5.11, “IGMP Snooping,” on page 693
Updated:
•
the command “show ssh server” on page 108
•
the command “web auto-logout” on page 112
•
the command “web https” on page 120
•
the command “show web” on page 126
•
the command “show usernames” on page 319
•
the command “ldap base-dn” on page 344
•
the command “ldap ssl” on page 354
Rev 2.60 – April 10, 2014
Updated:
•
Table 32, “Private MIBs Supported,” on page 445
Rev 2.50 – April 2014
Updated:
•
Section 3.1.7, “Command Output Filtering and Monitoring,” on page 60
•
the command “show protocols” on page 431
•
the command “show mac-address-table” on page 634
•
the command “deny/permit (MAC ACL rule)” on page 772
•
the command “show mac/ipv4 access-lists” on page 781
Added:
•
Section 5.4, “MLAG,” on page 581
•
configuration mode Config Interface MLAG Port Channel to the following commands:
• “flowcontrol” on page 527
• “mtu” on page 529
• “shutdown” on page 530
Mellanox Technologies Confidential
Mellanox Technologies Confidential
26
Rev 4.60
• “description” on page 531
• “speed” on page 532
• “load-interval” on page 533
• “clear counters” on page 536
• “switchport mode” on page 613
• “switchport access” on page 616
• “spanning-tree port-priority” on page 647
• “spanning-tree cost” on page 648
• “spanning-tree port type” on page 649
• “spanning-tree guard” on page 650
• “ip igmp snooping fast-leave” on page 699
• “dcb priority-flow-control mode on” on page 840
• “ipv4/mac port access-group” on page 771
• “sflow enable (interface)” on page 811
Rev 2.40 – February, 2014
Updated:
•
Section 4.3.5.2, “Importing Firmware and Changing the Default Firmware,” on
page 205 – updated Step 1
•
the command “show running-config” on page 248
•
the command “show log” on page 269
•
Section 4.9, “Cryptographic (X.509, IPSec) and Encryption,” on page 361
•
Section 5.3.1, “Configuring Static Link Aggregation Group (LAG),” on page 559 –
removed unnecessary step
•
the command “lldp tlv-select” on page 723
Added:
•
Section 3.1.7, “Command Output Filtering and Monitoring,” on page 60
•
FCoE and SX1700 GW license in Section 2.4, “Licenses,” on page 45
•
Section 4.13.1.8, “IF-MIB and Interface Information,” on page 452
Rev 2.30 – January, 2014
Updated:
•
Section 4.14.4, “Writing Configuration Classes,” on page 471
•
the command “crypto certificate generation” on page 368
•
the command “crypto certificate name” on page 369
Rev 2.20 – January, 2014
Updated:
•
Section 4.14.5.11, “Installed Image Capabilities,” on page 477
Mellanox Technologies Confidential
Mellanox Technologies Confidential
27
Rev 4.60
Rev 2.10 – January, 2014
Added:
•
Section 4.12.2.1, “Width Reduction Power Saving,” on page 410
Updated:
•
Section 2.2, “Starting the Command Line (CLI),” on page 42
•
Section 2.3, “Starting the Web User Interface (WebUI),” on page 43
•
Section 4.3.1, “Upgrading MLNX-OS Software,” on page 197 with EULA note
•
Section 4.14, “Puppet Agent,” on page 470
•
the command “load-interval” on page 533 with Config Interface Port Channel
•
the command “spanning-tree port-priority” on page 647 with Config Interface Port
Channel
•
Section 5.10, “OpenFlow,” on page 671
•
the command “openflow description (SwitchX)” on page 681
•
the command “show openflow” on page 692
•
the command “switchport {hybrid, trunk} allowed-vlan” on page 617 with Config
Interface Port Channel
•
the command “spanning-tree cost” on page 648 with Config Interface Port Channel
•
the command “spanning-tree port type” on page 649 with Config Interface Port Channel
•
the command “spanning-tree guard” on page 650 with Config Interface Port Channel
•
the command “spanning-tree bpdufilter” on page 651 with Config Interface Port Channel
•
the command “deny/permit (IPv4 ACL rule)” on page 773
•
the command “sflow enable (interface)” on page 811 with Config Interface Port Channel
•
Section 6.2, “OSPF,” on page 908
•
the command “router-id” on page 915
Rev 2.00 – December 2013
Added:
•
Section 5.1.3, “Transceiver Information,” on page 523
•
the command “run-interval” on page 482
Updated:
•
Section 4.3.1, “Upgrading MLNX-OS Software,” on page 197
•
Section 4.3.3, “Deleting Unused Images,” on page 201
•
Section 4.6, “Debugging,” on page 270
•
the example of the command “show cpld” on page 422
•
“Notification Indicator” column in Section 8.4.2, “Standalone Proxy-ARP Configuration,” on page 1435
Mellanox Technologies Confidential
Mellanox Technologies Confidential
28
Rev 4.60
•
the command “show puppet-agent” on page 484
•
the command “lldp tlv-select” on page 723
Moved:
Section 3.3, “Secure Shell (SSH),” on page 69 from 4.13.2
Removed:
•
mention of the MLNX-OS Command Reference Guide
•
the command “lldp tlv-select dcbx”
Rev 1.90 – November 2013
Added Appendix A,“MEX6200 System,” on page 467
Rev 1.80 – October 2013
Added:
•
Section 4.14, “Puppet Agent,” on page 470
•
Section 5.9.7, “MSTP,” on page 639
•
Section 5.10, “OpenFlow,” on page 671
•
Section 5.11.3, “IGMP Snooping Querier,” on page 695
•
the command “ip igmp snooping querier”
•
the command “igmp snooping querier query-interval”
•
the command “show ip igmp snooping querier”
•
Section 5.12.2, “DCBX,” on page 716
•
the command “lldp tlv-select dcbx”
•
the command “dcb application-priority”
•
the command “show dcb application-priority”
Updated:
•
the command “show lldp interfaces”
Rev 1.7.0 – October 2013
Merged “MLNX-OS Command Reference Guide” Rev. 1.6.9 and “MLNX-OS User Manual”
Rev. 1.6.9.
Mellanox Technologies Confidential
Mellanox Technologies Confidential
29
Rev 4.60
About this Manual
This manual provides general information concerning the scope and organization of this User’s
Manual.
Intended Audience
This manual is intended for network administrators who are responsible for configuring and
managing Mellanox Technologies’ SwitchX based Switch Platforms.
Related Documentation
The following table lists the documents referenced in this User’s Manual.
Table 1 - Reference Documents
Document Name
Description
Director switch Installation Guide
Each Mellanox Technologies' switch platform is
shipped with an Installation Guide document to
bring-up and initialize the switch platform.
System Hardware User Manual
This document contains hardware descriptions, LED
assignments and hardware specifications among other
things.
Switch Product Release Notes
Please look up the relevant SwitchX®-based switch
system/series release note file
Mellanox Virtual Modular Switch
Reference Guide
This reference architecture provides general information concerning Mellanox L2 and L3 Virtual Modular
Switch (VMS) configuration and design.
All of these documents can be found on the Mellanox website. They are available either through
the product pages or through the support page with a login and password.
Glossary
Table 2 - Glossary
AAA
Authentication, Authorization, and Accounting.
Authentication - verifies user credentials (username and password).
Authorization - grants or refuses privileges to a user/client for accessing specific services.
Accounting - tracks network resources consumption by users.
ARP
Address Resolution Protocol. A protocol that translates IP addresses into
MAC addresses for communication over a local area network (LAN).
CLI
Command Line Interface. A user interface in which you type commands at the
prompt
DCB
Data Center Bridging
Mellanox Technologies Confidential
Mellanox Technologies Confidential
30
Rev 4.60
Table 2 - Glossary
DCBX
DCBX protocol is an extension of the Link Layer Discovery Protocol
(LLDP). DCBX end points exchange request and acknowledgment messages.
For flexibility, parameters are coded in a type-length-value (TLV) format.
DHCP
The Dynamic Host Configuration Protocol (DHCP) is an automatic configuration protocol used on IP networks.
DNS
Domain Name System. A hierarchical naming system for devices in a computer network
ETS
ETS provides a common management framework for assignment of bandwidth to traffic classes.
FTP/TFTP/sFTP
File Transfer Protocol (FTP) is a standard network protocol used to transfer
files from one host to another over a TCP-based network, such as the Internet.
Gateway
A network node that interfaces with another network using a different network
protocol
HA (High Availability)
A system design protocol that provides redundancy of system components,
thus enables overcoming single or multiple failures in minimal downtime
Host
A computer platform executing an Operating System which may control one
or more network adapters
LACP
Link Aggregation Control Protocol (LACP) provides a method to control the
bundling of several physical ports together to form a single logical channel.
LACP allows a network device to negotiate an automatic bundling of links by
sending LACP packets to the peer (directly connected device that also implements LACP).
LDAP
The Lightweight Directory Access Protocol is an application protocol for
reading and editing directories over an IP network.
LLDP (Link Layer Discovery
Protocol)
A vendor neutral link layer protocol used by network devices to advertise their
identify, capabilities and for neighbor discovery
MAC
A Media Access Control address (MAC address) is a unique identifier
assigned to network interfaces for communications on the physical network
segment. MAC addresses are used for numerous network technologies and
most IEEE 802 network technologies including Ethernet.
MTU (Maximum Transfer Unit)
The maximum size of a packet payload (not including headers) that can be
sent /received from a port
Network Adapter
A hardware device that allows for communication between computers in a
network
PFC/FC
Priority Based Flow Control applies pause functionality to traffic classes OR
classes of service on the Ethernet link.
RADIUS
Remote Authentication Dial In User Service. A networking protocol that
enables AAA centralized management for computers to connect and use a network service.
RDMA (Remote Direct Memory
Access)
Accessing memory in a remote side without involvement of the remote CPU
Mellanox Technologies Confidential
Mellanox Technologies Confidential
31
Rev 4.60
Table 2 - Glossary
RSTP
Rapid Spanning Tree Protocol. A spanning-tree protocol used to prevent loops
in bridge configurations. RSTP is not aware of VLANs and blocks ports at the
physical level.
SA (Subnet Administrator)
The interface for querying and manipulating subnet management data
SCP
Secure Copy or SCP is a means of securely transferring computer files
between a local and a remote host or between two remote hosts. It is based on
the Secure Shell (SSH) protocol.
SNMP
Simple Network Management Protocol. A network protocol for the management of a network and the monitoring of network devices and their functions
NTP
Network Time Protocol. A protocol for synchronizing computer clocks in a
network
SSH
Secure Shell. A protocol (program) for securely logging in to and running programs on remote machines across a network. The program authenticates
access to the remote machine and encrypts the transferred information through
the connection.
syslog
A standard for forwarding log messages in an IP network
TACACS+
Terminal Access Controller Access-Control System Plus. A networking protocol that enables access to a network of devices via one or more centralized
servers. TACACS+ provides separate AAA services.
XML Gateway
Extensible Markup Language Gateway. Provides an XML request-response
protocol for setting and retrieving HW management information.
Mellanox Technologies Confidential
Mellanox Technologies Confidential
32
Rev 4.60
1
Introduction
Mellanox® Operating System (MLNX-OS®) enables the management and configuration of Mellanox Technologies’ SwitchX® Family silicon based switch platforms.
MLNX-OS provides a full suite of management options, including support for SNMPv1, 2, 3,
and web user interface (WebUI). In addition, it incorporates a familiar industry-standard CLI,
which enables administrators to easily configure and manage the system.
1.1
System Features
Table 3 - General System Features
Feature
Description
Software Management
•
•
Dual software image
Software and firmware updates
File management
•
•
•
FTP
TFTP
SCP
Logging
•
•
Event history log
SysLog support
Management Interface
•
•
DHCP/Zeroconf
IPv6
Chassis Management
•
•
•
•
Monitoring environmental controls
Power management
Auto-temperature control
High availability
Network Management
Interfaces
•
•
•
SNMP v1,v2c,v3
interfaces (XML Gateway)
Puppet Agent
Security
•
•
•
•
SSH
Telnet
RADIUS
TACACS+
Date and Time
•
NTP
Cables & Transceivers
•
Transceiver info
Unbreakable links
•
LLR
Mellanox Technologies Confidential
Mellanox Technologies Confidential
33
Rev 4.60
1.2
Ethernet Features
Table 4 - Ethernet Features
Feature
Description
General
•
•
•
ACL – 6400 rules (permit/deny)
Breakout cables
Jumbo Frames (9K)
Ethernet support
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
•
48K unicast MAC addresses on SwitchX®-2 based systems
• 2K static multicast MAC addresses
90100 unicast MAC addresses on Spectrum™ based systems
DCBX
DHCP Relay
ETS (802.1Qaz)
Flow control (802.3x)
IGMP snooping v1,2
LAG/LACP (802.3ad), 16 links per LAG (64 LAGs)
LLDP
MLAG
MSTP
OpenFlow 1.3
PFC (802.1Qbb)
Rapid Spanning Tree (802.1w)
sFlow
VLAN (802.1Q) – 4K
•
•
•
•
•
•
•
•
•
•
•
•
BGP
DHCP Relay
ECMP
IGMP
IPv4
IPv6
OSPF
PIM
VLAN interface
Loopback interface
Router interface
VRRP
IP routing
Mellanox Technologies Confidential
Mellanox Technologies Confidential
34
Rev 4.60
Figure 1: Managing an Ethernet Fabric Using MLNX-OS
Mellanox Technologies Confidential
Mellanox Technologies Confidential
35
Rev 4.60
2
Getting Started
The procedures described in this chapter assume that you have already installed and powered on
your switch according to the instructions in the Hardware Installation Guide, which was shipped
with the product.
2.1
Configuring the Switch for the First Time
To configure the switch:
Step 1.
Connect the host PC to the console (RJ-45) port of the switch system using the supplied cable.
The console ports for systems are shown below.
Figure 2: Console Ports SX10xx Systems
Make sure to connect to the console RJ-45 port of the switch and not to the MGT port.
DHCP is enabled by default over the MGT port. Therefore, if you have configured
your DHCP server and connected an RJ-45 cable to the MGT port, simply log in using
the designated IP address.
Step 2.
Configure a serial terminal with the settings described below.
This step may be skipped if the DHCP option is used and an IP is already configured
for the MGT port.
Mellanox Technologies Confidential
Mellanox Technologies Confidential
36
Rev 4.60
Table 5 - Serial Terminal Program Configuration for PPC Based Systems
Parameter
Setting
Baud Rate
9600
Data bits
8
Stop bits
1
Parity
None
Flow Control
None
Table 6 - Serial Terminal Program Configuration for x86 Based Systems
Parameter
Setting
Baud Rate
115200
Data bits
8
Stop bits
1
Parity
None
Flow Control
None
Step 3.
You are prompted with the boot menu.
Mellanox MLNX-OS Boot Menu:
1:
2:
u:
c:
USB menu (if USB device is connected) (password required)
Command prompt (password required)
Choice:
Select “1” to boot with software version installed on partition #1.
Select “2” to boot with software version installed on partition #2.
Selecting “u” is not currently supported.
Select “c” to proceed to advanced booting options – available to Mellanox Support
only.
The MLNX-OS Boot Menu features a countdown timer. It is recommended to allow
the timer to run out by not selecting any of the options.
Step 4.
Login as admin and use admin as password.
If the machine is still initializing, you might not be able to access the CLI until initialization
completes. As an indication that initialization is ongoing, a countdown of the number of
remaining modules to be configured is displayed in the following format: “
Modules are being configured”.
Step 5.
Go through the Mellanox configuration wizard.
Mellanox Technologies Confidential
Mellanox Technologies Confidential
37
Rev 4.60
The following table shows an example of a wizard session.
Table 7 - Configuration Wizard Session - IP Configuration by DHCP (Sheet 1 of 2)
Wizard Session Display (Example)
Comments
Mellanox configuration wizard
Do you want to use the wizard for initial configuration? yes
You must perform this configuration the first
time you operate the switch or after resetting
the switch to the factory defaults. Type “y” and
then press .
Step1: Hostname? [switch-1]
If you wish to accept the default hostname,
then press . Otherwise, type a different
hostname and press .
Step 2: Use DHCP on mgmt0 interface? [yes]
Perform this step to obtain an IP address for the
switch. (mgmt0 is the management port of the
switch.)
If you wish the DHCP server to assign the IP
address, type “yes” and press .
If you type “no” (no DHCP), then you will be
asked whether you wish to use the “zeroconf”
configuration or not. If you enter “yes” (yes
Zeroconf), the session will continue as shown
in Table 8.
If you enter “no” (no Zeroconf), then you need
to enter a static IP, and the session will continue as shown in Table 9.
Step 3: Enable IPv6 [yes]
Perform this step to enable IPv6 on management ports.
If you wish to enable IPv6, type “yes” and
press .
If you enter “no” (no IPv6), then you will automatically be referred to Step 5.
Step 4: Enable IPv6 autoconfig (SLAAC) on
mgmt0 interface
Perform this step to enable StateLess address
autoconfig on external management port.
If you wish to enable it, type “yes” and press
.
If you wish to disable it, enter “no”.
Step 5: Use DHCPv6 on mgmt0 interface?
[yes]
Perform this step to enable DHCPv6 on the
MGMT0 interface.
Step 5: Admin password (Press to
leave unchanged)?
Step 4: Confirm admin password?
To avoid illegal access to the machine, please
type a password and then press . Then
confirm the password by re-entering it.
Note that password characters are not printed.
Mellanox Technologies Confidential
Mellanox Technologies Confidential
38
Rev 4.60
Table 7 - Configuration Wizard Session - IP Configuration by DHCP (Sheet 2 of 2)
Wizard Session Display (Example)
You have entered the following information:
1. Hostname:
2. Use DHCP on mgmt0 interface: yes
3. Enable IPv6: yes
4. Enable IPv6 autoconfig (SLAAC) on mgmt0
interface: yes
5. Enable DHCPv6 on mgmt0 interface: no
6. Admin password (Enter to leave unchanged):
(CHANGED)
To change an answer, enter the step number to
return to.
Otherwise hit to save changes and exit.
Comments
The wizard displays a summary of your
choices and then asks you to confirm the
choices or to re-edit them.
Either press to save changes and exit,
or enter the configuration step number that you
wish to return to.
Note:
To run the command “configuration jumpstart” you must be in Config mode.
Choice:
Configuration changes saved.
To return to the wizard from the CLI, enter the
“configuration jump-start” command from
configuration mode. Launching CLI...
[standalone: master] >
Mellanox Technologies Confidential
Mellanox Technologies Confidential
39
Rev 4.60
Table 8 - Configuration Wizard Session - IP Zeroconf Configuration
Wizard Session Display - IP Zeroconf Configuration (Example)
Mellanox configuration wizard
Do you want to use the wizard for initial configuration? y
Step 1: Hostname? [switch-112126]
Step 2: Use DHCP on mgmt0 interface? [no]
Step 3: Use zeroconf on mgmt0 interface? [no] yes
Step 4: Default gateway? [192.168.10.1]
Step 5: Primary DNS server?
Step 6: Domain name?
Step 7: Enable IPv6? [yes] yes
Step 8: Enable IPv6 autoconfig (SLAAC) on mgmt0 interface? [no] no
Step 9: Admin password (Enter to leave unchanged)?
You have entered the following information:
1.
2.
3.
4.
5.
6.
7.
8.
9.
Hostname: switch-112126
Use DHCP on mgmt0 interface: no
Use zeroconf on mgmt0 interface: yes
Default gateway: 192.168.10.1
Primary DNS server:
Domain name:
Enable IPv6: yes
Enable IPv6 autoconfig (SLAAC) on mgmt0 interface: yes
Admin password (Enter to leave unchanged): (unchanged)
To change an answer, enter the step number to return to.
Otherwise hit to save changes and exit.
Choice:
Configuration changes saved.
To return to the wizard from the CLI, enter the “configuration jump-start”
command from configure mode. Launching CLI...
[standalone: master] >
Mellanox Technologies Confidential
Mellanox Technologies Confidential
40
Rev 4.60
Table 9 - Configuration Wizard Session - Static IP Configuration
Wizard Session Display - Static IP Configuration (Example)
Mellanox configuration wizard
Do you want to use the wizard for initial configuration? y
Step 1: Hostname? [switch-112126]
Step 2: Use DHCP on mgmt0 interface? [yes] n
Step 3: Use zeroconf on mgmt0 interface? [no]
Step 4: Primary IP address? 192.168.10.4
Mask length may not be zero if address is not zero (interface mgmt0)
Step 5: Netmask? [0.0.0.0] 255.255.255.0
Step 6: Default gateway? 192.168.10.1
Step 7: Primary DNS server?
Step 8: Domain name?
Step 9: Enable IPv6? [yes] yes
Step 10: Enable IPv6 autoconfig (SLAAC) on mgmt0 interface? [no] no
Step 11: Admin password (Enter to leave unchanged)?
You have entered the following information:
1.
2.
3.
4.
5.
6.
7.
8.
9.
10.
11.
Hostname: switch-112126
Use DHCP on mgmt0 interface: no
Use zeroconf on mgmt0 interface: no
Primary IP address: 192.168.10.4
Netmask: 255.255.255.0
Default gateway: 192.168.10.1
Primary DNS server:
Domain name:
Enable IPv6: yes
Enable IPv6 autoconfig (SLAAC) on mgmt0 interface: no
Admin password (Enter to leave unchanged): (unchanged)
To change an answer, enter the step number to return to.
Otherwise hit to save changes and exit.
Choice:
Configuration changes saved.
To return to the wizard from the CLI, enter the “configuration jump-start”
command from configure mode. Launching CLI...
[standalone: master] >
Mellanox Technologies Confidential
Mellanox Technologies Confidential
41
Rev 4.60
Step 6.
Check the mgmt0 interface configuration before attempting a remote (for example, SSH) connection to the switch. Specifically, verify the existence of an IP address.
switch # show interfaces mgmt0
Interface mgmt0 state
Admin up:
yes
Link up:
yes
IP address:
169.254.15.134
Netmask:
255.255.0.0
IPv6 enabled:
yes
Autoconf enabled: yes
Autoconf route:
yes
Autoconf privacy: no
IPv6 addresses:
1
IPv6 address:
fe80::202:c9ff:fe11:a1b2/64
Speed:
1000Mb/s (auto)
Duplex:
full (auto)
Interface type:
ethernet
Interface source: physical
MTU:
1500
HW address:
00:02:C9:11:A1:B2
Comment:
RX bytes:
11700449
TX bytes:
RX packets:
55753
TX packets:
RX mcast packets: 0
TX discards:
RX discards:
0
TX errors:
RX errors:
0
TX overruns:
RX overruns:
0
TX carrier:
RX frame:
0
TX collisions:
TX queue len: 1000
2.1.1
15139846
28452
0
0
0
0
0
Re-Running the Wizard
To rerun the wizard:
Step 1.
Enter the config mode.
switch > enable
switch # config terminal
Step 2.
Rerun the wizard.
switch (config) # configuration jump-start
2.2
Starting the Command Line (CLI)
Step 1.
Set up an Ethernet connection between the switch and a local network machine using a standard RJ-45 connector.
Step 2.
Start a remote secured shell (SSH) to the switch using the command “ssh -l
.”
rem_mach1 > ssh -l
Step 3.
Login to the switch (default username is admin, password admin)
Step 4.
Read and accept the EULA when prompted.
Mellanox Technologies Confidential
Mellanox Technologies Confidential
42
Rev 4.60
Step 5.
Once you get the prompt, you are ready to use the system.
Mellanox MLNX-OS Switch Management
Password:
Last login: