Dell PowerEdge MX Networking Deployment Guide

• 1

  Dell PowerEdge MX Platform Overview
• 2

  Dell Technologies Demo Center
• 3

  Dell PowerEdge MX models and components
• 4

  PowerEdge MX7000 - front
• 5

  Dell PowerEdge MX7000 - rear
• 6

  PowerEdge MX compute slot to I/O slot mapping
• 7

  Open Manage Enterprise - Modular Edition
  • Introduction
  • PowerEdge MX initial deployment

• 1

  PowerEdge MX Scalable Fabric Architecture
• 2

  Scalable Fabric Architecture
• 3

  Complex Scalable Fabric topologies
• 4

  Quad-port Ethernet NICs
• 5

  Interfaces and port groups
• 6

  Recommended port order for MX7116n FEM connectivity
• 7

  Embedded top-of-rack switching
• 8

  MX Chassis management wiring

• 1

  Dell SmartFabric OS10
• 2

  Operating modes
• 3

  Changing operating modes
• 4

  VLAN restrictions
• 5

  LLDP for iDRAC
• 6

  Virtual Link Trunking
• 7

  Storage networking
• 8

  Host FCoE session load balancing
• 9

  PowerEdge MX IOM operations
  • Switch Management page overview
  • Switch Overview
  • Hardware tab
  • View port status
  • Firmware tab
  • Upgrading Dell SmartFabric OS10
  • Alerts tab
  • Settings tab
• 10

  OS10 privileged accounts
• 11

  NIC teaming guidelines

• 1

  Full Switch Mode
• 2

  VLAN scaling guidelines for Full Switch mode
• 3

  Managing Fibre Channel Zones on MX9116n FSE
• 4

  Full Switch mode IO module replacement process
• 5

  VLAN stacking

• 1

  Overview of SmartFabric Services for PowerEdge MX
• 2

  Functional overview
• 3

  OS10 operating mode differences
• 4

  CLI commands available in SmartFabric mode
• 5

  IOM slot placement in SmartFabric mode
• 6

  Switch-to-switch (VLTi) cabling
• 7

  Configuring port speed and breakout
• 8

  VLAN scaling guidelines
• 9

  Maximum Transmission Unit behavior
• 10

  Layer 2 Multicast, IGMP, and MLD snooping
• 11

  Upstream network requirements
  • Supported slot configurations for IOMs
• 12

  Other restrictions and guidelines
• 13

  Ethernet – No Spanning Tree uplink
• 14

  Spanning Tree Protocol - legacy Ethernet uplink
• 15

  Networks and automated QoS
• 16

  Server templates, profiles, virtual identities, networks, and deployment
  • Upgrading Z9432F-ON using DUP in SmartFabric mode
  • Deployment
  • 25 GbE solution using 100 GbE NIC
• 17

  VMware vCenter integration - OpenManage Network Integration
• 18

  OpenManage Integration for VMware vCenter

• 1

  SmartFabric Creation
• 2

  Steps to create a SmartFabric
• 3

  Physically cable PowerEdge MX chassis and upstream switches
• 4

  Define VLANs
  • Define VLANs for FCoE
• 5

  Create the SmartFabric
• 6

  Optional steps
  • Forward error correction
  • Configure uplink port speed or breakout
  • Configure Ethernet ports
• 7

  Create Ethernet – No Spanning Tree uplink
• 8

  Ethernet – No Spanning Tree upstream switch configuration
• 9

  Optional - Configure Fibre Channel
  • Configure Fibre Channel universal ports
  • Create Fibre Channel uplinks
• 10

  Enable support for larger VLAN counts
• 11

  Uplink failure detection
• 12

  Configuring the upstream switch and connecting uplink cables

• 1

  Server Deployment
• 2

  Deploying a server
• 3

  Server preparation
• 4

  Create a server template
• 5

  Create identity pools
• 6

  Associate server template with networks – no FCoE
• 7

  Associate server template with networks - with FCoE
• 8

  Deploy a server template
• 9

  Profile deployment

• 1

  SmartFabric Deployment Validation
• 2

  Validate the SmartFabric health
• 3

  Validation of quad-port NIC topologies
• 4

  Validating Ethernet - No Spanning Tree uplinks

• 1

  SmartFabric Operations
• 2

  Viewing SmartFabric health and status
• 3

  Edit a SmartFabric
• 4

  Edit uplinks
• 5

  Edit VLANs
• 6

  Delete SmartFabric
• 7

  Connect non-MX Ethernet devices to a SmartFabric
• 8

  Expanding from a single-chassis to dual-chassis configuration
• 9

  SmartFabric mode IOM replacement process
• 10

  MXG610 Fibre Channel switch module replacement process
• 11

  Chassis Backup and Restore
  • Backing up the chassis
  • Restoring chassis
  • Manual backup of IOM configuration through the CLI

• 1

  General Troubleshooting
• 2

  View or extract logs using OME-M
• 3

  Troubleshooting MCM topology errors
• 4

  Troubleshooting VLT and vPC configuration on upstream switches
• 5

  Troubleshooting VLTi connections between MX I/O modules
• 6

  Troubleshooting FEM and compute sled discovery
• 7

  Troubleshooting FC and FCoE
• 8

  Rebalancing FC and FCoE sessions
• 9

  Common CLI troubleshooting commands for Full Switch and SmartFabric modes

• 1

  SmartFabric Troubleshooting
• 2

  Troubleshooting SmartFabric issues
• 3

  Troubleshoot port group breakout errors
• 4

  Troubleshooting VLTi between switches
• 5

  Troubleshooting uplink errors
• 6

  Troubleshooting legacy Ethernet uplink with STP
• 7

  Troubleshooting common issues
• 8

  SmartFabric Services troubleshooting commands

• 1

  Configuration Scenarios
• 2

  Scenario 1: SmartFabric deployment with S5232F-ON upstream switches with Ethernet - No Spanning Tree uplink
• 3

  Scenario 2: SmartFabric connected to Cisco Nexus 3232C switches with Ethernet - No Spanning Tree uplink
• 4

  Scenario 3: SmartFabric deployment with S5232F-ON upstream switches with legacy Ethernet uplink
• 5

  Scenario 4: SmartFabric connected to Cisco Nexus 3232C switches with legacy Ethernet uplink
• 6

  Scenario 5: Connect MX9116n FSE to Fibre Channel storage - NPIV Proxy Gateway mode
• 7

  Scenario 6: Connect MX9116n FSE to Fibre Channel storage - FC Direct Attach
• 8

  Scenario 7: Connect MX5108n to Fibre Channel storage - FSB
• 9

  Scenario 8: Configure boot from SAN

• 1

  PowerEdge MX 100 GbE Solution with Z9432F-ON external Fabric Switching Engine
• 2

  PowerEdge MX models and components for 100 GbE
  • Dell Networking MX8116n Fabric Expander Module
  • Dell PowerSwitch Z9432F-ON
  • Dell PowerEdge MX760c compute sled
• 3

  PowerEdge Scalable Fabric Architecture
  • 100 GbE deployment options
  • Topologies for 25 GbE
  • Topologies for 25 GbE and 100 GbE in the same scalable fabric
  • MX Chassis management wiring
• 4

  MX8116n management
  • MX8116n within OME-Modular
• 5

  Z9432F-ON management
• 6

  MX8116n FEM port mapping on the Z9432F-ON
  • Compute sleds with 100 GbE dual port mezzanine cards
  • Compute sleds with 25 GbE quad port mezzanine cards
  • Compute sleds with 25 GbE dual port mezzanine cards
• 7

  100 GbE and 25 GbE solution configuration examples in Full-Switch mode
  • 100 GbE solution example in Full-Switch mode
  • 25 GbE solution example in Full-Switch mode
• 8

  100 GbE solution configuration validation
  • Show Interface Status
  • Show Port Group
  • Show LLDP neighbors
  • Show interface port channel summary
  • Show VLAN
  • Show VLT
• 9

  100 GbE combined deployment with legacy IOMs
  • Single chassis combined deployment
  • Multi-chassis combined deployment
  • Networking configuration management of combined deployments
  • Combined deployment restrictions
• 10

  100 GbE deployment with rack servers

• 1

  PowerEdge MX 100 GbE and 25 GbE solution with Z9432F-ON FSE in SmartFabric mode
• 2

  Deploy SmartFabric mode on external FSE
• 3

  OMNI integration for SFS Content

• 1

  PowerEdge MX 100 GbE solution with Z9664F-ON external Fabric Switching Engine
• 2

  Dell PowerSwitch Z9664F-ON
• 3

  Z9664F-ON 100 GbE and 25 GbE solution configuration examples in Full-Switch mode
  • Z9664F-ON solution example in Full-Switch mode
  • Z9432F-ON configuration - external network ToR
  • Configure global switch settings
  • Configure VLTi
  • Configure downstream interfaces
• 4

  Z9664F-ON Configuration for 100 GbE in Full switch mode
  • Configure global switch settings
  • Port-groups breakout
  • Configure VLTi
  • Configure downstream interfaces
• 5

  Full Switch configuration validation
  • Show interface status
  • Show port group
  • Show LLDP neighbors
  • Show interface port channel summary
  • Show VLT

• 1

  Advanced NPAR
• 2

  Hardware and software requirements
• 3

  Restrictions and limitations
  • Advanced NPAR feature restrictions
  • Scalability restrictions
• 4

  Advanced NPAR solution for MX Platform
• 5

  Advanced NPAR on MX SmartFabric mode
  • Configure NPAR device settings and NIC partitioning
  • Advanced Quad Port NIC NPAR status
  • SmartFabric configuration in OME-Modular
• 6

  Advanced NPAR Quad Port NIC in Full Switch mode
  • S5232F-ON configuration
  • MX9116n configuration in Full switch mode
• 7

  Configuration validation
  • Show LLDP
  • Show Eth-npar

• 1

  Additional Tasks
• 2

  Reset SmartFabric OS10 switch to factory defaults
• 3

  Reset Cisco Nexus 3232C to factory defaults
• 4

  Connect to IO Module console port using RACADM
• 5

  MX I/O module OS10 installation using ONIE
  • Manual installation
  • Automatic installation
• 6

  MXG610s FC switch upgrade downgrade
• 7

  MXG610s switch details validation

• 1

  Additional Information
• 2

  PTM port mapping
• 3

  Supported cables and optical connectors
• 4

  PowerEdge MX IOM slot support matrix

• 1

  Dell PowerSwitch S4148U-ON Configuration in Scenario 7
• 2

  Switch configuration commands

• 1

  Dell PowerStore 1000T
• 2

  About Dell PowerStore 1000T
• 3

  Configure PowerStore 1000T FC storage
  • Create a host
  • Create host groups and add hosts
  • Create volume groups
  • Create volumes
• 4

  Determine PowerStore 1000T storage array FC WWPNs
• 5

  Determine CNA FCoE port WWPNs

• 1

  Hardware and Version Information
• 2

  Hardware used in this guide
  • Dell PowerSwitch S3048-ON
  • Dell PowerSwitch S5232F-ON
  • Dell PowerSwitch S4148U-ON
  • Dell PowerSwitch Z9432F-ON
  • Dell PowerSwitch Z9664F-ON
  • Dell PowerStore 1000T
  • Cisco Nexus 3232C
• 3

  Software and firmware versions used
  • Scenarios 1 through 4
  • Scenarios 5 through 8

• 1

  References
• 2

  Dell Technologies documentation
  • OME-M and OS10 compatibility and documentation
  • Dell Technologies Networking Infrastructure Solutions documentation
• 3

  Feedback and technical support