Skip to content

Latest commit

 

History

History
61 lines (41 loc) · 3.26 KB

configure_management_network.md

File metadata and controls

61 lines (41 loc) · 3.26 KB

Configure Management Network Switches

HPE Cray EX systems can have network switches in many roles: spine switches, leaf switches, aggregation switches, and CDU switches. Newer systems have HPE Aruba switches, while older systems have Dell and Mellanox switches. Switch IP addresses are generated by Cray Site Init (CSI).

The configuration steps are different for these switch vendors. The switch configuration procedures for HPE Aruba will be grouped separately from the switch configuration procedures for other vendors.

It is assumed that the administrator configuring the Management Network has a basic understanding of networking protocols (STP, VLAN, OSPF, LAG/MLAG) and knows how to configure network equipment. It is also assumed that they understand and know how to read an SHCD file.

Before configuring/reconfiguring any switches make sure to get the current running config and save that in case you need to revert the config.

Save the output:

show run

Topics:

Details

HPE Aruba Switch Configuration

The management network switches should be configured in this order: Spine, Aggregation (if present), CDU (if present), and Leaf. Only systems with liquid-cooled cabinets will have the CDU switches. Only systems with many nodes in air-cooled cabinets will have Aggregation switches.

  1. Configure Aruba Spine Switch
  2. Configure Aruba Aggregation Switch (if present)
  3. Configure Aruba CDU Switch (if present)
  4. Configure Aruba Leaf Switch
  5. Update Management Network Firmware
  6. Workaround for known mac-learning issue with 8325.

Dell and Mellanox Switch Configuration

The management network switches should be configured in this order: Spine, Aggregation (if present), CDU (if present), and Leaf. Only systems with liquid-cooled cabinets will have the CDU switches. Only systems with many nodes in air-cooled cabinets will have Aggregation switches.

On a typical system, the Mellanox switches are Spine switches and the Dell switches are used for Aggregation, CDU, and Leaf switches.

  1. Configure Mellanox Spine Switch
  2. Configure Dell Aggregation Switch (if present)
  3. Configure Dell CDU Switch (if present)
  4. Configure Dell Leaf Switch
  5. Update Management Network Firmware

Next Topic

After completing this procedure the next step is to collect MAC Addresses for the management nodes using the PIT node and the management network switches configured in this procedure.