IPU-POD₆₄ Reference Design: Build and Test Guide

• 1. Overview
  • 1.1. Acronyms and abbreviations
• 2. IPU‑POD₆₄ reference design components
  • 2.1. IPU-M2000s
    • 2.1.1. Overview
    • 2.1.2. QR code label
    • 2.1.3. LED indicators
      • Rear side LEDs
      • Front side LEDs
  • 2.2. Server
  • 2.3. Switches
    • 2.3.1. 100GE RoCE/RDMA switch (ToR switch)
    • 2.3.2. 1GE management switch
  • 2.4. Power distribution units
  • 2.5. Rack
  • 2.6. Supplementary mounting components
  • 2.7. Cables
    • 2.7.1. RJ45 cables
    • 2.7.2. OSFP cables
    • 2.7.3. QSFP cables
• 3. Rack assembly
  • 3.1. Equipment checklist
  • 3.2. Document reproduction
  • 3.3. Required tools
  • 3.4. Preparing the rack
    • 3.4.1. Rail distance
    • 3.4.2. Unpacking the rack
    • 3.4.3. Removing the side panels and doors
    • 3.4.4. Removing the vertical accessory channels
    • 3.4.5. Adjusting the rear accessory channels
    • 3.4.6. Adjusting the rear vertical rails
    • 3.4.7. Adjusting the front vertical rails
    • 3.4.8. Installing the rack rails
    • 3.4.9. Installing PDU brackets
  • 3.5. Installing the equipment
    • 3.5.1. Installing the IPU-M2000s
    • 3.5.2. Installing the management switch
    • 3.5.3. Installing the ToR switch
    • 3.5.4. Installing the PDUs
    • 3.5.5. Installing the Dell R6525 server(s)
  • 3.6. Cabling the rack
    • 3.6.1. IPU-M2000 to IPU-M2000 IPU-Link connectivity (OSFP)
    • 3.6.2. IPU-M2000 to IPU-M2000 Sync-Link cabling
    • 3.6.3. IPU-M2000 to management switch cabling (RJ45)
    • 3.6.4. Management switch: BMC cabling
    • 3.6.5. Management switch: BMC + GW SoC cabling
    • 3.6.6. IPU-M2000 to ToR switch cabling (QSFP)
    • 3.6.7. Dell R6525 server(s) cabling
    • 3.6.8. ToR switch to Dell server(s)
    • 3.6.9. Management switch to Dell server(s): iDRAC
    • 3.6.10. Management switch to Dell server(s): network connector
    • 3.6.11. Management switch to Dell server(s): switch management
    • 3.6.12. Management switch to PDUs
  • 3.7. Power cabling
    • 3.7.1. IPU-M2000 power cabling
    • 3.7.2. Server power cabling: Dell R6525
    • 3.7.3. Switch power cabling
  • 3.8. Completing the rack
    • 3.8.1. Blanking panels
    • 3.8.2. Front and rear doors
    • 3.8.3. Side panels
    • 3.8.4. PDU plugs
    • 3.8.5. Packaging
• 4. Server and switch configuration
  • 4.1. Server configuration
    • 4.1.1. Hardware recommendations
    • 4.1.2. Storage configuration recommendations
    • 4.1.3. Memory configuration recommendations
    • 4.1.4. BIOS configuration
    • 4.1.5. Operating system installation
      • Ubuntu 18.04 packages
      • CentOS 7 packages
      • Python packages
    • 4.1.6. User accounts and groups
    • 4.1.7. DHCP Service (Dynamic Host Configuration Protocol)
      • DHCP file templates
    • 4.1.8. Rsyslog service
      • Rsyslog file templates
    • 4.1.9. NTP service (Network Time Protocol)
      • NTP file structure
    • 4.1.10. Other configuration files and folders
  • 4.2. Network configuration
    • 4.2.1. Overview
    • 4.2.2. IPU‑POD₆₄ network interfaces
    • 4.2.3. Management switch configuration
    • 4.2.4. ToR switch configuration
    • 4.2.5. IPU‑POD₆₄ VLAN assignments
    • 4.2.6. Server network configuration
      • Example netplan configuration file
• 5. Software installation and configuration
  • 5.1. Management server
  • 5.2. V-IPU software installation and configuration
  • 5.3. IPU-M2000 software installation and configuration
    • 5.3.1. Download IPU-M2000 software update bundle
    • 5.3.2. Software update of all IPU-M2000s
    • 5.3.3. IPU-M2000 GW root file system config files
  • 5.4. Rack tool
• 6. Manual installation tests
  • 6.1. Running system tests
  • 6.2. Troubleshooting
    • 6.2.1. BMC BISTs
    • 6.2.2. V-IPU built in self tests
      • IPU-Link cabling test
      • Sync-Link test
      • IPU-Link training test
      • IPU-Link traffic test
• 7. Revision history
• 8. Trademarks & copyright