IPU-POD₆₄ Reference Design: Build and Test Guide

• 1. Overview
  • 1.1. Acronyms and abbreviations
• 2. IPU‑POD₆₄ reference design components
  • 2.1. IPU-M2000s
    • 2.1.1. Overview
    • 2.1.2. QR code label
    • 2.1.3. LED indicators
      • Rear side LEDs
      • Front side LEDs
  • 2.2. Server
  • 2.3. Switches
    • 2.3.1. 100GE RoCE/RDMA switch (ToR switch)
    • 2.3.2. 1GbE management switch
  • 2.4. Power distribution units
  • 2.5. Rack
  • 2.6. Supplementary mounting components
  • 2.7. Cables
    • 2.7.1. RJ45 cables
    • 2.7.2. OSFP cables
    • 2.7.3. QSFP cables
• 3. Rack assembly
  • 3.1. Equipment checklist
  • 3.2. Document reproduction
  • 3.3. Required tools
  • 3.4. Preparing the rack
    • 3.4.1. Rail distance
    • 3.4.2. Unpacking the rack
    • 3.4.3. Removing the side panels and doors
    • 3.4.4. Removing the vertical accessory channels
    • 3.4.5. Adjusting the rear accessory channels
    • 3.4.6. Adjusting the rear vertical rails
    • 3.4.7. Adjusting the front vertical rails
    • 3.4.8. Installing the rack rails
    • 3.4.9. Installing PDU brackets
  • 3.5. Installing the equipment
    • 3.5.1. Installing the IPU-M2000s
    • 3.5.2. Installing the management switch
    • 3.5.3. Installing the ToR switch
    • 3.5.4. Installing the PDUs
    • 3.5.5. Installing the Dell R6525 server(s)
  • 3.6. Cabling the rack
    • 3.6.1. IPU-M2000 to IPU-M2000 IPU-Link connectivity (OSFP)
    • 3.6.2. IPU-M2000 to IPU-M2000 Sync-Link cabling
    • 3.6.3. IPU-M2000 to management switch cabling (RJ45)
    • 3.6.4. Management switch: BMC cabling
    • 3.6.5. Management switch: BMC + IPU-Gateway cabling
    • 3.6.6. IPU-M2000 to ToR switch cabling (QSFP)
    • 3.6.7. Dell R6525 server(s) cabling
    • 3.6.8. ToR switch to Dell server(s)
    • 3.6.9. Management switch to Dell server(s): iDRAC
    • 3.6.10. Management switch to Dell server(s): network connector
    • 3.6.11. Management switch to Dell server(s): switch management
    • 3.6.12. Management switch to PDUs
  • 3.7. Power cabling
    • 3.7.1. IPU-M2000 power cabling
    • 3.7.2. Server power cabling: Dell R6525
    • 3.7.3. Switch power cabling
  • 3.8. Completing the rack
    • 3.8.1. Blanking panels
    • 3.8.2. Front and rear doors
    • 3.8.3. Side panels
    • 3.8.4. PDU plugs
    • 3.8.5. Packaging
• 4. General server installation and switch configuration
  • 4.1. Server configuration
    • 4.1.1. Hardware recommendations
    • 4.1.2. Storage configuration recommendations
    • 4.1.3. Memory configuration recommendations
    • 4.1.4. BIOS configuration
    • 4.1.5. Operating system installation
      • Ubuntu 18.04 packages
      • CentOS 7 packages
      • Python packages
    • 4.1.6. User accounts and groups
    • 4.1.7. DHCP Service (Dynamic Host Configuration Protocol)
      • DHCP file templates
    • 4.1.8. Rsyslog service
      • Rsyslog file templates
    • 4.1.9. NTP service (Network Time Protocol)
      • NTP file structure
    • 4.1.10. Other configuration files and folders
    • 4.1.11. User application memory usage
  • 4.2. Network configuration
    • 4.2.1. Overview
    • 4.2.2. IPU‑POD₆₄ network interfaces
    • 4.2.3. Management switch configuration
    • 4.2.4. ToR switch configuration
    • 4.2.5. IPU‑POD₆₄ VLAN assignments
    • 4.2.6. Server network configuration
      • Example netplan configuration file
• 5. Management server software installation
  • 5.1. Overview of management server
  • 5.2. V-IPU software
    • 5.2.1. V-IPU release notes
    • 5.2.2. V-IPU installation
  • 5.3. IPU-M software
    • 5.3.1. IPU-M release notes
    • 5.3.2. IPU-M installation
  • 5.4. Rack tool
• 6. IPU-M2000 software and firmware upgrade
  • 6.1. What happens during the upgrade
  • 6.2. Upgrade instructions
• 7. Manual installation tests
  • 7.1. Running system tests
  • 7.2. Troubleshooting
    • 7.2.1. BMC BISTs
    • 7.2.2. V-IPU built in self tests
      • IPU-Link cabling test
      • Sync-Link test
      • IPU-Link training test
      • IPU-Link traffic test
• 8. Revision history
• 9. Safety and compliance
• 10. Trademarks & copyright