IPU-POD₆₄ Reference Design: Build and Test Guide

• 1. Overview
  • 1.1. Acronyms and abbreviations
• 2. IPU‑POD₆₄ reference design components
  • 2.1. IPU-M2000s
    • 2.1.1. Overview
    • 2.1.2. QR code label
  • 2.2. Server
  • 2.3. Switches
    • 2.3.1. 100GE RoCE/RDMA switch (ToR switch)
    • 2.3.2. 1GE management switch
  • 2.4. Power distribution units
  • 2.5. Rack
  • 2.6. Supplementary mounting components
  • 2.7. Cables
    • 2.7.1. RJ45 cables
    • 2.7.2. OSFP cables
    • 2.7.3. QSFP cables
• 3. Rack assembly
  • 3.1. Equipment checklist
  • 3.2. Preparing the rack
    • 3.2.1. Rail distance
    • 3.2.2. Unpacking the rack
    • 3.2.3. Removing the side panels and doors
    • 3.2.4. Removing the vertical accessory channels
    • 3.2.5. Adjusting the rear accessory channels
    • 3.2.6. Adjusting the rear vertical rails
    • 3.2.7. Adjusting the front vertical rails
    • 3.2.8. Installing the rack rails
    • 3.2.9. Installing PDU brackets
  • 3.3. Installing the equipment
    • 3.3.1. Installing the IPU-M2000s
    • 3.3.2. Installing the management switch
    • 3.3.3. Installing the ToR switch
    • 3.3.4. Installing the PDUs
    • 3.3.5. Installing the Dell R6525 server(s)
  • 3.4. Cabling the rack
    • 3.4.1. IPU-M2000 to IPU-M2000 IPU-Link connectivity (OSFP)
    • 3.4.2. IPU-M2000 to IPU-M2000 Sync-Link cabling
    • 3.4.3. IPU-M2000 to management switch cabling (RJ45)
    • 3.4.4. Management switch: BMC cabling
    • 3.4.5. Management switch: BMC + GW SoC cabling
    • 3.4.6. IPU-M2000 to ToR switch cabling (QSFP)
    • 3.4.7. Dell R6525 server(s) cabling
    • 3.4.8. ToR switch to Dell server(s)
    • 3.4.9. Management switch to Dell server(s): iDRAC
    • 3.4.10. Management switch to Dell server(s): network connector
    • 3.4.11. Management switch to Dell server(s): switch management
    • 3.4.12. Management switch to PDUs
  • 3.5. Power cabling
    • 3.5.1. IPU-M2000 power cabling
    • 3.5.2. Server power cabling: Dell R6525
    • 3.5.3. Switch power cabling
  • 3.6. Completing the rack
    • 3.6.1. Blanking panels
    • 3.6.2. Front and rear doors
    • 3.6.3. Side panels
• 4. Server and switch configuration
  • 4.1. Server configuration
    • 4.1.1. Hardware recommendations
    • 4.1.2. Storage configuration recommendations
    • 4.1.3. Memory configuration
    • 4.1.4. BIOS configuration
    • 4.1.5. Operating system recommendations
    • 4.1.6. Ubuntu 18.04 packages
    • 4.1.7. CentOS 7 packages
    • 4.1.8. Python packages
    • 4.1.9. User accounts and groups
    • 4.1.10. DHCP Service (Dynamic Host Configuration Protocol)
      • File templates
    • 4.1.11. Rsyslog service
      • File templates
    • 4.1.12. NTP service (Network Time Protocol)
      • File structure
    • 4.1.13. Other configuration files and folders
  • 4.2. Network configuration
    • 4.2.1. Overview
    • 4.2.2. IPU‑POD₆₄ network interfaces
    • 4.2.3. Management switch configuration
    • 4.2.4. ToR switch configuration
    • 4.2.5. IPU‑POD₆₄ VLAN assignments
    • 4.2.6. Server network configuration
      • Example netplan configuration file
• 5. Software installation and configuration
  • 5.1. Management server
  • 5.2. V-IPU software installation and configuration
  • 5.3. IPU-M2000 software installation and configuration
    • 5.3.1. Download IPU-M2000 software update bundle
    • 5.3.2. Software update of all IPU-M2000s
    • 5.3.3. IPU-M2000 GW root file system config files
  • 5.4. Rack tool
• 6. Manual installation tests
  • 6.1. Running system BISTs
  • 6.2. Troubleshooting
    • 6.2.1. BMC BISTs
    • 6.2.2. V-IPU built in self tests
      • IPU-Link cabling test
      • Sync-Link test
      • IPU-Link training test
      • IPU-Link traffic test
• 7. Revision history
• 8. Trademarks & copyright