IPU-POD128 Reference Design: Build and Test Guide
- 1. Overview
- 2. IPU‑POD128 design components
- 3. IPU-POD64 rack assembly
- 3.1. Equipment checklist
- 3.2. Document reproduction
- 3.3. Required tools
- 3.4. Preparing the rack
- 3.4.1. Rail distance
- 3.4.2. Unpacking the rack
- 3.4.3. Removing the side panels and doors
- 3.4.4. Removing the vertical accessory channels
- 3.4.5. Adjusting the rear accessory channels
- 3.4.6. Adjusting the rear vertical rails
- 3.4.7. Adjusting the front vertical rails
- 3.4.8. Installing the rack rails
- 3.4.9. Installing PDU brackets
- 3.5. Installing the equipment
- 3.6. Cabling the rack
- 3.6.1. IPU-M2000 to IPU-M2000 IPU-Link connectivity (OSFP)
- 3.6.2. IPU-M2000 to IPU-M2000 Sync-Link cabling
- 3.6.3. IPU-M2000 to management switch cabling (RJ45)
- 3.6.4. Management switch: BMC cabling
- 3.6.5. Management switch: BMC + IPU-Gateway cabling
- 3.6.6. IPU-M2000 to ToR switch cabling (QSFP)
- 3.6.7. Dell R6525 server(s) cabling
- 3.6.8. ToR switch to Dell server(s)
- 3.6.9. Management switch to Dell server(s): iDRAC
- 3.6.10. Management switch to Dell server(s): network connector
- 3.6.11. Management switch to Dell server(s): switch management
- 3.6.12. Management switch to PDUs
- 3.7. Power cabling
- 3.8. Completing the rack
- 4. IPU‑POD64 server and switch configuration
- 4.1. Server configuration
- 4.1.1. Hardware recommendations
- 4.1.2. Storage configuration recommendations
- 4.1.3. Memory configuration recommendations
- 4.1.4. BIOS configuration
- 4.1.5. Operating system installation
- 4.1.6. User accounts and groups
- 4.1.7. DHCP Service (Dynamic Host Configuration Protocol)
- 4.1.8. Rsyslog service
- 4.1.9. NTP service (Network Time Protocol)
- 4.1.10. Other configuration files and folders
- 4.1.11. User application memory usage
- 4.2. Network configuration
- 4.1. Server configuration
- 5. IPU‑POD64 software installation and configuration
- 6. IPU‑POD64 manual installation tests
- 7. IPU-POD128 installation
- 8. IPU‑POD128 network configuration
- 8.1. Overview
- 8.2. Useful resources
- 8.3. IP addressing
- 8.4. Merging IPU‑POD64 racks to create IPU‑POD128
- 8.4.1. Networking pre-requisites
- 8.4.2. Phase 1: Edit configuration files
- 8.4.3. Phase 2: Activate new configuration
- Step 6: Inform users of down time
- Step 7: lrack2 DHCP server
- Step 8: lrack1 DHCP server
- Step 9: Restart IPU-M2000s on lrack1
- Step 10: Netplan configuration on lrack1
- Step 11: Update rack_config files on lrack1
- Step 12: Restart IPU-M2000s on lrack2
- Step 13: Verify IPU-M2000 interface access
- Step 14: Create V-IPU cluster on lrack1
- Step 15: Test access to V-IPU agents
- Step 16: Create partitions on lrack1
- Step 17: lrack1 RNIC addresses
- Step 18: lrack2 RNIC addresses
- Step 19: rsyslog.d
- Step 20: chrony.conf
- Step 21: Refresh overlay files on lrack1
- Step 22: Check IPU-M2000s logging to lrack1
- Step 23: Check IPU-M2000s have NTP date and time
- Step 24: Run ML application
- 8.5. IPU-M2000 setup files
- 8.6. DHCP files
- 8.6.1. Lrack1 and lrack2: /etc/dhcp/dhcpd.conf
- 8.6.2. Lrack1: /etc/dhcp/dhcpd.d/ipum-dhcp.conf
- 8.6.3. Lrack2: /etc/dhcp/dhcpd.d/ipum-dhcp.conf
- 8.6.4. Lrack1 and lrack2: /etc/dhcp/dhcpd.d/ files
- 8.6.5. Lrack1: /etc/dhcp/dhcpd.d/lrack1 files
- 8.6.6. Lrack1: /etc/dhcp/dhcpd.d/lrack2 files
- 8.6.7. Lrack2: /etc/dhcp/dhcpd.d/lrack2 files
- 8.7. /etc/netplan files
- 9. System integration testing
- 10. Revision history
- 11. Safety and compliance
- 12. Trademarks & copyright