2. IPU-POD DA systems

In addition to the IPU-M2000s, you will also need a host server, a mounting rack, two PDUs, and cables to build an IPU-POD DA system. These are described in the following sections.

2.1. IPU-M2000 overview

The IPU-M2000 front panel contains (from left to right in Fig. 2.1):

  • 2 RNIC ports for connection to the server

  • 8 Sync-Link ports for connection between IPU-M2000s

  • 2 management GbE ports for connection to the server

  • 2 GW-Link ports – not currently used in IPU-POD DA systems

  • 8 IPU-Link ports for connection between IPU-M2000s

_images/m2000_DA_front_panel.png

Fig. 2.1 Front panel

The IPU-M2000 back panel contains:

  • 2 power connectors per IPU-M2000

  • 5 fans (n+1 redundant and removable)

  • QR code

_images/m2000_DA_back_panel.png

Fig. 2.2 Back panel

The QR code contains the following information for each IPU-M2000:

  • Company name (Graphcore)

  • Serial number

  • Part number

  • BMC Ethernet MAC address

  • IPU-Gateway Ethernet MAC address

  • Graphcore support web URL (https://www.graphcore.ai/support)

2.2. Host server

You will need one host server with an installed 100GbE RoCEv2 NIC.

This document describes the use of a Dell PowerEdge R6525 server. Other servers are supported – see the Approved server list or contact Graphcore support for details of other supported server types.

2.3. Mounting rack

The IPU-M2000 is an Open Compute compliant 1U 19-inch chassis so the mounting rack needs to support this standard.

The IPU-M2000 mounting system requires a rail-to-rail distance of 720mm. Additional height may be required for any horizontal PDUs and ToR datacentre switches.

You will also need one IPU-M2000 slider kit per IPU-M2000, for installation in the rack.

2.4. PDUs

For power feed redundancy the IPU-POD DA system will require two PDUs supporting output voltage in the range 115-230Vac.

Each IPU-M2000 connects to both PDUs with C15-to-C14 cables. The recommended PowerEdge server connects to both PDUs with two C13-to-C14 cables.

PDU examples:

  • Horizontal mounting (1U Rackmount): Tripp Lite PDUH32HV (supports one IPU‑POD16 system)

  • Vertical mounting (zero U): AP8886 PDU (supports multiple IPU‑POD16 systems)

2.5. Cables

You will need the following cables for each IPU-M2000:

  • 2x 1.45m IEC60320 AC power cables for the IPU-M2000

  • 1x 1.5m QSFP cable to connect the IPU-M2000 to the server (black)

  • 1x 1.5m Cat5e cable to connect the IPU-M2000 to the server (blue)

  • 1x 0.6m Cat5e cable to connect management ports between IPU-M2000s (blue)

  • 4x 0.3m OSFP cables to connect IPU-Link ports between IPU-M2000s (black)

  • 2x 0.15m Cat5e cables to connect Sync-Link ports between IPU-M2000s (red)

You will also need one IPU-M2000 slider kit per IPU-M2000 for installation in the rack.

The standard IPU-M2000 provides only the power cables, the IPU-M2000 Founders Edition contains all the cables required.

Note that you may not need all of the supplied cables - it will depend on the IPU-POD DA configuration that you choose.

2.6. Other system pre-requisites

2.6.1. Power delivery

  • Power requirement IPU‑POD4 DA: 2500W per PDU for redundancy

  • Power requirement IPU‑POD16 DA: 7kW per PDU for redundancy

2.6.2. Cooling delivery

  • Airflow requirements IPU‑POD4 DA: 150 CFM or higher at 35C maximum

  • Airflow requirements IPU‑POD16 DA: 465 CFM or higher at 35C maximum

2.6.3. Management and data connectivity

  • Suitable management and data connectivity into the server to service the workload requirements of the completed system.