Deployment

Guides for deploying applications on the IPU

PopDist and PopRun: User Guide

Command-line tool and API to support running distributed applications across multiple IPUs.

Using IPUs from Docker

User guide explaining how to run applications on one or more physical IPUs using pre-built Graphcore Docker containers

PopEF: User Guide

A file format for exporting and importing models to run on the IPU, and a library for managing those files

Model Runtime: User Guide

A library built on the Poplar runtime to enable loading and running models stored in the Poplar Exchange Format (PopEF) on the IPU.

Poplar Triton Backend: User Guide

Information on the Poplar Triton backend: what it is used for, how to install it and how to use it

IPU TensorFlow Serving 2 User Guide

Information on exporting models from TensorFlow 2 and running them on IPUs using TensorFlow Serving

IPU TensorFlow Serving 1 User Guide

Information on exporting models from TensorFlow 1 and running them on IPUs using TensorFlow Serving

Kubernetes IPU Operator User Guide

Kubernetes Operator support for IPUs.

Using MACVLAN with Kubernetes

Using Kubernetes with MACVLAN to provide access to the RDMA network interface.