Logo
Poplar Triton Backend: User Guide
Version: latest
  • 1. Introduction
    • 1.1. Overview
    • 1.2. Setting the environment variables
    • 1.3. Building the Triton server
    • 1.4. Configuring the model repository
      • 1.4.1. PopEF files
      • 1.4.2. Input / output name mapping
      • 1.4.3. Triton model configuration
        • Backend
        • Instance groups
        • Batching
        • Timeouts
        • Synchronous execution
    • 1.5. Configuring the Poplar backend
    • 1.6. Starting the server
    • 1.7. Profiling
      • 1.7.1. Triton performance analyzer and metrics
    • 1.8. Limitations
  • 2. API reference
    • 2.1. BackendState
    • 2.2. ModelState
    • 2.3. InputBuffers
    • 2.4. OutputBuffers
    • 2.5. ModelInstanceState
    • 2.6. RequestCollection
    • 2.7. Request
    • 2.8. Tracepoint
    • 2.9. Latch
  • 3. Legal notices
Poplar Triton Backend: User Guide
  • »
  • 3. Legal notices
  • Edit on GitHub

3. Legal notices

Graphcloud®, Graphcore® and Poplar® are registered trademarks of Graphcore Ltd.

Bow™, Bow-2000™, Bow Pod™, Colossus™, In-Processor-Memory™, IPU-Core™, IPU-Exchange™, IPU-Fabric™, IPU-Link™, IPU-M2000™, IPU-Machine™, IPU-POD™, IPU-Tile™, PopART™, PopDist™, PopLibs™, PopRun™, PopVision™, PopTorch™, Streaming Memory™ and Virtual-IPU™ are trademarks of Graphcore Ltd.

All other trademarks are the property of their respective owners.

© Copyright 2021, Graphcore Ltd.

Previous

Revision 697904f7.

Read the Docs v: latest
Versions
latest
Downloads
pdf
On Read the Docs
Project Home
Builds