Poplar Triton Backend: User Guide

• 1. Introduction
  • 1.1. Overview
  • 1.2. Setting the environment variables
  • 1.3. Building the Triton server
  • 1.4. Configuring the model repository
    • 1.4.1. PopEF files
    • 1.4.2. Input / output name mapping
    • 1.4.3. Triton model configuration
      • Backend
      • Instance groups
      • Batching
      • Timeouts
      • Synchronous execution
  • 1.5. Configuring the Poplar backend
  • 1.6. Starting the server
  • 1.7. Profiling
    • 1.7.1. Triton performance analyzer and metrics
  • 1.8. Limitations
• 2. API reference
  • 2.1. BackendState
  • 2.2. ModelState
  • 2.3. InputBuffers
  • 2.4. OutputBuffers
  • 2.5. ModelInstanceState
  • 2.6. RequestCollection
  • 2.7. Request
  • 2.8. Tracepoint
  • 2.9. Latch
• 3. Legal notices