Poplar Triton Backend: User Guide
Version: latest
1. Introduction
1.1. Overview
1.2. Setting the environment variables
1.3. Building the Triton server
1.4. Configuring the model repository
1.4.1. PopEF files
1.4.2. Input / output name mapping
1.4.3. Triton model configuration
Backend
Instance groups
Batching
Timeouts
Synchronous execution
1.5. Configuring the Poplar backend
1.6. Starting the server
1.7. Profiling
1.7.1. Triton performance analyzer and metrics
1.8. Limitations
2. API reference
2.1. BackendState
2.2. ModelState
2.3. InputBuffers
2.4. OutputBuffers
2.5. ModelInstanceState
2.6. RequestCollection
2.7. Request
2.8. Tracepoint
2.9. Latch
3. Trademarks & copyright
Poplar Triton Backend: User Guide
Poplar Triton Backend: User Guide
1. Introduction
1.1. Overview
1.2. Setting the environment variables
1.3. Building the Triton server
1.4. Configuring the model repository
1.4.1. PopEF files
1.4.2. Input / output name mapping
1.4.3. Triton model configuration
Backend
Instance groups
Batching
Timeouts
Synchronous execution
1.5. Configuring the Poplar backend
1.6. Starting the server
1.7. Profiling
1.7.1. Triton performance analyzer and metrics
1.8. Limitations
2. API reference
2.1. BackendState
2.2. ModelState
2.3. InputBuffers
2.4. OutputBuffers
2.5. ModelInstanceState
2.6. RequestCollection
2.7. Request
2.8. Tracepoint
2.9. Latch
3. Trademarks & copyright
Read the Docs
v: latest