Poplar Triton Backend: User Guide
Version: latest
1. Introduction
1.1. Overview
1.2. Setting the environment variables
1.3. Building the Triton server
1.4. Configuring the model repository
1.4.1. PopEF files
1.4.2. Input / output name mapping
1.4.3. Triton model configuration
Backend
Instance groups
Batching
Timeouts
Synchronous execution
1.5. Configuring the Poplar backend
1.6. Starting the server
1.7. Profiling
1.7.1. Triton performance analyzer and metrics
1.8. Limitations
2. API reference
2.1. BackendState
2.2. ModelState
2.3. InputBuffers
2.4. OutputBuffers
2.5. ModelInstanceState
2.6. RequestCollection
2.7. Request
2.8. Tracepoint
2.9. Latch
3. Legal notices
Poplar Triton Backend: User Guide
»
Poplar Triton Backend: User Guide
Edit on GitHub
Poplar Triton Backend: User Guide
1. Introduction
1.1. Overview
1.2. Setting the environment variables
1.3. Building the Triton server
1.4. Configuring the model repository
1.4.1. PopEF files
1.4.2. Input / output name mapping
1.4.3. Triton model configuration
Backend
Instance groups
Batching
Timeouts
Synchronous execution
1.5. Configuring the Poplar backend
1.6. Starting the server
1.7. Profiling
1.7.1. Triton performance analyzer and metrics
1.8. Limitations
2. API reference
2.1. BackendState
2.2. ModelState
2.3. InputBuffers
2.4. OutputBuffers
2.5. ModelInstanceState
2.6. RequestCollection
2.7. Request
2.8. Tracepoint
2.9. Latch
3. Legal notices
Read the Docs
v: latest
Versions
latest
Downloads
pdf
On Read the Docs
Project Home
Builds