TRITONBACKEND_Backend |
|
TRITONBACKEND_BackendAttribute |
|
TRITONBACKEND_Batcher |
|
TRITONBACKEND_Input |
|
TRITONBACKEND_MemoryManager |
|
TRITONBACKEND_Model |
|
TRITONBACKEND_ModelInstance |
|
TRITONBACKEND_Output |
|
TRITONBACKEND_Request |
|
TRITONBACKEND_Response |
|
TRITONBACKEND_ResponseFactory |
|
TRITONBACKEND_State |
|
TRITONREPOAGENT_Agent |
|
TRITONREPOAGENT_AgentModel |
|
TRITONSERVER_BufferAttributes |
|
TRITONSERVER_Error |
|
TRITONSERVER_InferenceRequest |
|
TRITONSERVER_InferenceRequestReleaseFn_t |
Type for inference request release callback function.
|
TRITONSERVER_InferenceResponse |
|
TRITONSERVER_InferenceResponseCompleteFn_t |
Type for callback function indicating that an inference response
has completed.
|
TRITONSERVER_InferenceTrace |
|
TRITONSERVER_InferenceTraceActivityFn_t |
Type for trace timeline activity callback function.
|
TRITONSERVER_InferenceTraceReleaseFn_t |
Type for trace release callback function.
|
TRITONSERVER_InferenceTraceTensorActivityFn_t |
Type for trace tensor activity callback function.
|
TRITONSERVER_Message |
|
TRITONSERVER_Metric |
|
TRITONSERVER_MetricFamily |
|
TRITONSERVER_Metrics |
|
TRITONSERVER_Parameter |
|
TRITONSERVER_ResponseAllocator |
|
TRITONSERVER_ResponseAllocatorAllocFn_t |
TRITONSERVER_ResponseAllocator
Object representing a memory allocator for output tensors in an
inference response.
|
TRITONSERVER_ResponseAllocatorBufferAttributesFn_t |
Type for allocation function that allocates a buffer to hold an
output tensor with buffer attributes.
|
TRITONSERVER_ResponseAllocatorQueryFn_t |
Type for function that is called to query the allocator's preferred memory
type and memory type ID.
|
TRITONSERVER_ResponseAllocatorReleaseFn_t |
Type for function that is called when the server no longer holds
any reference to a buffer allocated by
TRITONSERVER_ResponseAllocatorAllocFn_t.
|
TRITONSERVER_ResponseAllocatorStartFn_t |
Type for function that is called to indicate that subsequent
allocation requests will refer to a new response.
|
TRITONSERVER_Server |
|
TRITONSERVER_ServerOptions |
|