A B C D E F G H I L M N O P R S T U V W

A

AddInput(BytePointer, Tensor) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.GenericInferRequest

Add an input tensor to be sent within an InferRequest object.

AddInput(String, Tensor) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.GenericInferRequest

AddRequestedOutput(BytePointer, Tensor) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.GenericInferRequest

Add a requested output to be sent within an InferRequest object.

AddRequestedOutput(String, Tensor) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.GenericInferRequest

AddRequestedOutput(BytePointer) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.GenericInferRequest

Add a requested output to be sent within an InferRequest object.

AddRequestedOutput(String) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.GenericInferRequest

Allocator - Class in org.bytedeco.tritonserver.tritondevelopertoolsserver

Custom Allocator object for providing custom functions for allocator.

Allocator(Pointer) - Constructor for class org.bytedeco.tritonserver.tritondevelopertoolsserver.Allocator

Pointer cast constructor.

Allocator(ResponseAllocatorAllocFn_t, OutputBufferReleaseFn_t, ResponseAllocatorStartFn_t) - Constructor for class org.bytedeco.tritonserver.tritondevelopertoolsserver.Allocator

Allocator(ResponseAllocatorAllocFn_t, OutputBufferReleaseFn_t) - Constructor for class org.bytedeco.tritonserver.tritondevelopertoolsserver.Allocator

AllocFn() - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.Allocator

allow_cpu_metrics_() - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.MetricsOptions

allow_cpu_metrics_(boolean) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.MetricsOptions

allow_gpu_metrics_() - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.MetricsOptions

allow_gpu_metrics_(boolean) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.MetricsOptions

allow_metrics_() - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.MetricsOptions

allow_metrics_(boolean) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.MetricsOptions

B

back() - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.StringVector

backend_dir_() - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.ServerOptions

backend_dir_(BytePointer) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.ServerOptions

BackendConfig - Class in org.bytedeco.tritonserver.tritondevelopertoolsserver

Structure to hold backend configuration for setting 'ServerOptions'.

BackendConfig(Pointer) - Constructor for class org.bytedeco.tritonserver.tritondevelopertoolsserver.BackendConfig

Pointer cast constructor.

BackendConfig(BytePointer, BytePointer, BytePointer) - Constructor for class org.bytedeco.tritonserver.tritondevelopertoolsserver.BackendConfig

BackendConfig(String, String, String) - Constructor for class org.bytedeco.tritonserver.tritondevelopertoolsserver.BackendConfig

be_config_() - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.ServerOptions

be_config_(BackendConfig) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.ServerOptions

begin() - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.StringSet

begin() - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.StringVector

BF16 - Static variable in class org.bytedeco.tritonserver.global.tritondevelopertoolsserver

enum class triton::developer_tools::server::DataType

BOOL - Static variable in class org.bytedeco.tritonserver.global.tritondevelopertoolsserver

enum class triton::developer_tools::server::DataType

buffer_() - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.Tensor

buffer_(BytePointer) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.Tensor

buffer_manager_thread_count_() - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.ServerOptions

buffer_manager_thread_count_(int) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.ServerOptions

byte_size_() - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.Tensor

byte_size_(long) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.Tensor

BYTES - Static variable in class org.bytedeco.tritonserver.global.tritondevelopertoolsserver

enum class triton::developer_tools::server::DataType

C

call(Pointer, long, int, long) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.OutputBufferReleaseFn_t

call(String, long, int, long, PointerPointer, IntPointer, LongPointer) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.ResponseAllocatorAllocFn_t

call(Pointer) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.ResponseAllocatorStartFn_t

call(TRITONSERVER_InferenceRequest, int, Pointer) - Method in class org.bytedeco.tritonserver.tritonserver.TRITONSERVER_InferenceRequestReleaseFn_t

call(TRITONSERVER_InferenceResponse, int, Pointer) - Method in class org.bytedeco.tritonserver.tritonserver.TRITONSERVER_InferenceResponseCompleteFn_t

call(TRITONSERVER_InferenceTrace, int, long, Pointer) - Method in class org.bytedeco.tritonserver.tritonserver.TRITONSERVER_InferenceTraceActivityFn_t

call(TRITONSERVER_InferenceTrace, Pointer) - Method in class org.bytedeco.tritonserver.tritonserver.TRITONSERVER_InferenceTraceReleaseFn_t

call(TRITONSERVER_InferenceTrace, int, String, int, Pointer, long, LongPointer, long, int, long, Pointer) - Method in class org.bytedeco.tritonserver.tritonserver.TRITONSERVER_InferenceTraceTensorActivityFn_t

call(TRITONSERVER_ResponseAllocator, String, long, int, long, Pointer, PointerPointer, PointerPointer, IntPointer, LongPointer) - Method in class org.bytedeco.tritonserver.tritonserver.TRITONSERVER_ResponseAllocatorAllocFn_t

call(TRITONSERVER_ResponseAllocator, String, TRITONSERVER_BufferAttributes, Pointer, Pointer) - Method in class org.bytedeco.tritonserver.tritonserver.TRITONSERVER_ResponseAllocatorBufferAttributesFn_t

call(TRITONSERVER_ResponseAllocator, Pointer, String, SizeTPointer, IntPointer, LongPointer) - Method in class org.bytedeco.tritonserver.tritonserver.TRITONSERVER_ResponseAllocatorQueryFn_t

call(TRITONSERVER_ResponseAllocator, Pointer, Pointer, long, int, long) - Method in class org.bytedeco.tritonserver.tritonserver.TRITONSERVER_ResponseAllocatorReleaseFn_t

call(TRITONSERVER_ResponseAllocator, Pointer) - Method in class org.bytedeco.tritonserver.tritonserver.TRITONSERVER_ResponseAllocatorStartFn_t

clear() - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.StringVector

correlation_id_() - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.InferOptions

correlation_id_(long) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.InferOptions

correlation_id_str_() - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.InferOptions

correlation_id_str_(BytePointer) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.InferOptions

count_() - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.RateLimitResource

count_(int) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.RateLimitResource

count_() - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.Trace

count_(int) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.Trace

CPU - Static variable in class org.bytedeco.tritonserver.global.tritondevelopertoolsserver

enum class triton::developer_tools::server::MemoryType

CPU_CORES - Static variable in class org.bytedeco.tritonserver.tritondevelopertoolsserver.HostPolicy

enum class triton::developer_tools::server::HostPolicy::Setting

CPU_PINNED - Static variable in class org.bytedeco.tritonserver.global.tritondevelopertoolsserver

enum class triton::developer_tools::server::MemoryType

Create(InferOptions) - Static method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.GenericInferRequest

Create an InferRequest instance.

Create(ServerOptions) - Static method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.GenericTritonServer

Create a GenericTritonServer instance.

cuda_memory_pool_byte_size_() - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.ServerOptions

cuda_memory_pool_byte_size_(CUDAMemoryPoolByteSize) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.ServerOptions

CUDAMemoryPoolByteSize - Class in org.bytedeco.tritonserver.tritondevelopertoolsserver

Structure to hold CUDA memory pool byte size for setting 'ServerOptions'.

CUDAMemoryPoolByteSize(Pointer) - Constructor for class org.bytedeco.tritonserver.tritondevelopertoolsserver.CUDAMemoryPoolByteSize

Pointer cast constructor.

CUDAMemoryPoolByteSize(int, long) - Constructor for class org.bytedeco.tritonserver.tritondevelopertoolsserver.CUDAMemoryPoolByteSize

custom_allocator_() - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.InferOptions

custom_allocator_(Allocator) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.InferOptions

D

data_type_() - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.Tensor

data_type_(int) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.Tensor

DebugString() - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.GenericInferResult

Return the complete response as a user friendly string.

DEFAULT - Static variable in class org.bytedeco.tritonserver.tritondevelopertoolsserver.LoggingOptions

enum class triton::developer_tools::server::LoggingOptions::LogFormat

device_() - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.RateLimitResource

device_(int) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.RateLimitResource

device_id_() - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.ModelLoadGPULimit

device_id_(int) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.ModelLoadGPULimit

disable_auto_complete_config_() - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.ServerOptions

disable_auto_complete_config_(boolean) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.ServerOptions

E

empty() - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.StringSet

empty() - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.StringVector

end() - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.StringSet

end() - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.StringVector

equals(StringSet.Iterator) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.StringSet.Iterator

equals(StringVector.Iterator) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.StringVector.Iterator

erase(BytePointer) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.StringSet

erase(StringVector.Iterator) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.StringVector

error_() - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.LoggingOptions

error_(boolean) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.LoggingOptions

ErrorMsg() - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.GenericInferResult

Return the error message of the error.

exit_on_error_() - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.ServerOptions

exit_on_error_(boolean) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.ServerOptions

exit_timeout_secs_() - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.ServerOptions

exit_timeout_secs_(int) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.ServerOptions

EXPLICIT - Static variable in class org.bytedeco.tritonserver.global.tritondevelopertoolsserver

enum class triton::developer_tools::server::ModelControlMode

F

file_() - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.Trace

file_(BytePointer) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.Trace

format_() - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.LoggingOptions

format_(int) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.LoggingOptions

FP16 - Static variable in class org.bytedeco.tritonserver.global.tritondevelopertoolsserver

enum class triton::developer_tools::server::DataType

FP32 - Static variable in class org.bytedeco.tritonserver.global.tritondevelopertoolsserver

enum class triton::developer_tools::server::DataType

FP64 - Static variable in class org.bytedeco.tritonserver.global.tritondevelopertoolsserver

enum class triton::developer_tools::server::DataType

fraction_() - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.ModelLoadGPULimit

fraction_(double) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.ModelLoadGPULimit

front() - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.StringSet

front() - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.StringVector

G

GenericInferRequest - Class in org.bytedeco.tritonserver.tritondevelopertoolsserver

Object that describes an inflight inference request.

GenericInferRequest(Pointer) - Constructor for class org.bytedeco.tritonserver.tritondevelopertoolsserver.GenericInferRequest

Pointer cast constructor.

GenericInferResult - Class in org.bytedeco.tritonserver.tritondevelopertoolsserver

An interface for InferResult object to interpret the response to an inference request.

GenericInferResult(Pointer) - Constructor for class org.bytedeco.tritonserver.tritondevelopertoolsserver.GenericInferResult

Pointer cast constructor.

GenericTritonServer - Class in org.bytedeco.tritonserver.tritondevelopertoolsserver

Object that encapsulates in-process C API functionalities.

GenericTritonServer(Pointer) - Constructor for class org.bytedeco.tritonserver.tritondevelopertoolsserver.GenericTritonServer

Pointer cast constructor.

get() - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.StringSet.Iterator

get(long) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.StringVector

get() - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.StringVector

get() - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.StringVector.Iterator

getPointer(long) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.LoggingOptions

getPointer(long) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.MetricsOptions

GPU - Static variable in class org.bytedeco.tritonserver.global.tritondevelopertoolsserver

enum class triton::developer_tools::server::MemoryType

gpu_device_() - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.CUDAMemoryPoolByteSize

gpu_device_(int) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.CUDAMemoryPoolByteSize

H

HasError() - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.GenericInferResult

Return if there is an error within this result.

host_policy_() - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.ServerOptions

host_policy_(HostPolicy) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.ServerOptions

HostPolicy - Class in org.bytedeco.tritonserver.tritondevelopertoolsserver

Structure to hold host policy for setting 'ServerOptions'.

HostPolicy(Pointer) - Constructor for class org.bytedeco.tritonserver.tritondevelopertoolsserver.HostPolicy

Pointer cast constructor.

HostPolicy(BytePointer, int, BytePointer) - Constructor for class org.bytedeco.tritonserver.tritondevelopertoolsserver.HostPolicy

HostPolicy(String, int, String) - Constructor for class org.bytedeco.tritonserver.tritondevelopertoolsserver.HostPolicy

I

Id() - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.GenericInferResult

Get the id of the request which generated this response.

increment() - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.StringSet.Iterator

increment() - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.StringVector.Iterator

Infer(GenericInferRequest) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.GenericTritonServer

InferOptions - Class in org.bytedeco.tritonserver.tritondevelopertoolsserver

Structure to hold options for Inference Request.

InferOptions(Pointer) - Constructor for class org.bytedeco.tritonserver.tritondevelopertoolsserver.InferOptions

Pointer cast constructor.

InferOptions(BytePointer) - Constructor for class org.bytedeco.tritonserver.tritondevelopertoolsserver.InferOptions

InferOptions(String) - Constructor for class org.bytedeco.tritonserver.tritondevelopertoolsserver.InferOptions

InferOptions(BytePointer, long, BytePointer, long, BytePointer, boolean, boolean, long, long, Allocator, Trace) - Constructor for class org.bytedeco.tritonserver.tritondevelopertoolsserver.InferOptions

InferOptions(String, long, String, long, String, boolean, boolean, long, long, Allocator, Trace) - Constructor for class org.bytedeco.tritonserver.tritondevelopertoolsserver.InferOptions

info_() - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.LoggingOptions

info_(boolean) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.LoggingOptions

insert(BytePointer) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.StringSet

insert(StringVector.Iterator, BytePointer) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.StringVector

INT16 - Static variable in class org.bytedeco.tritonserver.global.tritondevelopertoolsserver

enum class triton::developer_tools::server::DataType

INT32 - Static variable in class org.bytedeco.tritonserver.global.tritondevelopertoolsserver

enum class triton::developer_tools::server::DataType

INT64 - Static variable in class org.bytedeco.tritonserver.global.tritondevelopertoolsserver

enum class triton::developer_tools::server::DataType

INT8 - Static variable in class org.bytedeco.tritonserver.global.tritondevelopertoolsserver

enum class triton::developer_tools::server::DataType

INVALID - Static variable in class org.bytedeco.tritonserver.global.tritondevelopertoolsserver

enum class triton::developer_tools::server::DataType

IsModelReady(BytePointer, long) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.GenericTritonServer

Is the model ready?

IsModelReady(BytePointer) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.GenericTritonServer

IsModelReady(String, long) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.GenericTritonServer

IsModelReady(String) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.GenericTritonServer

ISO8601 - Static variable in class org.bytedeco.tritonserver.tritondevelopertoolsserver.LoggingOptions

enum class triton::developer_tools::server::LoggingOptions::LogFormat

IsServerLive() - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.GenericTritonServer

Is the server live?

IsServerReady() - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.GenericTritonServer

Is the server ready?

Iterator(Pointer) - Constructor for class org.bytedeco.tritonserver.tritondevelopertoolsserver.StringSet.Iterator

Iterator() - Constructor for class org.bytedeco.tritonserver.tritondevelopertoolsserver.StringSet.Iterator

Iterator(Pointer) - Constructor for class org.bytedeco.tritonserver.tritondevelopertoolsserver.StringVector.Iterator

Iterator() - Constructor for class org.bytedeco.tritonserver.tritondevelopertoolsserver.StringVector.Iterator

L

level_() - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.Trace

level_(int) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.Trace

LoadedModels() - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.GenericTritonServer

Get the set of names of models that are loaded and ready for inference.

LOADING - Static variable in class org.bytedeco.tritonserver.global.tritondevelopertoolsserver

enum class triton::developer_tools::server::ModelReadyState

LoadModel(BytePointer) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.GenericTritonServer

Load the requested model or reload the model if it is already loaded.

LoadModel(String) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.GenericTritonServer

log_file_() - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.LoggingOptions

log_file_(BytePointer) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.LoggingOptions

log_frequency_() - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.Trace

log_frequency_(int) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.Trace

logging_() - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.ServerOptions

logging_(LoggingOptions) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.ServerOptions

LoggingOptions - Class in org.bytedeco.tritonserver.tritondevelopertoolsserver

Structure to hold logging options for setting 'ServerOptions'.

LoggingOptions(Pointer) - Constructor for class org.bytedeco.tritonserver.tritondevelopertoolsserver.LoggingOptions

Pointer cast constructor.

LoggingOptions(long) - Constructor for class org.bytedeco.tritonserver.tritondevelopertoolsserver.LoggingOptions

Native array allocator.

LoggingOptions() - Constructor for class org.bytedeco.tritonserver.tritondevelopertoolsserver.LoggingOptions

LoggingOptions(int, boolean, boolean, boolean, int, BytePointer) - Constructor for class org.bytedeco.tritonserver.tritondevelopertoolsserver.LoggingOptions

LoggingOptions(int, boolean, boolean, boolean, int, String) - Constructor for class org.bytedeco.tritonserver.tritondevelopertoolsserver.LoggingOptions

M

map(InfoMap) - Method in class org.bytedeco.tritonserver.presets.tritondevelopertoolsserver

map(InfoMap) - Method in class org.bytedeco.tritonserver.presets.tritonserver

MAX - Static variable in class org.bytedeco.tritonserver.tritondevelopertoolsserver.LoggingOptions

enum class triton::developer_tools::server::LoggingOptions::VerboseLevel

memory_type_() - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.Tensor

memory_type_(int) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.Tensor

memory_type_id_() - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.Tensor

memory_type_id_(long) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.Tensor

message_() - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.TritonException

message_(BytePointer) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.TritonException

metrics_() - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.ServerOptions

metrics_(MetricsOptions) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.ServerOptions

metrics_interval_ms_() - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.MetricsOptions

metrics_interval_ms_(long) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.MetricsOptions

MetricsOptions - Class in org.bytedeco.tritonserver.tritondevelopertoolsserver

Structure to hold metrics options for setting 'ServerOptions'.

MetricsOptions(Pointer) - Constructor for class org.bytedeco.tritonserver.tritondevelopertoolsserver.MetricsOptions

Pointer cast constructor.

MetricsOptions(long) - Constructor for class org.bytedeco.tritonserver.tritondevelopertoolsserver.MetricsOptions

Native array allocator.

MetricsOptions() - Constructor for class org.bytedeco.tritonserver.tritondevelopertoolsserver.MetricsOptions

MetricsOptions(boolean, boolean, boolean, long) - Constructor for class org.bytedeco.tritonserver.tritondevelopertoolsserver.MetricsOptions

MIN - Static variable in class org.bytedeco.tritonserver.tritondevelopertoolsserver.LoggingOptions

enum class triton::developer_tools::server::LoggingOptions::VerboseLevel

min_cuda_compute_capability_() - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.ServerOptions

min_cuda_compute_capability_(double) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.ServerOptions

model_control_mode_() - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.ServerOptions

model_control_mode_(int) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.ServerOptions

model_load_gpu_limit_() - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.ServerOptions

model_load_gpu_limit_(ModelLoadGPULimit) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.ServerOptions

model_load_thread_count_() - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.ServerOptions

model_load_thread_count_(int) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.ServerOptions

model_name_() - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.InferOptions

model_name_(BytePointer) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.InferOptions

model_repository_paths_() - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.ServerOptions

model_repository_paths_(StringVector) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.ServerOptions

model_version_() - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.InferOptions

model_version_(long) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.InferOptions

ModelConfig(BytePointer, long) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.GenericTritonServer

Get the configuration of specified model.

ModelConfig(BytePointer) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.GenericTritonServer

ModelConfig(String, long) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.GenericTritonServer

ModelConfig(String) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.GenericTritonServer

ModelIndex() - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.GenericTritonServer

Get the index of model repository contents.

ModelLoadGPULimit - Class in org.bytedeco.tritonserver.tritondevelopertoolsserver

Structure to hold GPU limit of model loading for setting 'ServerOptions'.

ModelLoadGPULimit(Pointer) - Constructor for class org.bytedeco.tritonserver.tritondevelopertoolsserver.ModelLoadGPULimit

Pointer cast constructor.

ModelLoadGPULimit(int, double) - Constructor for class org.bytedeco.tritonserver.tritondevelopertoolsserver.ModelLoadGPULimit

ModelMetadata(BytePointer, long) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.GenericTritonServer

Get the metadata of specified model.

ModelMetadata(BytePointer) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.GenericTritonServer

ModelMetadata(String, long) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.GenericTritonServer

ModelMetadata(String) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.GenericTritonServer

ModelName() - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.GenericInferResult

Get the name of the model which generated this response.

ModelStatistics(BytePointer, long) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.GenericTritonServer

Get the inference statistics of the specified model.

ModelStatistics(String, long) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.GenericTritonServer

ModelVersion() - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.GenericInferResult

Get the version of the model which generated this response.

N

name_() - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.BackendConfig

name_(BytePointer) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.BackendConfig

name_() - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.HostPolicy

name_(BytePointer) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.HostPolicy

name_() - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.RateLimitResource

name_(BytePointer) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.RateLimitResource

name_() - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.RepositoryIndex

name_(BytePointer) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.RepositoryIndex

NewModelRepo - Class in org.bytedeco.tritonserver.tritondevelopertoolsserver

Structure to hold the full path to the model repository to be registered and the mapping from the original model name to the overridden one.

NewModelRepo(Pointer) - Constructor for class org.bytedeco.tritonserver.tritondevelopertoolsserver.NewModelRepo

Pointer cast constructor.

NewModelRepo(BytePointer) - Constructor for class org.bytedeco.tritonserver.tritondevelopertoolsserver.NewModelRepo

NewModelRepo(String) - Constructor for class org.bytedeco.tritonserver.tritondevelopertoolsserver.NewModelRepo

NewModelRepo(BytePointer, BytePointer, BytePointer) - Constructor for class org.bytedeco.tritonserver.tritondevelopertoolsserver.NewModelRepo

NewModelRepo(String, String, String) - Constructor for class org.bytedeco.tritonserver.tritondevelopertoolsserver.NewModelRepo

NONE - Static variable in class org.bytedeco.tritonserver.global.tritondevelopertoolsserver

enum class triton::developer_tools::server::ModelControlMode

NUMA_NODE - Static variable in class org.bytedeco.tritonserver.tritondevelopertoolsserver.HostPolicy

enum class triton::developer_tools::server::HostPolicy::Setting

O

OFF - Static variable in class org.bytedeco.tritonserver.tritondevelopertoolsserver.LoggingOptions

enum class triton::developer_tools::server::LoggingOptions::VerboseLevel

OFF - Static variable in class org.bytedeco.tritonserver.tritondevelopertoolsserver.Trace

enum class triton::developer_tools::server::Trace::Level

org.bytedeco.tritonserver.global - package org.bytedeco.tritonserver.global

org.bytedeco.tritonserver.presets - package org.bytedeco.tritonserver.presets

org.bytedeco.tritonserver.tritondevelopertoolsserver - package org.bytedeco.tritonserver.tritondevelopertoolsserver

org.bytedeco.tritonserver.tritonserver - package org.bytedeco.tritonserver.tritonserver

original_name_() - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.NewModelRepo

original_name_(BytePointer) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.NewModelRepo

Output(BytePointer) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.GenericInferResult

Get the result output as a shared pointer of 'Tensor' object.

Output(String) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.GenericInferResult

OutputBufferReleaseFn_t - Class in org.bytedeco.tritonserver.tritondevelopertoolsserver

OutputBufferReleaseFn_t(Pointer) - Constructor for class org.bytedeco.tritonserver.tritondevelopertoolsserver.OutputBufferReleaseFn_t

Pointer cast constructor.

OutputBufferReleaseFn_t() - Constructor for class org.bytedeco.tritonserver.tritondevelopertoolsserver.OutputBufferReleaseFn_t

OutputNames() - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.GenericInferResult

Get the output names from the infer result

override_name_() - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.NewModelRepo

override_name_(BytePointer) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.NewModelRepo

P

path_() - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.NewModelRepo

path_(BytePointer) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.NewModelRepo

pinned_memory_pool_byte_size_() - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.ServerOptions

pinned_memory_pool_byte_size_(long) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.ServerOptions

POLL - Static variable in class org.bytedeco.tritonserver.global.tritondevelopertoolsserver

enum class triton::developer_tools::server::ModelControlMode

pop_back() - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.StringVector

position(long) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.LoggingOptions

position(long) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.MetricsOptions

priority_() - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.InferOptions

priority_(long) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.InferOptions

push_back(BytePointer) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.StringVector

push_back(String) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.StringVector

put(StringSet) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.StringSet

put(StringVector) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.StringVector

put(long, BytePointer) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.StringVector

put(long, String) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.StringVector

put(BytePointer) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.StringVector

put(BytePointer...) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.StringVector

put(String) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.StringVector

put(String...) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.StringVector

R

rate_() - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.Trace

rate_(int) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.Trace

rate_limit_resource_() - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.ServerOptions

rate_limit_resource_(RateLimitResource) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.ServerOptions

RateLimitResource - Class in org.bytedeco.tritonserver.tritondevelopertoolsserver

Structure to hold rate limit resource for setting 'ServerOptions'.

RateLimitResource(Pointer) - Constructor for class org.bytedeco.tritonserver.tritondevelopertoolsserver.RateLimitResource

Pointer cast constructor.

RateLimitResource(BytePointer, int) - Constructor for class org.bytedeco.tritonserver.tritondevelopertoolsserver.RateLimitResource

RateLimitResource(String, int) - Constructor for class org.bytedeco.tritonserver.tritondevelopertoolsserver.RateLimitResource

RateLimitResource(BytePointer, int, int) - Constructor for class org.bytedeco.tritonserver.tritondevelopertoolsserver.RateLimitResource

RateLimitResource(String, int, int) - Constructor for class org.bytedeco.tritonserver.tritondevelopertoolsserver.RateLimitResource

READY - Static variable in class org.bytedeco.tritonserver.global.tritondevelopertoolsserver

enum class triton::developer_tools::server::ModelReadyState

RegisterModelRepo(NewModelRepo) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.GenericTritonServer

Register a new model repository.

ReleaseFn() - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.Allocator

repo_agent_dir_() - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.ServerOptions

repo_agent_dir_(BytePointer) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.ServerOptions

repository_poll_secs_() - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.ServerOptions

repository_poll_secs_(int) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.ServerOptions

RepositoryIndex - Class in org.bytedeco.tritonserver.tritondevelopertoolsserver

Structure to hold repository index for 'ModelIndex' function.

RepositoryIndex(Pointer) - Constructor for class org.bytedeco.tritonserver.tritondevelopertoolsserver.RepositoryIndex

Pointer cast constructor.

RepositoryIndex(BytePointer, BytePointer, int) - Constructor for class org.bytedeco.tritonserver.tritondevelopertoolsserver.RepositoryIndex

RepositoryIndex(String, String, int) - Constructor for class org.bytedeco.tritonserver.tritondevelopertoolsserver.RepositoryIndex

request_id_() - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.InferOptions

request_id_(BytePointer) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.InferOptions

request_timeout_() - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.InferOptions

request_timeout_(long) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.InferOptions

Reset() - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.GenericInferRequest

Clear inputs and outputs of the request.

resize(long) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.StringVector

response_cache_byte_size_() - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.ServerOptions

response_cache_byte_size_(long) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.ServerOptions

ResponseAllocatorAllocFn_t - Class in org.bytedeco.tritonserver.tritondevelopertoolsserver

Custom Response Allocator Callback function signatures.

ResponseAllocatorAllocFn_t(Pointer) - Constructor for class org.bytedeco.tritonserver.tritondevelopertoolsserver.ResponseAllocatorAllocFn_t

Pointer cast constructor.

ResponseAllocatorAllocFn_t() - Constructor for class org.bytedeco.tritonserver.tritondevelopertoolsserver.ResponseAllocatorAllocFn_t

ResponseAllocatorStartFn_t - Class in org.bytedeco.tritonserver.tritondevelopertoolsserver

ResponseAllocatorStartFn_t(Pointer) - Constructor for class org.bytedeco.tritonserver.tritondevelopertoolsserver.ResponseAllocatorStartFn_t

Pointer cast constructor.

ResponseAllocatorStartFn_t() - Constructor for class org.bytedeco.tritonserver.tritondevelopertoolsserver.ResponseAllocatorStartFn_t

S

sequence_end_() - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.InferOptions

sequence_end_(boolean) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.InferOptions

sequence_start_() - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.InferOptions

sequence_start_(boolean) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.InferOptions

server_id_() - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.ServerOptions

server_id_(BytePointer) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.ServerOptions

ServerMetadata() - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.GenericTritonServer

Get the metadata of the server.

ServerMetrics() - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.GenericTritonServer

Get the metrics of the server.

ServerOptions - Class in org.bytedeco.tritonserver.tritondevelopertoolsserver

Server options that are used to initialize Triton Server.

ServerOptions(Pointer) - Constructor for class org.bytedeco.tritonserver.tritondevelopertoolsserver.ServerOptions

Pointer cast constructor.

ServerOptions(StringVector) - Constructor for class org.bytedeco.tritonserver.tritondevelopertoolsserver.ServerOptions

ServerOptions(StringVector, LoggingOptions, MetricsOptions, BackendConfig, BytePointer, BytePointer, BytePointer, boolean, int, int, StringSet, RateLimitResource, long, CUDAMemoryPoolByteSize, long, double, boolean, int, int, int, ModelLoadGPULimit, HostPolicy, Trace) - Constructor for class org.bytedeco.tritonserver.tritondevelopertoolsserver.ServerOptions

ServerOptions(StringVector, LoggingOptions, MetricsOptions, BackendConfig, String, String, String, boolean, int, int, StringSet, RateLimitResource, long, CUDAMemoryPoolByteSize, long, double, boolean, int, int, int, ModelLoadGPULimit, HostPolicy, Trace) - Constructor for class org.bytedeco.tritonserver.tritondevelopertoolsserver.ServerOptions

ServerStop() - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.GenericTritonServer

Stop a server object.

SetLoggingOptions(LoggingOptions) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.ServerOptions

setting_() - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.BackendConfig

setting_(BytePointer) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.BackendConfig

setting_() - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.HostPolicy

setting_(int) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.HostPolicy

SetVerboseLevel(int) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.LoggingOptions

shape_() - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.Tensor

shape_(LongPointer) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.Tensor

size() - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.StringSet

size() - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.StringVector

size_() - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.CUDAMemoryPoolByteSize

size_(long) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.CUDAMemoryPoolByteSize

StartFn() - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.Allocator

startup_models_() - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.ServerOptions

startup_models_(StringSet) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.ServerOptions

state_() - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.RepositoryIndex

state_(int) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.RepositoryIndex

StringData(BytePointer) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.GenericInferResult

Get the result data as a vector of strings.

StringData(String) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.GenericInferResult

StringSet - Class in org.bytedeco.tritonserver.tritondevelopertoolsserver

StringSet(Pointer) - Constructor for class org.bytedeco.tritonserver.tritondevelopertoolsserver.StringSet

Pointer cast constructor.

StringSet() - Constructor for class org.bytedeco.tritonserver.tritondevelopertoolsserver.StringSet

StringSet.Iterator - Class in org.bytedeco.tritonserver.tritondevelopertoolsserver

StringVector - Class in org.bytedeco.tritonserver.tritondevelopertoolsserver

StringVector(Pointer) - Constructor for class org.bytedeco.tritonserver.tritondevelopertoolsserver.StringVector

Pointer cast constructor.

StringVector(BytePointer) - Constructor for class org.bytedeco.tritonserver.tritondevelopertoolsserver.StringVector

StringVector(BytePointer...) - Constructor for class org.bytedeco.tritonserver.tritondevelopertoolsserver.StringVector

StringVector(String) - Constructor for class org.bytedeco.tritonserver.tritondevelopertoolsserver.StringVector

StringVector(String...) - Constructor for class org.bytedeco.tritonserver.tritondevelopertoolsserver.StringVector

StringVector() - Constructor for class org.bytedeco.tritonserver.tritondevelopertoolsserver.StringVector

StringVector(long) - Constructor for class org.bytedeco.tritonserver.tritondevelopertoolsserver.StringVector

StringVector.Iterator - Class in org.bytedeco.tritonserver.tritondevelopertoolsserver

T

Tensor - Class in org.bytedeco.tritonserver.tritondevelopertoolsserver

Structure to hold information of a tensor.

Tensor(Pointer) - Constructor for class org.bytedeco.tritonserver.tritondevelopertoolsserver.Tensor

Pointer cast constructor.

Tensor(BytePointer, long, int, LongPointer, int, long) - Constructor for class org.bytedeco.tritonserver.tritondevelopertoolsserver.Tensor

Tensor(ByteBuffer, long, int, LongBuffer, int, long) - Constructor for class org.bytedeco.tritonserver.tritondevelopertoolsserver.Tensor

Tensor(byte[], long, int, long[], int, long) - Constructor for class org.bytedeco.tritonserver.tritondevelopertoolsserver.Tensor

Tensor(BytePointer, long, int, long) - Constructor for class org.bytedeco.tritonserver.tritondevelopertoolsserver.Tensor

Tensor(ByteBuffer, long, int, long) - Constructor for class org.bytedeco.tritonserver.tritondevelopertoolsserver.Tensor

Tensor(byte[], long, int, long) - Constructor for class org.bytedeco.tritonserver.tritondevelopertoolsserver.Tensor

TENSORS - Static variable in class org.bytedeco.tritonserver.tritondevelopertoolsserver.Trace

enum class triton::developer_tools::server::Trace::Level

TIMESTAMPS - Static variable in class org.bytedeco.tritonserver.tritondevelopertoolsserver.Trace

enum class triton::developer_tools::server::Trace::Level

toString() - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.StringVector

Trace - Class in org.bytedeco.tritonserver.tritondevelopertoolsserver

Structure to hold global trace setting for 'ServerOptions' and model-specific trace setting for 'InferOptions'.

Trace(Pointer) - Constructor for class org.bytedeco.tritonserver.tritondevelopertoolsserver.Trace

Pointer cast constructor.

Trace(BytePointer, int) - Constructor for class org.bytedeco.tritonserver.tritondevelopertoolsserver.Trace

Trace(String, int) - Constructor for class org.bytedeco.tritonserver.tritondevelopertoolsserver.Trace

Trace(BytePointer, int, int, int, int) - Constructor for class org.bytedeco.tritonserver.tritondevelopertoolsserver.Trace

Trace(String, int, int, int, int) - Constructor for class org.bytedeco.tritonserver.tritondevelopertoolsserver.Trace

trace_() - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.InferOptions

trace_(Trace) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.InferOptions

trace_() - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.ServerOptions

trace_(Trace) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.ServerOptions

TRITONBACKEND_API_VERSION_MAJOR - Static variable in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND API Version The TRITONBACKEND API is versioned with major and minor version numbers.

TRITONBACKEND_API_VERSION_MINOR - Static variable in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_ApiVersion(IntPointer, IntPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Get the TRITONBACKEND API version supported by Triton.

TRITONBACKEND_ApiVersion(IntBuffer, IntBuffer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_ApiVersion(int[], int[]) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_ARTIFACT_FILESYSTEM - Static variable in class org.bytedeco.tritonserver.global.tritonserver

enum TRITONBACKEND_ArtifactType

TRITONBACKEND_Backend - Class in org.bytedeco.tritonserver.tritonserver

TRITONBACKEND_Backend() - Constructor for class org.bytedeco.tritonserver.tritonserver.TRITONBACKEND_Backend

Empty constructor.

TRITONBACKEND_Backend(Pointer) - Constructor for class org.bytedeco.tritonserver.tritonserver.TRITONBACKEND_Backend

Pointer cast constructor.

TRITONBACKEND_BackendArtifacts(TRITONBACKEND_Backend, IntPointer, PointerPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Get the location of the files that make up the backend implementation.

TRITONBACKEND_BackendArtifacts(TRITONBACKEND_Backend, IntPointer, BytePointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_BackendArtifacts(TRITONBACKEND_Backend, IntBuffer, ByteBuffer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_BackendArtifacts(TRITONBACKEND_Backend, int[], byte[]) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_BackendAttribute - Class in org.bytedeco.tritonserver.tritonserver

TRITONBACKEND_BackendAttribute() - Constructor for class org.bytedeco.tritonserver.tritonserver.TRITONBACKEND_BackendAttribute

Empty constructor.

TRITONBACKEND_BackendAttribute(Pointer) - Constructor for class org.bytedeco.tritonserver.tritonserver.TRITONBACKEND_BackendAttribute

Pointer cast constructor.

TRITONBACKEND_BackendAttributeAddPreferredInstanceGroup(TRITONBACKEND_BackendAttribute, int, long, LongPointer, long) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_BackendAttribute API to modify attributes associated with a backend.

TRITONBACKEND_BackendAttributeAddPreferredInstanceGroup(TRITONBACKEND_BackendAttribute, int, long, LongBuffer, long) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_BackendAttributeAddPreferredInstanceGroup(TRITONBACKEND_BackendAttribute, int, long, long[], long) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_BackendAttributeSetParallelModelInstanceLoading(TRITONBACKEND_BackendAttribute, boolean) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Sets whether or not the backend supports concurrently loading multiple TRITONBACKEND_ModelInstances in a thread-safe manner.

TRITONBACKEND_BackendConfig(TRITONBACKEND_Backend, PointerPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Get the backend configuration.

TRITONBACKEND_BackendConfig(TRITONBACKEND_Backend, TRITONSERVER_Message) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_BackendExecutionPolicy(TRITONBACKEND_Backend, IntPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Get the execution policy for this backend.

TRITONBACKEND_BackendExecutionPolicy(TRITONBACKEND_Backend, IntBuffer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_BackendExecutionPolicy(TRITONBACKEND_Backend, int[]) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_BackendMemoryManager(TRITONBACKEND_Backend, PointerPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Get the memory manager associated with a backend.

TRITONBACKEND_BackendMemoryManager(TRITONBACKEND_Backend, TRITONBACKEND_MemoryManager) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_BackendName(TRITONBACKEND_Backend, PointerPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Get the name of the backend.

TRITONBACKEND_BackendName(TRITONBACKEND_Backend, BytePointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_BackendName(TRITONBACKEND_Backend, ByteBuffer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_BackendName(TRITONBACKEND_Backend, byte[]) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_BackendSetExecutionPolicy(TRITONBACKEND_Backend, int) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Set the execution policy for this backend.

TRITONBACKEND_BackendSetState(TRITONBACKEND_Backend, Pointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Set the user-specified state associated with the backend.

TRITONBACKEND_BackendState(TRITONBACKEND_Backend, PointerPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Get the user-specified state associated with the backend.

TRITONBACKEND_BackendState(TRITONBACKEND_Backend, Pointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_Batcher - Class in org.bytedeco.tritonserver.tritonserver

TRITONBACKEND_Batcher() - Constructor for class org.bytedeco.tritonserver.tritonserver.TRITONBACKEND_Batcher

Empty constructor.

TRITONBACKEND_Batcher(Pointer) - Constructor for class org.bytedeco.tritonserver.tritonserver.TRITONBACKEND_Batcher

Pointer cast constructor.

TRITONBACKEND_EXECUTION_BLOCKING - Static variable in class org.bytedeco.tritonserver.global.tritonserver

enum TRITONBACKEND_ExecutionPolicy

TRITONBACKEND_EXECUTION_DEVICE_BLOCKING - Static variable in class org.bytedeco.tritonserver.global.tritonserver

enum TRITONBACKEND_ExecutionPolicy

TRITONBACKEND_Finalize(TRITONBACKEND_Backend) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Finalize for a backend.

TRITONBACKEND_GetBackendAttribute(TRITONBACKEND_Backend, TRITONBACKEND_BackendAttribute) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Query the backend for different model attributes.

TRITONBACKEND_InferenceRequestTimeoutMicroseconds(TRITONBACKEND_Request, LongPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Get the timeout of the request.

TRITONBACKEND_InferenceRequestTimeoutMicroseconds(TRITONBACKEND_Request, LongBuffer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_InferenceRequestTimeoutMicroseconds(TRITONBACKEND_Request, long[]) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_InferenceResponseOutput(TRITONBACKEND_Response, int, PointerPointer, IntPointer, PointerPointer, LongPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Get all information about an output tensor by its index.

TRITONBACKEND_InferenceResponseOutput(TRITONBACKEND_Response, int, BytePointer, IntPointer, LongPointer, LongPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_InferenceResponseOutput(TRITONBACKEND_Response, int, ByteBuffer, IntBuffer, LongBuffer, LongBuffer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_InferenceResponseOutput(TRITONBACKEND_Response, int, byte[], int[], long[], long[]) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_InferenceResponseOutputByName(TRITONBACKEND_Response, String, IntPointer, PointerPointer, LongPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Get all information about an output tensor by its name.

TRITONBACKEND_InferenceResponseOutputByName(TRITONBACKEND_Response, String, IntPointer, LongPointer, LongPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_InferenceResponseOutputByName(TRITONBACKEND_Response, BytePointer, IntBuffer, LongBuffer, LongBuffer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_InferenceResponseOutputByName(TRITONBACKEND_Response, String, int[], long[], long[]) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_InferenceResponseOutputByName(TRITONBACKEND_Response, BytePointer, IntPointer, LongPointer, LongPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_InferenceResponseOutputByName(TRITONBACKEND_Response, String, IntBuffer, LongBuffer, LongBuffer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_InferenceResponseOutputByName(TRITONBACKEND_Response, BytePointer, int[], long[], long[]) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_Initialize(TRITONBACKEND_Backend) - Static method in class org.bytedeco.tritonserver.global.tritonserver

The following functions can be implemented by a backend.

TRITONBACKEND_Input - Class in org.bytedeco.tritonserver.tritonserver

TRITONBACKEND_Input() - Constructor for class org.bytedeco.tritonserver.tritonserver.TRITONBACKEND_Input

Empty constructor.

TRITONBACKEND_Input(Pointer) - Constructor for class org.bytedeco.tritonserver.tritonserver.TRITONBACKEND_Input

Pointer cast constructor.

TRITONBACKEND_InputBuffer(TRITONBACKEND_Input, int, PointerPointer, LongPointer, IntPointer, LongPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Get a buffer holding (part of) the tensor data for an input.

TRITONBACKEND_InputBuffer(TRITONBACKEND_Input, int, Pointer, LongPointer, IntPointer, LongPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_InputBuffer(TRITONBACKEND_Input, int, Pointer, LongBuffer, IntBuffer, LongBuffer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_InputBuffer(TRITONBACKEND_Input, int, Pointer, long[], int[], long[]) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_InputBufferAttributes(TRITONBACKEND_Input, int, PointerPointer, PointerPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Get the buffer attributes associated with the given input buffer.

TRITONBACKEND_InputBufferAttributes(TRITONBACKEND_Input, int, Pointer, TRITONSERVER_BufferAttributes) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_InputBufferForHostPolicy(TRITONBACKEND_Input, String, int, PointerPointer, LongPointer, IntPointer, LongPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Get a buffer holding (part of) the tensor data for an input for a specific host policy.

TRITONBACKEND_InputBufferForHostPolicy(TRITONBACKEND_Input, String, int, Pointer, LongPointer, IntPointer, LongPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_InputBufferForHostPolicy(TRITONBACKEND_Input, BytePointer, int, Pointer, LongBuffer, IntBuffer, LongBuffer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_InputBufferForHostPolicy(TRITONBACKEND_Input, String, int, Pointer, long[], int[], long[]) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_InputBufferForHostPolicy(TRITONBACKEND_Input, BytePointer, int, Pointer, LongPointer, IntPointer, LongPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_InputBufferForHostPolicy(TRITONBACKEND_Input, String, int, Pointer, LongBuffer, IntBuffer, LongBuffer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_InputBufferForHostPolicy(TRITONBACKEND_Input, BytePointer, int, Pointer, long[], int[], long[]) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_InputProperties(TRITONBACKEND_Input, PointerPointer, IntPointer, PointerPointer, IntPointer, LongPointer, IntPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_Input Object representing an input tensor.

TRITONBACKEND_InputProperties(TRITONBACKEND_Input, BytePointer, IntPointer, LongPointer, IntPointer, LongPointer, IntPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_InputProperties(TRITONBACKEND_Input, ByteBuffer, IntBuffer, LongBuffer, IntBuffer, LongBuffer, IntBuffer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_InputProperties(TRITONBACKEND_Input, byte[], int[], long[], int[], long[], int[]) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_InputPropertiesForHostPolicy(TRITONBACKEND_Input, String, PointerPointer, IntPointer, PointerPointer, IntPointer, LongPointer, IntPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Get the name and properties of an input tensor associated with a given host policy.

TRITONBACKEND_InputPropertiesForHostPolicy(TRITONBACKEND_Input, String, BytePointer, IntPointer, LongPointer, IntPointer, LongPointer, IntPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_InputPropertiesForHostPolicy(TRITONBACKEND_Input, BytePointer, ByteBuffer, IntBuffer, LongBuffer, IntBuffer, LongBuffer, IntBuffer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_InputPropertiesForHostPolicy(TRITONBACKEND_Input, String, byte[], int[], long[], int[], long[], int[]) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_InputPropertiesForHostPolicy(TRITONBACKEND_Input, BytePointer, BytePointer, IntPointer, LongPointer, IntPointer, LongPointer, IntPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_InputPropertiesForHostPolicy(TRITONBACKEND_Input, String, ByteBuffer, IntBuffer, LongBuffer, IntBuffer, LongBuffer, IntBuffer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_InputPropertiesForHostPolicy(TRITONBACKEND_Input, BytePointer, byte[], int[], long[], int[], long[], int[]) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_MemoryManager - Class in org.bytedeco.tritonserver.tritonserver

TRITONBACKEND_MemoryManager() - Constructor for class org.bytedeco.tritonserver.tritonserver.TRITONBACKEND_MemoryManager

Empty constructor.

TRITONBACKEND_MemoryManager(Pointer) - Constructor for class org.bytedeco.tritonserver.tritonserver.TRITONBACKEND_MemoryManager

Pointer cast constructor.

TRITONBACKEND_MemoryManagerAllocate(TRITONBACKEND_MemoryManager, PointerPointer, int, long, long) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_MemoryManager Object representing an memory manager that is capable of allocating and otherwise managing different memory types.

TRITONBACKEND_MemoryManagerAllocate(TRITONBACKEND_MemoryManager, Pointer, int, long, long) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_MemoryManagerFree(TRITONBACKEND_MemoryManager, Pointer, int, long) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Free a buffer that was previously allocated with TRITONBACKEND_MemoryManagerAllocate.

TRITONBACKEND_Model - Class in org.bytedeco.tritonserver.tritonserver

TRITONBACKEND_Model() - Constructor for class org.bytedeco.tritonserver.tritonserver.TRITONBACKEND_Model

Empty constructor.

TRITONBACKEND_Model(Pointer) - Constructor for class org.bytedeco.tritonserver.tritonserver.TRITONBACKEND_Model

Pointer cast constructor.

TRITONBACKEND_ModelAutoCompleteConfig(TRITONBACKEND_Model, boolean[]) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Whether the backend should attempt to auto-complete the model configuration.

TRITONBACKEND_ModelAutoCompleteConfig(TRITONBACKEND_Model, BoolPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_ModelBackend(TRITONBACKEND_Model, PointerPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Get the backend used by the model.

TRITONBACKEND_ModelBackend(TRITONBACKEND_Model, TRITONBACKEND_Backend) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_ModelBatcherFinalize(TRITONBACKEND_Batcher) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Free memory associated with batcher.

TRITONBACKEND_ModelBatcherInitialize(PointerPointer, TRITONBACKEND_Model) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND Batching API to add custom batching strategy The following functions can be implemented by a backend to add custom batching conditionals on top of the existing Triton batching strategy.

TRITONBACKEND_ModelBatcherInitialize(TRITONBACKEND_Batcher, TRITONBACKEND_Model) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_ModelBatchFinalize(Pointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Callback to be invoked when Triton has finishing forming a batch.

TRITONBACKEND_ModelBatchIncludeRequest(TRITONBACKEND_Request, Pointer, boolean[]) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Check whether a request should be added to the pending model batch.

TRITONBACKEND_ModelBatchIncludeRequest(TRITONBACKEND_Request, Pointer, BoolPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_ModelBatchInitialize(TRITONBACKEND_Batcher, PointerPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_ModelBatchInitialize(TRITONBACKEND_Batcher, Pointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_ModelConfig(TRITONBACKEND_Model, int, PointerPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Get the model configuration.

TRITONBACKEND_ModelConfig(TRITONBACKEND_Model, int, TRITONSERVER_Message) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_ModelFinalize(TRITONBACKEND_Model) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Finalize for a model.

TRITONBACKEND_ModelInitialize(TRITONBACKEND_Model) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Initialize for a model.

TRITONBACKEND_ModelInstance - Class in org.bytedeco.tritonserver.tritonserver

TRITONBACKEND_ModelInstance() - Constructor for class org.bytedeco.tritonserver.tritonserver.TRITONBACKEND_ModelInstance

Empty constructor.

TRITONBACKEND_ModelInstance(Pointer) - Constructor for class org.bytedeco.tritonserver.tritonserver.TRITONBACKEND_ModelInstance

Pointer cast constructor.

TRITONBACKEND_ModelInstanceDeviceId(TRITONBACKEND_ModelInstance, IntPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Get the device ID of the model instance.

TRITONBACKEND_ModelInstanceDeviceId(TRITONBACKEND_ModelInstance, IntBuffer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_ModelInstanceDeviceId(TRITONBACKEND_ModelInstance, int[]) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_ModelInstanceExecute(TRITONBACKEND_ModelInstance, PointerPointer, int) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Execute a batch of one or more requests on a model instance.

TRITONBACKEND_ModelInstanceExecute(TRITONBACKEND_ModelInstance, TRITONBACKEND_Request, int) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_ModelInstanceFinalize(TRITONBACKEND_ModelInstance) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Finalize for a model instance.

TRITONBACKEND_ModelInstanceHostPolicy(TRITONBACKEND_ModelInstance, PointerPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Get the host policy setting.

TRITONBACKEND_ModelInstanceHostPolicy(TRITONBACKEND_ModelInstance, TRITONSERVER_Message) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_ModelInstanceInitialize(TRITONBACKEND_ModelInstance) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Initialize for a model instance.

TRITONBACKEND_ModelInstanceIsPassive(TRITONBACKEND_ModelInstance, boolean[]) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Whether the model instance is passive.

TRITONBACKEND_ModelInstanceIsPassive(TRITONBACKEND_ModelInstance, BoolPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_ModelInstanceKind(TRITONBACKEND_ModelInstance, IntPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Get the kind of the model instance.

TRITONBACKEND_ModelInstanceKind(TRITONBACKEND_ModelInstance, IntBuffer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_ModelInstanceKind(TRITONBACKEND_ModelInstance, int[]) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_ModelInstanceModel(TRITONBACKEND_ModelInstance, PointerPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Get the model associated with a model instance.

TRITONBACKEND_ModelInstanceModel(TRITONBACKEND_ModelInstance, TRITONBACKEND_Model) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_ModelInstanceName(TRITONBACKEND_ModelInstance, PointerPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_ModelInstance Object representing a model instance implemented using the backend.

TRITONBACKEND_ModelInstanceName(TRITONBACKEND_ModelInstance, BytePointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_ModelInstanceName(TRITONBACKEND_ModelInstance, ByteBuffer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_ModelInstanceName(TRITONBACKEND_ModelInstance, byte[]) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_ModelInstanceProfileCount(TRITONBACKEND_ModelInstance, IntPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Get the number of optimization profiles to be loaded for the instance.

TRITONBACKEND_ModelInstanceProfileCount(TRITONBACKEND_ModelInstance, IntBuffer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_ModelInstanceProfileCount(TRITONBACKEND_ModelInstance, int[]) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_ModelInstanceProfileName(TRITONBACKEND_ModelInstance, int, PointerPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Get the name of optimization profile.

TRITONBACKEND_ModelInstanceProfileName(TRITONBACKEND_ModelInstance, int, BytePointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_ModelInstanceProfileName(TRITONBACKEND_ModelInstance, int, ByteBuffer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_ModelInstanceProfileName(TRITONBACKEND_ModelInstance, int, byte[]) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_ModelInstanceReportBatchStatistics(TRITONBACKEND_ModelInstance, long, long, long, long, long) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Record statistics for the execution of an entire batch of inference requests.

TRITONBACKEND_ModelInstanceReportMemoryUsage(TRITONBACKEND_ModelInstance, PointerPointer, int) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Report the memory usage of the model instance that will be released on TRITONBACKEND_ModelInstanceFinalize.

TRITONBACKEND_ModelInstanceReportMemoryUsage(TRITONBACKEND_ModelInstance, TRITONSERVER_BufferAttributes, int) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_ModelInstanceReportResponseStatistics(TRITONBACKEND_ModelInstanceResponseStatistics) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Record statistics for an inference response.

TRITONBACKEND_ModelInstanceReportStatistics(TRITONBACKEND_ModelInstance, TRITONBACKEND_Request, boolean, long, long, long, long) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Record statistics for an inference request.

TRITONBACKEND_ModelInstanceResponseStatistics - Class in org.bytedeco.tritonserver.tritonserver

TRITONBACKEND_ModelInstanceResponseStatistics() - Constructor for class org.bytedeco.tritonserver.tritonserver.TRITONBACKEND_ModelInstanceResponseStatistics

Empty constructor.

TRITONBACKEND_ModelInstanceResponseStatistics(Pointer) - Constructor for class org.bytedeco.tritonserver.tritonserver.TRITONBACKEND_ModelInstanceResponseStatistics

Pointer cast constructor.

TRITONBACKEND_ModelInstanceResponseStatisticsDelete(TRITONBACKEND_ModelInstanceResponseStatistics) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Delete an inference response statistics object.

TRITONBACKEND_ModelInstanceResponseStatisticsNew(PointerPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Create a new inference response statistics object.

TRITONBACKEND_ModelInstanceResponseStatisticsNew(TRITONBACKEND_ModelInstanceResponseStatistics) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_ModelInstanceResponseStatisticsSetComputeOutputStart(TRITONBACKEND_ModelInstanceResponseStatistics, long) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Set compute output start time to an inference response statistics object.

TRITONBACKEND_ModelInstanceResponseStatisticsSetError(TRITONBACKEND_ModelInstanceResponseStatistics, TRITONSERVER_Error) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Set error to an inference response statistics object.

TRITONBACKEND_ModelInstanceResponseStatisticsSetModelInstance(TRITONBACKEND_ModelInstanceResponseStatistics, TRITONBACKEND_ModelInstance) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Set model instance to an inference response statistics object.

TRITONBACKEND_ModelInstanceResponseStatisticsSetResponseEnd(TRITONBACKEND_ModelInstanceResponseStatistics, long) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Set response end time to an inference response statistics object.

TRITONBACKEND_ModelInstanceResponseStatisticsSetResponseFactory(TRITONBACKEND_ModelInstanceResponseStatistics, TRITONBACKEND_ResponseFactory) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Set response factory to an inference response statistics object.

TRITONBACKEND_ModelInstanceResponseStatisticsSetResponseStart(TRITONBACKEND_ModelInstanceResponseStatistics, long) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Set response start time to an inference response statistics object.

TRITONBACKEND_ModelInstanceSecondaryDeviceCount(TRITONBACKEND_ModelInstance, IntPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Get the number of secondary devices configured for the instance.

TRITONBACKEND_ModelInstanceSecondaryDeviceCount(TRITONBACKEND_ModelInstance, IntBuffer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_ModelInstanceSecondaryDeviceCount(TRITONBACKEND_ModelInstance, int[]) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_ModelInstanceSecondaryDeviceProperties(TRITONBACKEND_ModelInstance, int, PointerPointer, LongPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Get the properties of indexed secondary device.

TRITONBACKEND_ModelInstanceSecondaryDeviceProperties(TRITONBACKEND_ModelInstance, int, BytePointer, LongPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_ModelInstanceSecondaryDeviceProperties(TRITONBACKEND_ModelInstance, int, ByteBuffer, LongBuffer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_ModelInstanceSecondaryDeviceProperties(TRITONBACKEND_ModelInstance, int, byte[], long[]) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_ModelInstanceSetState(TRITONBACKEND_ModelInstance, Pointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Set the user-specified state associated with the model instance.

TRITONBACKEND_ModelInstanceState(TRITONBACKEND_ModelInstance, PointerPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Get the user-specified state associated with the model instance.

TRITONBACKEND_ModelInstanceState(TRITONBACKEND_ModelInstance, Pointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_ModelName(TRITONBACKEND_Model, PointerPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_Model Object representing a model implemented using the backend.

TRITONBACKEND_ModelName(TRITONBACKEND_Model, BytePointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_ModelName(TRITONBACKEND_Model, ByteBuffer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_ModelName(TRITONBACKEND_Model, byte[]) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_ModelReportMemoryUsage(TRITONBACKEND_Model, PointerPointer, int) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Report the memory usage of the model that will be released on TRITONBACKEND_ModelFinalize.

TRITONBACKEND_ModelReportMemoryUsage(TRITONBACKEND_Model, TRITONSERVER_BufferAttributes, int) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_ModelRepository(TRITONBACKEND_Model, IntPointer, PointerPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Get the location of the files that make up the model.

TRITONBACKEND_ModelRepository(TRITONBACKEND_Model, IntPointer, BytePointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_ModelRepository(TRITONBACKEND_Model, IntBuffer, ByteBuffer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_ModelRepository(TRITONBACKEND_Model, int[], byte[]) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_ModelServer(TRITONBACKEND_Model, PointerPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Get the TRITONSERVER_Server object that this model is being served by.

TRITONBACKEND_ModelServer(TRITONBACKEND_Model, TRITONSERVER_Server) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_ModelSetConfig(TRITONBACKEND_Model, int, TRITONSERVER_Message) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Set the model configuration in Triton server.

TRITONBACKEND_ModelSetState(TRITONBACKEND_Model, Pointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Set the user-specified state associated with the model.

TRITONBACKEND_ModelState(TRITONBACKEND_Model, PointerPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Get the user-specified state associated with the model.

TRITONBACKEND_ModelState(TRITONBACKEND_Model, Pointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_ModelVersion(TRITONBACKEND_Model, LongPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Get the version of the model.

TRITONBACKEND_ModelVersion(TRITONBACKEND_Model, LongBuffer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_ModelVersion(TRITONBACKEND_Model, long[]) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_Output - Class in org.bytedeco.tritonserver.tritonserver

TRITONBACKEND_Output() - Constructor for class org.bytedeco.tritonserver.tritonserver.TRITONBACKEND_Output

Empty constructor.

TRITONBACKEND_Output(Pointer) - Constructor for class org.bytedeco.tritonserver.tritonserver.TRITONBACKEND_Output

Pointer cast constructor.

TRITONBACKEND_OutputBuffer(TRITONBACKEND_Output, PointerPointer, long, IntPointer, LongPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_Output Object representing a response output tensor.

TRITONBACKEND_OutputBuffer(TRITONBACKEND_Output, Pointer, long, IntPointer, LongPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_OutputBuffer(TRITONBACKEND_Output, Pointer, long, IntBuffer, LongBuffer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_OutputBuffer(TRITONBACKEND_Output, Pointer, long, int[], long[]) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_OutputBufferAttributes(TRITONBACKEND_Output, PointerPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Get the buffer attributes associated with the given output buffer.

TRITONBACKEND_OutputBufferAttributes(TRITONBACKEND_Output, TRITONSERVER_BufferAttributes) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_Request - Class in org.bytedeco.tritonserver.tritonserver

TRITONBACKEND_Request() - Constructor for class org.bytedeco.tritonserver.tritonserver.TRITONBACKEND_Request

Empty constructor.

TRITONBACKEND_Request(Pointer) - Constructor for class org.bytedeco.tritonserver.tritonserver.TRITONBACKEND_Request

Pointer cast constructor.

TRITONBACKEND_RequestCorrelationId(TRITONBACKEND_Request, LongPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Get the correlation ID of the request if it is an unsigned integer.

TRITONBACKEND_RequestCorrelationId(TRITONBACKEND_Request, LongBuffer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_RequestCorrelationId(TRITONBACKEND_Request, long[]) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_RequestCorrelationIdString(TRITONBACKEND_Request, PointerPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Get the correlation ID of the request if it is a string.

TRITONBACKEND_RequestCorrelationIdString(TRITONBACKEND_Request, BytePointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_RequestCorrelationIdString(TRITONBACKEND_Request, ByteBuffer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_RequestCorrelationIdString(TRITONBACKEND_Request, byte[]) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_RequestFlags(TRITONBACKEND_Request, IntPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Get the flag(s) associated with a request.

TRITONBACKEND_RequestFlags(TRITONBACKEND_Request, IntBuffer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_RequestFlags(TRITONBACKEND_Request, int[]) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_RequestId(TRITONBACKEND_Request, PointerPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_Request Object representing an inference request.

TRITONBACKEND_RequestId(TRITONBACKEND_Request, BytePointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_RequestId(TRITONBACKEND_Request, ByteBuffer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_RequestId(TRITONBACKEND_Request, byte[]) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_RequestInput(TRITONBACKEND_Request, String, PointerPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Get a named request input.

TRITONBACKEND_RequestInput(TRITONBACKEND_Request, String, TRITONBACKEND_Input) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_RequestInput(TRITONBACKEND_Request, BytePointer, TRITONBACKEND_Input) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_RequestInputByIndex(TRITONBACKEND_Request, int, PointerPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Get a request input by index.

TRITONBACKEND_RequestInputByIndex(TRITONBACKEND_Request, int, TRITONBACKEND_Input) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_RequestInputCount(TRITONBACKEND_Request, IntPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Get the number of input tensors specified in the request.

TRITONBACKEND_RequestInputCount(TRITONBACKEND_Request, IntBuffer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_RequestInputCount(TRITONBACKEND_Request, int[]) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_RequestInputName(TRITONBACKEND_Request, int, PointerPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Get the name of an input tensor.

TRITONBACKEND_RequestInputName(TRITONBACKEND_Request, int, BytePointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_RequestInputName(TRITONBACKEND_Request, int, ByteBuffer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_RequestInputName(TRITONBACKEND_Request, int, byte[]) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_RequestIsCancelled(TRITONBACKEND_Request, boolean[]) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Query whether the request is cancelled or not.

TRITONBACKEND_RequestIsCancelled(TRITONBACKEND_Request, BoolPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_RequestOutputBufferProperties(TRITONBACKEND_Request, String, SizeTPointer, IntPointer, LongPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Returns the preferred memory type and memory type ID of the output buffer for the request.

TRITONBACKEND_RequestOutputBufferProperties(TRITONBACKEND_Request, BytePointer, SizeTPointer, IntBuffer, LongBuffer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_RequestOutputBufferProperties(TRITONBACKEND_Request, String, SizeTPointer, int[], long[]) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_RequestOutputBufferProperties(TRITONBACKEND_Request, BytePointer, SizeTPointer, IntPointer, LongPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_RequestOutputBufferProperties(TRITONBACKEND_Request, String, SizeTPointer, IntBuffer, LongBuffer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_RequestOutputBufferProperties(TRITONBACKEND_Request, BytePointer, SizeTPointer, int[], long[]) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_RequestOutputCount(TRITONBACKEND_Request, IntPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Get the number of output tensors requested to be returned in the request.

TRITONBACKEND_RequestOutputCount(TRITONBACKEND_Request, IntBuffer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_RequestOutputCount(TRITONBACKEND_Request, int[]) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_RequestOutputName(TRITONBACKEND_Request, int, PointerPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Get the name of a requested output tensor.

TRITONBACKEND_RequestOutputName(TRITONBACKEND_Request, int, BytePointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_RequestOutputName(TRITONBACKEND_Request, int, ByteBuffer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_RequestOutputName(TRITONBACKEND_Request, int, byte[]) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_RequestParameter(TRITONBACKEND_Request, int, PointerPointer, IntPointer, PointerPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Get a request parameters by index.

TRITONBACKEND_RequestParameter(TRITONBACKEND_Request, int, BytePointer, IntPointer, Pointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_RequestParameter(TRITONBACKEND_Request, int, ByteBuffer, IntBuffer, Pointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_RequestParameter(TRITONBACKEND_Request, int, byte[], int[], Pointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_RequestParameterCount(TRITONBACKEND_Request, IntPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Get the number of parameters specified in the inference request.

TRITONBACKEND_RequestParameterCount(TRITONBACKEND_Request, IntBuffer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_RequestParameterCount(TRITONBACKEND_Request, int[]) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_RequestRelease(TRITONBACKEND_Request, int) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Release the request.

TRITONBACKEND_RequestTrace(TRITONBACKEND_Request, PointerPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Get the trace associated with a request.

TRITONBACKEND_RequestTrace(TRITONBACKEND_Request, TRITONSERVER_InferenceTrace) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_Response - Class in org.bytedeco.tritonserver.tritonserver

TRITONBACKEND_Response() - Constructor for class org.bytedeco.tritonserver.tritonserver.TRITONBACKEND_Response

Empty constructor.

TRITONBACKEND_Response(Pointer) - Constructor for class org.bytedeco.tritonserver.tritonserver.TRITONBACKEND_Response

Pointer cast constructor.

TRITONBACKEND_ResponseDelete(TRITONBACKEND_Response) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Destroy a response.

TRITONBACKEND_ResponseFactory - Class in org.bytedeco.tritonserver.tritonserver

TRITONBACKEND_ResponseFactory() - Constructor for class org.bytedeco.tritonserver.tritonserver.TRITONBACKEND_ResponseFactory

Empty constructor.

TRITONBACKEND_ResponseFactory(Pointer) - Constructor for class org.bytedeco.tritonserver.tritonserver.TRITONBACKEND_ResponseFactory

Pointer cast constructor.

TRITONBACKEND_ResponseFactoryDelete(TRITONBACKEND_ResponseFactory) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Destroy a response factory.

TRITONBACKEND_ResponseFactoryIsCancelled(TRITONBACKEND_ResponseFactory, boolean[]) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Query whether the response factory is cancelled or not.

TRITONBACKEND_ResponseFactoryIsCancelled(TRITONBACKEND_ResponseFactory, BoolPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_ResponseFactoryNew(PointerPointer, TRITONBACKEND_Request) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_ResponseFactory Object representing an inference response factory.

TRITONBACKEND_ResponseFactoryNew(TRITONBACKEND_ResponseFactory, TRITONBACKEND_Request) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_ResponseFactorySendFlags(TRITONBACKEND_ResponseFactory, int) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Send response flags without a corresponding response.

TRITONBACKEND_ResponseNew(PointerPointer, TRITONBACKEND_Request) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_Response Object representing an inference response.

TRITONBACKEND_ResponseNew(TRITONBACKEND_Response, TRITONBACKEND_Request) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_ResponseNewFromFactory(PointerPointer, TRITONBACKEND_ResponseFactory) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Create a response using a factory.

TRITONBACKEND_ResponseNewFromFactory(TRITONBACKEND_Response, TRITONBACKEND_ResponseFactory) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_ResponseOutput(TRITONBACKEND_Response, PointerPointer, String, int, LongPointer, int) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Create an output tensor in the response.

TRITONBACKEND_ResponseOutput(TRITONBACKEND_Response, TRITONBACKEND_Output, String, int, LongPointer, int) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_ResponseOutput(TRITONBACKEND_Response, TRITONBACKEND_Output, BytePointer, int, LongBuffer, int) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_ResponseOutput(TRITONBACKEND_Response, TRITONBACKEND_Output, String, int, long[], int) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_ResponseOutput(TRITONBACKEND_Response, TRITONBACKEND_Output, BytePointer, int, LongPointer, int) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_ResponseOutput(TRITONBACKEND_Response, TRITONBACKEND_Output, String, int, LongBuffer, int) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_ResponseOutput(TRITONBACKEND_Response, TRITONBACKEND_Output, BytePointer, int, long[], int) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_ResponseSend(TRITONBACKEND_Response, int, TRITONSERVER_Error) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Send a response.

TRITONBACKEND_ResponseSetBoolParameter(TRITONBACKEND_Response, String, boolean) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Set a boolean parameter in the response.

TRITONBACKEND_ResponseSetBoolParameter(TRITONBACKEND_Response, BytePointer, boolean) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_ResponseSetDoubleParameter(TRITONBACKEND_Response, String, double) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Set a double parameter in the response.

TRITONBACKEND_ResponseSetDoubleParameter(TRITONBACKEND_Response, BytePointer, double) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_ResponseSetIntParameter(TRITONBACKEND_Response, String, long) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Set an integer parameter in the response.

TRITONBACKEND_ResponseSetIntParameter(TRITONBACKEND_Response, BytePointer, long) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_ResponseSetStringParameter(TRITONBACKEND_Response, String, String) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Set a string parameter in the response.

TRITONBACKEND_ResponseSetStringParameter(TRITONBACKEND_Response, BytePointer, BytePointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_State - Class in org.bytedeco.tritonserver.tritonserver

TRITONBACKEND_State() - Constructor for class org.bytedeco.tritonserver.tritonserver.TRITONBACKEND_State

Empty constructor.

TRITONBACKEND_State(Pointer) - Constructor for class org.bytedeco.tritonserver.tritonserver.TRITONBACKEND_State

Pointer cast constructor.

TRITONBACKEND_StateBuffer(TRITONBACKEND_State, PointerPointer, long, IntPointer, LongPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Get a buffer to use to hold the tensor data for the state.

TRITONBACKEND_StateBuffer(TRITONBACKEND_State, Pointer, long, IntPointer, LongPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_StateBuffer(TRITONBACKEND_State, Pointer, long, IntBuffer, LongBuffer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_StateBuffer(TRITONBACKEND_State, Pointer, long, int[], long[]) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_StateBufferAttributes(TRITONBACKEND_State, PointerPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Get the buffer attributes associated with the given state buffer.

TRITONBACKEND_StateBufferAttributes(TRITONBACKEND_State, TRITONSERVER_BufferAttributes) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_StateNew(PointerPointer, TRITONBACKEND_Request, String, int, LongPointer, int) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_State Object representing a state.

TRITONBACKEND_StateNew(TRITONBACKEND_State, TRITONBACKEND_Request, String, int, LongPointer, int) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_StateNew(TRITONBACKEND_State, TRITONBACKEND_Request, BytePointer, int, LongBuffer, int) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_StateNew(TRITONBACKEND_State, TRITONBACKEND_Request, String, int, long[], int) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_StateNew(TRITONBACKEND_State, TRITONBACKEND_Request, BytePointer, int, LongPointer, int) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_StateNew(TRITONBACKEND_State, TRITONBACKEND_Request, String, int, LongBuffer, int) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_StateNew(TRITONBACKEND_State, TRITONBACKEND_Request, BytePointer, int, long[], int) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONBACKEND_StateUpdate(TRITONBACKEND_State) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Update the state for the sequence.

tritondevelopertoolsserver - Class in org.bytedeco.tritonserver.global

tritondevelopertoolsserver() - Constructor for class org.bytedeco.tritonserver.global.tritondevelopertoolsserver

tritondevelopertoolsserver - Class in org.bytedeco.tritonserver.presets

tritondevelopertoolsserver() - Constructor for class org.bytedeco.tritonserver.presets.tritondevelopertoolsserver

TritonException - Class in org.bytedeco.tritonserver.tritondevelopertoolsserver

TritonException(Pointer) - Constructor for class org.bytedeco.tritonserver.tritondevelopertoolsserver.TritonException

Pointer cast constructor.

TritonException(BytePointer) - Constructor for class org.bytedeco.tritonserver.tritondevelopertoolsserver.TritonException

TritonException(String) - Constructor for class org.bytedeco.tritonserver.tritondevelopertoolsserver.TritonException

TRITONREPOAGENT_ACTION_LOAD - Static variable in class org.bytedeco.tritonserver.global.tritonserver

enum TRITONREPOAGENT_ActionType

TRITONREPOAGENT_ACTION_LOAD_COMPLETE - Static variable in class org.bytedeco.tritonserver.global.tritonserver

enum TRITONREPOAGENT_ActionType

TRITONREPOAGENT_ACTION_LOAD_FAIL - Static variable in class org.bytedeco.tritonserver.global.tritonserver

enum TRITONREPOAGENT_ActionType

TRITONREPOAGENT_ACTION_UNLOAD - Static variable in class org.bytedeco.tritonserver.global.tritonserver

enum TRITONREPOAGENT_ActionType

TRITONREPOAGENT_ACTION_UNLOAD_COMPLETE - Static variable in class org.bytedeco.tritonserver.global.tritonserver

enum TRITONREPOAGENT_ActionType

TRITONREPOAGENT_Agent - Class in org.bytedeco.tritonserver.tritonserver

TRITONREPOAGENT_Agent() - Constructor for class org.bytedeco.tritonserver.tritonserver.TRITONREPOAGENT_Agent

Empty constructor.

TRITONREPOAGENT_Agent(Pointer) - Constructor for class org.bytedeco.tritonserver.tritonserver.TRITONREPOAGENT_Agent

Pointer cast constructor.

TRITONREPOAGENT_AgentModel - Class in org.bytedeco.tritonserver.tritonserver

TRITONREPOAGENT_AgentModel() - Constructor for class org.bytedeco.tritonserver.tritonserver.TRITONREPOAGENT_AgentModel

Empty constructor.

TRITONREPOAGENT_AgentModel(Pointer) - Constructor for class org.bytedeco.tritonserver.tritonserver.TRITONREPOAGENT_AgentModel

Pointer cast constructor.

TRITONREPOAGENT_API_VERSION_MAJOR - Static variable in class org.bytedeco.tritonserver.global.tritonserver

TRITONREPOAGENT API Version The TRITONREPOAGENT API is versioned with major and minor version numbers.

TRITONREPOAGENT_API_VERSION_MINOR - Static variable in class org.bytedeco.tritonserver.global.tritonserver

TRITONREPOAGENT_ApiVersion(IntPointer, IntPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Get the TRITONREPOAGENT API version supported by Triton.

TRITONREPOAGENT_ApiVersion(IntBuffer, IntBuffer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONREPOAGENT_ApiVersion(int[], int[]) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONREPOAGENT_ARTIFACT_FILESYSTEM - Static variable in class org.bytedeco.tritonserver.global.tritonserver

enum TRITONREPOAGENT_ArtifactType

TRITONREPOAGENT_ARTIFACT_REMOTE_FILESYSTEM - Static variable in class org.bytedeco.tritonserver.global.tritonserver

enum TRITONREPOAGENT_ArtifactType

TRITONREPOAGENT_Finalize(TRITONREPOAGENT_Agent) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Finalize for an agent.

TRITONREPOAGENT_Initialize(TRITONREPOAGENT_Agent) - Static method in class org.bytedeco.tritonserver.global.tritonserver

The following functions can be implemented by an agent.

TRITONREPOAGENT_ModelAction(TRITONREPOAGENT_Agent, TRITONREPOAGENT_AgentModel, int) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Handle an action for a specified model.

TRITONREPOAGENT_ModelConfig(TRITONREPOAGENT_Agent, TRITONREPOAGENT_AgentModel, int, PointerPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Get the model configuration.

TRITONREPOAGENT_ModelConfig(TRITONREPOAGENT_Agent, TRITONREPOAGENT_AgentModel, int, TRITONSERVER_Message) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONREPOAGENT_ModelFinalize(TRITONREPOAGENT_Agent, TRITONREPOAGENT_AgentModel) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Finalize for a model.

TRITONREPOAGENT_ModelInitialize(TRITONREPOAGENT_Agent, TRITONREPOAGENT_AgentModel) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Initialize a model associated with an agent.

TRITONREPOAGENT_ModelParameter(TRITONREPOAGENT_Agent, TRITONREPOAGENT_AgentModel, int, PointerPointer, PointerPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Get a parameter name and value.

TRITONREPOAGENT_ModelParameter(TRITONREPOAGENT_Agent, TRITONREPOAGENT_AgentModel, int, BytePointer, BytePointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONREPOAGENT_ModelParameter(TRITONREPOAGENT_Agent, TRITONREPOAGENT_AgentModel, int, ByteBuffer, ByteBuffer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONREPOAGENT_ModelParameter(TRITONREPOAGENT_Agent, TRITONREPOAGENT_AgentModel, int, byte[], byte[]) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONREPOAGENT_ModelParameterCount(TRITONREPOAGENT_Agent, TRITONREPOAGENT_AgentModel, IntPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Get the number of agent parameters defined for a model.

TRITONREPOAGENT_ModelParameterCount(TRITONREPOAGENT_Agent, TRITONREPOAGENT_AgentModel, IntBuffer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONREPOAGENT_ModelParameterCount(TRITONREPOAGENT_Agent, TRITONREPOAGENT_AgentModel, int[]) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONREPOAGENT_ModelRepositoryLocation(TRITONREPOAGENT_Agent, TRITONREPOAGENT_AgentModel, IntPointer, PointerPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Get the location of the files that make up the model.

TRITONREPOAGENT_ModelRepositoryLocation(TRITONREPOAGENT_Agent, TRITONREPOAGENT_AgentModel, IntPointer, BytePointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONREPOAGENT_ModelRepositoryLocation(TRITONREPOAGENT_Agent, TRITONREPOAGENT_AgentModel, IntBuffer, ByteBuffer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONREPOAGENT_ModelRepositoryLocation(TRITONREPOAGENT_Agent, TRITONREPOAGENT_AgentModel, int[], byte[]) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONREPOAGENT_ModelRepositoryLocationAcquire(TRITONREPOAGENT_Agent, TRITONREPOAGENT_AgentModel, int, PointerPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Acquire a location where the agent can produce a new version of the model repository files.

TRITONREPOAGENT_ModelRepositoryLocationAcquire(TRITONREPOAGENT_Agent, TRITONREPOAGENT_AgentModel, int, BytePointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONREPOAGENT_ModelRepositoryLocationAcquire(TRITONREPOAGENT_Agent, TRITONREPOAGENT_AgentModel, int, ByteBuffer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONREPOAGENT_ModelRepositoryLocationAcquire(TRITONREPOAGENT_Agent, TRITONREPOAGENT_AgentModel, int, byte[]) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONREPOAGENT_ModelRepositoryLocationRelease(TRITONREPOAGENT_Agent, TRITONREPOAGENT_AgentModel, String) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Discard and release ownership of a previously acquired location and its contents.

TRITONREPOAGENT_ModelRepositoryLocationRelease(TRITONREPOAGENT_Agent, TRITONREPOAGENT_AgentModel, BytePointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONREPOAGENT_ModelRepositoryUpdate(TRITONREPOAGENT_Agent, TRITONREPOAGENT_AgentModel, int, String) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Inform Triton that the specified repository location should be used for the model in place of the original model repository.

TRITONREPOAGENT_ModelRepositoryUpdate(TRITONREPOAGENT_Agent, TRITONREPOAGENT_AgentModel, int, BytePointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONREPOAGENT_ModelSetState(TRITONREPOAGENT_AgentModel, Pointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Set the user-specified state associated with the model.

TRITONREPOAGENT_ModelState(TRITONREPOAGENT_AgentModel, PointerPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Get the user-specified state associated with the model.

TRITONREPOAGENT_ModelState(TRITONREPOAGENT_AgentModel, Pointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONREPOAGENT_SetState(TRITONREPOAGENT_Agent, Pointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Set the user-specified state associated with the agent.

TRITONREPOAGENT_State(TRITONREPOAGENT_Agent, PointerPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Get the user-specified state associated with the agent.

TRITONREPOAGENT_State(TRITONREPOAGENT_Agent, Pointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

tritonserver - Class in org.bytedeco.tritonserver.global

tritonserver() - Constructor for class org.bytedeco.tritonserver.global.tritonserver

tritonserver - Class in org.bytedeco.tritonserver.presets

tritonserver() - Constructor for class org.bytedeco.tritonserver.presets.tritonserver

TRITONSERVER_API_VERSION_MAJOR - Static variable in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER API Version The TRITONSERVER API is versioned with major and minor version numbers.

TRITONSERVER_API_VERSION_MINOR - Static variable in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_ApiVersion(IntPointer, IntPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Get the TRITONBACKEND API version supported by the Triton shared library.

TRITONSERVER_ApiVersion(IntBuffer, IntBuffer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_ApiVersion(int[], int[]) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_BATCH_FIRST_DIM - Static variable in class org.bytedeco.tritonserver.global.tritonserver

enum TRITONSERVER_ModelBatchFlag

TRITONSERVER_BATCH_UNKNOWN - Static variable in class org.bytedeco.tritonserver.global.tritonserver

enum TRITONSERVER_ModelBatchFlag

TRITONSERVER_BufferAttributes - Class in org.bytedeco.tritonserver.tritonserver

TRITONSERVER_BufferAttributes() - Constructor for class org.bytedeco.tritonserver.tritonserver.TRITONSERVER_BufferAttributes

Empty constructor.

TRITONSERVER_BufferAttributes(Pointer) - Constructor for class org.bytedeco.tritonserver.tritonserver.TRITONSERVER_BufferAttributes

Pointer cast constructor.

TRITONSERVER_BufferAttributesByteSize(TRITONSERVER_BufferAttributes, SizeTPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Get the byte size field of the buffer attributes.

TRITONSERVER_BufferAttributesCudaIpcHandle(TRITONSERVER_BufferAttributes, PointerPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Get the CudaIpcHandle field of the buffer attributes object.

TRITONSERVER_BufferAttributesCudaIpcHandle(TRITONSERVER_BufferAttributes, Pointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_BufferAttributesDelete(TRITONSERVER_BufferAttributes) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Delete a buffer attributes object.

TRITONSERVER_BufferAttributesMemoryType(TRITONSERVER_BufferAttributes, IntPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Get the memory type field of the buffer attributes.

TRITONSERVER_BufferAttributesMemoryType(TRITONSERVER_BufferAttributes, IntBuffer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_BufferAttributesMemoryType(TRITONSERVER_BufferAttributes, int[]) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_BufferAttributesMemoryTypeId(TRITONSERVER_BufferAttributes, LongPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Get the memory type id field of the buffer attributes.

TRITONSERVER_BufferAttributesMemoryTypeId(TRITONSERVER_BufferAttributes, LongBuffer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_BufferAttributesMemoryTypeId(TRITONSERVER_BufferAttributes, long[]) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_BufferAttributesNew(PointerPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_BufferAttributes API to create, modify, or retrieve attributes associated with a buffer.

TRITONSERVER_BufferAttributesNew(TRITONSERVER_BufferAttributes) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_BufferAttributesSetByteSize(TRITONSERVER_BufferAttributes, long) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Set the byte size field of the buffer attributes.

TRITONSERVER_BufferAttributesSetCudaIpcHandle(TRITONSERVER_BufferAttributes, Pointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Set the CudaIpcHandle field of the buffer attributes.

TRITONSERVER_BufferAttributesSetMemoryType(TRITONSERVER_BufferAttributes, int) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Set the memory type field of the buffer attributes.

TRITONSERVER_BufferAttributesSetMemoryTypeId(TRITONSERVER_BufferAttributes, long) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Set the memory type id field of the buffer attributes.

TRITONSERVER_DataTypeByteSize(int) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Get the size of a Triton datatype in bytes.

TRITONSERVER_DataTypeString(int) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Get the string representation of a data type.

TRITONSERVER_Error - Class in org.bytedeco.tritonserver.tritonserver

TRITONSERVER_Error() - Constructor for class org.bytedeco.tritonserver.tritonserver.TRITONSERVER_Error

Empty constructor.

TRITONSERVER_Error(Pointer) - Constructor for class org.bytedeco.tritonserver.tritonserver.TRITONSERVER_Error

Pointer cast constructor.

TRITONSERVER_ERROR_ALREADY_EXISTS - Static variable in class org.bytedeco.tritonserver.global.tritonserver

enum TRITONSERVER_Error_Code

TRITONSERVER_ERROR_CANCELLED - Static variable in class org.bytedeco.tritonserver.global.tritonserver

enum TRITONSERVER_Error_Code

TRITONSERVER_ERROR_INTERNAL - Static variable in class org.bytedeco.tritonserver.global.tritonserver

enum TRITONSERVER_Error_Code

TRITONSERVER_ERROR_INVALID_ARG - Static variable in class org.bytedeco.tritonserver.global.tritonserver

enum TRITONSERVER_Error_Code

TRITONSERVER_ERROR_NOT_FOUND - Static variable in class org.bytedeco.tritonserver.global.tritonserver

enum TRITONSERVER_Error_Code

TRITONSERVER_ERROR_UNAVAILABLE - Static variable in class org.bytedeco.tritonserver.global.tritonserver

enum TRITONSERVER_Error_Code

TRITONSERVER_ERROR_UNKNOWN - Static variable in class org.bytedeco.tritonserver.global.tritonserver

enum TRITONSERVER_Error_Code

TRITONSERVER_ERROR_UNSUPPORTED - Static variable in class org.bytedeco.tritonserver.global.tritonserver

enum TRITONSERVER_Error_Code

TRITONSERVER_ErrorCode(TRITONSERVER_Error) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Get the error code.

TRITONSERVER_ErrorCodeString(TRITONSERVER_Error) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Get the string representation of an error code.

TRITONSERVER_ErrorDelete(TRITONSERVER_Error) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Delete an error object.

TRITONSERVER_ErrorMessage(TRITONSERVER_Error) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Get the error message.

TRITONSERVER_ErrorNew(int, String) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Create a new error object.

TRITONSERVER_ErrorNew(int, BytePointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_GetMetricFamilyKind(TRITONSERVER_MetricFamily, IntPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Get the TRITONSERVER_MetricKind of the metric family.

TRITONSERVER_GetMetricFamilyKind(TRITONSERVER_MetricFamily, IntBuffer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_GetMetricFamilyKind(TRITONSERVER_MetricFamily, int[]) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_GetMetricKind(TRITONSERVER_Metric, IntPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Get the TRITONSERVER_MetricKind of metric of its corresponding family.

TRITONSERVER_GetMetricKind(TRITONSERVER_Metric, IntBuffer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_GetMetricKind(TRITONSERVER_Metric, int[]) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_INDEX_FLAG_READY - Static variable in class org.bytedeco.tritonserver.global.tritonserver

enum TRITONSERVER_ModelIndexFlag

TRITONSERVER_InferenceRequest - Class in org.bytedeco.tritonserver.tritonserver

TRITONSERVER_InferenceRequest() - Constructor for class org.bytedeco.tritonserver.tritonserver.TRITONSERVER_InferenceRequest

Empty constructor.

TRITONSERVER_InferenceRequest(Pointer) - Constructor for class org.bytedeco.tritonserver.tritonserver.TRITONSERVER_InferenceRequest

Pointer cast constructor.

TRITONSERVER_InferenceRequestAddInput(TRITONSERVER_InferenceRequest, String, int, LongPointer, long) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Add an input to a request.

TRITONSERVER_InferenceRequestAddInput(TRITONSERVER_InferenceRequest, BytePointer, int, LongBuffer, long) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_InferenceRequestAddInput(TRITONSERVER_InferenceRequest, String, int, long[], long) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_InferenceRequestAddInput(TRITONSERVER_InferenceRequest, BytePointer, int, LongPointer, long) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_InferenceRequestAddInput(TRITONSERVER_InferenceRequest, String, int, LongBuffer, long) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_InferenceRequestAddInput(TRITONSERVER_InferenceRequest, BytePointer, int, long[], long) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_InferenceRequestAddRawInput(TRITONSERVER_InferenceRequest, String) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Add a raw input to a request.

TRITONSERVER_InferenceRequestAddRawInput(TRITONSERVER_InferenceRequest, BytePointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_InferenceRequestAddRequestedOutput(TRITONSERVER_InferenceRequest, String) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Add an output request to an inference request.

TRITONSERVER_InferenceRequestAddRequestedOutput(TRITONSERVER_InferenceRequest, BytePointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_InferenceRequestAppendInputData(TRITONSERVER_InferenceRequest, String, Pointer, long, int, long) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Assign a buffer of data to an input.

TRITONSERVER_InferenceRequestAppendInputData(TRITONSERVER_InferenceRequest, BytePointer, Pointer, long, int, long) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_InferenceRequestAppendInputDataWithBufferAttributes(TRITONSERVER_InferenceRequest, String, Pointer, TRITONSERVER_BufferAttributes) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Assign a buffer of data to an input.

TRITONSERVER_InferenceRequestAppendInputDataWithBufferAttributes(TRITONSERVER_InferenceRequest, BytePointer, Pointer, TRITONSERVER_BufferAttributes) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_InferenceRequestAppendInputDataWithHostPolicy(TRITONSERVER_InferenceRequest, String, Pointer, long, int, long, String) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Assign a buffer of data to an input for execution on all model instances with the specified host policy.

TRITONSERVER_InferenceRequestAppendInputDataWithHostPolicy(TRITONSERVER_InferenceRequest, BytePointer, Pointer, long, int, long, BytePointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_InferenceRequestCancel(TRITONSERVER_InferenceRequest) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Cancel an inference request.

TRITONSERVER_InferenceRequestCorrelationId(TRITONSERVER_InferenceRequest, LongPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Get the correlation ID of the inference request as an unsigned integer.

TRITONSERVER_InferenceRequestCorrelationId(TRITONSERVER_InferenceRequest, LongBuffer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_InferenceRequestCorrelationId(TRITONSERVER_InferenceRequest, long[]) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_InferenceRequestCorrelationIdString(TRITONSERVER_InferenceRequest, PointerPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Get the correlation ID of the inference request as a string.

TRITONSERVER_InferenceRequestCorrelationIdString(TRITONSERVER_InferenceRequest, BytePointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_InferenceRequestCorrelationIdString(TRITONSERVER_InferenceRequest, ByteBuffer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_InferenceRequestCorrelationIdString(TRITONSERVER_InferenceRequest, byte[]) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_InferenceRequestDelete(TRITONSERVER_InferenceRequest) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Delete an inference request object.

TRITONSERVER_InferenceRequestFlags(TRITONSERVER_InferenceRequest, IntPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Get the flag(s) associated with a request.

TRITONSERVER_InferenceRequestFlags(TRITONSERVER_InferenceRequest, IntBuffer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_InferenceRequestFlags(TRITONSERVER_InferenceRequest, int[]) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_InferenceRequestId(TRITONSERVER_InferenceRequest, PointerPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Get the ID for a request.

TRITONSERVER_InferenceRequestId(TRITONSERVER_InferenceRequest, BytePointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_InferenceRequestId(TRITONSERVER_InferenceRequest, ByteBuffer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_InferenceRequestId(TRITONSERVER_InferenceRequest, byte[]) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_InferenceRequestIsCancelled(TRITONSERVER_InferenceRequest, boolean[]) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Query whether the request is cancelled or not.

TRITONSERVER_InferenceRequestIsCancelled(TRITONSERVER_InferenceRequest, BoolPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_InferenceRequestNew(PointerPointer, TRITONSERVER_Server, String, long) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Create a new inference request object.

TRITONSERVER_InferenceRequestNew(TRITONSERVER_InferenceRequest, TRITONSERVER_Server, String, long) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_InferenceRequestNew(TRITONSERVER_InferenceRequest, TRITONSERVER_Server, BytePointer, long) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_InferenceRequestPriority(TRITONSERVER_InferenceRequest, IntPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Deprecated.

TRITONSERVER_InferenceRequestPriority(TRITONSERVER_InferenceRequest, IntBuffer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_InferenceRequestPriority(TRITONSERVER_InferenceRequest, int[]) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_InferenceRequestPriorityUInt64(TRITONSERVER_InferenceRequest, LongPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Get the priority for a request.

TRITONSERVER_InferenceRequestPriorityUInt64(TRITONSERVER_InferenceRequest, LongBuffer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_InferenceRequestPriorityUInt64(TRITONSERVER_InferenceRequest, long[]) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_InferenceRequestReleaseFn_t - Class in org.bytedeco.tritonserver.tritonserver

Type for inference request release callback function.

TRITONSERVER_InferenceRequestReleaseFn_t(Pointer) - Constructor for class org.bytedeco.tritonserver.tritonserver.TRITONSERVER_InferenceRequestReleaseFn_t

Pointer cast constructor.

TRITONSERVER_InferenceRequestReleaseFn_t() - Constructor for class org.bytedeco.tritonserver.tritonserver.TRITONSERVER_InferenceRequestReleaseFn_t

TRITONSERVER_InferenceRequestRemoveAllInputData(TRITONSERVER_InferenceRequest, String) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Clear all input data from an input, releasing ownership of the buffer(s) that were appended to the input with TRITONSERVER_InferenceRequestAppendInputData or TRITONSERVER_InferenceRequestAppendInputDataWithHostPolicy

TRITONSERVER_InferenceRequestRemoveAllInputData(TRITONSERVER_InferenceRequest, BytePointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_InferenceRequestRemoveAllInputs(TRITONSERVER_InferenceRequest) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Remove all inputs from a request.

TRITONSERVER_InferenceRequestRemoveAllRequestedOutputs(TRITONSERVER_InferenceRequest) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Remove all output requests from an inference request.

TRITONSERVER_InferenceRequestRemoveInput(TRITONSERVER_InferenceRequest, String) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Remove an input from a request.

TRITONSERVER_InferenceRequestRemoveInput(TRITONSERVER_InferenceRequest, BytePointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_InferenceRequestRemoveRequestedOutput(TRITONSERVER_InferenceRequest, String) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Remove an output request from an inference request.

TRITONSERVER_InferenceRequestRemoveRequestedOutput(TRITONSERVER_InferenceRequest, BytePointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_InferenceRequestSetBoolParameter(TRITONSERVER_InferenceRequest, String, boolean) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Set a boolean parameter in the request.

TRITONSERVER_InferenceRequestSetBoolParameter(TRITONSERVER_InferenceRequest, BytePointer, boolean) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_InferenceRequestSetCorrelationId(TRITONSERVER_InferenceRequest, long) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Set the correlation ID of the inference request to be an unsigned integer.

TRITONSERVER_InferenceRequestSetCorrelationIdString(TRITONSERVER_InferenceRequest, String) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Set the correlation ID of the inference request to be a string.

TRITONSERVER_InferenceRequestSetCorrelationIdString(TRITONSERVER_InferenceRequest, BytePointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_InferenceRequestSetDoubleParameter(TRITONSERVER_InferenceRequest, String, double) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Set a double parameter in the request.

TRITONSERVER_InferenceRequestSetDoubleParameter(TRITONSERVER_InferenceRequest, BytePointer, double) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_InferenceRequestSetFlags(TRITONSERVER_InferenceRequest, int) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Set the flag(s) associated with a request.

TRITONSERVER_InferenceRequestSetId(TRITONSERVER_InferenceRequest, String) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Set the ID for a request.

TRITONSERVER_InferenceRequestSetId(TRITONSERVER_InferenceRequest, BytePointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_InferenceRequestSetIntParameter(TRITONSERVER_InferenceRequest, String, long) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Set an integer parameter in the request.

TRITONSERVER_InferenceRequestSetIntParameter(TRITONSERVER_InferenceRequest, BytePointer, long) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_InferenceRequestSetPriority(TRITONSERVER_InferenceRequest, int) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Deprecated.

TRITONSERVER_InferenceRequestSetPriorityUInt64(TRITONSERVER_InferenceRequest, long) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Set the priority for a request.

TRITONSERVER_InferenceRequestSetReleaseCallback(TRITONSERVER_InferenceRequest, TRITONSERVER_InferenceRequestReleaseFn_t, Pointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Set the release callback for an inference request.

TRITONSERVER_InferenceRequestSetResponseCallback(TRITONSERVER_InferenceRequest, TRITONSERVER_ResponseAllocator, Pointer, TRITONSERVER_InferenceResponseCompleteFn_t, Pointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Set the allocator and response callback for an inference request.

TRITONSERVER_InferenceRequestSetStringParameter(TRITONSERVER_InferenceRequest, String, String) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Set a string parameter in the request.

TRITONSERVER_InferenceRequestSetStringParameter(TRITONSERVER_InferenceRequest, BytePointer, BytePointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_InferenceRequestSetTimeoutMicroseconds(TRITONSERVER_InferenceRequest, long) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Set the timeout for a request, in microseconds.

TRITONSERVER_InferenceRequestTimeoutMicroseconds(TRITONSERVER_InferenceRequest, LongPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Get the timeout for a request, in microseconds.

TRITONSERVER_InferenceRequestTimeoutMicroseconds(TRITONSERVER_InferenceRequest, LongBuffer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_InferenceRequestTimeoutMicroseconds(TRITONSERVER_InferenceRequest, long[]) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_InferenceResponse - Class in org.bytedeco.tritonserver.tritonserver

TRITONSERVER_InferenceResponse() - Constructor for class org.bytedeco.tritonserver.tritonserver.TRITONSERVER_InferenceResponse

Empty constructor.

TRITONSERVER_InferenceResponse(Pointer) - Constructor for class org.bytedeco.tritonserver.tritonserver.TRITONSERVER_InferenceResponse

Pointer cast constructor.

TRITONSERVER_InferenceResponseCompleteFn_t - Class in org.bytedeco.tritonserver.tritonserver

Type for callback function indicating that an inference response has completed.

TRITONSERVER_InferenceResponseCompleteFn_t(Pointer) - Constructor for class org.bytedeco.tritonserver.tritonserver.TRITONSERVER_InferenceResponseCompleteFn_t

Pointer cast constructor.

TRITONSERVER_InferenceResponseCompleteFn_t() - Constructor for class org.bytedeco.tritonserver.tritonserver.TRITONSERVER_InferenceResponseCompleteFn_t

TRITONSERVER_InferenceResponseDelete(TRITONSERVER_InferenceResponse) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_InferenceResponse Object representing an inference response.

TRITONSERVER_InferenceResponseError(TRITONSERVER_InferenceResponse) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Return the error status of an inference response.

TRITONSERVER_InferenceResponseId(TRITONSERVER_InferenceResponse, PointerPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Get the ID of the request corresponding to a response.

TRITONSERVER_InferenceResponseId(TRITONSERVER_InferenceResponse, BytePointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_InferenceResponseId(TRITONSERVER_InferenceResponse, ByteBuffer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_InferenceResponseId(TRITONSERVER_InferenceResponse, byte[]) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_InferenceResponseModel(TRITONSERVER_InferenceResponse, PointerPointer, LongPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Get model used to produce a response.

TRITONSERVER_InferenceResponseModel(TRITONSERVER_InferenceResponse, BytePointer, LongPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_InferenceResponseModel(TRITONSERVER_InferenceResponse, ByteBuffer, LongBuffer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_InferenceResponseModel(TRITONSERVER_InferenceResponse, byte[], long[]) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_InferenceResponseOutput(TRITONSERVER_InferenceResponse, int, PointerPointer, IntPointer, PointerPointer, LongPointer, PointerPointer, SizeTPointer, IntPointer, LongPointer, PointerPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Get all information about an output tensor.

TRITONSERVER_InferenceResponseOutput(TRITONSERVER_InferenceResponse, int, BytePointer, IntPointer, LongPointer, LongPointer, Pointer, SizeTPointer, IntPointer, LongPointer, Pointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_InferenceResponseOutput(TRITONSERVER_InferenceResponse, int, ByteBuffer, IntBuffer, LongBuffer, LongBuffer, Pointer, SizeTPointer, IntBuffer, LongBuffer, Pointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_InferenceResponseOutput(TRITONSERVER_InferenceResponse, int, byte[], int[], long[], long[], Pointer, SizeTPointer, int[], long[], Pointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_InferenceResponseOutputClassificationLabel(TRITONSERVER_InferenceResponse, int, long, PointerPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Get a classification label associated with an output for a given index.

TRITONSERVER_InferenceResponseOutputClassificationLabel(TRITONSERVER_InferenceResponse, int, long, BytePointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_InferenceResponseOutputClassificationLabel(TRITONSERVER_InferenceResponse, int, long, ByteBuffer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_InferenceResponseOutputClassificationLabel(TRITONSERVER_InferenceResponse, int, long, byte[]) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_InferenceResponseOutputCount(TRITONSERVER_InferenceResponse, IntPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Get the number of outputs available in the response.

TRITONSERVER_InferenceResponseOutputCount(TRITONSERVER_InferenceResponse, IntBuffer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_InferenceResponseOutputCount(TRITONSERVER_InferenceResponse, int[]) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_InferenceResponseParameter(TRITONSERVER_InferenceResponse, int, PointerPointer, IntPointer, PointerPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Get all information about a parameter.

TRITONSERVER_InferenceResponseParameter(TRITONSERVER_InferenceResponse, int, BytePointer, IntPointer, Pointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_InferenceResponseParameter(TRITONSERVER_InferenceResponse, int, ByteBuffer, IntBuffer, Pointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_InferenceResponseParameter(TRITONSERVER_InferenceResponse, int, byte[], int[], Pointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_InferenceResponseParameterCount(TRITONSERVER_InferenceResponse, IntPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Get the number of parameters available in the response.

TRITONSERVER_InferenceResponseParameterCount(TRITONSERVER_InferenceResponse, IntBuffer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_InferenceResponseParameterCount(TRITONSERVER_InferenceResponse, int[]) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_InferenceTrace - Class in org.bytedeco.tritonserver.tritonserver

TRITONSERVER_InferenceTrace() - Constructor for class org.bytedeco.tritonserver.tritonserver.TRITONSERVER_InferenceTrace

Empty constructor.

TRITONSERVER_InferenceTrace(Pointer) - Constructor for class org.bytedeco.tritonserver.tritonserver.TRITONSERVER_InferenceTrace

Pointer cast constructor.

TRITONSERVER_InferenceTraceActivityFn_t - Class in org.bytedeco.tritonserver.tritonserver

Type for trace timeline activity callback function.

TRITONSERVER_InferenceTraceActivityFn_t(Pointer) - Constructor for class org.bytedeco.tritonserver.tritonserver.TRITONSERVER_InferenceTraceActivityFn_t

Pointer cast constructor.

TRITONSERVER_InferenceTraceActivityFn_t() - Constructor for class org.bytedeco.tritonserver.tritonserver.TRITONSERVER_InferenceTraceActivityFn_t

TRITONSERVER_InferenceTraceActivityString(int) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Get the string representation of a trace activity.

TRITONSERVER_InferenceTraceContext(TRITONSERVER_InferenceTrace, PointerPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Get TRITONSERVER_InferenceTrace context.

TRITONSERVER_InferenceTraceContext(TRITONSERVER_InferenceTrace, BytePointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_InferenceTraceContext(TRITONSERVER_InferenceTrace, ByteBuffer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_InferenceTraceContext(TRITONSERVER_InferenceTrace, byte[]) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_InferenceTraceDelete(TRITONSERVER_InferenceTrace) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Delete a trace object.

TRITONSERVER_InferenceTraceId(TRITONSERVER_InferenceTrace, LongPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Get the id associated with a trace.

TRITONSERVER_InferenceTraceId(TRITONSERVER_InferenceTrace, LongBuffer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_InferenceTraceId(TRITONSERVER_InferenceTrace, long[]) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_InferenceTraceLevelString(int) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Get the string representation of a trace level.

TRITONSERVER_InferenceTraceModelName(TRITONSERVER_InferenceTrace, PointerPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Get the name of the model associated with a trace.

TRITONSERVER_InferenceTraceModelName(TRITONSERVER_InferenceTrace, BytePointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_InferenceTraceModelName(TRITONSERVER_InferenceTrace, ByteBuffer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_InferenceTraceModelName(TRITONSERVER_InferenceTrace, byte[]) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_InferenceTraceModelVersion(TRITONSERVER_InferenceTrace, LongPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Get the version of the model associated with a trace.

TRITONSERVER_InferenceTraceModelVersion(TRITONSERVER_InferenceTrace, LongBuffer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_InferenceTraceModelVersion(TRITONSERVER_InferenceTrace, long[]) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_InferenceTraceNew(PointerPointer, int, long, TRITONSERVER_InferenceTraceActivityFn_t, TRITONSERVER_InferenceTraceReleaseFn_t, Pointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Create a new inference trace object.

TRITONSERVER_InferenceTraceNew(TRITONSERVER_InferenceTrace, int, long, TRITONSERVER_InferenceTraceActivityFn_t, TRITONSERVER_InferenceTraceReleaseFn_t, Pointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_InferenceTraceParentId(TRITONSERVER_InferenceTrace, LongPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Get the parent id associated with a trace.

TRITONSERVER_InferenceTraceParentId(TRITONSERVER_InferenceTrace, LongBuffer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_InferenceTraceParentId(TRITONSERVER_InferenceTrace, long[]) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_InferenceTraceReleaseFn_t - Class in org.bytedeco.tritonserver.tritonserver

Type for trace release callback function.

TRITONSERVER_InferenceTraceReleaseFn_t(Pointer) - Constructor for class org.bytedeco.tritonserver.tritonserver.TRITONSERVER_InferenceTraceReleaseFn_t

Pointer cast constructor.

TRITONSERVER_InferenceTraceReleaseFn_t() - Constructor for class org.bytedeco.tritonserver.tritonserver.TRITONSERVER_InferenceTraceReleaseFn_t

TRITONSERVER_InferenceTraceReportActivity(TRITONSERVER_InferenceTrace, long, String) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Report a trace activity.

TRITONSERVER_InferenceTraceReportActivity(TRITONSERVER_InferenceTrace, long, BytePointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_InferenceTraceRequestId(TRITONSERVER_InferenceTrace, PointerPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Get the request id associated with a trace.

TRITONSERVER_InferenceTraceRequestId(TRITONSERVER_InferenceTrace, BytePointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_InferenceTraceRequestId(TRITONSERVER_InferenceTrace, ByteBuffer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_InferenceTraceRequestId(TRITONSERVER_InferenceTrace, byte[]) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_InferenceTraceSetContext(TRITONSERVER_InferenceTrace, String) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Set TRITONSERVER_InferenceTrace context.

TRITONSERVER_InferenceTraceSetContext(TRITONSERVER_InferenceTrace, BytePointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_InferenceTraceSpawnChildTrace(TRITONSERVER_InferenceTrace, PointerPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Get the child trace, spawned from the parent trace.

TRITONSERVER_InferenceTraceSpawnChildTrace(TRITONSERVER_InferenceTrace, TRITONSERVER_InferenceTrace) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_InferenceTraceTensorActivityFn_t - Class in org.bytedeco.tritonserver.tritonserver

Type for trace tensor activity callback function.

TRITONSERVER_InferenceTraceTensorActivityFn_t(Pointer) - Constructor for class org.bytedeco.tritonserver.tritonserver.TRITONSERVER_InferenceTraceTensorActivityFn_t

Pointer cast constructor.

TRITONSERVER_InferenceTraceTensorActivityFn_t() - Constructor for class org.bytedeco.tritonserver.tritonserver.TRITONSERVER_InferenceTraceTensorActivityFn_t

TRITONSERVER_InferenceTraceTensorNew(PointerPointer, int, long, TRITONSERVER_InferenceTraceActivityFn_t, TRITONSERVER_InferenceTraceTensorActivityFn_t, TRITONSERVER_InferenceTraceReleaseFn_t, Pointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Create a new inference trace object.

TRITONSERVER_InferenceTraceTensorNew(TRITONSERVER_InferenceTrace, int, long, TRITONSERVER_InferenceTraceActivityFn_t, TRITONSERVER_InferenceTraceTensorActivityFn_t, TRITONSERVER_InferenceTraceReleaseFn_t, Pointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_INSTANCEGROUPKIND_AUTO - Static variable in class org.bytedeco.tritonserver.global.tritonserver

enum TRITONSERVER_InstanceGroupKind

TRITONSERVER_INSTANCEGROUPKIND_CPU - Static variable in class org.bytedeco.tritonserver.global.tritonserver

enum TRITONSERVER_InstanceGroupKind

TRITONSERVER_INSTANCEGROUPKIND_GPU - Static variable in class org.bytedeco.tritonserver.global.tritonserver

enum TRITONSERVER_InstanceGroupKind

TRITONSERVER_INSTANCEGROUPKIND_MODEL - Static variable in class org.bytedeco.tritonserver.global.tritonserver

enum TRITONSERVER_InstanceGroupKind

TRITONSERVER_InstanceGroupKindString(int) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Get the string representation of an instance-group kind.

TRITONSERVER_LOG_DEFAULT - Static variable in class org.bytedeco.tritonserver.global.tritonserver

enum TRITONSERVER_LogFormat

TRITONSERVER_LOG_ERROR - Static variable in class org.bytedeco.tritonserver.global.tritonserver

enum TRITONSERVER_LogLevel

TRITONSERVER_LOG_INFO - Static variable in class org.bytedeco.tritonserver.global.tritonserver

enum TRITONSERVER_LogLevel

TRITONSERVER_LOG_ISO8601 - Static variable in class org.bytedeco.tritonserver.global.tritonserver

enum TRITONSERVER_LogFormat

TRITONSERVER_LOG_VERBOSE - Static variable in class org.bytedeco.tritonserver.global.tritonserver

enum TRITONSERVER_LogLevel

TRITONSERVER_LOG_WARN - Static variable in class org.bytedeco.tritonserver.global.tritonserver

enum TRITONSERVER_LogLevel

TRITONSERVER_LogIsEnabled(int) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Is a log level enabled?

TRITONSERVER_LogMessage(int, String, int, String) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Log a message at a given log level if that level is enabled.

TRITONSERVER_LogMessage(int, BytePointer, int, BytePointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_MEMORY_CPU - Static variable in class org.bytedeco.tritonserver.global.tritonserver

enum TRITONSERVER_MemoryType

TRITONSERVER_MEMORY_CPU_PINNED - Static variable in class org.bytedeco.tritonserver.global.tritonserver

enum TRITONSERVER_MemoryType

TRITONSERVER_MEMORY_GPU - Static variable in class org.bytedeco.tritonserver.global.tritonserver

enum TRITONSERVER_MemoryType

TRITONSERVER_MemoryTypeString(int) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Get the string representation of a memory type.

TRITONSERVER_Message - Class in org.bytedeco.tritonserver.tritonserver

TRITONSERVER_Message() - Constructor for class org.bytedeco.tritonserver.tritonserver.TRITONSERVER_Message

Empty constructor.

TRITONSERVER_Message(Pointer) - Constructor for class org.bytedeco.tritonserver.tritonserver.TRITONSERVER_Message

Pointer cast constructor.

TRITONSERVER_MessageDelete(TRITONSERVER_Message) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Delete a message object.

TRITONSERVER_MessageNewFromSerializedJson(PointerPointer, String, long) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_Message Object representing a Triton Server message.

TRITONSERVER_MessageNewFromSerializedJson(TRITONSERVER_Message, String, long) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_MessageNewFromSerializedJson(TRITONSERVER_Message, BytePointer, long) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_MessageSerializeToJson(TRITONSERVER_Message, PointerPointer, SizeTPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Get the base and size of the buffer containing the serialized message in JSON format.

TRITONSERVER_MessageSerializeToJson(TRITONSERVER_Message, BytePointer, SizeTPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_MessageSerializeToJson(TRITONSERVER_Message, ByteBuffer, SizeTPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_MessageSerializeToJson(TRITONSERVER_Message, byte[], SizeTPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_Metric - Class in org.bytedeco.tritonserver.tritonserver

TRITONSERVER_Metric() - Constructor for class org.bytedeco.tritonserver.tritonserver.TRITONSERVER_Metric

Empty constructor.

TRITONSERVER_Metric(Pointer) - Constructor for class org.bytedeco.tritonserver.tritonserver.TRITONSERVER_Metric

Pointer cast constructor.

TRITONSERVER_METRIC_KIND_COUNTER - Static variable in class org.bytedeco.tritonserver.global.tritonserver

enum TRITONSERVER_MetricKind

TRITONSERVER_METRIC_KIND_GAUGE - Static variable in class org.bytedeco.tritonserver.global.tritonserver

enum TRITONSERVER_MetricKind

TRITONSERVER_METRIC_KIND_HISTOGRAM - Static variable in class org.bytedeco.tritonserver.global.tritonserver

enum TRITONSERVER_MetricKind

TRITONSERVER_METRIC_PROMETHEUS - Static variable in class org.bytedeco.tritonserver.global.tritonserver

enum TRITONSERVER_MetricFormat

TRITONSERVER_MetricArgs - Class in org.bytedeco.tritonserver.tritonserver

TRITONSERVER_MetricArgs() - Constructor for class org.bytedeco.tritonserver.tritonserver.TRITONSERVER_MetricArgs

Empty constructor.

TRITONSERVER_MetricArgs(Pointer) - Constructor for class org.bytedeco.tritonserver.tritonserver.TRITONSERVER_MetricArgs

Pointer cast constructor.

TRITONSERVER_MetricArgsDelete(TRITONSERVER_MetricArgs) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Delete a metric args object.

TRITONSERVER_MetricArgsNew(PointerPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Create a new metric args object.

TRITONSERVER_MetricArgsNew(TRITONSERVER_MetricArgs) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_MetricArgsSetHistogram(TRITONSERVER_MetricArgs, DoublePointer, long) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Set metric args with histogram metric parameter.

TRITONSERVER_MetricArgsSetHistogram(TRITONSERVER_MetricArgs, DoubleBuffer, long) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_MetricArgsSetHistogram(TRITONSERVER_MetricArgs, double[], long) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_MetricDelete(TRITONSERVER_Metric) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Delete a metric object.

TRITONSERVER_MetricFamily - Class in org.bytedeco.tritonserver.tritonserver

TRITONSERVER_MetricFamily() - Constructor for class org.bytedeco.tritonserver.tritonserver.TRITONSERVER_MetricFamily

Empty constructor.

TRITONSERVER_MetricFamily(Pointer) - Constructor for class org.bytedeco.tritonserver.tritonserver.TRITONSERVER_MetricFamily

Pointer cast constructor.

TRITONSERVER_MetricFamilyDelete(TRITONSERVER_MetricFamily) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Delete a metric family object.

TRITONSERVER_MetricFamilyNew(PointerPointer, int, String, String) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Create a new metric family object.

TRITONSERVER_MetricFamilyNew(TRITONSERVER_MetricFamily, int, String, String) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_MetricFamilyNew(TRITONSERVER_MetricFamily, int, BytePointer, BytePointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_MetricIncrement(TRITONSERVER_Metric, double) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Increment the current value of metric by value.

TRITONSERVER_MetricNew(PointerPointer, TRITONSERVER_MetricFamily, PointerPointer, long) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Create a new metric object.

TRITONSERVER_MetricNew(TRITONSERVER_Metric, TRITONSERVER_MetricFamily, TRITONSERVER_Parameter, long) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_MetricNewWithArgs(PointerPointer, TRITONSERVER_MetricFamily, PointerPointer, long, TRITONSERVER_MetricArgs) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Create a new metric object.

TRITONSERVER_MetricNewWithArgs(TRITONSERVER_Metric, TRITONSERVER_MetricFamily, TRITONSERVER_Parameter, long, TRITONSERVER_MetricArgs) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_MetricObserve(TRITONSERVER_Metric, double) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Sample an observation and count it to the appropriate bucket of a metric.

TRITONSERVER_Metrics - Class in org.bytedeco.tritonserver.tritonserver

TRITONSERVER_Metrics() - Constructor for class org.bytedeco.tritonserver.tritonserver.TRITONSERVER_Metrics

Empty constructor.

TRITONSERVER_Metrics(Pointer) - Constructor for class org.bytedeco.tritonserver.tritonserver.TRITONSERVER_Metrics

Pointer cast constructor.

TRITONSERVER_MetricsDelete(TRITONSERVER_Metrics) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Delete a metrics object.

TRITONSERVER_MetricSet(TRITONSERVER_Metric, double) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Set the current value of metric to value.

TRITONSERVER_MetricsFormatted(TRITONSERVER_Metrics, int, PointerPointer, SizeTPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Get a buffer containing the metrics in the specified format.

TRITONSERVER_MetricsFormatted(TRITONSERVER_Metrics, int, BytePointer, SizeTPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_MetricsFormatted(TRITONSERVER_Metrics, int, ByteBuffer, SizeTPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_MetricsFormatted(TRITONSERVER_Metrics, int, byte[], SizeTPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_MetricValue(TRITONSERVER_Metric, DoublePointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Get the current value of a metric object.

TRITONSERVER_MetricValue(TRITONSERVER_Metric, DoubleBuffer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_MetricValue(TRITONSERVER_Metric, double[]) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_MODEL_CONTROL_EXPLICIT - Static variable in class org.bytedeco.tritonserver.global.tritonserver

enum TRITONSERVER_ModelControlMode

TRITONSERVER_MODEL_CONTROL_NONE - Static variable in class org.bytedeco.tritonserver.global.tritonserver

enum TRITONSERVER_ModelControlMode

TRITONSERVER_MODEL_CONTROL_POLL - Static variable in class org.bytedeco.tritonserver.global.tritonserver

enum TRITONSERVER_ModelControlMode

TRITONSERVER_Parameter - Class in org.bytedeco.tritonserver.tritonserver

TRITONSERVER_Parameter() - Constructor for class org.bytedeco.tritonserver.tritonserver.TRITONSERVER_Parameter

Empty constructor.

TRITONSERVER_Parameter(Pointer) - Constructor for class org.bytedeco.tritonserver.tritonserver.TRITONSERVER_Parameter

Pointer cast constructor.

TRITONSERVER_PARAMETER_BOOL - Static variable in class org.bytedeco.tritonserver.global.tritonserver

enum TRITONSERVER_ParameterType

TRITONSERVER_PARAMETER_BYTES - Static variable in class org.bytedeco.tritonserver.global.tritonserver

enum TRITONSERVER_ParameterType

TRITONSERVER_PARAMETER_DOUBLE - Static variable in class org.bytedeco.tritonserver.global.tritonserver

enum TRITONSERVER_ParameterType

TRITONSERVER_PARAMETER_INT - Static variable in class org.bytedeco.tritonserver.global.tritonserver

enum TRITONSERVER_ParameterType

TRITONSERVER_PARAMETER_STRING - Static variable in class org.bytedeco.tritonserver.global.tritonserver

enum TRITONSERVER_ParameterType

TRITONSERVER_ParameterBytesNew(String, Pointer, long) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Create a new parameter object with type TRITONSERVER_PARAMETER_BYTES.

TRITONSERVER_ParameterBytesNew(BytePointer, Pointer, long) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_ParameterDelete(TRITONSERVER_Parameter) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Delete an parameter object.

TRITONSERVER_ParameterNew(String, int, Pointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Create a new parameter object.

TRITONSERVER_ParameterNew(BytePointer, int, Pointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_ParameterTypeString(int) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Get the string representation of a parameter type.

TRITONSERVER_RATE_LIMIT_EXEC_COUNT - Static variable in class org.bytedeco.tritonserver.global.tritonserver

enum TRITONSERVER_RateLimitMode

TRITONSERVER_RATE_LIMIT_OFF - Static variable in class org.bytedeco.tritonserver.global.tritonserver

enum TRITONSERVER_RateLimitMode

TRITONSERVER_REQUEST_FLAG_SEQUENCE_END - Static variable in class org.bytedeco.tritonserver.global.tritonserver

enum TRITONSERVER_RequestFlag

TRITONSERVER_REQUEST_FLAG_SEQUENCE_START - Static variable in class org.bytedeco.tritonserver.global.tritonserver

enum TRITONSERVER_RequestFlag

TRITONSERVER_REQUEST_RELEASE_ALL - Static variable in class org.bytedeco.tritonserver.global.tritonserver

enum TRITONSERVER_RequestReleaseFlag

TRITONSERVER_REQUEST_RELEASE_RESCHEDULE - Static variable in class org.bytedeco.tritonserver.global.tritonserver

enum TRITONSERVER_RequestReleaseFlag

TRITONSERVER_RESPONSE_COMPLETE_FINAL - Static variable in class org.bytedeco.tritonserver.global.tritonserver

enum TRITONSERVER_ResponseCompleteFlag

TRITONSERVER_ResponseAllocator - Class in org.bytedeco.tritonserver.tritonserver

TRITONSERVER_ResponseAllocator() - Constructor for class org.bytedeco.tritonserver.tritonserver.TRITONSERVER_ResponseAllocator

Empty constructor.

TRITONSERVER_ResponseAllocator(Pointer) - Constructor for class org.bytedeco.tritonserver.tritonserver.TRITONSERVER_ResponseAllocator

Pointer cast constructor.

TRITONSERVER_ResponseAllocatorAllocFn_t - Class in org.bytedeco.tritonserver.tritonserver

TRITONSERVER_ResponseAllocator Object representing a memory allocator for output tensors in an inference response.

TRITONSERVER_ResponseAllocatorAllocFn_t(Pointer) - Constructor for class org.bytedeco.tritonserver.tritonserver.TRITONSERVER_ResponseAllocatorAllocFn_t

Pointer cast constructor.

TRITONSERVER_ResponseAllocatorAllocFn_t() - Constructor for class org.bytedeco.tritonserver.tritonserver.TRITONSERVER_ResponseAllocatorAllocFn_t

TRITONSERVER_ResponseAllocatorBufferAttributesFn_t - Class in org.bytedeco.tritonserver.tritonserver

Type for allocation function that allocates a buffer to hold an output tensor with buffer attributes.

TRITONSERVER_ResponseAllocatorBufferAttributesFn_t(Pointer) - Constructor for class org.bytedeco.tritonserver.tritonserver.TRITONSERVER_ResponseAllocatorBufferAttributesFn_t

Pointer cast constructor.

TRITONSERVER_ResponseAllocatorBufferAttributesFn_t() - Constructor for class org.bytedeco.tritonserver.tritonserver.TRITONSERVER_ResponseAllocatorBufferAttributesFn_t

TRITONSERVER_ResponseAllocatorDelete(TRITONSERVER_ResponseAllocator) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Delete a response allocator.

TRITONSERVER_ResponseAllocatorNew(PointerPointer, TRITONSERVER_ResponseAllocatorAllocFn_t, TRITONSERVER_ResponseAllocatorReleaseFn_t, TRITONSERVER_ResponseAllocatorStartFn_t) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Create a new response allocator object.

TRITONSERVER_ResponseAllocatorNew(TRITONSERVER_ResponseAllocator, TRITONSERVER_ResponseAllocatorAllocFn_t, TRITONSERVER_ResponseAllocatorReleaseFn_t, TRITONSERVER_ResponseAllocatorStartFn_t) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_ResponseAllocatorQueryFn_t - Class in org.bytedeco.tritonserver.tritonserver

Type for function that is called to query the allocator's preferred memory type and memory type ID.

TRITONSERVER_ResponseAllocatorQueryFn_t(Pointer) - Constructor for class org.bytedeco.tritonserver.tritonserver.TRITONSERVER_ResponseAllocatorQueryFn_t

Pointer cast constructor.

TRITONSERVER_ResponseAllocatorQueryFn_t() - Constructor for class org.bytedeco.tritonserver.tritonserver.TRITONSERVER_ResponseAllocatorQueryFn_t

TRITONSERVER_ResponseAllocatorReleaseFn_t - Class in org.bytedeco.tritonserver.tritonserver

Type for function that is called when the server no longer holds any reference to a buffer allocated by TRITONSERVER_ResponseAllocatorAllocFn_t.

TRITONSERVER_ResponseAllocatorReleaseFn_t(Pointer) - Constructor for class org.bytedeco.tritonserver.tritonserver.TRITONSERVER_ResponseAllocatorReleaseFn_t

Pointer cast constructor.

TRITONSERVER_ResponseAllocatorReleaseFn_t() - Constructor for class org.bytedeco.tritonserver.tritonserver.TRITONSERVER_ResponseAllocatorReleaseFn_t

TRITONSERVER_ResponseAllocatorSetBufferAttributesFunction(TRITONSERVER_ResponseAllocator, TRITONSERVER_ResponseAllocatorBufferAttributesFn_t) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Set the buffer attributes function for a response allocator object.

TRITONSERVER_ResponseAllocatorSetQueryFunction(TRITONSERVER_ResponseAllocator, TRITONSERVER_ResponseAllocatorQueryFn_t) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Set the query function to a response allocator object.

TRITONSERVER_ResponseAllocatorStartFn_t - Class in org.bytedeco.tritonserver.tritonserver

Type for function that is called to indicate that subsequent allocation requests will refer to a new response.

TRITONSERVER_ResponseAllocatorStartFn_t(Pointer) - Constructor for class org.bytedeco.tritonserver.tritonserver.TRITONSERVER_ResponseAllocatorStartFn_t

Pointer cast constructor.

TRITONSERVER_ResponseAllocatorStartFn_t() - Constructor for class org.bytedeco.tritonserver.tritonserver.TRITONSERVER_ResponseAllocatorStartFn_t

TRITONSERVER_Server - Class in org.bytedeco.tritonserver.tritonserver

TRITONSERVER_Server() - Constructor for class org.bytedeco.tritonserver.tritonserver.TRITONSERVER_Server

Empty constructor.

TRITONSERVER_Server(Pointer) - Constructor for class org.bytedeco.tritonserver.tritonserver.TRITONSERVER_Server

Pointer cast constructor.

TRITONSERVER_ServerDelete(TRITONSERVER_Server) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Delete a server object.

TRITONSERVER_ServerInferAsync(TRITONSERVER_Server, TRITONSERVER_InferenceRequest, TRITONSERVER_InferenceTrace) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Perform inference using the meta-data and inputs supplied by the 'inference_request'.

TRITONSERVER_ServerIsLive(TRITONSERVER_Server, boolean[]) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Is the server live?

TRITONSERVER_ServerIsLive(TRITONSERVER_Server, BoolPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_ServerIsReady(TRITONSERVER_Server, boolean[]) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Is the server ready?

TRITONSERVER_ServerIsReady(TRITONSERVER_Server, BoolPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_ServerLoadModel(TRITONSERVER_Server, String) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Load the requested model or reload the model if it is already loaded.

TRITONSERVER_ServerLoadModel(TRITONSERVER_Server, BytePointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_ServerLoadModelWithParameters(TRITONSERVER_Server, String, PointerPointer, long) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Load the requested model or reload the model if it is already loaded, with load parameters provided.

TRITONSERVER_ServerLoadModelWithParameters(TRITONSERVER_Server, String, TRITONSERVER_Parameter, long) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_ServerLoadModelWithParameters(TRITONSERVER_Server, BytePointer, TRITONSERVER_Parameter, long) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_ServerMetadata(TRITONSERVER_Server, PointerPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Get the metadata of the server as a TRITONSERVER_Message object.

TRITONSERVER_ServerMetadata(TRITONSERVER_Server, TRITONSERVER_Message) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_ServerMetrics(TRITONSERVER_Server, PointerPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Get the current metrics for the server.

TRITONSERVER_ServerMetrics(TRITONSERVER_Server, TRITONSERVER_Metrics) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_ServerModelBatchProperties(TRITONSERVER_Server, String, long, IntPointer, PointerPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Get the batch properties of the model.

TRITONSERVER_ServerModelBatchProperties(TRITONSERVER_Server, String, long, IntPointer, Pointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_ServerModelBatchProperties(TRITONSERVER_Server, BytePointer, long, IntBuffer, Pointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_ServerModelBatchProperties(TRITONSERVER_Server, String, long, int[], Pointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_ServerModelBatchProperties(TRITONSERVER_Server, BytePointer, long, IntPointer, Pointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_ServerModelBatchProperties(TRITONSERVER_Server, String, long, IntBuffer, Pointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_ServerModelBatchProperties(TRITONSERVER_Server, BytePointer, long, int[], Pointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_ServerModelConfig(TRITONSERVER_Server, String, long, int, PointerPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Get the configuration of a model as a TRITONSERVER_Message object.

TRITONSERVER_ServerModelConfig(TRITONSERVER_Server, String, long, int, TRITONSERVER_Message) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_ServerModelConfig(TRITONSERVER_Server, BytePointer, long, int, TRITONSERVER_Message) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_ServerModelIndex(TRITONSERVER_Server, int, PointerPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Get the index of all unique models in the model repositories as a TRITONSERVER_Message object.

TRITONSERVER_ServerModelIndex(TRITONSERVER_Server, int, TRITONSERVER_Message) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_ServerModelIsReady(TRITONSERVER_Server, String, long, boolean[]) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Is the model ready?

TRITONSERVER_ServerModelIsReady(TRITONSERVER_Server, BytePointer, long, BoolPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_ServerModelMetadata(TRITONSERVER_Server, String, long, PointerPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Get the metadata of a model as a TRITONSERVER_Message object.

TRITONSERVER_ServerModelMetadata(TRITONSERVER_Server, String, long, TRITONSERVER_Message) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_ServerModelMetadata(TRITONSERVER_Server, BytePointer, long, TRITONSERVER_Message) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_ServerModelStatistics(TRITONSERVER_Server, String, long, PointerPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Get the statistics of a model as a TRITONSERVER_Message object.

TRITONSERVER_ServerModelStatistics(TRITONSERVER_Server, String, long, TRITONSERVER_Message) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_ServerModelStatistics(TRITONSERVER_Server, BytePointer, long, TRITONSERVER_Message) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_ServerModelTransactionProperties(TRITONSERVER_Server, String, long, IntPointer, PointerPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Get the transaction policy of the model.

TRITONSERVER_ServerModelTransactionProperties(TRITONSERVER_Server, String, long, IntPointer, Pointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_ServerModelTransactionProperties(TRITONSERVER_Server, BytePointer, long, IntBuffer, Pointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_ServerModelTransactionProperties(TRITONSERVER_Server, String, long, int[], Pointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_ServerModelTransactionProperties(TRITONSERVER_Server, BytePointer, long, IntPointer, Pointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_ServerModelTransactionProperties(TRITONSERVER_Server, String, long, IntBuffer, Pointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_ServerModelTransactionProperties(TRITONSERVER_Server, BytePointer, long, int[], Pointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_ServerNew(PointerPointer, TRITONSERVER_ServerOptions) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Create a new server object.

TRITONSERVER_ServerNew(TRITONSERVER_Server, TRITONSERVER_ServerOptions) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_ServerOptions - Class in org.bytedeco.tritonserver.tritonserver

TRITONSERVER_ServerOptions() - Constructor for class org.bytedeco.tritonserver.tritonserver.TRITONSERVER_ServerOptions

Empty constructor.

TRITONSERVER_ServerOptions(Pointer) - Constructor for class org.bytedeco.tritonserver.tritonserver.TRITONSERVER_ServerOptions

Pointer cast constructor.

TRITONSERVER_ServerOptionsAddRateLimiterResource(TRITONSERVER_ServerOptions, String, long, int) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Add resource count for rate limiting.

TRITONSERVER_ServerOptionsAddRateLimiterResource(TRITONSERVER_ServerOptions, BytePointer, long, int) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_ServerOptionsDelete(TRITONSERVER_ServerOptions) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Delete a server options object.

TRITONSERVER_ServerOptionsNew(PointerPointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Create a new server options object.

TRITONSERVER_ServerOptionsNew(TRITONSERVER_ServerOptions) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_ServerOptionsSetBackendConfig(TRITONSERVER_ServerOptions, String, String, String) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Set a configuration setting for a named backend in a server options.

TRITONSERVER_ServerOptionsSetBackendConfig(TRITONSERVER_ServerOptions, BytePointer, BytePointer, BytePointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_ServerOptionsSetBackendDirectory(TRITONSERVER_ServerOptions, String) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Set the directory containing backend shared libraries.

TRITONSERVER_ServerOptionsSetBackendDirectory(TRITONSERVER_ServerOptions, BytePointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_ServerOptionsSetBufferManagerThreadCount(TRITONSERVER_ServerOptions, int) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Set the number of threads used in buffer manager in a server options.

TRITONSERVER_ServerOptionsSetCacheConfig(TRITONSERVER_ServerOptions, String, String) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Set the cache config that will be used to initialize the cache implementation for "cache_name".

TRITONSERVER_ServerOptionsSetCacheConfig(TRITONSERVER_ServerOptions, BytePointer, BytePointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_ServerOptionsSetCacheDirectory(TRITONSERVER_ServerOptions, String) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Set the directory containing cache shared libraries.

TRITONSERVER_ServerOptionsSetCacheDirectory(TRITONSERVER_ServerOptions, BytePointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_ServerOptionsSetCpuMetrics(TRITONSERVER_ServerOptions, boolean) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Enable or disable CPU metrics collection in a server options.

TRITONSERVER_ServerOptionsSetCudaMemoryPoolByteSize(TRITONSERVER_ServerOptions, int, long) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Set the total CUDA memory byte size that the server can allocate on given GPU device in a server options.

TRITONSERVER_ServerOptionsSetCudaVirtualAddressSize(TRITONSERVER_ServerOptions, int, long) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Set the size of the virtual address space that will be used for growable memory in implicit state.

TRITONSERVER_ServerOptionsSetEnablePeerAccess(TRITONSERVER_ServerOptions, boolean) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Enable peer access to allow GPU device to directly access the memory of another GPU device.

TRITONSERVER_ServerOptionsSetExitOnError(TRITONSERVER_ServerOptions, boolean) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Enable or disable exit-on-error in a server options.

TRITONSERVER_ServerOptionsSetExitTimeout(TRITONSERVER_ServerOptions, int) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Set the exit timeout, in seconds, for the server in a server options.

TRITONSERVER_ServerOptionsSetGpuMetrics(TRITONSERVER_ServerOptions, boolean) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Enable or disable GPU metrics collection in a server options.

TRITONSERVER_ServerOptionsSetHostPolicy(TRITONSERVER_ServerOptions, String, String, String) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Set a host policy setting for a given policy name in a server options.

TRITONSERVER_ServerOptionsSetHostPolicy(TRITONSERVER_ServerOptions, BytePointer, BytePointer, BytePointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_ServerOptionsSetLogError(TRITONSERVER_ServerOptions, boolean) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Enable or disable error level logging.

TRITONSERVER_ServerOptionsSetLogFile(TRITONSERVER_ServerOptions, String) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Provide a log output file.

TRITONSERVER_ServerOptionsSetLogFile(TRITONSERVER_ServerOptions, BytePointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_ServerOptionsSetLogFormat(TRITONSERVER_ServerOptions, int) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Set the logging format.

TRITONSERVER_ServerOptionsSetLogInfo(TRITONSERVER_ServerOptions, boolean) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Enable or disable info level logging.

TRITONSERVER_ServerOptionsSetLogVerbose(TRITONSERVER_ServerOptions, int) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Set verbose logging level.

TRITONSERVER_ServerOptionsSetLogWarn(TRITONSERVER_ServerOptions, boolean) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Enable or disable warning level logging.

TRITONSERVER_ServerOptionsSetMetrics(TRITONSERVER_ServerOptions, boolean) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Enable or disable metrics collection in a server options.

TRITONSERVER_ServerOptionsSetMetricsConfig(TRITONSERVER_ServerOptions, String, String, String) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Set a configuration setting for metrics in server options.

TRITONSERVER_ServerOptionsSetMetricsConfig(TRITONSERVER_ServerOptions, BytePointer, BytePointer, BytePointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_ServerOptionsSetMetricsInterval(TRITONSERVER_ServerOptions, long) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Set the interval for metrics collection in a server options.

TRITONSERVER_ServerOptionsSetMinSupportedComputeCapability(TRITONSERVER_ServerOptions, double) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Set the minimum support CUDA compute capability in a server options.

TRITONSERVER_ServerOptionsSetModelConfigName(TRITONSERVER_ServerOptions, String) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Set the custom model configuration name to load for all models.

TRITONSERVER_ServerOptionsSetModelConfigName(TRITONSERVER_ServerOptions, BytePointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_ServerOptionsSetModelControlMode(TRITONSERVER_ServerOptions, int) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Set the model control mode in a server options.

TRITONSERVER_ServerOptionsSetModelLoadDeviceLimit(TRITONSERVER_ServerOptions, int, int, double) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Specify the limit on memory usage as a fraction on the device identified by 'kind' and 'device_id'.

TRITONSERVER_ServerOptionsSetModelLoadRetryCount(TRITONSERVER_ServerOptions, int) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Set the number of retry to load a model in a server options.

TRITONSERVER_ServerOptionsSetModelLoadThreadCount(TRITONSERVER_ServerOptions, int) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Set the number of threads to concurrently load models in a server options.

TRITONSERVER_ServerOptionsSetModelNamespacing(TRITONSERVER_ServerOptions, boolean) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Enable model namespacing to allow serving models with the same name if they are in different namespaces.

TRITONSERVER_ServerOptionsSetModelRepositoryPath(TRITONSERVER_ServerOptions, String) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Set the model repository path in a server options.

TRITONSERVER_ServerOptionsSetModelRepositoryPath(TRITONSERVER_ServerOptions, BytePointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_ServerOptionsSetPinnedMemoryPoolByteSize(TRITONSERVER_ServerOptions, long) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Set the total pinned memory byte size that the server can allocate in a server options.

TRITONSERVER_ServerOptionsSetRateLimiterMode(TRITONSERVER_ServerOptions, int) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Set the rate limit mode in a server options.

TRITONSERVER_ServerOptionsSetRepoAgentDirectory(TRITONSERVER_ServerOptions, String) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Set the directory containing repository agent shared libraries.

TRITONSERVER_ServerOptionsSetRepoAgentDirectory(TRITONSERVER_ServerOptions, BytePointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_ServerOptionsSetResponseCacheByteSize(TRITONSERVER_ServerOptions, long) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Deprecated.

TRITONSERVER_ServerOptionsSetServerId(TRITONSERVER_ServerOptions, String) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Set the textual ID for the server in a server options.

TRITONSERVER_ServerOptionsSetServerId(TRITONSERVER_ServerOptions, BytePointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_ServerOptionsSetStartupModel(TRITONSERVER_ServerOptions, String) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Set the model to be loaded at startup in a server options.

TRITONSERVER_ServerOptionsSetStartupModel(TRITONSERVER_ServerOptions, BytePointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_ServerOptionsSetStrictModelConfig(TRITONSERVER_ServerOptions, boolean) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Enable or disable strict model configuration handling in a server options.

TRITONSERVER_ServerOptionsSetStrictReadiness(TRITONSERVER_ServerOptions, boolean) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Enable or disable strict readiness handling in a server options.

TRITONSERVER_ServerPollModelRepository(TRITONSERVER_Server) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Check the model repository for changes and update server state based on those changes.

TRITONSERVER_ServerRegisterModelRepository(TRITONSERVER_Server, String, PointerPointer, int) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Register a new model repository.

TRITONSERVER_ServerRegisterModelRepository(TRITONSERVER_Server, String, TRITONSERVER_Parameter, int) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_ServerRegisterModelRepository(TRITONSERVER_Server, BytePointer, TRITONSERVER_Parameter, int) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_ServerSetExitTimeout(TRITONSERVER_Server, int) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Set the exit timeout on the server object.

TRITONSERVER_ServerStop(TRITONSERVER_Server) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Stop a server object.

TRITONSERVER_ServerUnloadModel(TRITONSERVER_Server, String) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Unload the requested model.

TRITONSERVER_ServerUnloadModel(TRITONSERVER_Server, BytePointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_ServerUnloadModelAndDependents(TRITONSERVER_Server, String) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Unload the requested model, and also unload any dependent model that was loaded along with the requested model (for example, the models composing an ensemble).

TRITONSERVER_ServerUnloadModelAndDependents(TRITONSERVER_Server, BytePointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_ServerUnregisterModelRepository(TRITONSERVER_Server, String) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Unregister a model repository.

TRITONSERVER_ServerUnregisterModelRepository(TRITONSERVER_Server, BytePointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_StringToDataType(String) - Static method in class org.bytedeco.tritonserver.global.tritonserver

Get the Triton datatype corresponding to a string representation of a datatype.

TRITONSERVER_StringToDataType(BytePointer) - Static method in class org.bytedeco.tritonserver.global.tritonserver

TRITONSERVER_TRACE_COMPUTE_END - Static variable in class org.bytedeco.tritonserver.global.tritonserver

enum TRITONSERVER_InferenceTraceActivity

TRITONSERVER_TRACE_COMPUTE_INPUT_END - Static variable in class org.bytedeco.tritonserver.global.tritonserver

enum TRITONSERVER_InferenceTraceActivity

TRITONSERVER_TRACE_COMPUTE_OUTPUT_START - Static variable in class org.bytedeco.tritonserver.global.tritonserver

enum TRITONSERVER_InferenceTraceActivity

TRITONSERVER_TRACE_COMPUTE_START - Static variable in class org.bytedeco.tritonserver.global.tritonserver

enum TRITONSERVER_InferenceTraceActivity

TRITONSERVER_TRACE_CUSTOM_ACTIVITY - Static variable in class org.bytedeco.tritonserver.global.tritonserver

enum TRITONSERVER_InferenceTraceActivity

TRITONSERVER_TRACE_LEVEL_DISABLED - Static variable in class org.bytedeco.tritonserver.global.tritonserver

enum TRITONSERVER_InferenceTraceLevel

TRITONSERVER_TRACE_LEVEL_MAX - Static variable in class org.bytedeco.tritonserver.global.tritonserver

enum TRITONSERVER_InferenceTraceLevel

TRITONSERVER_TRACE_LEVEL_MIN - Static variable in class org.bytedeco.tritonserver.global.tritonserver

enum TRITONSERVER_InferenceTraceLevel

TRITONSERVER_TRACE_LEVEL_TENSORS - Static variable in class org.bytedeco.tritonserver.global.tritonserver

enum TRITONSERVER_InferenceTraceLevel

TRITONSERVER_TRACE_LEVEL_TIMESTAMPS - Static variable in class org.bytedeco.tritonserver.global.tritonserver

enum TRITONSERVER_InferenceTraceLevel

TRITONSERVER_TRACE_QUEUE_START - Static variable in class org.bytedeco.tritonserver.global.tritonserver

enum TRITONSERVER_InferenceTraceActivity

TRITONSERVER_TRACE_REQUEST_END - Static variable in class org.bytedeco.tritonserver.global.tritonserver

enum TRITONSERVER_InferenceTraceActivity

TRITONSERVER_TRACE_REQUEST_START - Static variable in class org.bytedeco.tritonserver.global.tritonserver

enum TRITONSERVER_InferenceTraceActivity

TRITONSERVER_TRACE_TENSOR_BACKEND_INPUT - Static variable in class org.bytedeco.tritonserver.global.tritonserver

enum TRITONSERVER_InferenceTraceActivity

TRITONSERVER_TRACE_TENSOR_BACKEND_OUTPUT - Static variable in class org.bytedeco.tritonserver.global.tritonserver

enum TRITONSERVER_InferenceTraceActivity

TRITONSERVER_TRACE_TENSOR_QUEUE_INPUT - Static variable in class org.bytedeco.tritonserver.global.tritonserver

enum TRITONSERVER_InferenceTraceActivity

TRITONSERVER_TXN_DECOUPLED - Static variable in class org.bytedeco.tritonserver.global.tritonserver

enum TRITONSERVER_ModelTxnPropertyFlag

TRITONSERVER_TXN_ONE_TO_ONE - Static variable in class org.bytedeco.tritonserver.global.tritonserver

enum TRITONSERVER_ModelTxnPropertyFlag

TRITONSERVER_TYPE_BF16 - Static variable in class org.bytedeco.tritonserver.global.tritonserver

enum TRITONSERVER_DataType

TRITONSERVER_TYPE_BOOL - Static variable in class org.bytedeco.tritonserver.global.tritonserver

enum TRITONSERVER_DataType

TRITONSERVER_TYPE_BYTES - Static variable in class org.bytedeco.tritonserver.global.tritonserver

enum TRITONSERVER_DataType

TRITONSERVER_TYPE_FP16 - Static variable in class org.bytedeco.tritonserver.global.tritonserver

enum TRITONSERVER_DataType

TRITONSERVER_TYPE_FP32 - Static variable in class org.bytedeco.tritonserver.global.tritonserver

enum TRITONSERVER_DataType

TRITONSERVER_TYPE_FP64 - Static variable in class org.bytedeco.tritonserver.global.tritonserver

enum TRITONSERVER_DataType

TRITONSERVER_TYPE_INT16 - Static variable in class org.bytedeco.tritonserver.global.tritonserver

enum TRITONSERVER_DataType

TRITONSERVER_TYPE_INT32 - Static variable in class org.bytedeco.tritonserver.global.tritonserver

enum TRITONSERVER_DataType

TRITONSERVER_TYPE_INT64 - Static variable in class org.bytedeco.tritonserver.global.tritonserver

enum TRITONSERVER_DataType

TRITONSERVER_TYPE_INT8 - Static variable in class org.bytedeco.tritonserver.global.tritonserver

enum TRITONSERVER_DataType

TRITONSERVER_TYPE_INVALID - Static variable in class org.bytedeco.tritonserver.global.tritonserver

enum TRITONSERVER_DataType

TRITONSERVER_TYPE_UINT16 - Static variable in class org.bytedeco.tritonserver.global.tritonserver

enum TRITONSERVER_DataType

TRITONSERVER_TYPE_UINT32 - Static variable in class org.bytedeco.tritonserver.global.tritonserver

enum TRITONSERVER_DataType

TRITONSERVER_TYPE_UINT64 - Static variable in class org.bytedeco.tritonserver.global.tritonserver

enum TRITONSERVER_DataType

TRITONSERVER_TYPE_UINT8 - Static variable in class org.bytedeco.tritonserver.global.tritonserver

enum TRITONSERVER_DataType

U

UINT16 - Static variable in class org.bytedeco.tritonserver.global.tritondevelopertoolsserver

enum class triton::developer_tools::server::DataType

UINT32 - Static variable in class org.bytedeco.tritonserver.global.tritondevelopertoolsserver

enum class triton::developer_tools::server::DataType

UINT64 - Static variable in class org.bytedeco.tritonserver.global.tritondevelopertoolsserver

enum class triton::developer_tools::server::DataType

UINT8 - Static variable in class org.bytedeco.tritonserver.global.tritondevelopertoolsserver

enum class triton::developer_tools::server::DataType

UNAVAILABLE - Static variable in class org.bytedeco.tritonserver.global.tritondevelopertoolsserver

enum class triton::developer_tools::server::ModelReadyState

UNKNOWN - Static variable in class org.bytedeco.tritonserver.global.tritondevelopertoolsserver

enum class triton::developer_tools::server::ModelReadyState

UNLOADING - Static variable in class org.bytedeco.tritonserver.global.tritondevelopertoolsserver

enum class triton::developer_tools::server::ModelReadyState

UnloadModel(BytePointer) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.GenericTritonServer

Unload the requested model.

UnloadModel(String) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.GenericTritonServer

UnregisterModelRepo(BytePointer) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.GenericTritonServer

Unregister a model repository.

UnregisterModelRepo(String) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.GenericTritonServer

V

value_() - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.BackendConfig

value_(BytePointer) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.BackendConfig

value_() - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.HostPolicy

value_(BytePointer) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.HostPolicy

verbose_() - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.LoggingOptions

verbose_(int) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.LoggingOptions

version_() - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.RepositoryIndex

version_(BytePointer) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.RepositoryIndex

W

warn_() - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.LoggingOptions

warn_(boolean) - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.LoggingOptions

what() - Method in class org.bytedeco.tritonserver.tritondevelopertoolsserver.TritonException

A B C D E F G H I L M N O P R S T U V W