Uses of Class
org.bytedeco.tritonserver.tritonserver.TRITONSERVER_ServerOptions

Packages that use TRITONSERVER_ServerOptions

Package	Description
org.bytedeco.tritonserver.global

Uses of TRITONSERVER_ServerOptions in org.bytedeco.tritonserver.global

Methods in org.bytedeco.tritonserver.global with parameters of type TRITONSERVER_ServerOptions

Modifier and Type	Method and Description
static TRITONSERVER_Error	tritonserver.TRITONSERVER_ServerNew(PointerPointer server, TRITONSERVER_ServerOptions options) Create a new server object.
static TRITONSERVER_Error	tritonserver.TRITONSERVER_ServerNew(TRITONSERVER_Server server, TRITONSERVER_ServerOptions options)
static TRITONSERVER_Error	tritonserver.TRITONSERVER_ServerOptionsAddRateLimiterResource(TRITONSERVER_ServerOptions options, BytePointer resource_name, long resource_count, int device)
static TRITONSERVER_Error	tritonserver.TRITONSERVER_ServerOptionsAddRateLimiterResource(TRITONSERVER_ServerOptions options, String resource_name, long resource_count, int device) Add resource count for rate limiting.
static TRITONSERVER_Error	tritonserver.TRITONSERVER_ServerOptionsDelete(TRITONSERVER_ServerOptions options) Delete a server options object.
static TRITONSERVER_Error	tritonserver.TRITONSERVER_ServerOptionsNew(TRITONSERVER_ServerOptions options)
static TRITONSERVER_Error	tritonserver.TRITONSERVER_ServerOptionsSetBackendConfig(TRITONSERVER_ServerOptions options, BytePointer backend_name, BytePointer setting, BytePointer value)
static TRITONSERVER_Error	tritonserver.TRITONSERVER_ServerOptionsSetBackendConfig(TRITONSERVER_ServerOptions options, String backend_name, String setting, String value) Set a configuration setting for a named backend in a server options.
static TRITONSERVER_Error	tritonserver.TRITONSERVER_ServerOptionsSetBackendDirectory(TRITONSERVER_ServerOptions options, BytePointer backend_dir)
static TRITONSERVER_Error	tritonserver.TRITONSERVER_ServerOptionsSetBackendDirectory(TRITONSERVER_ServerOptions options, String backend_dir) Set the directory containing backend shared libraries.
static TRITONSERVER_Error	tritonserver.TRITONSERVER_ServerOptionsSetBufferManagerThreadCount(TRITONSERVER_ServerOptions options, int thread_count) Set the number of threads used in buffer manager in a server options.
static TRITONSERVER_Error	tritonserver.TRITONSERVER_ServerOptionsSetCacheConfig(TRITONSERVER_ServerOptions options, BytePointer cache_name, BytePointer config_json)
static TRITONSERVER_Error	tritonserver.TRITONSERVER_ServerOptionsSetCacheConfig(TRITONSERVER_ServerOptions options, String cache_name, String config_json) Set the cache config that will be used to initialize the cache implementation for "cache_name".
static TRITONSERVER_Error	tritonserver.TRITONSERVER_ServerOptionsSetCacheDirectory(TRITONSERVER_ServerOptions options, BytePointer cache_dir)
static TRITONSERVER_Error	tritonserver.TRITONSERVER_ServerOptionsSetCacheDirectory(TRITONSERVER_ServerOptions options, String cache_dir) Set the directory containing cache shared libraries.
static TRITONSERVER_Error	tritonserver.TRITONSERVER_ServerOptionsSetCpuMetrics(TRITONSERVER_ServerOptions options, boolean cpu_metrics) Enable or disable CPU metrics collection in a server options.
static TRITONSERVER_Error	tritonserver.TRITONSERVER_ServerOptionsSetCudaMemoryPoolByteSize(TRITONSERVER_ServerOptions options, int gpu_device, long size) Set the total CUDA memory byte size that the server can allocate on given GPU device in a server options.
static TRITONSERVER_Error	tritonserver.TRITONSERVER_ServerOptionsSetCudaVirtualAddressSize(TRITONSERVER_ServerOptions options, int gpu_device, long cuda_virtual_address_size) Set the size of the virtual address space that will be used for growable memory in implicit state.
static TRITONSERVER_Error	tritonserver.TRITONSERVER_ServerOptionsSetEnablePeerAccess(TRITONSERVER_ServerOptions options, boolean enable_peer_access) Enable peer access to allow GPU device to directly access the memory of another GPU device.
static TRITONSERVER_Error	tritonserver.TRITONSERVER_ServerOptionsSetExitOnError(TRITONSERVER_ServerOptions options, boolean exit) Enable or disable exit-on-error in a server options.
static TRITONSERVER_Error	tritonserver.TRITONSERVER_ServerOptionsSetExitTimeout(TRITONSERVER_ServerOptions options, int timeout) Set the exit timeout, in seconds, for the server in a server options.
static TRITONSERVER_Error	tritonserver.TRITONSERVER_ServerOptionsSetGpuMetrics(TRITONSERVER_ServerOptions options, boolean gpu_metrics) Enable or disable GPU metrics collection in a server options.
static TRITONSERVER_Error	tritonserver.TRITONSERVER_ServerOptionsSetHostPolicy(TRITONSERVER_ServerOptions options, BytePointer policy_name, BytePointer setting, BytePointer value)
static TRITONSERVER_Error	tritonserver.TRITONSERVER_ServerOptionsSetHostPolicy(TRITONSERVER_ServerOptions options, String policy_name, String setting, String value) Set a host policy setting for a given policy name in a server options.
static TRITONSERVER_Error	tritonserver.TRITONSERVER_ServerOptionsSetLogError(TRITONSERVER_ServerOptions options, boolean log) Enable or disable error level logging.
static TRITONSERVER_Error	tritonserver.TRITONSERVER_ServerOptionsSetLogFile(TRITONSERVER_ServerOptions options, BytePointer file)
static TRITONSERVER_Error	tritonserver.TRITONSERVER_ServerOptionsSetLogFile(TRITONSERVER_ServerOptions options, String file) Provide a log output file.
static TRITONSERVER_Error	tritonserver.TRITONSERVER_ServerOptionsSetLogFormat(TRITONSERVER_ServerOptions options, int format) Set the logging format.
static TRITONSERVER_Error	tritonserver.TRITONSERVER_ServerOptionsSetLogInfo(TRITONSERVER_ServerOptions options, boolean log) Enable or disable info level logging.
static TRITONSERVER_Error	tritonserver.TRITONSERVER_ServerOptionsSetLogVerbose(TRITONSERVER_ServerOptions options, int level) Set verbose logging level.
static TRITONSERVER_Error	tritonserver.TRITONSERVER_ServerOptionsSetLogWarn(TRITONSERVER_ServerOptions options, boolean log) Enable or disable warning level logging.
static TRITONSERVER_Error	tritonserver.TRITONSERVER_ServerOptionsSetMetrics(TRITONSERVER_ServerOptions options, boolean metrics) Enable or disable metrics collection in a server options.
static TRITONSERVER_Error	tritonserver.TRITONSERVER_ServerOptionsSetMetricsConfig(TRITONSERVER_ServerOptions options, BytePointer name, BytePointer setting, BytePointer value)
static TRITONSERVER_Error	tritonserver.TRITONSERVER_ServerOptionsSetMetricsConfig(TRITONSERVER_ServerOptions options, String name, String setting, String value) Set a configuration setting for metrics in server options.
static TRITONSERVER_Error	tritonserver.TRITONSERVER_ServerOptionsSetMetricsInterval(TRITONSERVER_ServerOptions options, long metrics_interval_ms) Set the interval for metrics collection in a server options.
static TRITONSERVER_Error	tritonserver.TRITONSERVER_ServerOptionsSetMinSupportedComputeCapability(TRITONSERVER_ServerOptions options, double cc) Set the minimum support CUDA compute capability in a server options.
static TRITONSERVER_Error	tritonserver.TRITONSERVER_ServerOptionsSetModelConfigName(TRITONSERVER_ServerOptions options, BytePointer model_config_name)
static TRITONSERVER_Error	tritonserver.TRITONSERVER_ServerOptionsSetModelConfigName(TRITONSERVER_ServerOptions options, String model_config_name) Set the custom model configuration name to load for all models.
static TRITONSERVER_Error	tritonserver.TRITONSERVER_ServerOptionsSetModelControlMode(TRITONSERVER_ServerOptions options, int mode) Set the model control mode in a server options.
static TRITONSERVER_Error	tritonserver.TRITONSERVER_ServerOptionsSetModelLoadDeviceLimit(TRITONSERVER_ServerOptions options, int kind, int device_id, double fraction) Specify the limit on memory usage as a fraction on the device identified by 'kind' and 'device_id'.
static TRITONSERVER_Error	tritonserver.TRITONSERVER_ServerOptionsSetModelLoadRetryCount(TRITONSERVER_ServerOptions options, int retry_count) Set the number of retry to load a model in a server options.
static TRITONSERVER_Error	tritonserver.TRITONSERVER_ServerOptionsSetModelLoadThreadCount(TRITONSERVER_ServerOptions options, int thread_count) Set the number of threads to concurrently load models in a server options.
static TRITONSERVER_Error	tritonserver.TRITONSERVER_ServerOptionsSetModelNamespacing(TRITONSERVER_ServerOptions options, boolean enable_namespace) Enable model namespacing to allow serving models with the same name if they are in different namespaces.
static TRITONSERVER_Error	tritonserver.TRITONSERVER_ServerOptionsSetModelRepositoryPath(TRITONSERVER_ServerOptions options, BytePointer model_repository_path)
static TRITONSERVER_Error	tritonserver.TRITONSERVER_ServerOptionsSetModelRepositoryPath(TRITONSERVER_ServerOptions options, String model_repository_path) Set the model repository path in a server options.
static TRITONSERVER_Error	tritonserver.TRITONSERVER_ServerOptionsSetPinnedMemoryPoolByteSize(TRITONSERVER_ServerOptions options, long size) Set the total pinned memory byte size that the server can allocate in a server options.
static TRITONSERVER_Error	tritonserver.TRITONSERVER_ServerOptionsSetRateLimiterMode(TRITONSERVER_ServerOptions options, int mode) Set the rate limit mode in a server options.
static TRITONSERVER_Error	tritonserver.TRITONSERVER_ServerOptionsSetRepoAgentDirectory(TRITONSERVER_ServerOptions options, BytePointer repoagent_dir)
static TRITONSERVER_Error	tritonserver.TRITONSERVER_ServerOptionsSetRepoAgentDirectory(TRITONSERVER_ServerOptions options, String repoagent_dir) Set the directory containing repository agent shared libraries.
static TRITONSERVER_Error	tritonserver.TRITONSERVER_ServerOptionsSetResponseCacheByteSize(TRITONSERVER_ServerOptions options, long size) Deprecated.
static TRITONSERVER_Error	tritonserver.TRITONSERVER_ServerOptionsSetServerId(TRITONSERVER_ServerOptions options, BytePointer server_id)
static TRITONSERVER_Error	tritonserver.TRITONSERVER_ServerOptionsSetServerId(TRITONSERVER_ServerOptions options, String server_id) Set the textual ID for the server in a server options.
static TRITONSERVER_Error	tritonserver.TRITONSERVER_ServerOptionsSetStartupModel(TRITONSERVER_ServerOptions options, BytePointer model_name)
static TRITONSERVER_Error	tritonserver.TRITONSERVER_ServerOptionsSetStartupModel(TRITONSERVER_ServerOptions options, String model_name) Set the model to be loaded at startup in a server options.
static TRITONSERVER_Error	tritonserver.TRITONSERVER_ServerOptionsSetStrictModelConfig(TRITONSERVER_ServerOptions options, boolean strict) Enable or disable strict model configuration handling in a server options.
static TRITONSERVER_Error	tritonserver.TRITONSERVER_ServerOptionsSetStrictReadiness(TRITONSERVER_ServerOptions options, boolean strict) Enable or disable strict readiness handling in a server options.