org.bytedeco.tensorrt.global

Class nvinfer

java.lang.Object

org.bytedeco.tensorrt.presets.nvinfer

org.bytedeco.tensorrt.global.nvinfer

All Implemented Interfaces:

LoadEnabled, InfoMapper

public class nvinfer
extends nvinfer

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	nvinfer.ActivationType \enum ActivationType \brief Enumerates the types of activation to perform in an activation layer.
static class	nvinfer.AllocatorFlag \enum AllocatorFlag \brief Allowed type of memory allocation.
static class	nvinfer.APILanguage \enum APILanguage \brief Programming language used in the implementation of a TRT interface
static class	nvinfer.BoundingBoxFormat \enum BoundingBoxFormat \brief Representation of bounding box data used for the Boxes input tensor in INMSLayer
static class	nvinfer.BuilderFlag \enum BuilderFlag \brief List of valid modes that the builder can enable when creating an engine from a network definition.
static class	nvinfer.CalibrationAlgoType Deprecated. Deprecated in TensorRT 10.1. Superseded by explicit quantization.
static class	nvinfer.CumulativeOperation \enum CumulativeOperation \brief Enumerates the cumulative operations that may be performed by a Cumulative layer.
static class	nvinfer.DataType \enum DataType \brief The type of weights and tensors.
static class	nvinfer.DeviceType \enum DeviceType \brief The device that this layer/network will execute on.
static class	nvinfer.DimensionOperation \enum DimensionOperation \brief An operation on two IDimensionExpr, which represent integer expressions used in dimension computations.
static class	nvinfer.ElementWiseOperation \enum ElementWiseOperation \brief Enumerates the binary operations that may be performed by an ElementWise layer.
static class	nvinfer.EngineCapability \enum EngineCapability \brief List of supported engine capability flows.
static class	nvinfer.ErrorCode \enum ErrorCode \brief Error codes that can be returned by TensorRT during execution.
static class	nvinfer.ExecutionContextAllocationStrategy \enum ExecutionContextAllocationStrategy \brief Different memory allocation behaviors for IExecutionContext.
static class	nvinfer.FillOperation \enum FillOperation \brief Enumerates the tensor fill operations that may performed by a fill layer.
static class	nvinfer.GatherMode \brief Control form of IGatherLayer
static class	nvinfer.HardwareCompatibilityLevel \enum HardwareCompatibilityLevel \brief Describes requirements of compatibility with GPU architectures other than that of the GPU on which the engine was built.
static class	nvinfer.InterpolationMode \enum InterpolationMode \brief Enumerates various modes of interpolation
static class	nvinfer.LayerInformationFormat \enum LayerInformationFormat \brief The format in which the IEngineInspector prints the layer information.
static class	nvinfer.LayerType \enum LayerType \brief The type values of layer classes.
static class	nvinfer.LoopOutput \enum LoopOutput \brief Enum that describes kinds of loop outputs.
static class	nvinfer.MatrixOperation \enum MatrixOperation \brief Enumerates the operations that may be performed on a tensor by IMatrixMultiplyLayer before multiplication.
static class	nvinfer.MemoryPoolType \enum MemoryPoolType \brief The type for memory pools used by TensorRT.
static class	nvinfer.NetworkDefinitionCreationFlag \enum NetworkDefinitionCreationFlag \brief List of immutable network properties expressed at network creation time.
static class	nvinfer.OptProfileSelector \enum OptProfileSelector \brief When setting or querying optimization profile parameters (such as shape tensor inputs or dynamic dimensions), select whether we are interested in the minimum, optimum, or maximum values for these parameters.
static class	nvinfer.PaddingMode \enum PaddingMode \brief Enumerates the modes of padding to perform in convolution, deconvolution and pooling layer, padding mode takes precedence if setPaddingMode() and setPrePadding() are also used.
static class	nvinfer.PluginCapabilityType \enum PluginCapabilityType \brief Enumerates the different capability types a IPluginV3 object may have
static class	nvinfer.PluginCreatorVersion Deprecated. Deprecated in TensorRT 10.10. PluginCreatorVersion is used only in relation to plugin creators based off IPluginCreator, which is deprecated.
static class	nvinfer.PluginFieldType \enum PluginFieldType \brief The possible field types for custom layer.
static class	nvinfer.PluginVersion Deprecated. Deprecated in TensorRT 10.10. PluginVersion is used only in relation to IPluginV2-descendent plugin interfaces, which are all deprecated.
static class	nvinfer.PoolingType \enum PoolingType \brief The type of pooling to perform in a pooling layer.
static class	nvinfer.PreviewFeature \enum PreviewFeature \brief Define preview features Preview Features have been fully tested but are not yet as stable as other features in TensorRT.
static class	nvinfer.ProfilingVerbosity \enum ProfilingVerbosity \brief List of verbosity levels of layer information exposed in NVTX annotations and in IEngineInspector.
static class	nvinfer.QuantizationFlag Deprecated. Deprecated in TensorRT 10.1. Superseded by explicit quantization.
static class	nvinfer.ReduceOperation \enum ReduceOperation \brief Enumerates the reduce operations that may be performed by a Reduce layer.
static class	nvinfer.ResizeCoordinateTransformation \enum ResizeCoordinateTransformation \brief The resize coordinate transformation function.
static class	nvinfer.ResizeRoundMode \enum ResizeRoundMode \brief The rounding mode for nearest neighbor resize.
static class	nvinfer.ResizeSelector \enum ResizeSelector \brief The coordinate selector when resize to single pixel output.
static class	nvinfer.RuntimePlatform \enum RuntimePlatform \brief Describes the intended runtime platform (operating system and CPU architecture) for the execution of the TensorRT engine.
static class	nvinfer.SampleMode \brief Controls how ISliceLayer and IGridSample handle out-of-bounds coordinates.
static class	nvinfer.ScaleMode \brief Controls how shift, scale and power are applied in a Scale layer.
static class	nvinfer.ScatterMode \enum ScatterMode \brief Control form of IScatterLayer
static class	nvinfer.SeekPosition \enum SeekPosition \brief Controls the seek mode of IStreamReaderV2.
static class	nvinfer.SerializationFlag \enum SerializationFlag \brief List of valid flags that the engine can enable when serializing the bytes.
static class	nvinfer.TacticSource \enum TacticSource \brief List of tactic sources for TensorRT.
static class	nvinfer.TempfileControlFlag \enum TempfileControlFlag \brief Flags used to control TensorRT's behavior when creating executable temporary files.
static class	nvinfer.TensorFormat \enum TensorFormat \brief Format of the input/output tensors.
static class	nvinfer.TensorIOMode \enum TensorIOMode \brief Definition of tensor IO Mode.
static class	nvinfer.TensorLocation \enum TensorLocation \brief The location for tensor data storage, device or host.
static class	nvinfer.TensorRTPhase \enum TensorRTPhase \brief Indicates a phase of operation of TensorRT
static class	nvinfer.TilingOptimizationLevel \enum TilingOptimizationLevel \brief Define the optimization levels for Tiling TensorRT will try tiling optimization for on-chip caching if non-zero level is set.
static class	nvinfer.TopKOperation \enum TopKOperation \brief Enumerates the operations that may be performed by a TopK layer.
static class	nvinfer.TripLimit \enum TripLimit \brief Enum that describes kinds of trip limits.
static class	nvinfer.UnaryOperation \enum UnaryOperation \brief Enumerates the unary operations that may be performed by a Unary layer.
static class	nvinfer.WeightsRole \enum WeightsRole \brief How a layer uses particular Weights.

Field Summary

Fields

Modifier and Type	Field and Description
static int	kPLUGIN_VERSION_PYTHON_BIT
static int	NV_INFER_INTERNAL_INCLUDE \file NvInferRuntimeCommon.h This file provides the nvinfer1::IPluginRegistry interface, which will be moved to the NvInferRuntime.h header in a future release.
static int	NV_TENSORRT_BUILD TensorRT build number.
static int	NV_TENSORRT_LWS_MAJOR TensorRT LWS major version.
static int	NV_TENSORRT_LWS_MINOR TensorRT LWS minor version.
static int	NV_TENSORRT_LWS_PATCH TensorRT LWS patch version.
static int	NV_TENSORRT_MAJOR TensorRT major version.
static int	NV_TENSORRT_MINOR TensorRT minor version.
static int	NV_TENSORRT_PATCH TensorRT patch version.
static int	NV_TENSORRT_RELEASE_TYPE TensorRT release type
static int	NV_TENSORRT_RELEASE_TYPE_EARLY_ACCESS An early access release
static int	NV_TENSORRT_RELEASE_TYPE_GENERAL_AVAILABILITY A final release
static int	NV_TENSORRT_RELEASE_TYPE_RELEASE_CANDIDATE A release candidate
static int	NV_TENSORRT_VERSION
static int	TRT_BUILD_ENTERPRISE
static int	TRT_MAJOR_ENTERPRISE /** \file NvInferVersion.h /** /** Defines the TensorRT version /**
static int	TRT_MINOR_ENTERPRISE
static int	TRT_PATCH_ENTERPRISE

Constructor Summary

Constructors

Constructor and Description
nvinfer()

Method Summary

Modifier and Type	Method and Description
static Pointer	createInferBuilder_INTERNAL(Pointer logger, int version) Internal C entry point for creating IBuilder.
static IBuilder	createInferBuilder(ILogger logger) \brief Create an instance of an IBuilder class.
static Pointer	createInferRefitter_INTERNAL(Pointer engine, Pointer logger, int version) Internal C entry point for creating IRefitter.
static IRefitter	createInferRefitter(ICudaEngine engine, ILogger logger) \brief Create an instance of an IRefitter class.
static Pointer	createInferRuntime_INTERNAL(Pointer logger, int version) Internal C entry point for creating IRuntime.
static IRuntime	createInferRuntime(ILogger logger) \brief Create an instance of an IRuntime class.
static IPluginRegistry	getBuilderPluginRegistry(int capability)
static IPluginRegistry	getBuilderPluginRegistry(nvinfer.EngineCapability capability) \brief Return the plugin registry for building a Standard engine, or nullptr if no registry exists.
static SafeIPluginRegistry	getBuilderSafePluginRegistry(int capability)
static SafeIPluginRegistry	getBuilderSafePluginRegistry(nvinfer.EngineCapability capability) \brief Return the plugin registry for building a Safety engine, or nullptr if no registry exists.
static int	getInferLibBuildVersion() \brief Return the library build version number.
static int	getInferLibMajorVersion() \brief Return the library major version number.
static int	getInferLibMinorVersion() \brief Return the library minor version number.
static int	getInferLibPatchVersion() \brief Return the library patch version number.
static int	getInferLibVersion() \brief Return the library version number.
static ILogger	getLogger() \brief Return the logger object.
static IPluginRegistry	getPluginRegistry() \brief Return the plugin registry
static int	kPLUGIN_VERSION_PYTHON_BIT() \brief Bit at the plugin version to identify that it is a plugin.
static int	NV_TENSORRT_VERSION() TensorRT version as a single integer.

Methods inherited from class org.bytedeco.tensorrt.presets.nvinfer

init, map

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

TRT_MAJOR_ENTERPRISE

public static final int TRT_MAJOR_ENTERPRISE

/** \file NvInferVersion.h /** /** Defines the TensorRT version /**

See Also:

Constant Field Values

TRT_MINOR_ENTERPRISE

public static final int TRT_MINOR_ENTERPRISE

See Also:

Constant Field Values

TRT_PATCH_ENTERPRISE

public static final int TRT_PATCH_ENTERPRISE

See Also:

Constant Field Values

TRT_BUILD_ENTERPRISE

public static final int TRT_BUILD_ENTERPRISE

See Also:

Constant Field Values

NV_TENSORRT_MAJOR

public static final int NV_TENSORRT_MAJOR

TensorRT major version.

See Also:

Constant Field Values

NV_TENSORRT_MINOR

public static final int NV_TENSORRT_MINOR

TensorRT minor version.

See Also:

Constant Field Values

NV_TENSORRT_PATCH

public static final int NV_TENSORRT_PATCH

TensorRT patch version.

See Also:

Constant Field Values

NV_TENSORRT_BUILD

public static final int NV_TENSORRT_BUILD

TensorRT build number.

See Also:

Constant Field Values

NV_TENSORRT_LWS_MAJOR

public static final int NV_TENSORRT_LWS_MAJOR

TensorRT LWS major version.

See Also:

Constant Field Values

NV_TENSORRT_LWS_MINOR

public static final int NV_TENSORRT_LWS_MINOR

TensorRT LWS minor version.

See Also:

Constant Field Values

NV_TENSORRT_LWS_PATCH

public static final int NV_TENSORRT_LWS_PATCH

TensorRT LWS patch version.

See Also:

Constant Field Values

NV_TENSORRT_RELEASE_TYPE_EARLY_ACCESS

public static final int NV_TENSORRT_RELEASE_TYPE_EARLY_ACCESS

An early access release

See Also:

Constant Field Values

NV_TENSORRT_RELEASE_TYPE_RELEASE_CANDIDATE

public static final int NV_TENSORRT_RELEASE_TYPE_RELEASE_CANDIDATE

A release candidate

See Also:

Constant Field Values

NV_TENSORRT_RELEASE_TYPE_GENERAL_AVAILABILITY

public static final int NV_TENSORRT_RELEASE_TYPE_GENERAL_AVAILABILITY

A final release

See Also:

Constant Field Values

NV_TENSORRT_RELEASE_TYPE

public static final int NV_TENSORRT_RELEASE_TYPE

TensorRT release type

See Also:

Constant Field Values

NV_TENSORRT_VERSION

public static final int NV_TENSORRT_VERSION

NV_INFER_INTERNAL_INCLUDE

public static final int NV_INFER_INTERNAL_INCLUDE

\file NvInferRuntimeCommon.h This file provides the nvinfer1::IPluginRegistry interface, which will be moved to the NvInferRuntime.h header in a future release. \warning This file will be removed in a future release. \warning Do not directly include this file. Instead include NvInferRuntime.h

See Also:

Constant Field Values

kPLUGIN_VERSION_PYTHON_BIT

public static final int kPLUGIN_VERSION_PYTHON_BIT

Constructor Detail

nvinfer

public nvinfer()

Method Detail

NV_TENSORRT_VERSION

@MemberGetter
public static int NV_TENSORRT_VERSION()

TensorRT version as a single integer. Usable in preprocessor expressions.

getInferLibVersion

@NoException(value=true)
public static int getInferLibVersion()

\brief Return the library version number. The format is as for TENSORRT_VERSION: (MAJOR * 100 + MINOR) * 100 + PATCH

createInferRuntime_INTERNAL

@NoException(value=true)
public static Pointer createInferRuntime_INTERNAL(Pointer logger,
                                                                           int version)

Internal C entry point for creating IRuntime. \private

createInferRefitter_INTERNAL

@NoException(value=true)
public static Pointer createInferRefitter_INTERNAL(Pointer engine,
                                                                            Pointer logger,
                                                                            int version)

Internal C entry point for creating IRefitter. \private

getPluginRegistry

@NoException(value=true)
public static IPluginRegistry getPluginRegistry()

\brief Return the plugin registry

getLogger

@NoException(value=true)
public static ILogger getLogger()

\brief Return the logger object. \note the global logger is used only by standalone functions which have no associated builder, runtime or refitter.

createInferRuntime

@Namespace(value="nvinfer1")
 @NoException(value=true)
public static IRuntime createInferRuntime(@ByRef
                                                                                                 ILogger logger)

\brief Create an instance of an IRuntime class.

Parameters:

logger - The logging class for the runtime.

createInferRefitter

@Namespace(value="nvinfer1")
 @NoException(value=true)
public static IRefitter createInferRefitter(@ByRef
                                                                                                   ICudaEngine engine,
                                                                                                   @ByRef
                                                                                                   ILogger logger)

\brief Create an instance of an IRefitter class.

Parameters:

engine - The engine class for the refitter.

logger - The logging class for the refitter.

getInferLibMajorVersion

@NoException(value=true)
public static int getInferLibMajorVersion()

\brief Return the library major version number.

getInferLibMinorVersion

@NoException(value=true)
public static int getInferLibMinorVersion()

\brief Return the library minor version number.

getInferLibPatchVersion

@NoException(value=true)
public static int getInferLibPatchVersion()

\brief Return the library patch version number.

getInferLibBuildVersion

@NoException(value=true)
public static int getInferLibBuildVersion()

\brief Return the library build version number.

createInferBuilder_INTERNAL

@NoException(value=true)
public static Pointer createInferBuilder_INTERNAL(Pointer logger,
                                                                           int version)

Internal C entry point for creating IBuilder. \private

createInferBuilder

@Namespace(value="nvinfer1")
 @NoException(value=true)
public static IBuilder createInferBuilder(@ByRef
                                                                                                 ILogger logger)

\brief Create an instance of an IBuilder class.

Parameters:

logger - The logging class for the builder. unnamed namespace avoids linkage surprises when linking objects built with different versions of this header.

getBuilderPluginRegistry

@Namespace(value="nvinfer1")
 @NoException(value=true)
public static IPluginRegistry getBuilderPluginRegistry(nvinfer.EngineCapability capability)

\brief Return the plugin registry for building a Standard engine, or nullptr if no registry exists. Also return nullptr if the input argument is not EngineCapability::kSTANDARD. Engine capabilities EngineCapability::kSTANDARD and EngineCapability::kSAFETY have distinct plugin registries. When building a Safety engine, use nvinfer1::getBuilderSafePluginRegistry(). Use IPluginRegistry::registerCreator from the registry to register plugins. Plugins registered in a registry associated with a specific engine capability are only available when building engines with that engine capability. There is no plugin registry for EngineCapability::kDLA_STANDALONE.

getBuilderPluginRegistry

@Namespace(value="nvinfer1")
 @NoException(value=true)
public static IPluginRegistry getBuilderPluginRegistry(@Cast(value="nvinfer1::EngineCapability")
                                                                                                              int capability)

getBuilderSafePluginRegistry

@Namespace(value="nvinfer1")
 @NoException(value=true)
public static SafeIPluginRegistry getBuilderSafePluginRegistry(nvinfer.EngineCapability capability)

\brief Return the plugin registry for building a Safety engine, or nullptr if no registry exists. Also return nullptr if the input argument is not EngineCapability::kSAFETY. When building a Standard engine, use nvinfer1::getBuilderPluginRegistry(). Use safe::IPluginRegistry::registerCreator from the registry to register plugins.

getBuilderSafePluginRegistry

@Namespace(value="nvinfer1")
 @NoException(value=true)
public static SafeIPluginRegistry getBuilderSafePluginRegistry(@Cast(value="nvinfer1::EngineCapability")
                                                                                                                      int capability)

kPLUGIN_VERSION_PYTHON_BIT

@Namespace(value="nvinfer1")
 @MemberGetter
public static int kPLUGIN_VERSION_PYTHON_BIT()

\brief Bit at the plugin version to identify that it is a plugin.