Package org.bytedeco.tensorrt.nvinfer

Class Summary

Class	Description
cublasContext	Forward declaration of cublasContext to use in other interfaces
cudnnContext	Forward declaration of cudnnContext to use in other interfaces
Dims2	\class Dims2 \brief Descriptor for two-dimensional data.
Dims3	\class Dims3 \brief Descriptor for three-dimensional data.
Dims32	\class Dims \brief Structure to define the dimensions of a tensor.
Dims4	\class Dims4 \brief Descriptor for four-dimensional data.
DimsExprs	\class DimsExprs Analog of class Dims with expressions instead of constants for the dimensions.
DimsHW	\class DimsHW \brief Descriptor for two-dimensional spatial data.
DynamicPluginTensorDesc	\class DynamicPluginTensorDesc Summarizes tensors that a plugin might see for an input or output.
IActivationLayer	\class IActivationLayer \brief An Activation layer in a network definition.
IAlgorithm	\class IAlgorithm \brief Describes a variation of execution of a layer.
IAlgorithmContext	\class IAlgorithmContext \brief Describes the context and requirements, that could be fulfilled by one or more instances of IAlgorithm.
IAlgorithmIOInfo	\class IAlgorithmIOInfo \brief Carries information about input or output of the algorithm.
IAlgorithmSelector	\class IAlgorithmSelector \brief Interface implemented by application for selecting and reporting algorithms of a layer provided by the builder.
IAlgorithmVariant	\class IAlgorithmVariant \brief provides a unique 128-bit identifier, which along with the input and output information denotes the variation of algorithm and can be used to select or reproduce an algorithm, using IAlgorithmSelector::selectAlgorithms()
IAssertionLayer	\class IAssertionLayer \brief An assertion layer in a network The layer has a single input and no output.
IBuilder	\class IBuilder \brief Builds an engine from a network definition.
IBuilderConfig	\class IBuilderConfig \brief Holds properties for configuring a builder to produce an engine.
ICastLayer	\class ICastLayer \brief A cast layer in a network.
IConcatenationLayer	\class IConcatenationLayer \brief A concatenation layer in a network definition.
IConditionLayer	This layer represents a condition input to an IIfConditional.
IConstantLayer	\class IConstantLayer \brief Layer that represents a constant value.
IConvolutionLayer	\class IConvolutionLayer \brief A convolution layer in a network definition.
ICudaEngine	\class ICudaEngine \brief An engine for executing inference on a built network, with functionally unsafe features.
IDeconvolutionLayer	\class IDeconvolutionLayer \brief A deconvolution layer in a network definition.
IDequantizeLayer	\class IDequantizeLayer \brief A Dequantize layer in a network definition.
IDimensionExpr	\class IDimensionExpr An IDimensionExpr represents an integer expression constructed from constants, input dimensions, and binary operations.
IEinsumLayer	\class IEinsumLayer \brief An Einsum layer in a network This layer implements a summation over the elements of the inputs along dimensions specified by the equation parameter, based on the Einstein summation convention.
IElementWiseLayer	\class IElementWiseLayer \brief A elementwise layer in a network definition.
IEngineInspector	\class IEngineInspector \brief An engine inspector which prints out the layer information of an engine or an execution context.
IErrorRecorder	\class IErrorRecorder \brief Reference counted application-implemented error reporting interface for TensorRT objects.
IExecutionContext	\class IExecutionContext \brief Context for executing inference using an engine, with functionally unsafe features.
IExprBuilder	\class IExprBuilder Object for constructing IDimensionExpr.
IFillLayer	\brief Generate an output tensor with specified mode.
IFullyConnectedLayer	Deprecated Deprecated in TensorRT 8.4.
IGatherLayer	\class IGatherLayer \brief A Gather layer in a network definition.
IGpuAllocator	\class IGpuAllocator \brief Application-implemented class for controlling allocation on the GPU.
IGridSampleLayer	\class IGridSampleLayer \brief A GridSample layer in a network definition.
IHostMemory	\class IHostMemory \brief Class to handle library allocated memory that is accessible to the user.
IIdentityLayer	\class IIdentityLayer \brief A layer that represents the identity function.
IIfConditional	Helper for constructing conditionally-executed subgraphs.
IIfConditionalBoundaryLayer	This is a base class for Conditional boundary layers.
IIfConditionalInputLayer	This layer represents an input to an IIfConditional.
IIfConditionalOutputLayer	This layer represents an output of an IIfConditional.
IInt8Calibrator	\class IInt8Calibrator \brief Application-implemented interface for calibration.
IInt8EntropyCalibrator	Entropy calibrator.
IInt8EntropyCalibrator2	Entropy calibrator 2.
IInt8LegacyCalibrator	Legacy calibrator left for backward compatibility with TensorRT 2.0.
IInt8MinMaxCalibrator	MinMax Calibrator.
IIteratorLayer
ILayer	\class ILayer \brief Base class for all layer classes in a network definition.
ILogger	\class ILogger \brief Application-implemented logging interface for the builder, refitter and runtime.
ILoggerFinder	\class ILoggerFinder \brief A virtual base class to find a logger.
ILoop	Helper for creating a recurrent subgraph.
ILoopBoundaryLayer
ILoopOutputLayer	An ILoopOutputLayer is the sole way to get output from a loop.
ILRNLayer	\class ILRNLayer \brief A LRN layer in a network definition.
IMatrixMultiplyLayer	\class IMatrixMultiplyLayer \brief Layer that represents a Matrix Multiplication.
INetworkDefinition	\class INetworkDefinition \brief A network definition for input to the builder.
INMSLayer	\class INMSLayer \brief A non-maximum suppression layer in a network definition.
INoCopy	\class INoCopy \brief Base class for all TensorRT interfaces that are implemented by the TensorRT libraries Objects of such classes are not movable or copyable, and should only be manipulated via pointers.
INonZeroLayer	\class INonZero \brief A NonZero layer in a network.
INormalizationLayer	\class INormalizationLayer \brief A normalization layer in a network definition.
IOneHotLayer	\class IOneHotLayer \brief A OneHot layer in a network definition.
IOptimizationProfile	\class IOptimizationProfile \brief Optimization profile for dynamic input dimensions and shape tensors.
IOutputAllocator	\class IOutputAllocator \brief Callback from ExecutionContext::enqueueV3() Clients should override the method reallocateOutput.
IPaddingLayer	\class IPaddingLayer \brief Layer that represents a padding operation.
IParametricReLULayer	\class IParametricReLULayer \brief Layer that represents a parametric ReLU operation.
IPlugin
IPluginCreator	\class IPluginCreator \brief Plugin creator class for user implemented layers.
IPluginExt
IPluginFactory	Forward declaration of IPluginFactory for use by other interfaces.
IPluginLayer
IPluginRegistry	\class IPluginRegistry \brief Single registration point for all plugins in an application.
IPluginRegistry.PluginLibraryHandle	Pointer for plugin library handle.
IPluginV2	Deprecated Deprecated in TensorRT 8.5.
IPluginV2DynamicExt	\class IPluginV2DynamicExt Similar to IPluginV2Ext, but with support for dynamic shapes.
IPluginV2Ext	Deprecated Deprecated in TensorRT 8.5.
IPluginV2IOExt	\class IPluginV2IOExt \brief Plugin class for user-implemented layers.
IPluginV2Layer	\class IPluginV2Layer \brief Layer type for pluginV2
IPoolingLayer	\class IPoolingLayer \brief A Pooling layer in a network definition.
IProfiler	\class IProfiler \brief Application-implemented interface for profiling.
IQuantizeLayer	\class IQuantizeLayer \brief A Quantize layer in a network definition.
IRaggedSoftMaxLayer	\class IRaggedSoftMaxLayer \brief A RaggedSoftmax layer in a network definition.
IRecurrenceLayer
IReduceLayer	\class IReduceLayer \brief Layer that represents a reduction across a non-bool tensor.
IRefitter	\class IRefitter \brief Updates weights in an engine.
IResizeLayer	\class IResizeLayer \brief A resize layer in a network definition.
IReverseSequenceLayer	\class IReverseSequenceLayer \brief A ReverseSequence layer in a network definition.
IRNNv2Layer	Deprecated Deprecated prior to TensorRT 8.0 and will be removed in 9.0.
IRuntime	\class IRuntime \brief Allows a serialized functionally unsafe engine to be deserialized.
IScaleLayer	\class IScaleLayer \brief A Scale layer in a network definition.
IScatterLayer	\class IScatterLayer \brief A scatter layer in a network definition.
ISelectLayer	\warning Do not inherit from this class, as doing so will break forward-compatibility of the API and ABI.
IShapeLayer	\class IShapeLayer \brief Layer type for getting shape of a tensor.
IShuffleLayer	\class IShuffleLayer \brief Layer type for shuffling data.
ISliceLayer	\brief Slices an input tensor into an output tensor based on the offset and strides.
ISoftMaxLayer	\class ISoftMaxLayer \brief A Softmax layer in a network definition.
ITensor	\class ITensor \brief A tensor in a network definition.
ITimingCache	\class ITimingCache \brief Class to handle tactic timing info collected from builder.
ITopKLayer	\class ITopKLayer \brief Layer that represents a TopK reduction.
ITripLimitLayer
IUnaryLayer	\class IUnaryLayer \brief Layer that represents an unary operation.
Permutation
PluginField	\class PluginField \brief Structure containing plugin attribute field names and associated data This information can be parsed to decode necessary plugin metadata
PluginFieldCollection	Plugin field collection struct.
PluginTensorDesc	\struct PluginTensorDesc \brief Fields that a plugin might see for an input or output.
SafeIPluginRegistry	Forward declaration
VActivationLayer
VAlgorithm
VAlgorithmContext
VAlgorithmIOInfo
VAlgorithmVariant
VAssertionLayer
VBuilder
VBuilderConfig
VCastLayer
VConcatenationLayer
VConditionalBoundaryLayer
VConditionalInputLayer
VConditionalOutputLayer
VConditionLayer
VConstantLayer
VConvolutionLayer
VCudaEngine
VDeconvolutionLayer
VDequantizeLayer
VDimensionExpr
VEinsumLayer
VElementWiseLayer
VEngineInspector
VExecutionContext
VExprBuilder
VFillLayer
VFullyConnectedLayer
VGatherLayer
VGridSampleLayer
VHostMemory
VIdentityLayer
VIfConditional
VIteratorLayer
VLayer
VLoop
VLoopBoundaryLayer
VLoopOutputLayer
VLRNLayer
VMatrixMultiplyLayer
VNetworkDefinition
VNMSLayer
VNonZeroLayer
VNormalizationLayer
VOneHotLayer
VOptimizationProfile
VPaddingLayer
VParametricReLULayer
VPluginLayer
VPluginV2Layer
VPoolingLayer
VQuantizeLayer
VRaggedSoftMaxLayer
VRecurrenceLayer
VReduceLayer
VRefitter
VResizeLayer
VReverseSequenceLayer
VRNNv2Layer
VRoot	\file NvInferImpl.h This file contains definitions for API methods that cross the shared library boundary.
VRuntime
VScaleLayer
VScatterLayer
VSelectLayer
VShapeLayer
VShuffleLayer
VSliceLayer
VSoftMaxLayer
VTensor
VTimingCache
VTopKLayer
VTripLimitLayer
VUnaryLayer
Weights	\class Weights \brief An array of weights used as a layer parameter.

Enum Summary

Enum	Description
ILogger.Severity	\enum Severity The severity corresponding to a log message.