Package | Description |
---|---|
org.bytedeco.tensorrt.global | |
org.bytedeco.tensorrt.nvinfer | |
org.bytedeco.tensorrt.nvparsers |
Class and Description |
---|
DimsHW
\class DimsHW
\brief Descriptor for two-dimensional spatial data.
|
IBuilder
\class IBuilder
\brief Builds an engine from a network definition.
|
ICudaEngine
\class ICudaEngine
\brief An engine for executing inference on a built network, with functionally unsafe features.
|
ILogger
\class ILogger
\brief Application-implemented logging interface for the builder, refitter and runtime.
|
INetworkDefinition
\class INetworkDefinition
\brief A network definition for input to the builder.
|
IPluginRegistry
\class IPluginRegistry
\brief Single registration point for all plugins in an application.
|
IPluginV2
Deprecated.
Deprecated in TensorRT 8.5. Implement IPluginV2DynamicExt or IPluginV2IOExt depending on your
requirement.
|
IRefitter
\class IRefitter
\brief Updates weights in an engine.
|
IRuntime
\class IRuntime
\brief Allows a serialized functionally unsafe engine to be deserialized.
|
SafeIPluginRegistry
Forward declaration
|
Weights
\class Weights
\brief An array of weights used as a layer parameter.
|
Class and Description |
---|
cublasContext
Forward declaration of cublasContext to use in other interfaces
|
cudnnContext
Forward declaration of cudnnContext to use in other interfaces
|
Dims2
\class Dims2
\brief Descriptor for two-dimensional data.
|
Dims3
\class Dims3
\brief Descriptor for three-dimensional data.
|
Dims32
\class Dims
\brief Structure to define the dimensions of a tensor.
|
Dims4
\class Dims4
\brief Descriptor for four-dimensional data.
|
DimsExprs
\class DimsExprs
Analog of class Dims with expressions instead of constants for the dimensions.
|
DimsHW
\class DimsHW
\brief Descriptor for two-dimensional spatial data.
|
DynamicPluginTensorDesc
\class DynamicPluginTensorDesc
Summarizes tensors that a plugin might see for an input or output.
|
IActivationLayer
\class IActivationLayer
\brief An Activation layer in a network definition.
|
IAlgorithm
\class IAlgorithm
\brief Describes a variation of execution of a layer.
|
IAlgorithmContext
\class IAlgorithmContext
\brief Describes the context and requirements, that could be fulfilled by one or more instances of IAlgorithm.
|
IAlgorithmIOInfo
\class IAlgorithmIOInfo
\brief Carries information about input or output of the algorithm.
|
IAlgorithmSelector
\class IAlgorithmSelector
\brief Interface implemented by application for selecting and reporting algorithms of a layer provided by the
builder.
|
IAlgorithmVariant
\class IAlgorithmVariant
\brief provides a unique 128-bit identifier, which along with the input and output information
denotes the variation of algorithm and can be used to select or reproduce an algorithm,
using IAlgorithmSelector::selectAlgorithms()
|
IAssertionLayer
\class IAssertionLayer
\brief An assertion layer in a network
The layer has a single input and no output.
|
IBuilder
\class IBuilder
\brief Builds an engine from a network definition.
|
IBuilderConfig
\class IBuilderConfig
\brief Holds properties for configuring a builder to produce an engine.
|
ICastLayer
\class ICastLayer
\brief A cast layer in a network.
|
IConcatenationLayer
\class IConcatenationLayer
\brief A concatenation layer in a network definition.
|
IConditionLayer
This layer represents a condition input to an IIfConditional.
|
IConstantLayer
\class IConstantLayer
\brief Layer that represents a constant value.
|
IConvolutionLayer
\class IConvolutionLayer
\brief A convolution layer in a network definition.
|
ICudaEngine
\class ICudaEngine
\brief An engine for executing inference on a built network, with functionally unsafe features.
|
IDeconvolutionLayer
\class IDeconvolutionLayer
\brief A deconvolution layer in a network definition.
|
IDequantizeLayer
\class IDequantizeLayer
\brief A Dequantize layer in a network definition.
|
IDimensionExpr
\class IDimensionExpr
An IDimensionExpr represents an integer expression constructed from constants,
input dimensions, and binary operations.
|
IEinsumLayer
\class IEinsumLayer
\brief An Einsum layer in a network
This layer implements a summation over the elements of the inputs along dimensions specified by the equation
parameter, based on the Einstein summation convention.
|
IElementWiseLayer
\class IElementWiseLayer
\brief A elementwise layer in a network definition.
|
IEngineInspector
\class IEngineInspector
\brief An engine inspector which prints out the layer information of an engine or an execution context.
|
IErrorRecorder
\class IErrorRecorder
\brief Reference counted application-implemented error reporting interface for TensorRT objects.
|
IExecutionContext
\class IExecutionContext
\brief Context for executing inference using an engine, with functionally unsafe features.
|
IExprBuilder
\class IExprBuilder
Object for constructing IDimensionExpr.
|
IFillLayer
\brief Generate an output tensor with specified mode.
|
IFullyConnectedLayer
Deprecated.
Deprecated in TensorRT 8.4. Superseded by IMatrixMultiplyLayer.
|
IGatherLayer
\class IGatherLayer
\brief A Gather layer in a network definition.
|
IGpuAllocator
\class IGpuAllocator
\brief Application-implemented class for controlling allocation on the GPU.
|
IGridSampleLayer
\class IGridSampleLayer
\brief A GridSample layer in a network definition.
|
IHostMemory
\class IHostMemory
\brief Class to handle library allocated memory that is accessible to the user.
|
IIdentityLayer
\class IIdentityLayer
\brief A layer that represents the identity function.
|
IIfConditional
Helper for constructing conditionally-executed subgraphs.
|
IIfConditionalBoundaryLayer
This is a base class for Conditional boundary layers.
|
IIfConditionalInputLayer
This layer represents an input to an IIfConditional.
|
IIfConditionalOutputLayer
This layer represents an output of an IIfConditional.
|
IInt8Calibrator
\class IInt8Calibrator
\brief Application-implemented interface for calibration.
|
IInt8EntropyCalibrator
Entropy calibrator.
|
IInt8EntropyCalibrator2
Entropy calibrator 2.
|
IInt8LegacyCalibrator
Legacy calibrator left for backward compatibility with TensorRT 2.0.
|
IInt8MinMaxCalibrator
MinMax Calibrator.
|
IIteratorLayer |
ILayer
\class ILayer
\brief Base class for all layer classes in a network definition.
|
ILogger
\class ILogger
\brief Application-implemented logging interface for the builder, refitter and runtime.
|
ILogger.Severity
\enum Severity
The severity corresponding to a log message.
|
ILoop
Helper for creating a recurrent subgraph.
|
ILoopBoundaryLayer |
ILoopOutputLayer
An ILoopOutputLayer is the sole way to get output from a loop.
|
ILRNLayer
\class ILRNLayer
\brief A LRN layer in a network definition.
|
IMatrixMultiplyLayer
\class IMatrixMultiplyLayer
\brief Layer that represents a Matrix Multiplication.
|
INetworkDefinition
\class INetworkDefinition
\brief A network definition for input to the builder.
|
INMSLayer
\class INMSLayer
\brief A non-maximum suppression layer in a network definition.
|
INoCopy
\class INoCopy
\brief Base class for all TensorRT interfaces that are implemented by the TensorRT libraries
Objects of such classes are not movable or copyable, and should only be manipulated
via pointers.
|
INonZeroLayer
\class INonZero
\brief A NonZero layer in a network.
|
INormalizationLayer
\class INormalizationLayer
\brief A normalization layer in a network definition.
|
IOneHotLayer
\class IOneHotLayer
\brief A OneHot layer in a network definition.
|
IOptimizationProfile
\class IOptimizationProfile
\brief Optimization profile for dynamic input dimensions and shape tensors.
|
IOutputAllocator
\class IOutputAllocator
\brief Callback from ExecutionContext::enqueueV3()
Clients should override the method reallocateOutput.
|
IPaddingLayer
\class IPaddingLayer
\brief Layer that represents a padding operation.
|
IParametricReLULayer
\class IParametricReLULayer
\brief Layer that represents a parametric ReLU operation.
|
IPlugin |
IPluginCreator
\class IPluginCreator
\brief Plugin creator class for user implemented layers.
|
IPluginFactory
Forward declaration of IPluginFactory for use by other interfaces.
|
IPluginRegistry
\class IPluginRegistry
\brief Single registration point for all plugins in an application.
|
IPluginRegistry.PluginLibraryHandle
Pointer for plugin library handle.
|
IPluginV2
Deprecated.
Deprecated in TensorRT 8.5. Implement IPluginV2DynamicExt or IPluginV2IOExt depending on your
requirement.
|
IPluginV2DynamicExt
\class IPluginV2DynamicExt
Similar to IPluginV2Ext, but with support for dynamic shapes.
|
IPluginV2Ext
Deprecated.
Deprecated in TensorRT 8.5. Implement IPluginV2DynamicExt or IPluginV2IOExt depending on your
requirement.
|
IPluginV2Layer
\class IPluginV2Layer
\brief Layer type for pluginV2
|
IPoolingLayer
\class IPoolingLayer
\brief A Pooling layer in a network definition.
|
IProfiler
\class IProfiler
\brief Application-implemented interface for profiling.
|
IQuantizeLayer
\class IQuantizeLayer
\brief A Quantize layer in a network definition.
|
IRaggedSoftMaxLayer
\class IRaggedSoftMaxLayer
\brief A RaggedSoftmax layer in a network definition.
|
IRecurrenceLayer |
IReduceLayer
\class IReduceLayer
\brief Layer that represents a reduction across a non-bool tensor.
|
IRefitter
\class IRefitter
\brief Updates weights in an engine.
|
IResizeLayer
\class IResizeLayer
\brief A resize layer in a network definition.
|
IReverseSequenceLayer
\class IReverseSequenceLayer
\brief A ReverseSequence layer in a network definition.
|
IRNNv2Layer
Deprecated.
Deprecated prior to TensorRT 8.0 and will be removed in 9.0. Superseded by
INetworkDefinition::addLoop().
\warning Do not inherit from this class, as doing so will break forward-compatibility of the API and ABI.
|
IRuntime
\class IRuntime
\brief Allows a serialized functionally unsafe engine to be deserialized.
|
IScaleLayer
\class IScaleLayer
\brief A Scale layer in a network definition.
|
IScatterLayer
\class IScatterLayer
\brief A scatter layer in a network definition.
|
ISelectLayer
\warning Do not inherit from this class, as doing so will break forward-compatibility of the API and ABI.
|
IShapeLayer
\class IShapeLayer
\brief Layer type for getting shape of a tensor.
|
IShuffleLayer
\class IShuffleLayer
\brief Layer type for shuffling data.
|
ISliceLayer
\brief Slices an input tensor into an output tensor based on the offset and strides.
|
ISoftMaxLayer
\class ISoftMaxLayer
\brief A Softmax layer in a network definition.
|
ITensor
\class ITensor
\brief A tensor in a network definition.
|
ITimingCache
\class ITimingCache
\brief Class to handle tactic timing info collected from builder.
|
ITopKLayer
\class ITopKLayer
\brief Layer that represents a TopK reduction.
|
ITripLimitLayer |
IUnaryLayer
\class IUnaryLayer
\brief Layer that represents an unary operation.
|
Permutation |
PluginField
\class PluginField
\brief Structure containing plugin attribute field names and associated data
This information can be parsed to decode necessary plugin metadata
|
PluginFieldCollection
Plugin field collection struct.
|
PluginTensorDesc
\struct PluginTensorDesc
\brief Fields that a plugin might see for an input or output.
|
VConditionalInputLayer |
VConditionalOutputLayer |
VConditionLayer |
VIdentityLayer |
VNonZeroLayer |
VParametricReLULayer |
VRaggedSoftMaxLayer |
VRecurrenceLayer |
VRoot
\file NvInferImpl.h
This file contains definitions for API methods that cross the shared library boundary.
|
VShapeLayer |
Weights
\class Weights
\brief An array of weights used as a layer parameter.
|
Class and Description |
---|
Dims32
\class Dims
\brief Structure to define the dimensions of a tensor.
|
Dims4
\class Dims4
\brief Descriptor for four-dimensional data.
|
IErrorRecorder
\class IErrorRecorder
\brief Reference counted application-implemented error reporting interface for TensorRT objects.
|
INetworkDefinition
\class INetworkDefinition
\brief A network definition for input to the builder.
|
IPluginV2
Deprecated.
Deprecated in TensorRT 8.5. Implement IPluginV2DynamicExt or IPluginV2IOExt depending on your
requirement.
|
ITensor
\class ITensor
\brief A tensor in a network definition.
|
Weights
\class Weights
\brief An array of weights used as a layer parameter.
|
Copyright © 2024. All rights reserved.