org.bytedeco.tensorflowlite

Class TfLiteContext

java.lang.Object

org.bytedeco.javacpp.Pointer

org.bytedeco.tensorflowlite.TfLiteContext

All Implemented Interfaces:

AutoCloseable

@Properties(inherit=tensorflowlite.class)
public class TfLiteContext
extends Pointer

TfLiteContext allows an op to access the tensors. TfLiteContext is a struct that is created by the TF Lite runtime and passed to the "methods" (C function pointers) in the TfLiteRegistration struct that are used to define custom ops and custom delegate kernels. It contains information and methods (C function pointers) that can be called by the code implementing a custom op or a custom delegate kernel. These methods provide access to the context in which that custom op or custom delegate kernel occurs, such as access to the input and output tensors for that op, as well as methods for allocating memory buffers and intermediate tensors, etc. See also TfLiteOpaqueContext, which is an more ABI-stable equivalent.

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	TfLiteContext.AcquireSubgraphContext_TfLiteContext_int_PointerPointer Retrieves the corresponding TfLiteContext of a subgraph that the given subgraph_index points to and switches to the delegate context for that subgraph.
static class	TfLiteContext.AddTensors_TfLiteContext_int_IntPointer Add tensors_to_add tensors, preserving pre-existing Tensor entries.
static class	TfLiteContext.AllocateBufferForEval_TfLiteContext_long_PointerPointer Allocate a buffer which will be deallocated right after invoke phase.
static class	TfLiteContext.AllocatePersistentBuffer_TfLiteContext_long Allocate persistent buffer which has the same life time as the interpreter.
static class	TfLiteContext.GetEvalTensor_TfLiteContext_int Returns a TfLiteEvalTensor struct for a given index.
static class	TfLiteContext.GetExecutionPlan_TfLiteContext_PointerPointer The execution plan contains a list of the node indices in execution order.
static class	TfLiteContext.GetExternalContext_TfLiteContext_int Access external contexts by type.
static class	TfLiteContext.GetModelMetadata_TfLiteContext_BytePointer_PointerPointer_SizeTPointer Retrieves named metadata buffer from the TFLite model.
static class	TfLiteContext.GetNodeAndRegistration_TfLiteContext_int_PointerPointer_PointerPointer Get a Tensor node by node_index.
static class	TfLiteContext.GetScratchBuffer_TfLiteContext_int Get the scratch buffer pointer.
static class	TfLiteContext.GetTensor_TfLiteContext_int Returns a TfLiteTensor struct for a given index.
static class	TfLiteContext.PreviewDelegatePartitioning_TfLiteContext_TfLiteIntArray_PointerPointer_IntPointer This method provides a preview of post-delegation partitioning.
static class	TfLiteContext.ReleaseSubgraphContext_TfLiteContext_int Releases the subgraph context by switching back to the TFLite kernel context for the subgraph that the given subgraph_index points to.
static class	TfLiteContext.ReplaceNodeSubsetsWithDelegateKernels_TfLiteContext_TfLiteRegistration_TfLiteIntArray_TfLiteDelegate Replace ops with one or more stub delegate operations.
static class	TfLiteContext.RequestScratchBufferInArena_TfLiteContext_long_IntPointer Request a scratch buffer in the arena through static memory planning.
static class	TfLiteContext.ResizeTensor_TfLiteContext_TfLiteTensor_TfLiteIntArray Request memory pointer be resized.
static class	TfLiteContext.ResizeTensorExplicit_TfLiteContext_TfLiteTensor_int_IntPointer Resize the memory pointer of the tensor.
static class	TfLiteContext.SetExternalContext_TfLiteContext_int_TfLiteExternalContext Set the value of a external context.

Nested classes/interfaces inherited from class org.bytedeco.javacpp.Pointer

Pointer.CustomDeallocator, Pointer.Deallocator, Pointer.NativeDeallocator, Pointer.ReferenceCounter

Field Summary

Fields inherited from class org.bytedeco.javacpp.Pointer

address, capacity, limit, position

Constructor Summary

Constructors

Constructor and Description
TfLiteContext() Default native constructor.
TfLiteContext(long size) Native array allocator.
TfLiteContext(Pointer p) Pointer cast constructor.

Method Summary

Modifier and Type	Method and Description
TfLiteContext.AcquireSubgraphContext_TfLiteContext_int_PointerPointer	AcquireSubgraphContext()
TfLiteContext	AcquireSubgraphContext(TfLiteContext.AcquireSubgraphContext_TfLiteContext_int_PointerPointer setter)
TfLiteContext.AddTensors_TfLiteContext_int_IntPointer	AddTensors()
TfLiteContext	AddTensors(TfLiteContext.AddTensors_TfLiteContext_int_IntPointer setter)
TfLiteContext.AllocateBufferForEval_TfLiteContext_long_PointerPointer	AllocateBufferForEval()
TfLiteContext	AllocateBufferForEval(TfLiteContext.AllocateBufferForEval_TfLiteContext_long_PointerPointer setter)
TfLiteContext.AllocatePersistentBuffer_TfLiteContext_long	AllocatePersistentBuffer()
TfLiteContext	AllocatePersistentBuffer(TfLiteContext.AllocatePersistentBuffer_TfLiteContext_long setter)
boolean	allow_fp32_relax_to_fp16() Flag for allowing float16 precision for FP32 calculation.
TfLiteContext	allow_fp32_relax_to_fp16(boolean setter)
TfLiteContext.GetEvalTensor_TfLiteContext_int	GetEvalTensor()
TfLiteContext	GetEvalTensor(TfLiteContext.GetEvalTensor_TfLiteContext_int setter)
TfLiteContext.GetExecutionPlan_TfLiteContext_PointerPointer	GetExecutionPlan()
TfLiteContext	GetExecutionPlan(TfLiteContext.GetExecutionPlan_TfLiteContext_PointerPointer setter)
TfLiteContext.GetExternalContext_TfLiteContext_int	GetExternalContext()
TfLiteContext	GetExternalContext(TfLiteContext.GetExternalContext_TfLiteContext_int setter)
TfLiteContext.GetModelMetadata_TfLiteContext_BytePointer_PointerPointer_SizeTPointer	GetModelMetadata()
TfLiteContext	GetModelMetadata(TfLiteContext.GetModelMetadata_TfLiteContext_BytePointer_PointerPointer_SizeTPointer setter)
TfLiteContext.GetNodeAndRegistration_TfLiteContext_int_PointerPointer_PointerPointer	GetNodeAndRegistration()
TfLiteContext	GetNodeAndRegistration(TfLiteContext.GetNodeAndRegistration_TfLiteContext_int_PointerPointer_PointerPointer setter)
TfLiteContext	getPointer(long i)
TfLiteContext.GetScratchBuffer_TfLiteContext_int	GetScratchBuffer()
TfLiteContext	GetScratchBuffer(TfLiteContext.GetScratchBuffer_TfLiteContext_int setter)
TfLiteContext.GetTensor_TfLiteContext_int	GetTensor()
TfLiteContext	GetTensor(TfLiteContext.GetTensor_TfLiteContext_int setter)
Pointer	impl_() opaque full context ptr (an opaque c++ data structure)
TfLiteContext	impl_(Pointer setter)
TfLiteContext	position(long position)
TfLiteContext.PreviewDelegatePartitioning_TfLiteContext_TfLiteIntArray_PointerPointer_IntPointer	PreviewDelegatePartitioning()
TfLiteContext	PreviewDelegatePartitioning(TfLiteContext.PreviewDelegatePartitioning_TfLiteContext_TfLiteIntArray_PointerPointer_IntPointer setter)
Pointer	profiler() Pointer to the op-level profiler, if set; nullptr otherwise.
TfLiteContext	profiler(Pointer setter)
int	recommended_num_threads() Number of threads that are recommended to subsystems like gemmlowp and eigen.
TfLiteContext	recommended_num_threads(int setter)
TfLiteContext.ReleaseSubgraphContext_TfLiteContext_int	ReleaseSubgraphContext()
TfLiteContext	ReleaseSubgraphContext(TfLiteContext.ReleaseSubgraphContext_TfLiteContext_int setter)
TfLiteContext.ReplaceNodeSubsetsWithDelegateKernels_TfLiteContext_TfLiteRegistration_TfLiteIntArray_TfLiteDelegate	ReplaceNodeSubsetsWithDelegateKernels()
TfLiteContext	ReplaceNodeSubsetsWithDelegateKernels(TfLiteContext.ReplaceNodeSubsetsWithDelegateKernels_TfLiteContext_TfLiteRegistration_TfLiteIntArray_TfLiteDelegate setter)
TfLiteContext.RequestScratchBufferInArena_TfLiteContext_long_IntPointer	RequestScratchBufferInArena()
TfLiteContext	RequestScratchBufferInArena(TfLiteContext.RequestScratchBufferInArena_TfLiteContext_long_IntPointer setter)
TfLiteContext.ResizeTensor_TfLiteContext_TfLiteTensor_TfLiteIntArray	ResizeTensor()
TfLiteContext	ResizeTensor(TfLiteContext.ResizeTensor_TfLiteContext_TfLiteTensor_TfLiteIntArray setter)
TfLiteContext.ResizeTensorExplicit_TfLiteContext_TfLiteTensor_int_IntPointer	ResizeTensorExplicit()
TfLiteContext	ResizeTensorExplicit(TfLiteContext.ResizeTensorExplicit_TfLiteContext_TfLiteTensor_int_IntPointer setter)
TfLiteContext.SetExternalContext_TfLiteContext_int_TfLiteExternalContext	SetExternalContext()
TfLiteContext	SetExternalContext(TfLiteContext.SetExternalContext_TfLiteContext_int_TfLiteExternalContext setter)
long	tensors_size() Number of tensors in the context.
TfLiteContext	tensors_size(long setter)
TfLiteTensor	tensors() An array of tensors in the interpreter context (of length tensors_size)
TfLiteContext	tensors(TfLiteTensor setter)

Methods inherited from class org.bytedeco.javacpp.Pointer

address, asBuffer, asByteBuffer, availablePhysicalBytes, calloc, capacity, capacity, close, deallocate, deallocate, deallocateReferences, deallocator, deallocator, equals, fill, formatBytes, free, getDirectBufferAddress, getPointer, getPointer, getPointer, hashCode, interruptDeallocatorThread, isNull, isNull, limit, limit, malloc, maxBytes, maxPhysicalBytes, memchr, memcmp, memcpy, memmove, memset, offsetAddress, offsetof, offsetof, parseBytes, physicalBytes, physicalBytesInaccurate, position, put, realloc, referenceCount, releaseReference, retainReference, setNull, sizeof, sizeof, toString, totalBytes, totalCount, totalPhysicalBytes, withDeallocator, zero

Methods inherited from class java.lang.Object

clone, finalize, getClass, notify, notifyAll, wait, wait, wait

Constructor Detail

TfLiteContext

public TfLiteContext()

Default native constructor.

TfLiteContext

public TfLiteContext(long size)

Native array allocator. Access with Pointer.position(long).

TfLiteContext

public TfLiteContext(Pointer p)

Pointer cast constructor. Invokes Pointer(Pointer).

Method Detail

position

public TfLiteContext position(long position)

Overrides:

position in class Pointer

getPointer

public TfLiteContext getPointer(long i)

Overrides:

getPointer in class Pointer

tensors_size

@Cast(value="size_t")
public long tensors_size()

Number of tensors in the context.

tensors_size

public TfLiteContext tensors_size(long setter)

GetExecutionPlan

public TfLiteContext.GetExecutionPlan_TfLiteContext_PointerPointer GetExecutionPlan()

GetExecutionPlan

public TfLiteContext GetExecutionPlan(TfLiteContext.GetExecutionPlan_TfLiteContext_PointerPointer setter)

tensors

public TfLiteTensor tensors()

An array of tensors in the interpreter context (of length tensors_size)

tensors

public TfLiteContext tensors(TfLiteTensor setter)

impl_

public Pointer impl_()

opaque full context ptr (an opaque c++ data structure)

impl_

public TfLiteContext impl_(Pointer setter)

ResizeTensor

public TfLiteContext.ResizeTensor_TfLiteContext_TfLiteTensor_TfLiteIntArray ResizeTensor()

ResizeTensor

public TfLiteContext ResizeTensor(TfLiteContext.ResizeTensor_TfLiteContext_TfLiteTensor_TfLiteIntArray setter)

AddTensors

public TfLiteContext.AddTensors_TfLiteContext_int_IntPointer AddTensors()

AddTensors

public TfLiteContext AddTensors(TfLiteContext.AddTensors_TfLiteContext_int_IntPointer setter)

GetNodeAndRegistration

public TfLiteContext.GetNodeAndRegistration_TfLiteContext_int_PointerPointer_PointerPointer GetNodeAndRegistration()

GetNodeAndRegistration

public TfLiteContext GetNodeAndRegistration(TfLiteContext.GetNodeAndRegistration_TfLiteContext_int_PointerPointer_PointerPointer setter)

ReplaceNodeSubsetsWithDelegateKernels

public TfLiteContext.ReplaceNodeSubsetsWithDelegateKernels_TfLiteContext_TfLiteRegistration_TfLiteIntArray_TfLiteDelegate ReplaceNodeSubsetsWithDelegateKernels()

ReplaceNodeSubsetsWithDelegateKernels

public TfLiteContext ReplaceNodeSubsetsWithDelegateKernels(TfLiteContext.ReplaceNodeSubsetsWithDelegateKernels_TfLiteContext_TfLiteRegistration_TfLiteIntArray_TfLiteDelegate setter)

recommended_num_threads

public int recommended_num_threads()

Number of threads that are recommended to subsystems like gemmlowp and eigen.

recommended_num_threads

public TfLiteContext recommended_num_threads(int setter)

GetExternalContext

public TfLiteContext.GetExternalContext_TfLiteContext_int GetExternalContext()

GetExternalContext

public TfLiteContext GetExternalContext(TfLiteContext.GetExternalContext_TfLiteContext_int setter)

SetExternalContext

public TfLiteContext.SetExternalContext_TfLiteContext_int_TfLiteExternalContext SetExternalContext()

SetExternalContext

public TfLiteContext SetExternalContext(TfLiteContext.SetExternalContext_TfLiteContext_int_TfLiteExternalContext setter)

allow_fp32_relax_to_fp16

@Cast(value="bool")
public boolean allow_fp32_relax_to_fp16()

Flag for allowing float16 precision for FP32 calculation. default: false. WARNING: This is an experimental API and subject to change.

allow_fp32_relax_to_fp16

public TfLiteContext allow_fp32_relax_to_fp16(boolean setter)

profiler

public Pointer profiler()

Pointer to the op-level profiler, if set; nullptr otherwise.

profiler

public TfLiteContext profiler(Pointer setter)

AllocatePersistentBuffer

public TfLiteContext.AllocatePersistentBuffer_TfLiteContext_long AllocatePersistentBuffer()

AllocatePersistentBuffer

public TfLiteContext AllocatePersistentBuffer(TfLiteContext.AllocatePersistentBuffer_TfLiteContext_long setter)

AllocateBufferForEval

public TfLiteContext.AllocateBufferForEval_TfLiteContext_long_PointerPointer AllocateBufferForEval()

AllocateBufferForEval

public TfLiteContext AllocateBufferForEval(TfLiteContext.AllocateBufferForEval_TfLiteContext_long_PointerPointer setter)

RequestScratchBufferInArena

public TfLiteContext.RequestScratchBufferInArena_TfLiteContext_long_IntPointer RequestScratchBufferInArena()

RequestScratchBufferInArena

public TfLiteContext RequestScratchBufferInArena(TfLiteContext.RequestScratchBufferInArena_TfLiteContext_long_IntPointer setter)

GetScratchBuffer

public TfLiteContext.GetScratchBuffer_TfLiteContext_int GetScratchBuffer()

GetScratchBuffer

public TfLiteContext GetScratchBuffer(TfLiteContext.GetScratchBuffer_TfLiteContext_int setter)

ResizeTensorExplicit

public TfLiteContext.ResizeTensorExplicit_TfLiteContext_TfLiteTensor_int_IntPointer ResizeTensorExplicit()

ResizeTensorExplicit

public TfLiteContext ResizeTensorExplicit(TfLiteContext.ResizeTensorExplicit_TfLiteContext_TfLiteTensor_int_IntPointer setter)

PreviewDelegatePartitioning

public TfLiteContext.PreviewDelegatePartitioning_TfLiteContext_TfLiteIntArray_PointerPointer_IntPointer PreviewDelegatePartitioning()

PreviewDelegatePartitioning

public TfLiteContext PreviewDelegatePartitioning(TfLiteContext.PreviewDelegatePartitioning_TfLiteContext_TfLiteIntArray_PointerPointer_IntPointer setter)

GetTensor

public TfLiteContext.GetTensor_TfLiteContext_int GetTensor()

GetTensor

public TfLiteContext GetTensor(TfLiteContext.GetTensor_TfLiteContext_int setter)

GetEvalTensor

public TfLiteContext.GetEvalTensor_TfLiteContext_int GetEvalTensor()

GetEvalTensor

public TfLiteContext GetEvalTensor(TfLiteContext.GetEvalTensor_TfLiteContext_int setter)

GetModelMetadata

public TfLiteContext.GetModelMetadata_TfLiteContext_BytePointer_PointerPointer_SizeTPointer GetModelMetadata()

GetModelMetadata

public TfLiteContext GetModelMetadata(TfLiteContext.GetModelMetadata_TfLiteContext_BytePointer_PointerPointer_SizeTPointer setter)

AcquireSubgraphContext

public TfLiteContext.AcquireSubgraphContext_TfLiteContext_int_PointerPointer AcquireSubgraphContext()

AcquireSubgraphContext

public TfLiteContext AcquireSubgraphContext(TfLiteContext.AcquireSubgraphContext_TfLiteContext_int_PointerPointer setter)

ReleaseSubgraphContext

public TfLiteContext.ReleaseSubgraphContext_TfLiteContext_int ReleaseSubgraphContext()

ReleaseSubgraphContext

public TfLiteContext ReleaseSubgraphContext(TfLiteContext.ReleaseSubgraphContext_TfLiteContext_int setter)