org.bytedeco.sentencepiece

Class SentencePieceNormalizer

java.lang.Object

org.bytedeco.javacpp.Pointer

org.bytedeco.sentencepiece.SentencePieceNormalizer

All Implemented Interfaces:

AutoCloseable

@Namespace(value="sentencepiece")
 @NoOffset
 @Properties(inherit=sentencepiece.class)
public class SentencePieceNormalizer
extends Pointer

Nested Class Summary

Nested classes/interfaces inherited from class org.bytedeco.javacpp.Pointer

Pointer.CustomDeallocator, Pointer.Deallocator, Pointer.NativeDeallocator, Pointer.ReferenceCounter

Field Summary

Fields inherited from class org.bytedeco.javacpp.Pointer

address, capacity, limit, position

Constructor Summary

Constructors

Constructor and Description
SentencePieceNormalizer()
SentencePieceNormalizer(long size) Native array allocator.
SentencePieceNormalizer(Pointer p) Pointer cast constructor.

Method Summary

Modifier and Type	Method and Description
SentencePieceNormalizer	getPointer(long i)
Status	LoadFromRuleName(String name)
Status	LoadFromRuleTSV(String filename)
Status	LoadFromSerializedProto(String serialized)
NormalizerSpec	mutable_normalizer_spec()
String	Normalize(String input)
Status	Normalize(String input, BytePointer normalized)
Status	Normalize(String input, BytePointer normalized, SizeTPointer norm_to_orig)
SentencePieceNormalizer	position(long position)
String	serialized_model_proto()

Methods inherited from class org.bytedeco.javacpp.Pointer

address, asBuffer, asByteBuffer, availablePhysicalBytes, calloc, capacity, capacity, close, deallocate, deallocate, deallocateReferences, deallocator, deallocator, equals, fill, formatBytes, free, getDirectBufferAddress, getPointer, getPointer, getPointer, hashCode, interruptDeallocatorThread, isNull, isNull, limit, limit, malloc, maxBytes, maxPhysicalBytes, memchr, memcmp, memcpy, memmove, memset, offsetAddress, offsetof, offsetof, parseBytes, physicalBytes, physicalBytesInaccurate, position, put, realloc, referenceCount, releaseReference, retainReference, setNull, sizeof, sizeof, toString, totalBytes, totalCount, totalPhysicalBytes, withDeallocator, zero

Methods inherited from class java.lang.Object

clone, finalize, getClass, notify, notifyAll, wait, wait, wait

Constructor Detail

SentencePieceNormalizer

public SentencePieceNormalizer(Pointer p)

Pointer cast constructor. Invokes Pointer(Pointer).

SentencePieceNormalizer

public SentencePieceNormalizer(long size)

Native array allocator. Access with Pointer.position(long).

SentencePieceNormalizer

public SentencePieceNormalizer()

Method Detail

position

public SentencePieceNormalizer position(long position)

Overrides:

position in class Pointer

getPointer

public SentencePieceNormalizer getPointer(long i)

Overrides:

getPointer in class Pointer

LoadFromSerializedProto

@ByVal
public Status LoadFromSerializedProto(@StdString
                                              String serialized)

LoadFromRuleTSV

@ByVal
public Status LoadFromRuleTSV(@StdString
                                      String filename)

LoadFromRuleName

@ByVal
public Status LoadFromRuleName(@StdString
                                       String name)

Normalize

@ByVal
public Status Normalize(@StdString
                                String input,
                                @StdString @Cast(value={"char*","std::string*"})
                                BytePointer normalized)

Normalize

@ByVal
public Status Normalize(@StdString
                                String input,
                                @StdString @Cast(value={"char*","std::string*"})
                                BytePointer normalized,
                                @Cast(value="size_t*") @StdVector
                                SizeTPointer norm_to_orig)

Normalize

@StdString
public String Normalize(@StdString
                                    String input)

mutable_normalizer_spec

public NormalizerSpec mutable_normalizer_spec()

serialized_model_proto

@StdString
public String serialized_model_proto()