org.bytedeco.parquet

Class ColumnWriter

java.lang.Object

org.bytedeco.javacpp.Pointer

org.bytedeco.parquet.ColumnWriter

All Implemented Interfaces:

AutoCloseable

@Namespace(value="parquet")
 @Properties(inherit=parquet.class)
public class ColumnWriter
extends Pointer

Nested Class Summary

Nested classes/interfaces inherited from class org.bytedeco.javacpp.Pointer

Pointer.CustomDeallocator, Pointer.Deallocator, Pointer.NativeDeallocator, Pointer.ReferenceCounter

Field Summary

Fields inherited from class org.bytedeco.javacpp.Pointer

address, capacity, limit, position

Constructor Summary

Constructors

Constructor and Description
ColumnWriter(Pointer p) Pointer cast constructor.

Method Summary

Modifier and Type	Method and Description
long	Close() \brief Closes the ColumnWriter, commits any buffered values to pages.
ColumnDescriptor	descr() \brief The schema for the column
static ColumnWriter	Make(ColumnChunkMetaDataBuilder arg0, PageWriter arg1, WriterProperties properties)
WriterProperties	properties() \brief The file-level writer properties
long	rows_written() \brief The number of rows written so far
long	total_bytes_written() \brief The total number of bytes written as serialized data and dictionary pages to the ColumnChunk so far
long	total_compressed_bytes() \brief The total size of the compressed pages + page headers.
Type.type	type() \brief The physical Parquet type of the column
Status	WriteArrow(short[] def_levels, short[] rep_levels, long num_levels, Array leaf_array, ArrowWriteContext ctx, boolean leaf_field_nullable)
Status	WriteArrow(ShortBuffer def_levels, ShortBuffer rep_levels, long num_levels, Array leaf_array, ArrowWriteContext ctx, boolean leaf_field_nullable)
Status	WriteArrow(ShortPointer def_levels, ShortPointer rep_levels, long num_levels, Array leaf_array, ArrowWriteContext ctx, boolean leaf_field_nullable) \brief Write Apache Arrow columnar data directly to ColumnWriter.

Methods inherited from class org.bytedeco.javacpp.Pointer

address, asBuffer, asByteBuffer, availablePhysicalBytes, calloc, capacity, capacity, close, deallocate, deallocate, deallocateReferences, deallocator, deallocator, equals, fill, formatBytes, free, getDirectBufferAddress, getPointer, getPointer, getPointer, getPointer, hashCode, interruptDeallocatorThread, isNull, isNull, limit, limit, malloc, maxBytes, maxPhysicalBytes, memchr, memcmp, memcpy, memmove, memset, offsetAddress, offsetof, offsetof, parseBytes, physicalBytes, physicalBytesInaccurate, position, position, put, realloc, referenceCount, releaseReference, retainReference, setNull, sizeof, sizeof, toString, totalBytes, totalCount, totalPhysicalBytes, withDeallocator, zero

Methods inherited from class java.lang.Object

clone, finalize, getClass, notify, notifyAll, wait, wait, wait

Constructor Detail

ColumnWriter

public ColumnWriter(Pointer p)

Pointer cast constructor. Invokes Pointer(Pointer).

Method Detail

Make

@SharedPtr
public static ColumnWriter Make(ColumnChunkMetaDataBuilder arg0,
                                            @UniquePtr
                                            PageWriter arg1,
                                            @Const
                                            WriterProperties properties)

Close

@Cast(value="int64_t")
public long Close()

\brief Closes the ColumnWriter, commits any buffered values to pages.

Returns:

Total size of the column in bytes

type

public Type.type type()

\brief The physical Parquet type of the column

descr

@Const
public ColumnDescriptor descr()

\brief The schema for the column

rows_written

@Cast(value="int64_t")
public long rows_written()

\brief The number of rows written so far

total_compressed_bytes

@Cast(value="int64_t")
public long total_compressed_bytes()

\brief The total size of the compressed pages + page headers. Some values might be still buffered and not written to a page yet

total_bytes_written

@Cast(value="int64_t")
public long total_bytes_written()

\brief The total number of bytes written as serialized data and dictionary pages to the ColumnChunk so far

properties

@Const
public WriterProperties properties()

\brief The file-level writer properties

WriteArrow

@ByVal
public Status WriteArrow(@Const
                                 ShortPointer def_levels,
                                 @Const
                                 ShortPointer rep_levels,
                                 @Cast(value="int64_t")
                                 long num_levels,
                                 @Const @ByRef
                                 Array leaf_array,
                                 ArrowWriteContext ctx,
                                 @Cast(value="bool")
                                 boolean leaf_field_nullable)

\brief Write Apache Arrow columnar data directly to ColumnWriter. Returns error status if the array data type is not compatible with the concrete writer type. leaf_array is always a primitive (possibly dictionary encoded type). Leaf_field_nullable indicates whether the leaf array is considered nullable according to its schema in a Table or its parent array.

WriteArrow

@ByVal
public Status WriteArrow(@Const
                                 ShortBuffer def_levels,
                                 @Const
                                 ShortBuffer rep_levels,
                                 @Cast(value="int64_t")
                                 long num_levels,
                                 @Const @ByRef
                                 Array leaf_array,
                                 ArrowWriteContext ctx,
                                 @Cast(value="bool")
                                 boolean leaf_field_nullable)

WriteArrow

@ByVal
public Status WriteArrow(@Const
                                 short[] def_levels,
                                 @Const
                                 short[] rep_levels,
                                 @Cast(value="int64_t")
                                 long num_levels,
                                 @Const @ByRef
                                 Array leaf_array,
                                 ArrowWriteContext ctx,
                                 @Cast(value="bool")
                                 boolean leaf_field_nullable)