org.bytedeco.parquet

Class ParquetFileReader

java.lang.Object

org.bytedeco.javacpp.Pointer

org.bytedeco.parquet.ParquetFileReader

All Implemented Interfaces:

AutoCloseable

@Namespace(value="parquet")
 @NoOffset
 @Properties(inherit=parquet.class)
public class ParquetFileReader
extends Pointer

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	ParquetFileReader.Contents

Nested classes/interfaces inherited from class org.bytedeco.javacpp.Pointer

Pointer.CustomDeallocator, Pointer.Deallocator, Pointer.NativeDeallocator, Pointer.ReferenceCounter

Field Summary

Fields inherited from class org.bytedeco.javacpp.Pointer

address, capacity, limit, position

Constructor Summary

Constructors

Constructor and Description
ParquetFileReader()
ParquetFileReader(long size) Native array allocator.
ParquetFileReader(Pointer p) Pointer cast constructor.

Method Summary

Modifier and Type	Method and Description
void	Close()
ParquetFileReader	getPointer(long i)
FileMetaData	metadata()
void	Open(ParquetFileReader.Contents contents)
static ParquetFileReader	Open(RandomAccessFile source)
static ParquetFileReader	Open(RandomAccessFile source, ReaderProperties props, FileMetaData metadata)
static ParquetFileReader	OpenFile(BytePointer path)
static ParquetFileReader	OpenFile(BytePointer path, boolean memory_map, ReaderProperties props, FileMetaData metadata)
static ParquetFileReader	OpenFile(String path)
static ParquetFileReader	OpenFile(String path, boolean memory_map, ReaderProperties props, FileMetaData metadata)
ParquetFileReader	position(long position)
void	PreBuffer(int[] row_groups, int[] column_indices, IOContext ctx, CacheOptions options)
void	PreBuffer(IntBuffer row_groups, IntBuffer column_indices, IOContext ctx, CacheOptions options)
void	PreBuffer(IntPointer row_groups, IntPointer column_indices, IOContext ctx, CacheOptions options) Pre-buffer the specified column indices in all row groups.
RowGroupReader	RowGroup(int i)
Future	WhenBuffered(int[] row_groups, int[] column_indices)
Future	WhenBuffered(IntBuffer row_groups, IntBuffer column_indices)
Future	WhenBuffered(IntPointer row_groups, IntPointer column_indices) Wait for the specified row groups and column indices to be pre-buffered.

Methods inherited from class org.bytedeco.javacpp.Pointer

address, asBuffer, asByteBuffer, availablePhysicalBytes, calloc, capacity, capacity, close, deallocate, deallocate, deallocateReferences, deallocator, deallocator, equals, fill, formatBytes, free, getDirectBufferAddress, getPointer, getPointer, getPointer, hashCode, interruptDeallocatorThread, isNull, isNull, limit, limit, malloc, maxBytes, maxPhysicalBytes, memchr, memcmp, memcpy, memmove, memset, offsetAddress, offsetof, offsetof, parseBytes, physicalBytes, physicalBytesInaccurate, position, put, realloc, referenceCount, releaseReference, retainReference, setNull, sizeof, sizeof, toString, totalBytes, totalCount, totalPhysicalBytes, withDeallocator, zero

Methods inherited from class java.lang.Object

clone, finalize, getClass, notify, notifyAll, wait, wait, wait

Constructor Detail

ParquetFileReader

public ParquetFileReader(Pointer p)

Pointer cast constructor. Invokes Pointer(Pointer).

ParquetFileReader

public ParquetFileReader(long size)

Native array allocator. Access with Pointer.position(long).

ParquetFileReader

public ParquetFileReader()

Method Detail

position

public ParquetFileReader position(long position)

Overrides:

position in class Pointer

getPointer

public ParquetFileReader getPointer(long i)

Overrides:

getPointer in class Pointer

Open

@UniquePtr
 @ByVal
public static ParquetFileReader Open(@SharedPtr @Cast(value={"","std::shared_ptr<arrow::io::RandomAccessFile>"})
                                                          RandomAccessFile source,
                                                          @Const @ByRef(nullValue="parquet::ReaderProperties(parquet::default_reader_properties())")
                                                          ReaderProperties props,
                                                          @SharedPtr
                                                          FileMetaData metadata)

Open

@UniquePtr
 @ByVal
public static ParquetFileReader Open(@SharedPtr @Cast(value={"","std::shared_ptr<arrow::io::RandomAccessFile>"})
                                                          RandomAccessFile source)

OpenFile

@UniquePtr
 @ByVal
public static ParquetFileReader OpenFile(@StdString
                                                              String path,
                                                              @Cast(value="bool")
                                                              boolean memory_map,
                                                              @Const @ByRef(nullValue="parquet::ReaderProperties(parquet::default_reader_properties())")
                                                              ReaderProperties props,
                                                              @SharedPtr
                                                              FileMetaData metadata)

OpenFile

@UniquePtr
 @ByVal
public static ParquetFileReader OpenFile(@StdString
                                                              String path)

OpenFile

@UniquePtr
 @ByVal
public static ParquetFileReader OpenFile(@StdString
                                                              BytePointer path,
                                                              @Cast(value="bool")
                                                              boolean memory_map,
                                                              @Const @ByRef(nullValue="parquet::ReaderProperties(parquet::default_reader_properties())")
                                                              ReaderProperties props,
                                                              @SharedPtr
                                                              FileMetaData metadata)

OpenFile

@UniquePtr
 @ByVal
public static ParquetFileReader OpenFile(@StdString
                                                              BytePointer path)

Open

public void Open(@UniquePtr @ByVal
                 ParquetFileReader.Contents contents)

Close

public void Close()

RowGroup

@SharedPtr
public RowGroupReader RowGroup(int i)

metadata

@SharedPtr
public FileMetaData metadata()

PreBuffer

public void PreBuffer(@StdVector
                      IntPointer row_groups,
                      @StdVector
                      IntPointer column_indices,
                      @Const @ByRef
                      IOContext ctx,
                      @Const @ByRef
                      CacheOptions options)

Pre-buffer the specified column indices in all row groups. Readers can optionally call this to cache the necessary slices of the file in-memory before deserialization. Arrow readers can automatically do this via an option. This is intended to increase performance when reading from high-latency filesystems (e.g. Amazon S3). After calling this, creating readers for row groups/column indices that were not buffered may fail. Creating multiple readers for the a subset of the buffered regions is acceptable. This may be called again to buffer a different set of row groups/columns. If memory usage is a concern, note that data will remain buffered in memory until either \a PreBuffer() is called again, or the reader itself is destructed. Reading - and buffering - only one row group at a time may be useful. This method may throw.

PreBuffer

public void PreBuffer(@StdVector
                      IntBuffer row_groups,
                      @StdVector
                      IntBuffer column_indices,
                      @Const @ByRef
                      IOContext ctx,
                      @Const @ByRef
                      CacheOptions options)

PreBuffer

public void PreBuffer(@StdVector
                      int[] row_groups,
                      @StdVector
                      int[] column_indices,
                      @Const @ByRef
                      IOContext ctx,
                      @Const @ByRef
                      CacheOptions options)

WhenBuffered

@ByVal
public Future WhenBuffered(@StdVector
                                   IntPointer row_groups,
                                   @StdVector
                                   IntPointer column_indices)

Wait for the specified row groups and column indices to be pre-buffered. After the returned Future completes, reading the specified row groups/columns will not block. PreBuffer must be called first. This method does not throw.

WhenBuffered

@ByVal
public Future WhenBuffered(@StdVector
                                   IntBuffer row_groups,
                                   @StdVector
                                   IntBuffer column_indices)

WhenBuffered

@ByVal
public Future WhenBuffered(@StdVector
                                   int[] row_groups,
                                   @StdVector
                                   int[] column_indices)