org.bytedeco.arrow_dataset

Class ParquetFragmentScanOptions

java.lang.Object

org.bytedeco.javacpp.Pointer

org.bytedeco.arrow_dataset.FragmentScanOptions

org.bytedeco.arrow_dataset.ParquetFragmentScanOptions

All Implemented Interfaces:

AutoCloseable

@Namespace(value="arrow::dataset")
 @NoOffset
 @Properties(inherit=arrow_dataset.class)
public class ParquetFragmentScanOptions
extends FragmentScanOptions

\brief Per-scan options for Parquet fragments

Nested Class Summary

Nested classes/interfaces inherited from class org.bytedeco.javacpp.Pointer

Pointer.CustomDeallocator, Pointer.Deallocator, Pointer.NativeDeallocator, Pointer.ReferenceCounter

Field Summary

Fields inherited from class org.bytedeco.javacpp.Pointer

address, capacity, limit, position

Constructor Summary

Constructors

Constructor and Description
ParquetFragmentScanOptions()
ParquetFragmentScanOptions(long size) Native array allocator.
ParquetFragmentScanOptions(Pointer p) Pointer cast constructor.

Method Summary

Modifier and Type	Method and Description
ArrowReaderProperties	arrow_reader_properties() Arrow reader properties.
ParquetFragmentScanOptions	arrow_reader_properties(ArrowReaderProperties setter)
boolean	enable_parallel_column_conversion() EXPERIMENTAL: Parallelize conversion across columns.
ParquetFragmentScanOptions	enable_parallel_column_conversion(boolean setter)
ParquetFragmentScanOptions	getPointer(long i)
ParquetFragmentScanOptions	position(long position)
ReaderProperties	reader_properties() Reader properties.
ParquetFragmentScanOptions	reader_properties(ReaderProperties setter)
String	type_name()

Methods inherited from class org.bytedeco.arrow_dataset.FragmentScanOptions

ToString

Methods inherited from class org.bytedeco.javacpp.Pointer

address, asBuffer, asByteBuffer, availablePhysicalBytes, calloc, capacity, capacity, close, deallocate, deallocate, deallocateReferences, deallocator, deallocator, equals, fill, formatBytes, free, getDirectBufferAddress, getPointer, getPointer, getPointer, hashCode, interruptDeallocatorThread, isNull, isNull, limit, limit, malloc, maxBytes, maxPhysicalBytes, memchr, memcmp, memcpy, memmove, memset, offsetAddress, offsetof, offsetof, parseBytes, physicalBytes, physicalBytesInaccurate, position, put, realloc, referenceCount, releaseReference, retainReference, setNull, sizeof, sizeof, toString, totalBytes, totalCount, totalPhysicalBytes, withDeallocator, zero

Methods inherited from class java.lang.Object

clone, finalize, getClass, notify, notifyAll, wait, wait, wait

Constructor Detail

ParquetFragmentScanOptions

public ParquetFragmentScanOptions(Pointer p)

Pointer cast constructor. Invokes Pointer(Pointer).

ParquetFragmentScanOptions

public ParquetFragmentScanOptions(long size)

Native array allocator. Access with Pointer.position(long).

ParquetFragmentScanOptions

public ParquetFragmentScanOptions()

Method Detail

position

public ParquetFragmentScanOptions position(long position)

Overrides:

position in class Pointer

getPointer

public ParquetFragmentScanOptions getPointer(long i)

Overrides:

getPointer in class Pointer

type_name

@StdString
public String type_name()

Overrides:

type_name in class FragmentScanOptions

reader_properties

@SharedPtr
public ReaderProperties reader_properties()

Reader properties. Not all properties are respected: memory_pool comes from ScanOptions.

reader_properties

public ParquetFragmentScanOptions reader_properties(ReaderProperties setter)

arrow_reader_properties

@SharedPtr
public ArrowReaderProperties arrow_reader_properties()

Arrow reader properties. Not all properties are respected: batch_size comes from ScanOptions, and use_threads will be overridden based on enable_parallel_column_conversion. Additionally, dictionary columns come from ParquetFileFormat::ReaderOptions::dict_columns.

arrow_reader_properties

public ParquetFragmentScanOptions arrow_reader_properties(ArrowReaderProperties setter)

enable_parallel_column_conversion

@Cast(value="bool")
public boolean enable_parallel_column_conversion()

EXPERIMENTAL: Parallelize conversion across columns. This option is ignored if a scan is already parallelized across input files to avoid thread contention. This option will be removed after support is added for simultaneous parallelization across files and columns. Only affects the threaded reader; the async reader will parallelize across columns if use_threads is enabled.

enable_parallel_column_conversion

public ParquetFragmentScanOptions enable_parallel_column_conversion(boolean setter)