org.bytedeco.arrow_dataset

Class HivePartitioning

java.lang.Object

org.bytedeco.javacpp.Pointer

org.bytedeco.arrow_dataset.Partitioning

org.bytedeco.arrow_dataset.KeyValuePartitioning

org.bytedeco.arrow_dataset.HivePartitioning

All Implemented Interfaces:

AutoCloseable

@Namespace(value="arrow::dataset")
 @NoOffset
 @Properties(inherit=arrow_dataset.class)
public class HivePartitioning
extends KeyValuePartitioning

\brief Multi-level, directory based partitioning originating from Apache Hive with all data files stored in the leaf directories. Data is partitioned by static values of a particular column in the schema. Partition keys are represented in the form $key=$value in directory names. Field order is ignored, as are missing or unrecognized field names. For example given schema the path "/day=321/ignored=3.4/year=2009" parses to ("year"_ == 2009 and "day"_ == 321)

Nested Class Summary

Nested classes/interfaces inherited from class org.bytedeco.arrow_dataset.KeyValuePartitioning

KeyValuePartitioning.Key

Nested classes/interfaces inherited from class org.bytedeco.arrow_dataset.Partitioning

Partitioning.PartitionedBatches

Nested classes/interfaces inherited from class org.bytedeco.javacpp.Pointer

Pointer.CustomDeallocator, Pointer.Deallocator, Pointer.NativeDeallocator, Pointer.ReferenceCounter

Field Summary

Fields inherited from class org.bytedeco.javacpp.Pointer

address, capacity, limit, position

Constructor Summary

Constructors

Constructor and Description
HivePartitioning(Pointer p) Pointer cast constructor.
HivePartitioning(Schema schema)
HivePartitioning(Schema schema, ArrayVector dictionaries, BytePointer null_fallback)
HivePartitioning(Schema schema, ArrayVector dictionaries, HivePartitioningOptions options)
HivePartitioning(Schema schema, ArrayVector dictionaries, String null_fallback) If a field in schema is of dictionary type, the corresponding element of dictionaries must be contain the dictionary of values for that field.

Method Summary

Modifier and Type	Method and Description
static PartitioningFactory	MakeFactory()
static PartitioningFactory	MakeFactory(HivePartitioningFactoryOptions arg0) \brief Create a factory for a hive partitioning.
String	null_fallback()
HivePartitioningOptions	options()
static KeyOptionalResult	ParseKey(BytePointer segment, HivePartitioningOptions options)
static KeyOptionalResult	ParseKey(String segment, HivePartitioningOptions options)
String	type_name() \brief The name identifying the kind of partitioning

Methods inherited from class org.bytedeco.arrow_dataset.KeyValuePartitioning

dictionaries, Format, Parse, Parse, Partition

Methods inherited from class org.bytedeco.arrow_dataset.Partitioning

Default, schema

Methods inherited from class org.bytedeco.javacpp.Pointer

address, asBuffer, asByteBuffer, availablePhysicalBytes, calloc, capacity, capacity, close, deallocate, deallocate, deallocateReferences, deallocator, deallocator, equals, fill, formatBytes, free, getDirectBufferAddress, getPointer, getPointer, getPointer, getPointer, hashCode, interruptDeallocatorThread, isNull, isNull, limit, limit, malloc, maxBytes, maxPhysicalBytes, memchr, memcmp, memcpy, memmove, memset, offsetAddress, offsetof, offsetof, parseBytes, physicalBytes, physicalBytesInaccurate, position, position, put, realloc, referenceCount, releaseReference, retainReference, setNull, sizeof, sizeof, toString, totalBytes, totalCount, totalPhysicalBytes, withDeallocator, zero

Methods inherited from class java.lang.Object

clone, finalize, getClass, notify, notifyAll, wait, wait, wait

Constructor Detail

HivePartitioning

public HivePartitioning(Pointer p)

Pointer cast constructor. Invokes Pointer(Pointer).

HivePartitioning

public HivePartitioning(@SharedPtr @ByVal
                        Schema schema,
                        @ByVal(nullValue="arrow::ArrayVector{}")
                        ArrayVector dictionaries,
                        @StdString
                        String null_fallback)

If a field in schema is of dictionary type, the corresponding element of dictionaries must be contain the dictionary of values for that field.

HivePartitioning

public HivePartitioning(@SharedPtr @ByVal
                        Schema schema)

HivePartitioning

public HivePartitioning(@SharedPtr @ByVal
                        Schema schema,
                        @ByVal(nullValue="arrow::ArrayVector{}")
                        ArrayVector dictionaries,
                        @StdString
                        BytePointer null_fallback)

HivePartitioning

public HivePartitioning(@SharedPtr @ByVal
                        Schema schema,
                        @ByVal
                        ArrayVector dictionaries,
                        @ByVal
                        HivePartitioningOptions options)

Method Detail

type_name

@StdString
public String type_name()

Description copied from class: Partitioning

\brief The name identifying the kind of partitioning

Overrides:

type_name in class Partitioning

null_fallback

@StdString
public String null_fallback()

options

@Const
 @ByRef
public HivePartitioningOptions options()

ParseKey

@ByVal
public static KeyOptionalResult ParseKey(@StdString
                                                 String segment,
                                                 @Const @ByRef
                                                 HivePartitioningOptions options)

ParseKey

@ByVal
public static KeyOptionalResult ParseKey(@StdString
                                                 BytePointer segment,
                                                 @Const @ByRef
                                                 HivePartitioningOptions options)

MakeFactory

@SharedPtr
public static PartitioningFactory MakeFactory(@ByVal(nullValue="arrow::dataset::HivePartitioningFactoryOptions{}")
                                                          HivePartitioningFactoryOptions arg0)

\brief Create a factory for a hive partitioning.

MakeFactory

@SharedPtr
public static PartitioningFactory MakeFactory()