org.bytedeco.arrow_dataset

Class Dataset

java.lang.Object

org.bytedeco.javacpp.Pointer

org.bytedeco.arrow_dataset.Dataset

All Implemented Interfaces:

AutoCloseable

Direct Known Subclasses:

FileSystemDataset, InMemoryDataset, UnionDataset

@Namespace(value="arrow::dataset")
 @NoOffset
 @Properties(inherit=arrow_dataset.class)
public class Dataset
extends Pointer

\}

\brief A container of zero or more Fragments. A Dataset acts as a union of Fragments, e.g. files deeply nested in a directory. A Dataset has a schema to which Fragments must align during a scan operation. This is analogous to Avro's reader and writer schema.

Nested Class Summary

Nested classes/interfaces inherited from class org.bytedeco.javacpp.Pointer

Pointer.CustomDeallocator, Pointer.Deallocator, Pointer.NativeDeallocator, Pointer.ReferenceCounter

Field Summary

Fields inherited from class org.bytedeco.javacpp.Pointer

address, capacity, limit, position

Constructor Summary

Constructors

Constructor and Description
Dataset(Pointer p) Pointer cast constructor.

Method Summary

Modifier and Type	Method and Description
FragmentIteratorResult	GetFragments()
FragmentIteratorResult	GetFragments(Expression predicate) \brief GetFragments returns an iterator of Fragments given a predicate.
ScannerBuilderResult	NewScan() \brief Begin to build a new Scan operation against this Dataset
Expression	partition_expression() \brief An expression which evaluates to true for all data viewed by this Dataset.
DatasetResult	ReplaceSchema(Schema schema) \brief Return a copy of this Dataset with a different schema.
Schema	schema()
String	type_name() \brief The name identifying the kind of Dataset

Methods inherited from class org.bytedeco.javacpp.Pointer

address, asBuffer, asByteBuffer, availablePhysicalBytes, calloc, capacity, capacity, close, deallocate, deallocate, deallocateReferences, deallocator, deallocator, equals, fill, formatBytes, free, getDirectBufferAddress, getPointer, getPointer, getPointer, getPointer, hashCode, interruptDeallocatorThread, isNull, isNull, limit, limit, malloc, maxBytes, maxPhysicalBytes, memchr, memcmp, memcpy, memmove, memset, offsetAddress, offsetof, offsetof, parseBytes, physicalBytes, physicalBytesInaccurate, position, position, put, realloc, referenceCount, releaseReference, retainReference, setNull, sizeof, sizeof, toString, totalBytes, totalCount, totalPhysicalBytes, withDeallocator, zero

Methods inherited from class java.lang.Object

clone, finalize, getClass, notify, notifyAll, wait, wait, wait

Constructor Detail

Dataset

public Dataset(Pointer p)

Pointer cast constructor. Invokes Pointer(Pointer).

Method Detail

NewScan

@ByVal
public ScannerBuilderResult NewScan()

\brief Begin to build a new Scan operation against this Dataset

GetFragments

@ByVal
public FragmentIteratorResult GetFragments(@ByVal
                                                   Expression predicate)

\brief GetFragments returns an iterator of Fragments given a predicate.

GetFragments

@ByVal
public FragmentIteratorResult GetFragments()

schema

@Const
 @SharedPtr
 @ByRef
public Schema schema()

partition_expression

@Const
 @ByRef
public Expression partition_expression()

\brief An expression which evaluates to true for all data viewed by this Dataset. May be null, which indicates no information is available.

type_name

@StdString
public String type_name()

\brief The name identifying the kind of Dataset

ReplaceSchema

@ByVal
public DatasetResult ReplaceSchema(@SharedPtr @ByVal
                                           Schema schema)

\brief Return a copy of this Dataset with a different schema. The copy will view the same Fragments. If the new schema is not compatible with the original dataset's schema then an error will be raised.