Package | Description |
---|---|
org.bytedeco.arrow_dataset |
Class and Description |
---|
CompressionTypeOptional |
CsvFileFormat
\addtogroup dataset-file-formats
\{
|
CsvFileWriteOptions |
CsvFragmentScanOptions
\brief Per-scan options for CSV fragments
|
Dataset
\}
|
DatasetFactory
\brief DatasetFactory provides a way to inspect/discover a Dataset's expected
schema before materializing said Dataset.
|
DatasetFactoryResult |
DatasetResult |
EnumeratedRecordBatch
\brief Combines a tagged batch with positional information
This is returned when scanning batches in an unordered fashion.
|
EnumeratedRecordBatchGeneratorResult |
EnumeratedRecordBatchIterator |
EnumeratedRecordBatchIterator.RangeIterator |
EnumeratedRecordBatchIteratorResult |
EnumeratedRecordBatchResult |
FileFormat
\brief Base class for file format implementation
|
FileFragment
\brief A Fragment that is stored in a file with a known format
|
FileFragmentResult |
FileFragmentVector |
FileFragmentVector.Iterator |
FileReaderResult |
FileSource
\defgroup dataset-file-formats File formats for reading and writing datasets
\defgroup dataset-filesystem File system datasets
\{
|
FileSystemDataset
\brief A Dataset of FileFragments.
|
FileSystemDatasetResult |
FileSystemDatasetWriteOptions
\brief Options for writing a dataset.
|
FileSystemFactoryOptions
\ingroup dataset-filesystem
|
FileWriteOptions
\brief Options for writing a file of this format.
|
FileWriter
\brief A writer for this format.
|
FileWriterResult |
FilterIterator
\brief Like MapIterator, but where the function can fail.
|
FilterIterator.Action |
FinishOptions |
Fragment
\brief A granular piece of a Dataset, such as an individual file.
|
FragmentEnumerated
\brief Create a generator that takes in a stream of generators and pulls from each
one in sequence.
|
FragmentIterator |
FragmentIterator.RangeIterator |
FragmentIteratorResult |
FragmentResult |
FragmentScanOptions
\brief Per-scan options for fragment(s) in a dataset.
|
FragmentVectorResult |
HivePartitioningFactoryOptions
\brief Options for inferring a hive-style partitioning.
|
HivePartitioningOptions |
InMemoryDataset.RecordBatchGenerator |
InspectOptions
\defgroup dataset-discovery Discovery API
\{
|
IpcFileFormat
\brief A FileFormat implementation that reads from and writes to Ipc files
|
IpcFileWriteOptions |
IpcFragmentScanOptions
\brief Per-scan options for IPC fragments
|
IterationTraits |
KeyOptional |
KeyOptionalResult
A class for representing either a usable value, or an error.
|
KeyValuePartitioning
\brief Subclass for the common case of a partitioning which yields an equality
expression for each segment
|
KeyValuePartitioning.Key
An unconverted equality expression consisting of a field name and the representation
of a scalar value
|
KeyValuePartitioningOptions
\brief Options for key-value based partitioning (hive/directory).
|
ParquetFactoryOptions
\brief Options for making a FileSystemDataset from a Parquet _metadata file.
|
ParquetFileFormat
\brief A FileFormat implementation that reads from Parquet files
|
ParquetFileFragment
\brief A FileFragment with parquet logic.
|
ParquetFileFragmentResult |
ParquetFileWriteOptions |
ParquetFragmentScanOptions
\brief Per-scan options for Parquet fragments
|
PartitionedBatchesResult |
Partitioning
\defgroup dataset-partitioning Partitioning API
\{
|
Partitioning.PartitionedBatches
\brief If the input batch shares any fields with this partitioning,
produce sub-batches which satisfy mutually exclusive Expressions.
|
PartitioningFactory
\brief PartitioningFactory provides creation of a partitioning when the
specific schema must be inferred from available paths (no explicit schema is known).
|
PartitioningFactoryOptions
\brief Options for inferring a partitioning.
|
PartitioningOrFactory
\brief Either a Partitioning or a PartitioningFactory
|
PartitioningResult |
RecordBatchGeneratorResult |
Scanner
\defgroup dataset-scanning Scanning API
\{
|
ScannerBuilder
\brief ScannerBuilder is a factory class to construct a Scanner.
|
ScannerBuilderResult |
ScannerResult |
ScanNodeOptions
\brief Construct a source ExecNode which yields batches from a dataset scan.
|
ScanOptions
Scan-specific options, which can be changed between scans of the same dataset.
|
ScanTask
\brief Read record batches from a range of a single data fragment.
|
ScanTaskIterator |
ScanTaskIterator.RangeIterator |
ScanTaskIteratorResult |
ScanTaskResult |
ScanTaskVector |
ScanTaskVector.Iterator |
ScanTaskVectorResult |
StringOptional |
StringUnorderedSet |
StringUnorderedSet.Iterator |
TaggedRecordBatch
\brief Combines a record batch with the fragment that the record batch originated
from
Knowing the source fragment can be useful for debugging & understanding loaded data
|
TaggedRecordBatchGeneratorResult |
TaggedRecordBatchIterator
\brief A generic Iterator that can return errors
|
TaggedRecordBatchIterator.RangeIterator |
TaggedRecordBatchIteratorResult |
TaggedRecordBatchResult |
TaggedRecordBatchVectorResult |
TransformFinish |
TransformSkip |
UnionDataset
\brief A Dataset wrapping child Datasets.
|
UnionDatasetResult |
WriteNodeOptions
\brief Wraps FileSystemDatasetWriteOptions for consumption as compute::ExecNodeOptions
|
Copyright © 2022. All rights reserved.