Package org.bytedeco.arrow_dataset

Class Summary

Class	Description
CompressionTypeOptional
CsvFileFormat	\addtogroup dataset-file-formats \{
CsvFileWriteOptions
CsvFileWriter
CsvFragmentScanOptions	\brief Per-scan options for CSV fragments
Dataset	\}
DatasetFactory	\brief DatasetFactory provides a way to inspect/discover a Dataset's expected schema before materializing said Dataset.
DatasetFactoryResult
DatasetResult
DirectoryPartitioning	\brief DirectoryPartitioning parses one segment of a path for each field in its schema.
EnsureResult
EnumeratedRecordBatch	\brief Combines a tagged batch with positional information This is returned when scanning batches in an unordered fashion.
EnumeratedRecordBatchGeneratorResult
EnumeratedRecordBatchIterator
EnumeratedRecordBatchIterator.RangeIterator
EnumeratedRecordBatchIteratorResult
EnumeratedRecordBatchResult
FileFormat	\brief Base class for file format implementation
FileFragment	\brief A Fragment that is stored in a file with a known format
FileFragmentResult
FileFragmentVector
FileFragmentVector.Iterator
FileReaderResult
FileSource	\defgroup dataset-file-formats File formats for reading and writing datasets \defgroup dataset-filesystem File system datasets \{
FileSystemDataset	\brief A Dataset of FileFragments.
FileSystemDatasetFactory	\brief FileSystemDatasetFactory creates a Dataset from a vector of fs::FileInfo or a fs::FileSelector.
FileSystemDatasetResult
FileSystemDatasetWriteOptions	\brief Options for writing a dataset.
FileSystemFactoryOptions	\ingroup dataset-filesystem
FileWriteOptions	\brief Options for writing a file of this format.
FileWriter	\brief A writer for this format.
FileWriterResult
FilterIterator	\brief Like MapIterator, but where the function can fail.
FinishOptions
Fragment	\brief A granular piece of a Dataset, such as an individual file.
FragmentEnumerated	\brief Create a generator that takes in a stream of generators and pulls from each one in sequence.
FragmentIterator
FragmentIterator.RangeIterator
FragmentIteratorResult
FragmentResult
FragmentScanOptions	\brief Per-scan options for fragment(s) in a dataset.
FragmentVectorResult
FunctionPartitioning	\brief Implementation provided by lambda or other callable
HivePartitioning	\brief Multi-level, directory based partitioning originating from Apache Hive with all data files stored in the leaf directories.
HivePartitioningFactoryOptions	\brief Options for inferring a hive-style partitioning.
HivePartitioningOptions
InMemoryDataset	\addtogroup dataset-implementations \{
InMemoryDataset.RecordBatchGenerator
InMemoryFragment	\defgroup dataset-implementations Concrete implementations \{
InMemoryScanTask	\}
InspectOptions	\defgroup dataset-discovery Discovery API \{
IpcFileFormat	\brief A FileFormat implementation that reads from and writes to Ipc files
IpcFileWriteOptions
IpcFileWriter
IpcFragmentScanOptions	\brief Per-scan options for IPC fragments
IterationTraits
KeyOptional
KeyOptionalResult	A class for representing either a usable value, or an error.
KeyValuePartitioning	\brief Subclass for the common case of a partitioning which yields an equality expression for each segment
KeyValuePartitioning.Key	An unconverted equality expression consisting of a field name and the representation of a scalar value
KeyValuePartitioningOptions	\brief Options for key-value based partitioning (hive/directory).
ParquetDatasetFactory	\brief Create FileSystemDataset from custom _metadata cache file.
ParquetFactoryOptions	\brief Options for making a FileSystemDataset from a Parquet _metadata file.
ParquetFileFormat	\brief A FileFormat implementation that reads from Parquet files
ParquetFileFragment	\brief A FileFragment with parquet logic.
ParquetFileFragmentResult
ParquetFileWriteOptions
ParquetFileWriter
ParquetFragmentScanOptions	\brief Per-scan options for Parquet fragments
PartitionedBatchesResult
Partitioning	\defgroup dataset-partitioning Partitioning API \{
Partitioning.PartitionedBatches	\brief If the input batch shares any fields with this partitioning, produce sub-batches which satisfy mutually exclusive Expressions.
PartitioningFactory	\brief PartitioningFactory provides creation of a partitioning when the specific schema must be inferred from available paths (no explicit schema is known).
PartitioningFactoryOptions	\brief Options for inferring a partitioning.
PartitioningOrFactory	\brief Either a Partitioning or a PartitioningFactory
PartitioningResult
RecordBatchGeneratorResult
Scanner	\defgroup dataset-scanning Scanning API \{
ScannerBuilder	\brief ScannerBuilder is a factory class to construct a Scanner.
ScannerBuilderResult
ScannerResult
ScanNodeOptions	\brief Construct a source ExecNode which yields batches from a dataset scan.
ScanOptions	Scan-specific options, which can be changed between scans of the same dataset.
ScanTask	\brief Read record batches from a range of a single data fragment.
ScanTaskIterator
ScanTaskIterator.RangeIterator
ScanTaskIteratorResult
ScanTaskResult
ScanTaskVector
ScanTaskVector.Iterator
ScanTaskVectorResult
SchemaManifest
StringOptional
StringUnorderedSet
StringUnorderedSet.Iterator
TaggedRecordBatch	\brief Combines a record batch with the fragment that the record batch originated from Knowing the source fragment can be useful for debugging & understanding loaded data
TaggedRecordBatchGeneratorResult
TaggedRecordBatchIterator	\brief A generic Iterator that can return errors
TaggedRecordBatchIterator.RangeIterator
TaggedRecordBatchIteratorResult
TaggedRecordBatchResult
TaggedRecordBatchVectorResult
TransformFinish
TransformSkip
UnionDataset	\brief A Dataset wrapping child Datasets.
UnionDatasetFactory	\}
UnionDatasetResult
WriteNodeOptions	\brief Wraps FileSystemDatasetWriteOptions for consumption as compute::ExecNodeOptions

Enum Summary

Enum	Description
FilterIterator.Action