| Class | Description |
|---|---|
| FileIndex |
A file index which supports listing files efficiently through metadata table.
|
| IncrementalInputSplits |
Utilities to generate incremental input splits
MergeOnReadInputSplit. |
| IncrementalInputSplits.Builder |
Builder for
IncrementalInputSplits. |
| IncrementalInputSplits.Result |
Represents a result of calling
IncrementalInputSplits.inputSplits(org.apache.hudi.common.table.HoodieTableMetaClient, org.apache.hadoop.conf.Configuration). |
| StreamReadMonitoringFunction |
This is the single (non-parallel) monitoring task which takes a
MergeOnReadInputSplit
, it is responsible for:
Monitoring a user-provided hoodie table path.
Deciding which files(or split) should be further read and processed.
Creating the splits corresponding to those files.
Assigning them to downstream tasks for further processing.
|
| StreamReadOperator |
The operator that reads the
splits received from the preceding StreamReadMonitoringFunction. |
Copyright © 2022 The Apache Software Foundation. All rights reserved.