A B C D E F G H I J L M N O P R S T U V W
All Classes All Packages
All Classes All Packages
All Classes All Packages
A
- Actions - Class in org.apache.iceberg.flink.actions
- addPostCommitTopology(DataStream<CommittableMessage<IcebergCommittable>>) - Method in class org.apache.iceberg.flink.sink.IcebergSink
- addPreCommitTopology(DataStream<CommittableMessage<WriteResult>>) - Method in class org.apache.iceberg.flink.sink.IcebergSink
- addPreWriteTopology(DataStream<RowData>) - Method in class org.apache.iceberg.flink.sink.IcebergSink
- alterDatabase(String, CatalogDatabase, boolean) - Method in class org.apache.iceberg.flink.FlinkCatalog
- alterFunction(ObjectPath, CatalogFunction, boolean) - Method in class org.apache.iceberg.flink.FlinkCatalog
- alterPartition(ObjectPath, CatalogPartitionSpec, CatalogPartition, boolean) - Method in class org.apache.iceberg.flink.FlinkCatalog
- alterPartitionColumnStatistics(ObjectPath, CatalogPartitionSpec, CatalogColumnStatistics, boolean) - Method in class org.apache.iceberg.flink.FlinkCatalog
- alterPartitionStatistics(ObjectPath, CatalogPartitionSpec, CatalogTableStatistics, boolean) - Method in class org.apache.iceberg.flink.FlinkCatalog
- alterTable(ObjectPath, CatalogBaseTable, boolean) - Method in class org.apache.iceberg.flink.FlinkCatalog
-
This alterTable API only supports altering table properties.
- alterTable(ObjectPath, CatalogBaseTable, List<TableChange>, boolean) - Method in class org.apache.iceberg.flink.FlinkCatalog
- alterTableColumnStatistics(ObjectPath, CatalogColumnStatistics, boolean) - Method in class org.apache.iceberg.flink.FlinkCatalog
- alterTableStatistics(ObjectPath, CatalogTableStatistics, boolean) - Method in class org.apache.iceberg.flink.FlinkCatalog
- append() - Method in class org.apache.iceberg.flink.sink.FlinkSink.Builder
-
Append the iceberg sink operators to write records to iceberg table.
- append() - Method in class org.apache.iceberg.flink.sink.IcebergSink.Builder
-
Append the iceberg sink operators to write records to iceberg table.
- apply(RowData) - Method in class org.apache.iceberg.flink.source.reader.AvroGenericRecordConverter
- apply(RowData) - Method in class org.apache.iceberg.flink.source.RowDataToAvroGenericRecordConverter
- apply(IcebergSourceSplit) - Method in class org.apache.iceberg.flink.source.reader.DataIteratorReaderFunction
- applyFilters(List<ResolvedExpression>) - Method in class org.apache.iceberg.flink.source.IcebergTableSource
- applyLimit(long) - Method in class org.apache.iceberg.flink.source.IcebergTableSource
- applyOverwrite(boolean) - Method in class org.apache.iceberg.flink.IcebergTableSink
- applyProjection(int[][]) - Method in class org.apache.iceberg.flink.source.IcebergTableSource
- applyPropertyChanges(UpdateProperties, List<TableChange>) - Static method in class org.apache.iceberg.flink.util.FlinkAlterTableUtil
-
Applies a list of Flink table property changes to an
UpdatePropertiesoperation. - applySchemaChanges(UpdateSchema, List<TableChange>) - Static method in class org.apache.iceberg.flink.util.FlinkAlterTableUtil
-
Applies a list of Flink table changes to an
UpdateSchemaoperation. - applyStaticPartition(Map<String, String>) - Method in class org.apache.iceberg.flink.IcebergTableSink
- arrayElementType(LogicalType) - Method in class org.apache.iceberg.flink.data.AvroWithFlinkSchemaVisitor
- AS_OF_TIMESTAMP - Static variable in class org.apache.iceberg.flink.FlinkReadOptions
- asOfTimestamp() - Method in class org.apache.iceberg.flink.FlinkReadConf
- asOfTimestamp() - Method in class org.apache.iceberg.flink.source.ScanContext
- asOfTimestamp(Long) - Method in class org.apache.iceberg.flink.source.FlinkSource.Builder
-
Deprecated.
- asOfTimestamp(Long) - Method in class org.apache.iceberg.flink.source.IcebergSource.Builder
- asOfTimestamp(Long) - Method in class org.apache.iceberg.flink.source.ScanContext.Builder
- ASSIGNED - org.apache.iceberg.flink.source.split.IcebergSourceSplitStatus
- assignerFactory(SplitAssignerFactory) - Method in class org.apache.iceberg.flink.source.IcebergSource.Builder
- asSummaryString() - Method in class org.apache.iceberg.flink.IcebergTableSink
- asSummaryString() - Method in class org.apache.iceberg.flink.source.IcebergTableSource
- Auto - org.apache.iceberg.flink.sink.shuffle.StatisticsType
-
Initially use Map for statistics tracking.
- AVAILABLE - org.apache.iceberg.flink.source.assigner.GetSplitResult.Status
- avroCompressionCodec() - Method in class org.apache.iceberg.flink.FlinkWriteConf
- avroCompressionLevel() - Method in class org.apache.iceberg.flink.FlinkWriteConf
- AvroGenericRecordConverter - Class in org.apache.iceberg.flink.source.reader
- AvroGenericRecordFileScanTaskReader - Class in org.apache.iceberg.flink.source
- AvroGenericRecordFileScanTaskReader(RowDataFileScanTaskReader, RowDataToAvroGenericRecordConverter) - Constructor for class org.apache.iceberg.flink.source.AvroGenericRecordFileScanTaskReader
- AvroGenericRecordReaderFunction - Class in org.apache.iceberg.flink.source.reader
-
Deprecated.since 1.7.0. Will be removed in 2.0.0; use
IcebergSource.forOutputType(RowDataConverter)andAvroGenericRecordConverterinstead. - AvroGenericRecordReaderFunction(String, ReadableConfig, Schema, Schema, String, boolean, FileIO, EncryptionManager, List<Expression>) - Constructor for class org.apache.iceberg.flink.source.reader.AvroGenericRecordReaderFunction
-
Deprecated.
- AvroGenericRecordToRowDataMapper - Class in org.apache.iceberg.flink.sink
-
This util class converts Avro GenericRecord to Flink RowData.
- AvroWithFlinkSchemaVisitor<T> - Class in org.apache.iceberg.flink.data
- AvroWithFlinkSchemaVisitor() - Constructor for class org.apache.iceberg.flink.data.AvroWithFlinkSchemaVisitor
B
- BASE_NAMESPACE - Static variable in class org.apache.iceberg.flink.FlinkCatalogFactory
- batch(String, DataIterator<T>) - Method in interface org.apache.iceberg.flink.source.reader.DataIteratorBatcher
- branch() - Method in class org.apache.iceberg.flink.FlinkReadConf
- branch() - Method in class org.apache.iceberg.flink.FlinkWriteConf
- branch() - Method in class org.apache.iceberg.flink.source.ScanContext
- branch(String) - Method in class org.apache.iceberg.flink.source.FlinkSource.Builder
-
Deprecated.
- branch(String) - Method in class org.apache.iceberg.flink.source.IcebergSource.Builder
- BRANCH - Static variable in class org.apache.iceberg.flink.FlinkReadOptions
- BRANCH - Static variable in class org.apache.iceberg.flink.FlinkWriteOptions
- build() - Method in class org.apache.iceberg.flink.source.FlinkSource.Builder
-
Deprecated.
- build() - Method in class org.apache.iceberg.flink.source.IcebergSource.Builder
- build() - Method in class org.apache.iceberg.flink.source.ScanContext.Builder
- builder() - Static method in class org.apache.iceberg.flink.source.IcebergSource
-
Deprecated.since 1.7.0. Will be removed in 2.0.0; use
IcebergSource.forRowData()orIcebergSource.forOutputType(RowDataConverter)instead - builder() - Static method in class org.apache.iceberg.flink.source.ScanContext
- Builder() - Constructor for class org.apache.iceberg.flink.source.FlinkSource.Builder
-
Deprecated.
- builderFor(DataStream<T>, MapFunction<T, RowData>, TypeInformation<RowData>) - Static method in class org.apache.iceberg.flink.sink.FlinkSink
-
Initialize a
FlinkSink.Builderto export the data from generic input data stream into iceberg table. - builderFor(DataStream<T>, MapFunction<T, RowData>, TypeInformation<RowData>) - Static method in class org.apache.iceberg.flink.sink.IcebergSink
-
Initialize a
IcebergSink.Builderto export the data from generic input data stream into iceberg table. - buildFormat() - Method in class org.apache.iceberg.flink.source.FlinkSource.Builder
-
Deprecated.
- buildReader(Schema, MessageType) - Static method in class org.apache.iceberg.flink.data.FlinkParquetReaders
- buildReader(Schema, MessageType, Map<Integer, ?>) - Static method in class org.apache.iceberg.flink.data.FlinkParquetReaders
- buildStream(StreamExecutionEnvironment) - Method in class org.apache.iceberg.flink.source.IcebergSource.Builder
-
Build the
IcebergSourceand create aDataStreamfrom the source. - buildWriter(LogicalType, MessageType) - Static method in class org.apache.iceberg.flink.data.FlinkParquetWriters
- buildWriter(RowType, Schema) - Static method in class org.apache.iceberg.flink.data.FlinkOrcWriter
C
- cancel() - Method in class org.apache.iceberg.flink.source.StreamingMonitorFunction
- CASE_SENSITIVE - Static variable in class org.apache.iceberg.flink.FlinkReadOptions
- CASE_SENSITIVE_OPTION - Static variable in class org.apache.iceberg.flink.FlinkReadOptions
- caseSensitive() - Method in class org.apache.iceberg.flink.FlinkReadConf
- caseSensitive() - Method in class org.apache.iceberg.flink.source.ScanContext
- caseSensitive(boolean) - Method in class org.apache.iceberg.flink.source.FlinkSource.Builder
-
Deprecated.
- caseSensitive(boolean) - Method in class org.apache.iceberg.flink.source.IcebergSource.Builder
- caseSensitive(boolean) - Method in class org.apache.iceberg.flink.source.ScanContext.Builder
- catalog() - Method in class org.apache.iceberg.flink.FlinkCatalog
- CatalogLoader - Interface in org.apache.iceberg.flink
-
Serializable loader to load an Iceberg
Catalog. - CatalogLoader.CustomCatalogLoader - Class in org.apache.iceberg.flink
- CatalogLoader.HadoopCatalogLoader - Class in org.apache.iceberg.flink
- CatalogLoader.HiveCatalogLoader - Class in org.apache.iceberg.flink
- CatalogLoader.RESTCatalogLoader - Class in org.apache.iceberg.flink
- checkpointId() - Method in class org.apache.iceberg.flink.sink.FlinkWriteResult
- clone() - Method in interface org.apache.iceberg.flink.CatalogLoader
-
Clone a CatalogLoader.
- clone() - Method in class org.apache.iceberg.flink.CatalogLoader.CustomCatalogLoader
- clone() - Method in class org.apache.iceberg.flink.CatalogLoader.HadoopCatalogLoader
- clone() - Method in class org.apache.iceberg.flink.CatalogLoader.HiveCatalogLoader
- clone() - Method in class org.apache.iceberg.flink.CatalogLoader.RESTCatalogLoader
- clone() - Method in class org.apache.iceberg.flink.TableLoader.CatalogTableLoader
- clone() - Method in interface org.apache.iceberg.flink.TableLoader
-
Clone a TableLoader
- clone() - Method in class org.apache.iceberg.flink.TableLoader.HadoopTableLoader
- clone(RowData, RowData, RowType, TypeSerializer[], RowData.FieldGetter[]) - Static method in class org.apache.iceberg.flink.data.RowDataUtil
-
Similar to the private
RowDataSerializer.copyRowData(RowData, RowData)method. - close() - Method in class org.apache.iceberg.flink.FlinkCatalog
- close() - Method in class org.apache.iceberg.flink.maintenance.operator.JdbcLockFactory
- close() - Method in interface org.apache.iceberg.flink.source.assigner.SplitAssigner
-
Some assigners may need to perform certain actions when their corresponding enumerators are closed
- close() - Method in class org.apache.iceberg.flink.source.DataIterator
- close() - Method in class org.apache.iceberg.flink.source.enumerator.ContinuousIcebergEnumerator
- close() - Method in class org.apache.iceberg.flink.source.enumerator.ContinuousSplitPlannerImpl
- close() - Method in class org.apache.iceberg.flink.source.FlinkInputFormat
- close() - Method in class org.apache.iceberg.flink.source.StreamingMonitorFunction
- close() - Method in class org.apache.iceberg.flink.source.StreamingReaderOperator
- close() - Method in class org.apache.iceberg.flink.TableLoader.CatalogTableLoader
- close() - Method in class org.apache.iceberg.flink.TableLoader.HadoopTableLoader
- clusterHadoopConf() - Static method in class org.apache.iceberg.flink.FlinkCatalogFactory
- ColumnStatsWatermarkExtractor - Class in org.apache.iceberg.flink.source.reader
-
SplitWatermarkExtractorimplementation which uses an Iceberg timestamp column statistics to get the watermarks for theIcebergSourceSplit. - ColumnStatsWatermarkExtractor(Schema, String, TimeUnit) - Constructor for class org.apache.iceberg.flink.source.reader.ColumnStatsWatermarkExtractor
-
Creates the extractor.
- commitChanges(Table, String, String, String, List<TableChange>, List<TableChange>) - Static method in class org.apache.iceberg.flink.util.FlinkAlterTableUtil
- commitChanges(Table, String, String, String, Map<String, String>) - Static method in class org.apache.iceberg.flink.util.FlinkAlterTableUtil
- commitManageSnapshots(Table, String, String) - Static method in class org.apache.iceberg.flink.util.FlinkAlterTableUtil
- COMPLETED - org.apache.iceberg.flink.source.split.IcebergSourceSplitStatus
- COMPRESSION_CODEC - Static variable in class org.apache.iceberg.flink.FlinkWriteOptions
- COMPRESSION_LEVEL - Static variable in class org.apache.iceberg.flink.FlinkWriteOptions
- COMPRESSION_STRATEGY - Static variable in class org.apache.iceberg.flink.FlinkWriteOptions
- CONCURRENT_RUN_THROTTLED - Static variable in class org.apache.iceberg.flink.maintenance.operator.TableMaintenanceMetrics
- CONFIG - Static variable in class org.apache.iceberg.flink.actions.Actions
- configure(Configuration) - Method in class org.apache.iceberg.flink.source.FlinkInputFormat
- constrained() - Static method in class org.apache.iceberg.flink.source.assigner.GetSplitResult
- CONSTRAINED - org.apache.iceberg.flink.source.assigner.GetSplitResult.Status
-
There are pending splits.
- ContinuousIcebergEnumerator - Class in org.apache.iceberg.flink.source.enumerator
- ContinuousIcebergEnumerator(SplitEnumeratorContext<IcebergSourceSplit>, SplitAssigner, ScanContext, ContinuousSplitPlanner, IcebergEnumeratorState) - Constructor for class org.apache.iceberg.flink.source.enumerator.ContinuousIcebergEnumerator
- ContinuousSplitPlanner - Interface in org.apache.iceberg.flink.source.enumerator
-
This interface is introduced so that we can plug in different split planner for unit test
- ContinuousSplitPlannerImpl - Class in org.apache.iceberg.flink.source.enumerator
- ContinuousSplitPlannerImpl(TableLoader, ScanContext, String) - Constructor for class org.apache.iceberg.flink.source.enumerator.ContinuousSplitPlannerImpl
- convert(TableSchema) - Static method in class org.apache.iceberg.flink.FlinkSchemaUtil
-
Deprecated.Use
FlinkSchemaUtil.convert(ResolvedSchema)instead. - convert(ResolvedSchema) - Static method in class org.apache.iceberg.flink.FlinkSchemaUtil
-
Convert the flink table schema to apache iceberg schema with column comment.
- convert(Expression) - Static method in class org.apache.iceberg.flink.FlinkFilters
-
Convert flink expression to iceberg expression.
- convert(LogicalType) - Static method in class org.apache.iceberg.flink.FlinkSchemaUtil
-
Convert a
Flink typeto aType. - convert(Schema) - Static method in class org.apache.iceberg.flink.FlinkSchemaUtil
-
Convert a
Schemato aFlink type. - convert(Schema, TableSchema) - Static method in class org.apache.iceberg.flink.FlinkSchemaUtil
-
Convert a Flink
TableSchemato aSchemabased on the given schema. - convert(Type) - Static method in class org.apache.iceberg.flink.FlinkSchemaUtil
-
Convert a
Typeto aFlink type. - convertConstant(Type, Object) - Static method in class org.apache.iceberg.flink.data.RowDataUtil
- ConverterReaderFunction<T> - Class in org.apache.iceberg.flink.source.reader
- ConverterReaderFunction(RowDataConverter<T>, ReadableConfig, Schema, Schema, String, boolean, FileIO, EncryptionManager, List<Expression>, long) - Constructor for class org.apache.iceberg.flink.source.reader.ConverterReaderFunction
- copy() - Method in class org.apache.iceberg.flink.IcebergTableSink
- copy() - Method in class org.apache.iceberg.flink.source.IcebergTableSource
- copyWithAppendsBetween(Long, long) - Method in class org.apache.iceberg.flink.source.ScanContext
- copyWithSnapshotId(long) - Method in class org.apache.iceberg.flink.source.ScanContext
- create() - Method in class org.apache.iceberg.flink.sink.RowDataTaskWriterFactory
- create() - Method in interface org.apache.iceberg.flink.sink.TaskWriterFactory
-
Initialize a
TaskWriterwith given task id and attempt id. - create(RowType, Types.StructType, Types.StructType) - Static method in class org.apache.iceberg.flink.data.RowDataProjection
-
Creates a projecting wrapper for
RowDatarows. - create(Schema, Schema) - Static method in class org.apache.iceberg.flink.data.RowDataProjection
-
Creates a projecting wrapper for
RowDatarows. - createAssigner() - Method in class org.apache.iceberg.flink.source.assigner.OrderedSplitAssignerFactory
- createAssigner() - Method in class org.apache.iceberg.flink.source.assigner.SimpleSplitAssignerFactory
- createAssigner() - Method in interface org.apache.iceberg.flink.source.assigner.SplitAssignerFactory
- createAssigner(Collection<IcebergSourceSplitState>) - Method in class org.apache.iceberg.flink.source.assigner.OrderedSplitAssignerFactory
- createAssigner(Collection<IcebergSourceSplitState>) - Method in class org.apache.iceberg.flink.source.assigner.SimpleSplitAssignerFactory
- createAssigner(Collection<IcebergSourceSplitState>) - Method in interface org.apache.iceberg.flink.source.assigner.SplitAssignerFactory
- createCatalog(String, Map<String, String>) - Method in class org.apache.iceberg.flink.FlinkCatalogFactory
- createCatalog(String, Map<String, String>, Configuration) - Method in class org.apache.iceberg.flink.FlinkCatalogFactory
- createCommitter(CommitterInitContext) - Method in class org.apache.iceberg.flink.sink.IcebergSink
- createDatabase(String, CatalogDatabase, boolean) - Method in class org.apache.iceberg.flink.FlinkCatalog
- createDataIterator(IcebergSourceSplit) - Method in class org.apache.iceberg.flink.source.reader.AvroGenericRecordReaderFunction
-
Deprecated.
- createDataIterator(IcebergSourceSplit) - Method in class org.apache.iceberg.flink.source.reader.ConverterReaderFunction
- createDataIterator(IcebergSourceSplit) - Method in class org.apache.iceberg.flink.source.reader.DataIteratorReaderFunction
- createDataIterator(IcebergSourceSplit) - Method in class org.apache.iceberg.flink.source.reader.MetaDataReaderFunction
- createDataIterator(IcebergSourceSplit) - Method in class org.apache.iceberg.flink.source.reader.RowDataReaderFunction
- createDynamicTableSink(DynamicTableFactory.Context) - Method in class org.apache.iceberg.flink.FlinkDynamicTableFactory
- createDynamicTableSource(DynamicTableFactory.Context) - Method in class org.apache.iceberg.flink.FlinkDynamicTableFactory
- createEnumerator(SplitEnumeratorContext<SingleThreadedIteratorSource.GlobalSplit<T>>) - Method in class org.apache.iceberg.flink.maintenance.operator.SingleThreadedIteratorSource
- createEnumerator(SplitEnumeratorContext<IcebergSourceSplit>) - Method in class org.apache.iceberg.flink.source.IcebergSource
- createFunction(ObjectPath, CatalogFunction, boolean) - Method in class org.apache.iceberg.flink.FlinkCatalog
- createInputSplits(int) - Method in class org.apache.iceberg.flink.source.FlinkInputFormat
- createLock() - Method in class org.apache.iceberg.flink.maintenance.operator.JdbcLockFactory
- createLock() - Method in interface org.apache.iceberg.flink.maintenance.operator.TriggerLockFactory
- createPartition(ObjectPath, CatalogPartitionSpec, CatalogPartition, boolean) - Method in class org.apache.iceberg.flink.FlinkCatalog
- createReader(SourceReaderContext) - Method in class org.apache.iceberg.flink.maintenance.operator.SingleThreadedIteratorSource
- createReader(SourceReaderContext) - Method in class org.apache.iceberg.flink.source.IcebergSource
- createRecoveryLock() - Method in class org.apache.iceberg.flink.maintenance.operator.JdbcLockFactory
- createRecoveryLock() - Method in interface org.apache.iceberg.flink.maintenance.operator.TriggerLockFactory
- createStreamOperator(StreamOperatorParameters<StatisticsOrRecord>) - Method in class org.apache.iceberg.flink.sink.shuffle.DataStatisticsOperatorFactory
- createTable(ObjectPath, CatalogBaseTable, boolean) - Method in class org.apache.iceberg.flink.FlinkCatalog
- createWriter(Sink.InitContext) - Method in class org.apache.iceberg.flink.sink.IcebergSink
- currentFileHasNext() - Method in class org.apache.iceberg.flink.source.DataIterator
- currentPath() - Method in class org.apache.iceberg.flink.data.ParquetWithFlinkSchemaVisitor
- custom(String, Map<String, String>, Configuration, String) - Static method in interface org.apache.iceberg.flink.CatalogLoader
D
- databaseExists(String) - Method in class org.apache.iceberg.flink.FlinkCatalog
- dataFileFormat() - Method in class org.apache.iceberg.flink.FlinkWriteConf
- DataIterator<T> - Class in org.apache.iceberg.flink.source
-
Flink data iterator that reads
CombinedScanTaskinto aCloseableIterator - DataIterator(FileScanTaskReader<T>, CombinedScanTask, FileIO, EncryptionManager) - Constructor for class org.apache.iceberg.flink.source.DataIterator
- DataIteratorBatcher<T> - Interface in org.apache.iceberg.flink.source.reader
-
Batcher converts iterator of T into iterator of batched
RecordsWithSplitIds<RecordAndPosition<T>>, as FLIP-27'sSplitReader.fetch()returns batched records. - DataIteratorReaderFunction<T> - Class in org.apache.iceberg.flink.source.reader
-
A
ReaderFunctionimplementation that usesDataIterator. - DataIteratorReaderFunction(DataIteratorBatcher<T>) - Constructor for class org.apache.iceberg.flink.source.reader.DataIteratorReaderFunction
- DataStatisticsCoordinatorProvider - Class in org.apache.iceberg.flink.sink.shuffle
-
DataStatisticsCoordinatorProvider provides the method to create new
DataStatisticsCoordinator - DataStatisticsCoordinatorProvider(String, OperatorID, Schema, SortOrder, int, StatisticsType, double) - Constructor for class org.apache.iceberg.flink.sink.shuffle.DataStatisticsCoordinatorProvider
- DataStatisticsOperator - Class in org.apache.iceberg.flink.sink.shuffle
-
DataStatisticsOperator collects traffic distribution statistics.
- DataStatisticsOperatorFactory - Class in org.apache.iceberg.flink.sink.shuffle
- DataStatisticsOperatorFactory(Schema, SortOrder, int, StatisticsType, double) - Constructor for class org.apache.iceberg.flink.sink.shuffle.DataStatisticsOperatorFactory
- DataTaskReader - Class in org.apache.iceberg.flink.source
- DataTaskReader(Schema) - Constructor for class org.apache.iceberg.flink.source.DataTaskReader
- DEFAULT_CATALOG_NAME - Static variable in class org.apache.iceberg.flink.FlinkCatalogFactory
- DEFAULT_DATABASE - Static variable in class org.apache.iceberg.flink.FlinkCatalogFactory
- DEFAULT_DATABASE_NAME - Static variable in class org.apache.iceberg.flink.FlinkCatalogFactory
- defaultEmitter() - Static method in interface org.apache.iceberg.flink.source.reader.SerializableRecordEmitter
- DefaultSplitAssigner - Class in org.apache.iceberg.flink.source.assigner
-
Since all methods are called in the source coordinator thread by enumerator, there is no need for locking.
- DefaultSplitAssigner(SerializableComparator<IcebergSourceSplit>) - Constructor for class org.apache.iceberg.flink.source.assigner.DefaultSplitAssigner
- DefaultSplitAssigner(SerializableComparator<IcebergSourceSplit>, Collection<IcebergSourceSplitState>) - Constructor for class org.apache.iceberg.flink.source.assigner.DefaultSplitAssigner
- deserialize(int, byte[]) - Method in class org.apache.iceberg.flink.source.enumerator.IcebergEnumeratorStateSerializer
- deserialize(int, byte[]) - Method in class org.apache.iceberg.flink.source.split.IcebergSourceSplitSerializer
- DISTRIBUTION_MODE - Static variable in class org.apache.iceberg.flink.FlinkWriteOptions
- distributionMode() - Method in class org.apache.iceberg.flink.FlinkWriteConf
- distributionMode(DistributionMode) - Method in class org.apache.iceberg.flink.sink.FlinkSink.Builder
-
Configure the write
DistributionModethat the flink sink will use. - distributionMode(DistributionMode) - Method in class org.apache.iceberg.flink.sink.IcebergSink.Builder
-
Configure the write
DistributionModethat the IcebergSink will use. - dropDatabase(String, boolean, boolean) - Method in class org.apache.iceberg.flink.FlinkCatalog
- dropFunction(ObjectPath, boolean) - Method in class org.apache.iceberg.flink.FlinkCatalog
- dropPartition(ObjectPath, CatalogPartitionSpec, boolean) - Method in class org.apache.iceberg.flink.FlinkCatalog
- dropTable(ObjectPath, boolean) - Method in class org.apache.iceberg.flink.FlinkCatalog
E
- ElapsedTimeGauge - Class in org.apache.iceberg.flink.util
-
This gauge measures the elapsed time between now and last recorded time set by
ElapsedTimeGauge.refreshLastRecordedTime(). - ElapsedTimeGauge(TimeUnit) - Constructor for class org.apache.iceberg.flink.util.ElapsedTimeGauge
- emitterWithWatermark(SplitWatermarkExtractor) - Static method in interface org.apache.iceberg.flink.source.reader.SerializableRecordEmitter
- END_SNAPSHOT_ID - Static variable in class org.apache.iceberg.flink.FlinkReadOptions
- END_TAG - Static variable in class org.apache.iceberg.flink.FlinkReadOptions
- endSnapshotId() - Method in class org.apache.iceberg.flink.FlinkReadConf
- endSnapshotId() - Method in class org.apache.iceberg.flink.source.ScanContext
- endSnapshotId(Long) - Method in class org.apache.iceberg.flink.source.FlinkSource.Builder
-
Deprecated.
- endSnapshotId(Long) - Method in class org.apache.iceberg.flink.source.IcebergSource.Builder
- endSnapshotId(Long) - Method in class org.apache.iceberg.flink.source.ScanContext.Builder
- endTag() - Method in class org.apache.iceberg.flink.FlinkReadConf
- endTag() - Method in class org.apache.iceberg.flink.source.ScanContext
- endTag(String) - Method in class org.apache.iceberg.flink.source.FlinkSource.Builder
-
Deprecated.
- endTag(String) - Method in class org.apache.iceberg.flink.source.IcebergSource.Builder
- endTag(String) - Method in class org.apache.iceberg.flink.source.ScanContext.Builder
- enumerationSplitCountHistory() - Method in class org.apache.iceberg.flink.source.enumerator.IcebergEnumeratorState
- env(StreamExecutionEnvironment) - Method in class org.apache.iceberg.flink.source.FlinkSource.Builder
-
Deprecated.
- equalityFieldColumns(List<String>) - Method in class org.apache.iceberg.flink.sink.FlinkSink.Builder
-
Configuring the equality field columns for iceberg table that accept CDC or UPSERT events.
- equalityFieldColumns(List<String>) - Method in class org.apache.iceberg.flink.sink.IcebergSink.Builder
-
Configuring the equality field columns for iceberg table that accept CDC or UPSERT events.
- equals(Object) - Method in class org.apache.iceberg.flink.data.RowDataProjection
- exceptions() - Method in class org.apache.iceberg.flink.maintenance.operator.TaskResult
- exposeLocality() - Method in class org.apache.iceberg.flink.source.ScanContext
- exposeLocality(boolean) - Method in class org.apache.iceberg.flink.source.FlinkSource.Builder
-
Deprecated.
- exposeLocality(boolean) - Method in class org.apache.iceberg.flink.source.IcebergSource.Builder
- exposeLocality(boolean) - Method in class org.apache.iceberg.flink.source.ScanContext.Builder
- extractWatermark(IcebergSourceSplit) - Method in class org.apache.iceberg.flink.source.reader.ColumnStatsWatermarkExtractor
-
Get the watermark for a split using column statistics.
- extractWatermark(IcebergSourceSplit) - Method in interface org.apache.iceberg.flink.source.reader.SplitWatermarkExtractor
-
Get the watermark for a split.
F
- factory() - Method in enum org.apache.iceberg.flink.source.assigner.SplitAssignerType
- factoryIdentifier() - Method in class org.apache.iceberg.flink.FlinkDynamicTableFactory
- FAILED_TASK_COUNTER - Static variable in class org.apache.iceberg.flink.maintenance.operator.TableMaintenanceMetrics
- fieldNameAndType(LogicalType, int) - Method in class org.apache.iceberg.flink.data.AvroWithFlinkSchemaVisitor
- fileIO() - Method in class org.apache.iceberg.flink.actions.RewriteDataFilesAction
- fileOffset() - Method in class org.apache.iceberg.flink.source.DataIterator
- fileOffset() - Method in class org.apache.iceberg.flink.source.reader.RecordAndPosition
- fileOffset() - Method in class org.apache.iceberg.flink.source.split.IcebergSourceSplit
- FileScanTaskReader<T> - Interface in org.apache.iceberg.flink.source
-
Read a
FileScanTaskinto aCloseableIterator - fileSequenceNumber() - Static method in class org.apache.iceberg.flink.source.split.SplitComparators
-
Comparator which orders the splits based on the file sequence number of the data files
- filter(RowData) - Method in class org.apache.iceberg.flink.FlinkSourceFilter
- filters() - Method in class org.apache.iceberg.flink.source.ScanContext
- filters(List<Expression>) - Method in class org.apache.iceberg.flink.source.FlinkSource.Builder
-
Deprecated.
- filters(List<Expression>) - Method in class org.apache.iceberg.flink.source.IcebergSource.Builder
- filters(List<Expression>) - Method in class org.apache.iceberg.flink.source.ScanContext.Builder
- finish() - Method in class org.apache.iceberg.flink.source.StreamingReaderOperator
- finishedSplitIds() - Method in class org.apache.iceberg.flink.source.split.SplitRequestEvent
- FLINK_UNKNOWN_VERSION - Static variable in class org.apache.iceberg.flink.util.FlinkPackage
- FlinkAlterTableUtil - Class in org.apache.iceberg.flink.util
- FlinkAppenderFactory - Class in org.apache.iceberg.flink.sink
- FlinkAppenderFactory(Table, Schema, RowType, Map<String, String>, PartitionSpec, int[], Schema, Schema) - Constructor for class org.apache.iceberg.flink.sink.FlinkAppenderFactory
- FlinkAvroReader - Class in org.apache.iceberg.flink.data
- FlinkAvroReader(Schema, Schema) - Constructor for class org.apache.iceberg.flink.data.FlinkAvroReader
- FlinkAvroReader(Schema, Schema, Map<Integer, ?>) - Constructor for class org.apache.iceberg.flink.data.FlinkAvroReader
- FlinkAvroWriter - Class in org.apache.iceberg.flink.data
- FlinkAvroWriter(RowType) - Constructor for class org.apache.iceberg.flink.data.FlinkAvroWriter
- FlinkCatalog - Class in org.apache.iceberg.flink
-
A Flink Catalog implementation that wraps an Iceberg
Catalog. - FlinkCatalog(String, String, Namespace, CatalogLoader, boolean, long) - Constructor for class org.apache.iceberg.flink.FlinkCatalog
- FlinkCatalogFactory - Class in org.apache.iceberg.flink
-
A Flink Catalog factory implementation that creates
FlinkCatalog. - FlinkCatalogFactory() - Constructor for class org.apache.iceberg.flink.FlinkCatalogFactory
- FlinkCompatibilityUtil - Class in org.apache.iceberg.flink.util
-
This is a small util class that try to hide calls to Flink Internal or PublicEvolve interfaces as Flink can change those APIs during minor version release.
- flinkConf(ReadableConfig) - Method in class org.apache.iceberg.flink.sink.FlinkSink.Builder
- flinkConf(ReadableConfig) - Method in class org.apache.iceberg.flink.sink.IcebergSink.Builder
- flinkConf(ReadableConfig) - Method in class org.apache.iceberg.flink.source.FlinkSource.Builder
-
Deprecated.
- flinkConfig(ReadableConfig) - Method in class org.apache.iceberg.flink.source.IcebergSource.Builder
- FlinkConfigOptions - Class in org.apache.iceberg.flink
-
When constructing Flink Iceberg source via Java API, configs can be set in
Configurationpassed to source builder. - FlinkDynamicTableFactory - Class in org.apache.iceberg.flink
- FlinkDynamicTableFactory() - Constructor for class org.apache.iceberg.flink.FlinkDynamicTableFactory
- FlinkDynamicTableFactory(FlinkCatalog) - Constructor for class org.apache.iceberg.flink.FlinkDynamicTableFactory
- FlinkFilters - Class in org.apache.iceberg.flink
- FlinkInputFormat - Class in org.apache.iceberg.flink.source
-
Flink
InputFormatfor Iceberg. - FlinkInputSplit - Class in org.apache.iceberg.flink.source
- FlinkOrcReader - Class in org.apache.iceberg.flink.data
- FlinkOrcReader(Schema, TypeDescription) - Constructor for class org.apache.iceberg.flink.data.FlinkOrcReader
- FlinkOrcReader(Schema, TypeDescription, Map<Integer, ?>) - Constructor for class org.apache.iceberg.flink.data.FlinkOrcReader
- FlinkOrcWriter - Class in org.apache.iceberg.flink.data
- FlinkPackage - Class in org.apache.iceberg.flink.util
- FlinkParquetReaders - Class in org.apache.iceberg.flink.data
- FlinkParquetWriters - Class in org.apache.iceberg.flink.data
- FlinkReadConf - Class in org.apache.iceberg.flink
- FlinkReadConf(Table, Map<String, String>, ReadableConfig) - Constructor for class org.apache.iceberg.flink.FlinkReadConf
- FlinkReadOptions - Class in org.apache.iceberg.flink
-
Flink source read options
- FlinkSchemaUtil - Class in org.apache.iceberg.flink
-
Converter between Flink types and Iceberg type.
- FlinkSink - Class in org.apache.iceberg.flink.sink
- FlinkSink.Builder - Class in org.apache.iceberg.flink.sink
- FlinkSource - Class in org.apache.iceberg.flink.source
-
Deprecated.since 1.7.0, will be removed in 2.0.0. Use
IcebergSourceinstead, which implement the newer FLIP-27 source interface. This class implements the oldSourceFunctionthat has been marked as deprecated in Flink since Aug 2023. - FlinkSource.Builder - Class in org.apache.iceberg.flink.source
-
Deprecated.Source builder to build
DataStream. - FlinkSourceFilter - Class in org.apache.iceberg.flink
- FlinkSourceFilter(Schema, Expression, boolean) - Constructor for class org.apache.iceberg.flink.FlinkSourceFilter
- FlinkSplitPlanner - Class in org.apache.iceberg.flink.source
- FlinkTypeVisitor<T> - Class in org.apache.iceberg.flink
- FlinkTypeVisitor() - Constructor for class org.apache.iceberg.flink.FlinkTypeVisitor
- FlinkValueReaders - Class in org.apache.iceberg.flink.data
- FlinkValueWriters - Class in org.apache.iceberg.flink.data
- FlinkWriteConf - Class in org.apache.iceberg.flink
-
A class for common Iceberg configs for Flink writes.
- FlinkWriteConf(Table, Map<String, String>, ReadableConfig) - Constructor for class org.apache.iceberg.flink.FlinkWriteConf
- FlinkWriteOptions - Class in org.apache.iceberg.flink
-
Flink sink write options
- FlinkWriteResult - Class in org.apache.iceberg.flink.sink
- FlinkWriteResult(long, WriteResult) - Constructor for class org.apache.iceberg.flink.sink.FlinkWriteResult
- forAvroSchema(Schema) - Static method in class org.apache.iceberg.flink.sink.AvroGenericRecordToRowDataMapper
-
Create a mapper based on Avro schema.
- forOutputType(RowDataConverter<T>) - Static method in class org.apache.iceberg.flink.source.IcebergSource
-
Create a source builder that would convert
RowDatato the output typeT. - forRow(DataStream<Row>, TableSchema) - Static method in class org.apache.iceberg.flink.sink.FlinkSink
-
Initialize a
FlinkSink.Builderto export the data from input data stream withRows into iceberg table. - forRow(DataStream<Row>, TableSchema) - Static method in class org.apache.iceberg.flink.sink.IcebergSink
-
Initialize a
IcebergSink.Builderto export the data from input data stream withRows into iceberg table. - forRowData() - Static method in class org.apache.iceberg.flink.source.FlinkSource
-
Deprecated.Initialize a
FlinkSource.Builderto read the data from iceberg table. - forRowData() - Static method in class org.apache.iceberg.flink.source.IcebergSource
-
Create a source builder for RowData output type.
- forRowData(DataStream<RowData>) - Static method in class org.apache.iceberg.flink.sink.FlinkSink
-
Initialize a
FlinkSink.Builderto export the data from input data stream withRowDatas into iceberg table. - forRowData(DataStream<RowData>) - Static method in class org.apache.iceberg.flink.sink.IcebergSink
-
Initialize a
IcebergSink.Builderto export the data from input data stream withRowDatas into iceberg table. - forSplit(IcebergSourceSplit) - Static method in class org.apache.iceberg.flink.source.assigner.GetSplitResult
- forTable(StreamExecutionEnvironment, Table) - Static method in class org.apache.iceberg.flink.actions.Actions
- forTable(Table) - Static method in class org.apache.iceberg.flink.actions.Actions
- fromAvroSchema(Schema) - Static method in class org.apache.iceberg.flink.source.RowDataToAvroGenericRecordConverter
-
Create a mapper based on Avro schema
- fromAvroSchema(Schema, String) - Static method in class org.apache.iceberg.flink.source.reader.AvroGenericRecordConverter
- fromCatalog(CatalogLoader, TableIdentifier) - Static method in interface org.apache.iceberg.flink.TableLoader
- fromCombinedScanTask(CombinedScanTask) - Static method in class org.apache.iceberg.flink.source.split.IcebergSourceSplit
- fromCombinedScanTask(CombinedScanTask, int, long) - Static method in class org.apache.iceberg.flink.source.split.IcebergSourceSplit
- fromHadoopTable(String) - Static method in interface org.apache.iceberg.flink.TableLoader
- fromHadoopTable(String, Configuration) - Static method in interface org.apache.iceberg.flink.TableLoader
- fromIcebergSchema(String, Schema) - Static method in class org.apache.iceberg.flink.source.RowDataToAvroGenericRecordConverter
-
Create a converter based on Iceberg schema
- fromIcebergSchema(Schema, String) - Static method in class org.apache.iceberg.flink.source.reader.AvroGenericRecordConverter
- fromTable(Table) - Static method in class org.apache.iceberg.flink.source.reader.AvroGenericRecordReaderFunction
-
Deprecated.Create a reader function without projection and name mapping.
- functionExists(ObjectPath) - Method in class org.apache.iceberg.flink.FlinkCatalog
G
- get(int, Class<T>) - Method in class org.apache.iceberg.flink.RowDataWrapper
- getArity() - Method in class org.apache.iceberg.flink.data.RowDataProjection
- getArity() - Method in class org.apache.iceberg.flink.data.StructRowData
- getArray(int) - Method in class org.apache.iceberg.flink.data.RowDataProjection
- getArray(int) - Method in class org.apache.iceberg.flink.data.StructRowData
- getBinary(int) - Method in class org.apache.iceberg.flink.data.RowDataProjection
- getBinary(int) - Method in class org.apache.iceberg.flink.data.StructRowData
- getBoolean(int) - Method in class org.apache.iceberg.flink.data.RowDataProjection
- getBoolean(int) - Method in class org.apache.iceberg.flink.data.StructRowData
- getBoundedness() - Method in class org.apache.iceberg.flink.source.IcebergSource
- getByte(int) - Method in class org.apache.iceberg.flink.data.RowDataProjection
- getByte(int) - Method in class org.apache.iceberg.flink.data.StructRowData
- getChangelogMode() - Method in class org.apache.iceberg.flink.source.IcebergTableSource
- getChangelogMode(ChangelogMode) - Method in class org.apache.iceberg.flink.IcebergTableSink
- getCommittableSerializer() - Method in class org.apache.iceberg.flink.sink.IcebergSink
- getCoordinator(OperatorCoordinator.Context) - Method in class org.apache.iceberg.flink.sink.shuffle.DataStatisticsCoordinatorProvider
- getCoordinatorProvider(String, OperatorID) - Method in class org.apache.iceberg.flink.sink.shuffle.DataStatisticsOperatorFactory
- getDatabase(String) - Method in class org.apache.iceberg.flink.FlinkCatalog
- getDecimal(int, int, int) - Method in class org.apache.iceberg.flink.data.RowDataProjection
- getDecimal(int, int, int) - Method in class org.apache.iceberg.flink.data.StructRowData
- getDouble(int) - Method in class org.apache.iceberg.flink.data.RowDataProjection
- getDouble(int) - Method in class org.apache.iceberg.flink.data.StructRowData
- getEnumeratorCheckpointSerializer() - Method in class org.apache.iceberg.flink.maintenance.operator.SingleThreadedIteratorSource
- getEnumeratorCheckpointSerializer() - Method in class org.apache.iceberg.flink.source.IcebergSource
- getFactory() - Method in class org.apache.iceberg.flink.FlinkCatalog
- getFloat(int) - Method in class org.apache.iceberg.flink.data.RowDataProjection
- getFloat(int) - Method in class org.apache.iceberg.flink.data.StructRowData
- getFunction(ObjectPath) - Method in class org.apache.iceberg.flink.FlinkCatalog
- getInputSplitAssigner(FlinkInputSplit[]) - Method in class org.apache.iceberg.flink.source.FlinkInputFormat
- getInt(int) - Method in class org.apache.iceberg.flink.data.RowDataProjection
- getInt(int) - Method in class org.apache.iceberg.flink.data.StructRowData
- getLong(int) - Method in class org.apache.iceberg.flink.data.RowDataProjection
- getLong(int) - Method in class org.apache.iceberg.flink.data.StructRowData
- getMap(int) - Method in class org.apache.iceberg.flink.data.RowDataProjection
- getMap(int) - Method in class org.apache.iceberg.flink.data.StructRowData
- getNext(String) - Method in class org.apache.iceberg.flink.source.assigner.DefaultSplitAssigner
- getNext(String) - Method in interface org.apache.iceberg.flink.source.assigner.SplitAssigner
-
Request a new split from the assigner when enumerator trying to assign splits to awaiting readers.
- getPartition(ObjectPath, CatalogPartitionSpec) - Method in class org.apache.iceberg.flink.FlinkCatalog
- getPartitionColumnStatistics(ObjectPath, CatalogPartitionSpec) - Method in class org.apache.iceberg.flink.FlinkCatalog
- getPartitionStatistics(ObjectPath, CatalogPartitionSpec) - Method in class org.apache.iceberg.flink.FlinkCatalog
- getProducedType() - Method in class org.apache.iceberg.flink.source.reader.AvroGenericRecordConverter
- getRawValue(int) - Method in class org.apache.iceberg.flink.data.RowDataProjection
- getRawValue(int) - Method in class org.apache.iceberg.flink.data.StructRowData
- getRow(int, int) - Method in class org.apache.iceberg.flink.data.RowDataProjection
- getRow(int, int) - Method in class org.apache.iceberg.flink.data.StructRowData
- getRowKind() - Method in class org.apache.iceberg.flink.data.RowDataProjection
- getRowKind() - Method in class org.apache.iceberg.flink.data.StructRowData
- getScanRuntimeProvider(ScanTableSource.ScanContext) - Method in class org.apache.iceberg.flink.source.IcebergTableSource
- getShort(int) - Method in class org.apache.iceberg.flink.data.RowDataProjection
- getShort(int) - Method in class org.apache.iceberg.flink.data.StructRowData
- getSinkRuntimeProvider(DynamicTableSink.Context) - Method in class org.apache.iceberg.flink.IcebergTableSink
- GetSplitResult - Class in org.apache.iceberg.flink.source.assigner
- GetSplitResult.Status - Enum in org.apache.iceberg.flink.source.assigner
- getSplitSerializer() - Method in class org.apache.iceberg.flink.maintenance.operator.SingleThreadedIteratorSource
- getSplitSerializer() - Method in class org.apache.iceberg.flink.source.IcebergSource
- getStatistics(BaseStatistics) - Method in class org.apache.iceberg.flink.source.FlinkInputFormat
- getStreamOperatorClass(ClassLoader) - Method in class org.apache.iceberg.flink.sink.shuffle.DataStatisticsOperatorFactory
- getString(int) - Method in class org.apache.iceberg.flink.data.RowDataProjection
- getString(int) - Method in class org.apache.iceberg.flink.data.StructRowData
- getTable(ObjectPath) - Method in class org.apache.iceberg.flink.FlinkCatalog
- getTableColumnStatistics(ObjectPath) - Method in class org.apache.iceberg.flink.FlinkCatalog
- getTableStatistics(ObjectPath) - Method in class org.apache.iceberg.flink.FlinkCatalog
- getTimestamp(int, int) - Method in class org.apache.iceberg.flink.data.RowDataProjection
- getTimestamp(int, int) - Method in class org.apache.iceberg.flink.data.StructRowData
- getValue() - Method in class org.apache.iceberg.flink.util.ElapsedTimeGauge
- getVersion() - Method in class org.apache.iceberg.flink.source.enumerator.IcebergEnumeratorStateSerializer
- getVersion() - Method in class org.apache.iceberg.flink.source.split.IcebergSourceSplitSerializer
- getWriteResultSerializer() - Method in class org.apache.iceberg.flink.sink.IcebergSink
- GROUP_KEY - Static variable in class org.apache.iceberg.flink.maintenance.operator.TableMaintenanceMetrics
- GROUP_VALUE_DEFAULT - Static variable in class org.apache.iceberg.flink.maintenance.operator.TableMaintenanceMetrics
H
- hadoop(String, Configuration, Map<String, String>) - Static method in interface org.apache.iceberg.flink.CatalogLoader
- HADOOP_CONF_DIR - Static variable in class org.apache.iceberg.flink.FlinkCatalogFactory
- handleOperatorEvent(OperatorEvent) - Method in class org.apache.iceberg.flink.sink.shuffle.DataStatisticsOperator
- hashCode() - Method in class org.apache.iceberg.flink.data.RowDataProjection
- hasNext() - Method in class org.apache.iceberg.flink.source.DataIterator
- hasRecord() - Method in class org.apache.iceberg.flink.sink.shuffle.StatisticsOrRecord
- hive(String, Configuration, Map<String, String>) - Static method in interface org.apache.iceberg.flink.CatalogLoader
- HIVE_CONF_DIR - Static variable in class org.apache.iceberg.flink.FlinkCatalogFactory
I
- ICEBERG_CATALOG_TYPE - Static variable in class org.apache.iceberg.flink.FlinkCatalogFactory
- ICEBERG_CATALOG_TYPE_HADOOP - Static variable in class org.apache.iceberg.flink.FlinkCatalogFactory
- ICEBERG_CATALOG_TYPE_HIVE - Static variable in class org.apache.iceberg.flink.FlinkCatalogFactory
- ICEBERG_CATALOG_TYPE_REST - Static variable in class org.apache.iceberg.flink.FlinkCatalogFactory
- IcebergEnumeratorState - Class in org.apache.iceberg.flink.source.enumerator
-
Enumerator state for checkpointing
- IcebergEnumeratorState(Collection<IcebergSourceSplitState>) - Constructor for class org.apache.iceberg.flink.source.enumerator.IcebergEnumeratorState
- IcebergEnumeratorState(IcebergEnumeratorPosition, Collection<IcebergSourceSplitState>) - Constructor for class org.apache.iceberg.flink.source.enumerator.IcebergEnumeratorState
- IcebergEnumeratorState(IcebergEnumeratorPosition, Collection<IcebergSourceSplitState>, int[]) - Constructor for class org.apache.iceberg.flink.source.enumerator.IcebergEnumeratorState
- IcebergEnumeratorStateSerializer - Class in org.apache.iceberg.flink.source.enumerator
- IcebergEnumeratorStateSerializer(boolean) - Constructor for class org.apache.iceberg.flink.source.enumerator.IcebergEnumeratorStateSerializer
- IcebergSink - Class in org.apache.iceberg.flink.sink
-
Flink v2 sink offer different hooks to insert custom topologies into the sink.
- IcebergSink.Builder - Class in org.apache.iceberg.flink.sink
- IcebergSource<T> - Class in org.apache.iceberg.flink.source
- IcebergSource.Builder<T> - Class in org.apache.iceberg.flink.source
- IcebergSourceReader<T> - Class in org.apache.iceberg.flink.source.reader
- IcebergSourceReader(SerializableRecordEmitter<T>, IcebergSourceReaderMetrics, ReaderFunction<T>, SerializableComparator<IcebergSourceSplit>, SourceReaderContext) - Constructor for class org.apache.iceberg.flink.source.reader.IcebergSourceReader
- IcebergSourceReaderMetrics - Class in org.apache.iceberg.flink.source.reader
- IcebergSourceReaderMetrics(MetricGroup, String) - Constructor for class org.apache.iceberg.flink.source.reader.IcebergSourceReaderMetrics
- IcebergSourceSplit - Class in org.apache.iceberg.flink.source.split
- IcebergSourceSplitSerializer - Class in org.apache.iceberg.flink.source.split
- IcebergSourceSplitSerializer(boolean) - Constructor for class org.apache.iceberg.flink.source.split.IcebergSourceSplitSerializer
- IcebergSourceSplitState - Class in org.apache.iceberg.flink.source.split
- IcebergSourceSplitState(IcebergSourceSplit, IcebergSourceSplitStatus) - Constructor for class org.apache.iceberg.flink.source.split.IcebergSourceSplitState
- IcebergSourceSplitStatus - Enum in org.apache.iceberg.flink.source.split
- IcebergTableSink - Class in org.apache.iceberg.flink
- IcebergTableSink(TableLoader, TableSchema, ReadableConfig, Map<String, String>) - Constructor for class org.apache.iceberg.flink.IcebergTableSink
- IcebergTableSource - Class in org.apache.iceberg.flink.source
-
Flink Iceberg table source.
- IcebergTableSource(TableLoader, TableSchema, Map<String, String>, ReadableConfig) - Constructor for class org.apache.iceberg.flink.source.IcebergTableSource
- INCLUDE_COLUMN_STATS - Static variable in class org.apache.iceberg.flink.FlinkReadOptions
- INCLUDE_COLUMN_STATS_OPTION - Static variable in class org.apache.iceberg.flink.FlinkReadOptions
- includeColumnStats() - Method in class org.apache.iceberg.flink.FlinkReadConf
- includeColumnStats() - Method in class org.apache.iceberg.flink.source.ScanContext
- includeColumnStats(boolean) - Method in class org.apache.iceberg.flink.source.IcebergSource.Builder
- includeColumnStats(boolean) - Method in class org.apache.iceberg.flink.source.ScanContext.Builder
- includeColumnStats(Collection<String>) - Method in class org.apache.iceberg.flink.source.ScanContext.Builder
- includeStatsForColumns() - Method in class org.apache.iceberg.flink.source.ScanContext
- INCREMENTAL_FROM_EARLIEST_SNAPSHOT - org.apache.iceberg.flink.source.StreamingStartingStrategy
-
Start incremental mode from the earliest snapshot inclusive.
- INCREMENTAL_FROM_LATEST_SNAPSHOT - org.apache.iceberg.flink.source.StreamingStartingStrategy
-
Start incremental mode from the latest snapshot inclusive.
- INCREMENTAL_FROM_SNAPSHOT_ID - org.apache.iceberg.flink.source.StreamingStartingStrategy
-
Start incremental mode from a snapshot with a specific id inclusive.
- INCREMENTAL_FROM_SNAPSHOT_TIMESTAMP - org.apache.iceberg.flink.source.StreamingStartingStrategy
-
Start incremental mode from a snapshot with a specific timestamp inclusive.
- incrementAssignedBytes(long) - Method in class org.apache.iceberg.flink.source.reader.IcebergSourceReaderMetrics
- incrementAssignedSplits(long) - Method in class org.apache.iceberg.flink.source.reader.IcebergSourceReaderMetrics
- incrementFinishedBytes(long) - Method in class org.apache.iceberg.flink.source.reader.IcebergSourceReaderMetrics
- incrementFinishedSplits(long) - Method in class org.apache.iceberg.flink.source.reader.IcebergSourceReaderMetrics
- incrementSplitReaderFetchCalls(long) - Method in class org.apache.iceberg.flink.source.reader.IcebergSourceReaderMetrics
- initialize(int, int) - Method in class org.apache.iceberg.flink.sink.RowDataTaskWriterFactory
- initialize(int, int) - Method in interface org.apache.iceberg.flink.sink.TaskWriterFactory
-
Initialize the factory with a given taskId and attemptId.
- initializedState(IcebergSourceSplit) - Method in class org.apache.iceberg.flink.source.reader.IcebergSourceReader
- initializeState(FunctionInitializationContext) - Method in class org.apache.iceberg.flink.source.StreamingMonitorFunction
- initializeState(StateInitializationContext) - Method in class org.apache.iceberg.flink.sink.shuffle.DataStatisticsOperator
- initializeState(StateInitializationContext) - Method in class org.apache.iceberg.flink.source.StreamingReaderOperator
- isAvailable() - Method in class org.apache.iceberg.flink.source.assigner.DefaultSplitAssigner
- isAvailable() - Method in interface org.apache.iceberg.flink.source.assigner.SplitAssigner
-
Enumerator can get a notification via CompletableFuture when the assigner has more splits available later.
- isBounded(Map<String, String>) - Static method in class org.apache.iceberg.flink.source.FlinkSource
-
Deprecated.
- isHeld() - Method in interface org.apache.iceberg.flink.maintenance.operator.TriggerLockFactory.Lock
-
Checks if the lock is already taken.
- isMapType(LogicalType) - Method in class org.apache.iceberg.flink.data.AvroWithFlinkSchemaVisitor
- isNullAt(int) - Method in class org.apache.iceberg.flink.data.RowDataProjection
- isNullAt(int) - Method in class org.apache.iceberg.flink.data.StructRowData
- isOpen() - Method in class org.apache.iceberg.flink.TableLoader.CatalogTableLoader
- isOpen() - Method in class org.apache.iceberg.flink.TableLoader.HadoopTableLoader
- isOpen() - Method in interface org.apache.iceberg.flink.TableLoader
- isPhysicalColumn(TableColumn) - Static method in class org.apache.iceberg.flink.util.FlinkCompatibilityUtil
- isPhysicalColumn(Column) - Static method in class org.apache.iceberg.flink.util.FlinkCompatibilityUtil
- isStreaming() - Method in class org.apache.iceberg.flink.source.ScanContext
- isStringType(LogicalType) - Method in class org.apache.iceberg.flink.data.AvroWithFlinkSchemaVisitor
J
- JdbcLockFactory - Class in org.apache.iceberg.flink.maintenance.operator
-
JDBC table backed implementation of the
TriggerLockFactory. - JdbcLockFactory(String, String, Map<String, String>) - Constructor for class org.apache.iceberg.flink.maintenance.operator.JdbcLockFactory
-
Creates a new
TriggerLockFactory.
L
- LAST_RUN_DURATION_MS - Static variable in class org.apache.iceberg.flink.maintenance.operator.TableMaintenanceMetrics
- lastEnumeratedPosition() - Method in class org.apache.iceberg.flink.source.enumerator.IcebergEnumeratorState
- limit() - Method in class org.apache.iceberg.flink.FlinkReadConf
- limit() - Method in class org.apache.iceberg.flink.source.ScanContext
- limit(long) - Method in class org.apache.iceberg.flink.source.ScanContext.Builder
- limit(Long) - Method in class org.apache.iceberg.flink.source.FlinkSource.Builder
-
Deprecated.
- limit(Long) - Method in class org.apache.iceberg.flink.source.IcebergSource.Builder
- LIMIT - Static variable in class org.apache.iceberg.flink.FlinkReadOptions
- LIMIT_OPTION - Static variable in class org.apache.iceberg.flink.FlinkReadOptions
- list(ArrayType, GroupType, T) - Method in class org.apache.iceberg.flink.data.ParquetWithFlinkSchemaVisitor
- listDatabases() - Method in class org.apache.iceberg.flink.FlinkCatalog
- listFunctions(String) - Method in class org.apache.iceberg.flink.FlinkCatalog
- listPartitions(ObjectPath) - Method in class org.apache.iceberg.flink.FlinkCatalog
- listPartitions(ObjectPath, CatalogPartitionSpec) - Method in class org.apache.iceberg.flink.FlinkCatalog
- listPartitionsByFilter(ObjectPath, List<Expression>) - Method in class org.apache.iceberg.flink.FlinkCatalog
- listTables(String) - Method in class org.apache.iceberg.flink.FlinkCatalog
- listViews(String) - Method in class org.apache.iceberg.flink.FlinkCatalog
- loadCatalog() - Method in class org.apache.iceberg.flink.CatalogLoader.CustomCatalogLoader
- loadCatalog() - Method in class org.apache.iceberg.flink.CatalogLoader.HadoopCatalogLoader
- loadCatalog() - Method in class org.apache.iceberg.flink.CatalogLoader.HiveCatalogLoader
- loadCatalog() - Method in interface org.apache.iceberg.flink.CatalogLoader
-
Create a new catalog with the provided properties.
- loadCatalog() - Method in class org.apache.iceberg.flink.CatalogLoader.RESTCatalogLoader
- loadTable() - Method in class org.apache.iceberg.flink.TableLoader.CatalogTableLoader
- loadTable() - Method in class org.apache.iceberg.flink.TableLoader.HadoopTableLoader
- loadTable() - Method in interface org.apache.iceberg.flink.TableLoader
- LockRemover - Class in org.apache.iceberg.flink.maintenance.operator
-
Manages locks and collect
Metricfor the Maintenance Tasks. - LockRemover(TriggerLockFactory, List<String>) - Constructor for class org.apache.iceberg.flink.maintenance.operator.LockRemover
M
- map(GenericRecord) - Method in class org.apache.iceberg.flink.sink.AvroGenericRecordToRowDataMapper
- map(MapType, GroupType, T, T) - Method in class org.apache.iceberg.flink.data.ParquetWithFlinkSchemaVisitor
- map(CombinedScanTask) - Method in class org.apache.iceberg.flink.source.RowDataRewriter.RewriteMap
- Map - org.apache.iceberg.flink.sink.shuffle.StatisticsType
-
Tracks the data statistics as
Map<SortKey, Long>frequency. - mapKeyType(LogicalType) - Method in class org.apache.iceberg.flink.data.AvroWithFlinkSchemaVisitor
- mapValueType(LogicalType) - Method in class org.apache.iceberg.flink.data.AvroWithFlinkSchemaVisitor
- MAX_ALLOWED_PLANNING_FAILURES - Static variable in class org.apache.iceberg.flink.FlinkReadOptions
- MAX_ALLOWED_PLANNING_FAILURES_OPTION - Static variable in class org.apache.iceberg.flink.FlinkReadOptions
- MAX_PLANNING_SNAPSHOT_COUNT - Static variable in class org.apache.iceberg.flink.FlinkReadOptions
- MAX_PLANNING_SNAPSHOT_COUNT_OPTION - Static variable in class org.apache.iceberg.flink.FlinkReadOptions
- maxAllowedPlanningFailures() - Method in class org.apache.iceberg.flink.FlinkReadConf
- maxAllowedPlanningFailures() - Method in class org.apache.iceberg.flink.source.ScanContext
- maxAllowedPlanningFailures(int) - Method in class org.apache.iceberg.flink.source.IcebergSource.Builder
- maxAllowedPlanningFailures(int) - Method in class org.apache.iceberg.flink.source.ScanContext.Builder
- maxParallelism(int) - Method in class org.apache.iceberg.flink.actions.RewriteDataFilesAction
- maxPlanningSnapshotCount() - Method in class org.apache.iceberg.flink.FlinkReadConf
- maxPlanningSnapshotCount() - Method in class org.apache.iceberg.flink.source.ScanContext
- maxPlanningSnapshotCount(int) - Method in class org.apache.iceberg.flink.source.FlinkSource.Builder
-
Deprecated.
- maxPlanningSnapshotCount(int) - Method in class org.apache.iceberg.flink.source.ScanContext.Builder
- message(RowType, MessageType, List<T>) - Method in class org.apache.iceberg.flink.data.ParquetWithFlinkSchemaVisitor
- MetaDataReaderFunction - Class in org.apache.iceberg.flink.source.reader
-
Reading metadata tables (like snapshots, manifests, etc.)
- MetaDataReaderFunction(ReadableConfig, Schema, Schema, FileIO, EncryptionManager) - Constructor for class org.apache.iceberg.flink.source.reader.MetaDataReaderFunction
- metrics() - Method in class org.apache.iceberg.flink.data.FlinkAvroWriter
- metrics() - Method in class org.apache.iceberg.flink.data.FlinkOrcWriter
- MONITOR_INTERVAL - Static variable in class org.apache.iceberg.flink.FlinkReadOptions
- MONITOR_INTERVAL_OPTION - Static variable in class org.apache.iceberg.flink.FlinkReadOptions
- monitorInterval() - Method in class org.apache.iceberg.flink.FlinkReadConf
- monitorInterval() - Method in class org.apache.iceberg.flink.source.ScanContext
- monitorInterval(Duration) - Method in class org.apache.iceberg.flink.source.FlinkSource.Builder
-
Deprecated.
- monitorInterval(Duration) - Method in class org.apache.iceberg.flink.source.IcebergSource.Builder
- monitorInterval(Duration) - Method in class org.apache.iceberg.flink.source.ScanContext.Builder
N
- nameMapping() - Method in class org.apache.iceberg.flink.FlinkReadConf
- nameMapping() - Method in class org.apache.iceberg.flink.source.ScanContext
- nameMapping(String) - Method in class org.apache.iceberg.flink.source.FlinkSource.Builder
-
Deprecated.
- nameMapping(String) - Method in class org.apache.iceberg.flink.source.IcebergSource.Builder
- nameMapping(String) - Method in class org.apache.iceberg.flink.source.ScanContext.Builder
- newAppender(OutputFile, FileFormat) - Method in class org.apache.iceberg.flink.sink.FlinkAppenderFactory
- newDataWriter(EncryptedOutputFile, FileFormat, StructLike) - Method in class org.apache.iceberg.flink.sink.FlinkAppenderFactory
- newEqDeleteWriter(EncryptedOutputFile, FileFormat, StructLike) - Method in class org.apache.iceberg.flink.sink.FlinkAppenderFactory
- newPosDeleteWriter(EncryptedOutputFile, FileFormat, StructLike) - Method in class org.apache.iceberg.flink.sink.FlinkAppenderFactory
- next() - Method in class org.apache.iceberg.flink.source.DataIterator
- nextRecord(RowData) - Method in class org.apache.iceberg.flink.source.FlinkInputFormat
- NOTHING_TO_TRIGGER - Static variable in class org.apache.iceberg.flink.maintenance.operator.TableMaintenanceMetrics
- nullType() - Method in class org.apache.iceberg.flink.data.AvroWithFlinkSchemaVisitor
O
- onCompletedSplits(Collection<String>) - Method in interface org.apache.iceberg.flink.source.assigner.SplitAssigner
-
Some assigner (like event time alignment) may rack in-progress splits to advance watermark upon completed splits
- onDiscoveredSplits(Collection<IcebergSourceSplit>) - Method in class org.apache.iceberg.flink.source.assigner.DefaultSplitAssigner
- onDiscoveredSplits(Collection<IcebergSourceSplit>) - Method in interface org.apache.iceberg.flink.source.assigner.SplitAssigner
-
Add new splits discovered by enumerator
- onSplitFinished(Map<String, IcebergSourceSplit>) - Method in class org.apache.iceberg.flink.source.reader.IcebergSourceReader
- onUnassignedSplits(Collection<IcebergSourceSplit>) - Method in class org.apache.iceberg.flink.source.assigner.DefaultSplitAssigner
- onUnassignedSplits(Collection<IcebergSourceSplit>) - Method in interface org.apache.iceberg.flink.source.assigner.SplitAssigner
-
Forward addSplitsBack event (for failed reader) to assigner
- open() - Method in class org.apache.iceberg.flink.FlinkCatalog
- open() - Method in class org.apache.iceberg.flink.maintenance.operator.JdbcLockFactory
- open() - Method in class org.apache.iceberg.flink.maintenance.operator.LockRemover
- open() - Method in interface org.apache.iceberg.flink.maintenance.operator.TriggerLockFactory
- open() - Method in class org.apache.iceberg.flink.sink.shuffle.DataStatisticsOperator
- open() - Method in class org.apache.iceberg.flink.TableLoader.CatalogTableLoader
- open() - Method in class org.apache.iceberg.flink.TableLoader.HadoopTableLoader
- open() - Method in interface org.apache.iceberg.flink.TableLoader
- open(Configuration) - Method in class org.apache.iceberg.flink.source.RowDataRewriter.RewriteMap
- open(Configuration) - Method in class org.apache.iceberg.flink.source.StreamingMonitorFunction
- open(FileScanTask, InputFilesDecryptor) - Method in class org.apache.iceberg.flink.source.AvroGenericRecordFileScanTaskReader
- open(FileScanTask, InputFilesDecryptor) - Method in class org.apache.iceberg.flink.source.DataTaskReader
- open(FileScanTask, InputFilesDecryptor) - Method in interface org.apache.iceberg.flink.source.FileScanTaskReader
- open(FileScanTask, InputFilesDecryptor) - Method in class org.apache.iceberg.flink.source.RowDataFileScanTaskReader
- open(FlinkInputSplit) - Method in class org.apache.iceberg.flink.source.FlinkInputFormat
- optionalOptions() - Method in class org.apache.iceberg.flink.FlinkDynamicTableFactory
- orcCompressionCodec() - Method in class org.apache.iceberg.flink.FlinkWriteConf
- orcCompressionStrategy() - Method in class org.apache.iceberg.flink.FlinkWriteConf
- OrderedSplitAssignerFactory - Class in org.apache.iceberg.flink.source.assigner
-
Create default assigner with a comparator that hands out splits where the order of the splits will be defined by the
SerializableComparator. - OrderedSplitAssignerFactory(SerializableComparator<IcebergSourceSplit>) - Constructor for class org.apache.iceberg.flink.source.assigner.OrderedSplitAssignerFactory
- org.apache.iceberg.flink - package org.apache.iceberg.flink
- org.apache.iceberg.flink.actions - package org.apache.iceberg.flink.actions
- org.apache.iceberg.flink.data - package org.apache.iceberg.flink.data
- org.apache.iceberg.flink.maintenance.operator - package org.apache.iceberg.flink.maintenance.operator
- org.apache.iceberg.flink.sink - package org.apache.iceberg.flink.sink
- org.apache.iceberg.flink.sink.shuffle - package org.apache.iceberg.flink.sink.shuffle
- org.apache.iceberg.flink.source - package org.apache.iceberg.flink.source
- org.apache.iceberg.flink.source.assigner - package org.apache.iceberg.flink.source.assigner
- org.apache.iceberg.flink.source.enumerator - package org.apache.iceberg.flink.source.enumerator
- org.apache.iceberg.flink.source.reader - package org.apache.iceberg.flink.source.reader
- org.apache.iceberg.flink.source.split - package org.apache.iceberg.flink.source.split
- org.apache.iceberg.flink.util - package org.apache.iceberg.flink.util
- overwrite(boolean) - Method in class org.apache.iceberg.flink.sink.FlinkSink.Builder
- overwrite(boolean) - Method in class org.apache.iceberg.flink.sink.IcebergSink.Builder
- OVERWRITE_MODE - Static variable in class org.apache.iceberg.flink.FlinkWriteOptions
- overwriteMode() - Method in class org.apache.iceberg.flink.FlinkWriteConf
P
- parquetCompressionCodec() - Method in class org.apache.iceberg.flink.FlinkWriteConf
- parquetCompressionLevel() - Method in class org.apache.iceberg.flink.FlinkWriteConf
- ParquetWithFlinkSchemaVisitor<T> - Class in org.apache.iceberg.flink.data
- ParquetWithFlinkSchemaVisitor() - Constructor for class org.apache.iceberg.flink.data.ParquetWithFlinkSchemaVisitor
- partition(StatisticsOrRecord, int) - Method in class org.apache.iceberg.flink.sink.shuffle.RangePartitioner
- partitionExists(ObjectPath, CatalogPartitionSpec) - Method in class org.apache.iceberg.flink.FlinkCatalog
- path(String) - Method in class org.apache.iceberg.flink.data.ParquetWithFlinkSchemaVisitor
- pendingRecords() - Method in class org.apache.iceberg.flink.source.assigner.DefaultSplitAssigner
- pendingRecords() - Method in interface org.apache.iceberg.flink.source.assigner.SplitAssigner
-
Return the number of pending records, which can act as a measure of the source lag.
- pendingSplitCount() - Method in class org.apache.iceberg.flink.source.assigner.DefaultSplitAssigner
- pendingSplitCount() - Method in interface org.apache.iceberg.flink.source.assigner.SplitAssigner
-
Return the number of pending splits that haven't been assigned yet.
- pendingSplits() - Method in class org.apache.iceberg.flink.source.enumerator.IcebergEnumeratorState
- planIcebergSourceSplits(Table, ScanContext, ExecutorService) - Static method in class org.apache.iceberg.flink.source.FlinkSplitPlanner
-
This returns splits for the FLIP-27 source
- planParallelism() - Method in class org.apache.iceberg.flink.source.ScanContext
- planParallelism(int) - Method in class org.apache.iceberg.flink.source.IcebergSource.Builder
- planParallelism(Integer) - Method in class org.apache.iceberg.flink.source.ScanContext.Builder
- planSplits(IcebergEnumeratorPosition) - Method in interface org.apache.iceberg.flink.source.enumerator.ContinuousSplitPlanner
-
Discover the files appended between
lastPositionand current table snapshot - planSplits(IcebergEnumeratorPosition) - Method in class org.apache.iceberg.flink.source.enumerator.ContinuousSplitPlannerImpl
- primitive(LogicalType, PrimitiveType) - Method in class org.apache.iceberg.flink.data.ParquetWithFlinkSchemaVisitor
- processElement(StreamRecord<RowData>) - Method in class org.apache.iceberg.flink.sink.shuffle.DataStatisticsOperator
- processElement(StreamRecord<TaskResult>) - Method in class org.apache.iceberg.flink.maintenance.operator.LockRemover
- processElement(StreamRecord<FlinkInputSplit>) - Method in class org.apache.iceberg.flink.source.StreamingReaderOperator
- processWatermark(Watermark) - Method in class org.apache.iceberg.flink.maintenance.operator.LockRemover
- processWatermark(Watermark) - Method in class org.apache.iceberg.flink.source.StreamingReaderOperator
- project() - Method in class org.apache.iceberg.flink.source.ScanContext
- project(TableSchema) - Method in class org.apache.iceberg.flink.source.FlinkSource.Builder
-
Deprecated.
- project(TableSchema) - Method in class org.apache.iceberg.flink.source.IcebergSource.Builder
- project(Schema) - Method in class org.apache.iceberg.flink.source.IcebergSource.Builder
- project(Schema) - Method in class org.apache.iceberg.flink.source.ScanContext.Builder
- properties(Map<String, String>) - Method in class org.apache.iceberg.flink.source.FlinkSource.Builder
-
Deprecated.
- properties(Map<String, String>) - Method in class org.apache.iceberg.flink.source.IcebergSource.Builder
-
Deprecated.
- PROPERTY_VERSION - Static variable in class org.apache.iceberg.flink.FlinkCatalogFactory
R
- RANGE_DISTRIBUTION_SORT_KEY_BASE_WEIGHT - Static variable in class org.apache.iceberg.flink.FlinkWriteOptions
- RANGE_DISTRIBUTION_STATISTICS_TYPE - Static variable in class org.apache.iceberg.flink.FlinkWriteOptions
- rangeDistributionSortKeyBaseWeight() - Method in class org.apache.iceberg.flink.FlinkWriteConf
- rangeDistributionSortKeyBaseWeight(double) - Method in class org.apache.iceberg.flink.sink.FlinkSink.Builder
-
If sort order contains partition columns, each sort key would map to one partition and data file.
- rangeDistributionStatisticsType() - Method in class org.apache.iceberg.flink.FlinkWriteConf
- rangeDistributionStatisticsType(StatisticsType) - Method in class org.apache.iceberg.flink.sink.FlinkSink.Builder
-
Range distribution needs to collect statistics about data distribution to properly shuffle the records in relatively balanced way.
- RangePartitioner - Class in org.apache.iceberg.flink.sink.shuffle
-
This custom partitioner implements the
DistributionMode.RANGEfor Flink sink. - RangePartitioner(Schema, SortOrder) - Constructor for class org.apache.iceberg.flink.sink.shuffle.RangePartitioner
- RATE_LIMITER_TRIGGERED - Static variable in class org.apache.iceberg.flink.maintenance.operator.TableMaintenanceMetrics
- reachedEnd() - Method in class org.apache.iceberg.flink.source.FlinkInputFormat
- read(RowData, Decoder) - Method in class org.apache.iceberg.flink.data.FlinkAvroReader
- read(VectorizedRowBatch, int) - Method in class org.apache.iceberg.flink.data.FlinkOrcReader
- readerFunction(ReaderFunction<T>) - Method in class org.apache.iceberg.flink.source.IcebergSource.Builder
-
Deprecated.since 1.7.0. Will be removed in 2.0.0; use
IcebergSource.forOutputType(RowDataConverter)instead to produce output type other thanRowData. - ReaderFunction<T> - Interface in org.apache.iceberg.flink.source.reader
- record() - Method in class org.apache.iceberg.flink.sink.shuffle.StatisticsOrRecord
- record() - Method in class org.apache.iceberg.flink.source.reader.RecordAndPosition
- record(T) - Method in class org.apache.iceberg.flink.source.reader.RecordAndPosition
-
Sets the next record of a sequence.
- RecordAndPosition<T> - Class in org.apache.iceberg.flink.source.reader
-
A record along with the reader position to be stored in the checkpoint.
- RecordAndPosition() - Constructor for class org.apache.iceberg.flink.source.reader.RecordAndPosition
- RecordAndPosition(T, int, long) - Constructor for class org.apache.iceberg.flink.source.reader.RecordAndPosition
- recordOffset() - Method in class org.apache.iceberg.flink.source.DataIterator
- recordOffset() - Method in class org.apache.iceberg.flink.source.reader.RecordAndPosition
- recordOffset() - Method in class org.apache.iceberg.flink.source.split.IcebergSourceSplit
- refreshLastRecordedTime() - Method in class org.apache.iceberg.flink.util.ElapsedTimeGauge
- renameTable(ObjectPath, String, boolean) - Method in class org.apache.iceberg.flink.FlinkCatalog
- requesterHostname() - Method in class org.apache.iceberg.flink.source.split.SplitRequestEvent
- requiredContext() - Method in class org.apache.iceberg.flink.FlinkCatalogFactory
- requiredOptions() - Method in class org.apache.iceberg.flink.FlinkDynamicTableFactory
- resolveConfig(Table, Map<String, String>, ReadableConfig) - Method in class org.apache.iceberg.flink.source.ScanContext.Builder
- rest(String, Configuration, Map<String, String>) - Static method in interface org.apache.iceberg.flink.CatalogLoader
- restoreEnumerator(SplitEnumeratorContext<SingleThreadedIteratorSource.GlobalSplit<T>>, Collection<SingleThreadedIteratorSource.GlobalSplit<T>>) - Method in class org.apache.iceberg.flink.maintenance.operator.SingleThreadedIteratorSource
- restoreEnumerator(SplitEnumeratorContext<IcebergSourceSplit>, IcebergEnumeratorState) - Method in class org.apache.iceberg.flink.source.IcebergSource
- rewriteDataFiles() - Method in class org.apache.iceberg.flink.actions.Actions
- RewriteDataFilesAction - Class in org.apache.iceberg.flink.actions
- RewriteDataFilesAction(StreamExecutionEnvironment, Table) - Constructor for class org.apache.iceberg.flink.actions.RewriteDataFilesAction
- rewriteDataForTasks(List<CombinedScanTask>) - Method in class org.apache.iceberg.flink.actions.RewriteDataFilesAction
- rewriteDataForTasks(DataStream<CombinedScanTask>, int) - Method in class org.apache.iceberg.flink.source.RowDataRewriter
- RewriteMap(Schema, String, FileIO, boolean, EncryptionManager, TaskWriterFactory<RowData>) - Constructor for class org.apache.iceberg.flink.source.RowDataRewriter.RewriteMap
- RowDataConverter<T> - Interface in org.apache.iceberg.flink.source.reader
-
Convert RowData to a different output type.
- RowDataFileScanTaskReader - Class in org.apache.iceberg.flink.source
- RowDataFileScanTaskReader(Schema, Schema, String, boolean, List<Expression>) - Constructor for class org.apache.iceberg.flink.source.RowDataFileScanTaskReader
- RowDataProjection - Class in org.apache.iceberg.flink.data
- RowDataReaderFunction - Class in org.apache.iceberg.flink.source.reader
- RowDataReaderFunction(ReadableConfig, Schema, Schema, String, boolean, FileIO, EncryptionManager, List<Expression>) - Constructor for class org.apache.iceberg.flink.source.reader.RowDataReaderFunction
- RowDataReaderFunction(ReadableConfig, Schema, Schema, String, boolean, FileIO, EncryptionManager, List<Expression>, long) - Constructor for class org.apache.iceberg.flink.source.reader.RowDataReaderFunction
- RowDataRewriter - Class in org.apache.iceberg.flink.source
- RowDataRewriter(Table, boolean, FileIO, EncryptionManager) - Constructor for class org.apache.iceberg.flink.source.RowDataRewriter
- RowDataRewriter.RewriteMap - Class in org.apache.iceberg.flink.source
- RowDataTaskWriterFactory - Class in org.apache.iceberg.flink.sink
- RowDataTaskWriterFactory(Table, RowType, long, FileFormat, Map<String, String>, List<Integer>, boolean) - Constructor for class org.apache.iceberg.flink.sink.RowDataTaskWriterFactory
- RowDataTaskWriterFactory(SerializableSupplier<Table>, RowType, long, FileFormat, Map<String, String>, List<Integer>, boolean) - Constructor for class org.apache.iceberg.flink.sink.RowDataTaskWriterFactory
- RowDataToAvroGenericRecordConverter - Class in org.apache.iceberg.flink.source
-
This is not serializable because Avro
Schemais not actually serializable, even though it implementsSerializableinterface. - RowDataUtil - Class in org.apache.iceberg.flink.data
- RowDataWrapper - Class in org.apache.iceberg.flink
- RowDataWrapper(RowType, Types.StructType) - Constructor for class org.apache.iceberg.flink.RowDataWrapper
- run(SourceFunction.SourceContext<FlinkInputSplit>) - Method in class org.apache.iceberg.flink.source.StreamingMonitorFunction
S
- ScanContext - Class in org.apache.iceberg.flink.source
-
Context object with optional arguments for a Flink Scan.
- ScanContext.Builder - Class in org.apache.iceberg.flink.source
- seek(int, long) - Method in class org.apache.iceberg.flink.source.DataIterator
-
(startingFileOffset, startingRecordOffset) points to the next row that reader should resume from.
- self() - Method in class org.apache.iceberg.flink.actions.RewriteDataFilesAction
- SerializableComparator<T> - Interface in org.apache.iceberg.flink.source.split
- SerializableRecordEmitter<T> - Interface in org.apache.iceberg.flink.source.reader
- serialize(IcebergEnumeratorState) - Method in class org.apache.iceberg.flink.source.enumerator.IcebergEnumeratorStateSerializer
- serialize(IcebergSourceSplit) - Method in class org.apache.iceberg.flink.source.split.IcebergSourceSplitSerializer
- set(int, T) - Method in class org.apache.iceberg.flink.RowDataWrapper
- set(String, String) - Method in class org.apache.iceberg.flink.sink.FlinkSink.Builder
-
Set the write properties for Flink sink.
- set(String, String) - Method in class org.apache.iceberg.flink.sink.IcebergSink.Builder
-
Set the write properties for IcebergSink.
- set(String, String) - Method in class org.apache.iceberg.flink.source.FlinkSource.Builder
-
Deprecated.
- set(String, String) - Method in class org.apache.iceberg.flink.source.IcebergSource.Builder
-
Set the read properties for Flink source.
- set(T, int, long) - Method in class org.apache.iceberg.flink.source.reader.RecordAndPosition
-
Updates the record and position in this object.
- setAll(Map<String, String>) - Method in class org.apache.iceberg.flink.sink.FlinkSink.Builder
-
Set the write properties for Flink sink.
- setAll(Map<String, String>) - Method in class org.apache.iceberg.flink.sink.IcebergSink.Builder
-
Set the write properties for IcebergSink.
- setAll(Map<String, String>) - Method in class org.apache.iceberg.flink.source.FlinkSource.Builder
-
Deprecated.
- setAll(Map<String, String>) - Method in class org.apache.iceberg.flink.source.IcebergSource.Builder
-
Set the read properties for Flink source.
- setBatchContext(long) - Method in class org.apache.iceberg.flink.data.FlinkOrcReader
- setRowKind(RowKind) - Method in class org.apache.iceberg.flink.data.RowDataProjection
- setRowKind(RowKind) - Method in class org.apache.iceberg.flink.data.StructRowData
- setRowPositionSupplier(Supplier<Long>) - Method in class org.apache.iceberg.flink.data.FlinkAvroReader
- setSchema(Schema) - Method in class org.apache.iceberg.flink.data.FlinkAvroReader
- setSchema(Schema) - Method in class org.apache.iceberg.flink.data.FlinkAvroWriter
- setSnapshotProperties(Map<String, String>) - Method in class org.apache.iceberg.flink.sink.FlinkSink.Builder
- setSnapshotProperty(String, String) - Method in class org.apache.iceberg.flink.sink.FlinkSink.Builder
- setSnapshotProperty(String, String) - Method in class org.apache.iceberg.flink.sink.IcebergSink.Builder
- setStruct(StructLike) - Method in class org.apache.iceberg.flink.data.StructRowData
- shouldWaitForMoreSplits() - Method in class org.apache.iceberg.flink.source.enumerator.ContinuousIcebergEnumerator
- shouldWaitForMoreSplits() - Method in class org.apache.iceberg.flink.source.enumerator.StaticIcebergEnumerator
- SIMPLE - org.apache.iceberg.flink.source.assigner.SplitAssignerType
- SimpleSplitAssignerFactory - Class in org.apache.iceberg.flink.source.assigner
-
Create simple assigner that hands out splits without any guarantee in order or locality.
- SimpleSplitAssignerFactory() - Constructor for class org.apache.iceberg.flink.source.assigner.SimpleSplitAssignerFactory
- SingleThreadedIteratorSource<T> - Class in org.apache.iceberg.flink.maintenance.operator
-
Implementation of the Source V2 API which uses an iterator to read the elements, and uses a single thread to do so.
- SingleThreadedIteratorSource() - Constructor for class org.apache.iceberg.flink.maintenance.operator.SingleThreadedIteratorSource
- size() - Method in class org.apache.iceberg.flink.RowDataWrapper
- Sketch - org.apache.iceberg.flink.sink.shuffle.StatisticsType
-
Sample the sort keys via reservoir sampling.
- SNAPSHOT_ID - Static variable in class org.apache.iceberg.flink.FlinkReadOptions
- snapshotId() - Method in class org.apache.iceberg.flink.FlinkReadConf
- snapshotId() - Method in class org.apache.iceberg.flink.source.ScanContext
- snapshotId(Long) - Method in class org.apache.iceberg.flink.source.FlinkSource.Builder
-
Deprecated.
- snapshotProperties(Map<String, String>) - Method in class org.apache.iceberg.flink.sink.IcebergSink.Builder
- snapshotState(long) - Method in class org.apache.iceberg.flink.source.enumerator.ContinuousIcebergEnumerator
- snapshotState(long) - Method in class org.apache.iceberg.flink.source.enumerator.StaticIcebergEnumerator
- snapshotState(FunctionSnapshotContext) - Method in class org.apache.iceberg.flink.source.StreamingMonitorFunction
- snapshotState(StateSnapshotContext) - Method in class org.apache.iceberg.flink.sink.shuffle.DataStatisticsOperator
- snapshotState(StateSnapshotContext) - Method in class org.apache.iceberg.flink.source.StreamingReaderOperator
- SOURCE_READER_FETCH_BATCH_RECORD_COUNT - Static variable in class org.apache.iceberg.flink.FlinkConfigOptions
- split() - Method in class org.apache.iceberg.flink.source.assigner.GetSplitResult
- split() - Method in class org.apache.iceberg.flink.source.split.IcebergSourceSplitState
- SPLIT_FILE_OPEN_COST - Static variable in class org.apache.iceberg.flink.FlinkReadOptions
- SPLIT_FILE_OPEN_COST_OPTION - Static variable in class org.apache.iceberg.flink.FlinkReadOptions
- SPLIT_LOOKBACK - Static variable in class org.apache.iceberg.flink.FlinkReadOptions
- SPLIT_LOOKBACK_OPTION - Static variable in class org.apache.iceberg.flink.FlinkReadOptions
- SPLIT_SIZE - Static variable in class org.apache.iceberg.flink.FlinkReadOptions
- SPLIT_SIZE_OPTION - Static variable in class org.apache.iceberg.flink.FlinkReadOptions
- SplitAssigner - Interface in org.apache.iceberg.flink.source.assigner
-
SplitAssigner interface is extracted out as a separate component so that we can plug in different split assignment strategy for different requirements.
- SplitAssignerFactory - Interface in org.apache.iceberg.flink.source.assigner
- SplitAssignerType - Enum in org.apache.iceberg.flink.source.assigner
- splitComparator(SerializableComparator<IcebergSourceSplit>) - Method in class org.apache.iceberg.flink.source.IcebergSource.Builder
- SplitComparators - Class in org.apache.iceberg.flink.source.split
-
Provides implementations of
SerializableComparatorwhich could be used for ordering splits. - splitFileOpenCost() - Method in class org.apache.iceberg.flink.FlinkReadConf
- splitId() - Method in class org.apache.iceberg.flink.source.split.IcebergSourceSplit
- splitLookback() - Method in class org.apache.iceberg.flink.FlinkReadConf
- splitLookback() - Method in class org.apache.iceberg.flink.source.ScanContext
- splitLookback(Integer) - Method in class org.apache.iceberg.flink.source.FlinkSource.Builder
-
Deprecated.
- splitLookback(Integer) - Method in class org.apache.iceberg.flink.source.IcebergSource.Builder
- splitLookback(Integer) - Method in class org.apache.iceberg.flink.source.ScanContext.Builder
- splitOpenFileCost() - Method in class org.apache.iceberg.flink.source.ScanContext
- splitOpenFileCost(Long) - Method in class org.apache.iceberg.flink.source.FlinkSource.Builder
-
Deprecated.
- splitOpenFileCost(Long) - Method in class org.apache.iceberg.flink.source.IcebergSource.Builder
- splitOpenFileCost(Long) - Method in class org.apache.iceberg.flink.source.ScanContext.Builder
- SplitRequestEvent - Class in org.apache.iceberg.flink.source.split
-
We can remove this class once FLINK-21364 is resolved.
- SplitRequestEvent() - Constructor for class org.apache.iceberg.flink.source.split.SplitRequestEvent
- SplitRequestEvent(Collection<String>) - Constructor for class org.apache.iceberg.flink.source.split.SplitRequestEvent
- SplitRequestEvent(Collection<String>, String) - Constructor for class org.apache.iceberg.flink.source.split.SplitRequestEvent
- splitSize() - Method in class org.apache.iceberg.flink.FlinkReadConf
- splitSize() - Method in class org.apache.iceberg.flink.source.ScanContext
- splitSize(Long) - Method in class org.apache.iceberg.flink.source.FlinkSource.Builder
-
Deprecated.
- splitSize(Long) - Method in class org.apache.iceberg.flink.source.IcebergSource.Builder
- splitSize(Long) - Method in class org.apache.iceberg.flink.source.ScanContext.Builder
- SplitWatermarkExtractor - Interface in org.apache.iceberg.flink.source.reader
-
The interface used to extract watermarks from splits.
- start() - Method in interface org.apache.iceberg.flink.source.assigner.SplitAssigner
-
Some assigners may need to start background threads or perform other activity such as registering as listeners to updates from other event sources e.g., watermark tracker.
- start() - Method in class org.apache.iceberg.flink.source.enumerator.ContinuousIcebergEnumerator
- start() - Method in class org.apache.iceberg.flink.source.enumerator.StaticIcebergEnumerator
- start() - Method in class org.apache.iceberg.flink.source.reader.IcebergSourceReader
- START_SNAPSHOT_ID - Static variable in class org.apache.iceberg.flink.FlinkReadOptions
- START_SNAPSHOT_TIMESTAMP - Static variable in class org.apache.iceberg.flink.FlinkReadOptions
- START_TAG - Static variable in class org.apache.iceberg.flink.FlinkReadOptions
- startEpoch() - Method in class org.apache.iceberg.flink.maintenance.operator.TaskResult
- STARTING_STRATEGY - Static variable in class org.apache.iceberg.flink.FlinkReadOptions
- STARTING_STRATEGY_OPTION - Static variable in class org.apache.iceberg.flink.FlinkReadOptions
- startingStrategy() - Method in class org.apache.iceberg.flink.FlinkReadConf
- startingStrategy(StreamingStartingStrategy) - Method in class org.apache.iceberg.flink.source.ScanContext.Builder
- startSnapshotId() - Method in class org.apache.iceberg.flink.FlinkReadConf
- startSnapshotId() - Method in class org.apache.iceberg.flink.source.ScanContext
- startSnapshotId(Long) - Method in class org.apache.iceberg.flink.source.FlinkSource.Builder
-
Deprecated.
- startSnapshotId(Long) - Method in class org.apache.iceberg.flink.source.IcebergSource.Builder
- startSnapshotId(Long) - Method in class org.apache.iceberg.flink.source.ScanContext.Builder
- startSnapshotTimestamp() - Method in class org.apache.iceberg.flink.FlinkReadConf
- startSnapshotTimestamp() - Method in class org.apache.iceberg.flink.source.ScanContext
- startSnapshotTimestamp(Long) - Method in class org.apache.iceberg.flink.source.IcebergSource.Builder
- startSnapshotTimestamp(Long) - Method in class org.apache.iceberg.flink.source.ScanContext.Builder
- startTag() - Method in class org.apache.iceberg.flink.FlinkReadConf
- startTag() - Method in class org.apache.iceberg.flink.source.ScanContext
- startTag(String) - Method in class org.apache.iceberg.flink.source.FlinkSource.Builder
-
Deprecated.
- startTag(String) - Method in class org.apache.iceberg.flink.source.IcebergSource.Builder
- startTag(String) - Method in class org.apache.iceberg.flink.source.ScanContext.Builder
- state() - Method in class org.apache.iceberg.flink.source.assigner.DefaultSplitAssigner
-
Simple assigner only tracks unassigned splits
- state() - Method in interface org.apache.iceberg.flink.source.assigner.SplitAssigner
-
Get assigner state for checkpointing.
- StaticIcebergEnumerator - Class in org.apache.iceberg.flink.source.enumerator
-
One-time split enumeration at the start-up for batch execution
- StaticIcebergEnumerator(SplitEnumeratorContext<IcebergSourceSplit>, SplitAssigner) - Constructor for class org.apache.iceberg.flink.source.enumerator.StaticIcebergEnumerator
- StatisticsOrRecord - Class in org.apache.iceberg.flink.sink.shuffle
-
The wrapper class for data statistics and record.
- StatisticsType - Enum in org.apache.iceberg.flink.sink.shuffle
-
Range distribution requires gathering statistics on the sort keys to determine proper range boundaries to distribute/cluster rows before writer operators.
- status() - Method in class org.apache.iceberg.flink.source.assigner.GetSplitResult
- status() - Method in class org.apache.iceberg.flink.source.split.IcebergSourceSplitState
- streaming() - Method in class org.apache.iceberg.flink.FlinkReadConf
- streaming(boolean) - Method in class org.apache.iceberg.flink.source.FlinkSource.Builder
-
Deprecated.
- streaming(boolean) - Method in class org.apache.iceberg.flink.source.IcebergSource.Builder
- streaming(boolean) - Method in class org.apache.iceberg.flink.source.ScanContext.Builder
- STREAMING - Static variable in class org.apache.iceberg.flink.FlinkReadOptions
- STREAMING_OPTION - Static variable in class org.apache.iceberg.flink.FlinkReadOptions
- StreamingMonitorFunction - Class in org.apache.iceberg.flink.source
-
This is the single (non-parallel) monitoring task which takes a
FlinkInputFormat, it is responsible for: Monitoring snapshots of the Iceberg table. - StreamingMonitorFunction(TableLoader, ScanContext) - Constructor for class org.apache.iceberg.flink.source.StreamingMonitorFunction
- StreamingReaderOperator - Class in org.apache.iceberg.flink.source
-
The operator that reads the
splitsreceived from the precedingStreamingMonitorFunction. - streamingStartingStrategy() - Method in class org.apache.iceberg.flink.source.ScanContext
- streamingStartingStrategy(StreamingStartingStrategy) - Method in class org.apache.iceberg.flink.source.IcebergSource.Builder
- StreamingStartingStrategy - Enum in org.apache.iceberg.flink.source
-
Starting strategy for streaming execution.
- struct(RowType, GroupType, List<T>) - Method in class org.apache.iceberg.flink.data.ParquetWithFlinkSchemaVisitor
- StructRowData - Class in org.apache.iceberg.flink.data
- StructRowData(Types.StructType) - Constructor for class org.apache.iceberg.flink.data.StructRowData
- StructRowData(Types.StructType, RowKind) - Constructor for class org.apache.iceberg.flink.data.StructRowData
- SUCCEEDED_TASK_COUNTER - Static variable in class org.apache.iceberg.flink.maintenance.operator.TableMaintenanceMetrics
- success() - Method in class org.apache.iceberg.flink.maintenance.operator.TaskResult
- supportedProperties() - Method in class org.apache.iceberg.flink.FlinkCatalogFactory
- supportsNestedProjection() - Method in class org.apache.iceberg.flink.source.IcebergTableSource
T
- table(Table) - Method in class org.apache.iceberg.flink.sink.FlinkSink.Builder
-
This iceberg
Tableinstance is used for initializingIcebergStreamWriterwhich will write all the records intoDataFiles and emit them to downstream operator. - table(Table) - Method in class org.apache.iceberg.flink.sink.IcebergSink.Builder
-
This iceberg
SerializableTableinstance is used for initializingIcebergStreamWriterwhich will write all the records intoDataFiles and emit them to downstream operator. - table(Table) - Method in class org.apache.iceberg.flink.source.FlinkSource.Builder
-
Deprecated.
- table(Table) - Method in class org.apache.iceberg.flink.source.IcebergSource.Builder
- TABLE_EXEC_ICEBERG_EXPOSE_SPLIT_LOCALITY_INFO - Static variable in class org.apache.iceberg.flink.FlinkConfigOptions
- TABLE_EXEC_ICEBERG_INFER_SOURCE_PARALLELISM - Static variable in class org.apache.iceberg.flink.FlinkConfigOptions
- TABLE_EXEC_ICEBERG_INFER_SOURCE_PARALLELISM_MAX - Static variable in class org.apache.iceberg.flink.FlinkConfigOptions
- TABLE_EXEC_ICEBERG_USE_FLIP27_SOURCE - Static variable in class org.apache.iceberg.flink.FlinkConfigOptions
- TABLE_EXEC_ICEBERG_WORKER_POOL_SIZE - Static variable in class org.apache.iceberg.flink.FlinkConfigOptions
- TABLE_EXEC_SPLIT_ASSIGNER_TYPE - Static variable in class org.apache.iceberg.flink.FlinkConfigOptions
- TABLE_REFRESH_INTERVAL - Static variable in class org.apache.iceberg.flink.FlinkWriteOptions
- TABLE_SCAN_THEN_INCREMENTAL - org.apache.iceberg.flink.source.StreamingStartingStrategy
-
Do a regular table scan then switch to the incremental mode.
- tableExists(ObjectPath) - Method in class org.apache.iceberg.flink.FlinkCatalog
- tableLoader(TableLoader) - Method in class org.apache.iceberg.flink.sink.FlinkSink.Builder
-
The table loader is used for loading tables in
IcebergFilesCommitterlazily, we need this loader becauseTableis not serializable and could not just use the loaded table from Builder#table in the remote task manager. - tableLoader(TableLoader) - Method in class org.apache.iceberg.flink.sink.IcebergSink.Builder
-
The table loader is used for loading tables in
IcebergCommitterlazily, we need this loader becauseTableis not serializable and could not just use the loaded table from Builder#table in the remote task manager. - tableLoader(TableLoader) - Method in class org.apache.iceberg.flink.source.FlinkSource.Builder
-
Deprecated.
- tableLoader(TableLoader) - Method in class org.apache.iceberg.flink.source.IcebergSource.Builder
- TableLoader - Interface in org.apache.iceberg.flink
-
Serializable loader to load an Iceberg
Table. - TableLoader.CatalogTableLoader - Class in org.apache.iceberg.flink
- TableLoader.HadoopTableLoader - Class in org.apache.iceberg.flink
- TableMaintenanceMetrics - Class in org.apache.iceberg.flink.maintenance.operator
- tableRefreshInterval() - Method in class org.apache.iceberg.flink.FlinkWriteConf
-
NOTE: This may be removed or changed in a future release.
- tableSchema(TableSchema) - Method in class org.apache.iceberg.flink.sink.FlinkSink.Builder
- tableSchema(TableSchema) - Method in class org.apache.iceberg.flink.sink.IcebergSink.Builder
- tag() - Method in class org.apache.iceberg.flink.FlinkReadConf
- tag() - Method in class org.apache.iceberg.flink.source.ScanContext
- tag(String) - Method in class org.apache.iceberg.flink.source.FlinkSource.Builder
-
Deprecated.
- tag(String) - Method in class org.apache.iceberg.flink.source.IcebergSource.Builder
- TAG - Static variable in class org.apache.iceberg.flink.FlinkReadOptions
- TARGET_FILE_SIZE_BYTES - Static variable in class org.apache.iceberg.flink.FlinkWriteOptions
- targetDataFileSize() - Method in class org.apache.iceberg.flink.FlinkWriteConf
- task() - Method in class org.apache.iceberg.flink.source.split.IcebergSourceSplit
- taskIndex() - Method in class org.apache.iceberg.flink.maintenance.operator.TaskResult
- TaskResult - Class in org.apache.iceberg.flink.maintenance.operator
-
The result of a single Maintenance Task.
- TaskResult(int, long, boolean, List<Exception>) - Constructor for class org.apache.iceberg.flink.maintenance.operator.TaskResult
- TaskWriterFactory<T> - Interface in org.apache.iceberg.flink.sink
-
Factory to create
TaskWriter - toBranch(String) - Method in class org.apache.iceberg.flink.sink.FlinkSink.Builder
- toBranch(String) - Method in class org.apache.iceberg.flink.sink.IcebergSink.Builder
- toSchema(RowType) - Static method in class org.apache.iceberg.flink.FlinkSchemaUtil
-
Convert a
RowTypeto aTableSchema. - toSchema(Schema) - Static method in class org.apache.iceberg.flink.FlinkSchemaUtil
-
Convert a
Schemato aTableSchema. - toSplitType(String, IcebergSourceSplit) - Method in class org.apache.iceberg.flink.source.reader.IcebergSourceReader
- toString() - Method in class org.apache.iceberg.flink.CatalogLoader.CustomCatalogLoader
- toString() - Method in class org.apache.iceberg.flink.CatalogLoader.HadoopCatalogLoader
- toString() - Method in class org.apache.iceberg.flink.CatalogLoader.HiveCatalogLoader
- toString() - Method in class org.apache.iceberg.flink.CatalogLoader.RESTCatalogLoader
- toString() - Method in class org.apache.iceberg.flink.data.RowDataProjection
- toString() - Method in class org.apache.iceberg.flink.maintenance.operator.TaskResult
- toString() - Method in class org.apache.iceberg.flink.sink.shuffle.StatisticsOrRecord
- toString() - Method in class org.apache.iceberg.flink.source.FlinkInputSplit
- toString() - Method in class org.apache.iceberg.flink.source.reader.RecordAndPosition
- toString() - Method in class org.apache.iceberg.flink.source.split.IcebergSourceSplit
- toString() - Method in class org.apache.iceberg.flink.TableLoader.CatalogTableLoader
- toString() - Method in class org.apache.iceberg.flink.TableLoader.HadoopTableLoader
- toTypeInfo(RowType) - Static method in class org.apache.iceberg.flink.util.FlinkCompatibilityUtil
- TRIGGERED - Static variable in class org.apache.iceberg.flink.maintenance.operator.TableMaintenanceMetrics
- TriggerLockFactory - Interface in org.apache.iceberg.flink.maintenance.operator
-
Lock interface for handling locks for the Flink Table Maintenance jobs.
- TriggerLockFactory.Lock - Interface in org.apache.iceberg.flink.maintenance.operator
- tryLock() - Method in interface org.apache.iceberg.flink.maintenance.operator.TriggerLockFactory.Lock
-
Tries to acquire a lock with a given key.
- TYPE - Static variable in class org.apache.iceberg.flink.FlinkCatalogFactory
U
- uidPrefix(String) - Method in class org.apache.iceberg.flink.sink.FlinkSink.Builder
-
Set the uid prefix for FlinkSink operators.
- uidSuffix(String) - Method in class org.apache.iceberg.flink.sink.IcebergSink.Builder
-
Set the uid suffix for IcebergSink operators.
- UNASSIGNED - org.apache.iceberg.flink.source.split.IcebergSourceSplitStatus
- unavailable() - Static method in class org.apache.iceberg.flink.source.assigner.GetSplitResult
- UNAVAILABLE - org.apache.iceberg.flink.source.assigner.GetSplitResult.Status
-
Assigner doesn't have pending splits.
- unlock() - Method in interface org.apache.iceberg.flink.maintenance.operator.TriggerLockFactory.Lock
-
Releases the lock.
- updatePosition(int, long) - Method in class org.apache.iceberg.flink.source.split.IcebergSourceSplit
- upsert(boolean) - Method in class org.apache.iceberg.flink.sink.FlinkSink.Builder
-
All INSERT/UPDATE_AFTER events from input stream will be transformed to UPSERT events, which means it will DELETE the old records and then INSERT the new records.
- upsert(boolean) - Method in class org.apache.iceberg.flink.sink.IcebergSink.Builder
-
All INSERT/UPDATE_AFTER events from input stream will be transformed to UPSERT events, which means it will DELETE the old records and then INSERT the new records.
- upsertMode() - Method in class org.apache.iceberg.flink.FlinkWriteConf
- useBranch(String) - Method in class org.apache.iceberg.flink.source.ScanContext.Builder
- useSnapshotId(Long) - Method in class org.apache.iceberg.flink.source.IcebergSource.Builder
- useSnapshotId(Long) - Method in class org.apache.iceberg.flink.source.ScanContext.Builder
- useTag(String) - Method in class org.apache.iceberg.flink.source.ScanContext.Builder
V
- valueOf(String) - Static method in enum org.apache.iceberg.flink.sink.shuffle.StatisticsType
-
Returns the enum constant of this type with the specified name.
- valueOf(String) - Static method in enum org.apache.iceberg.flink.source.assigner.GetSplitResult.Status
-
Returns the enum constant of this type with the specified name.
- valueOf(String) - Static method in enum org.apache.iceberg.flink.source.assigner.SplitAssignerType
-
Returns the enum constant of this type with the specified name.
- valueOf(String) - Static method in enum org.apache.iceberg.flink.source.split.IcebergSourceSplitStatus
-
Returns the enum constant of this type with the specified name.
- valueOf(String) - Static method in enum org.apache.iceberg.flink.source.StreamingStartingStrategy
-
Returns the enum constant of this type with the specified name.
- values() - Static method in enum org.apache.iceberg.flink.sink.shuffle.StatisticsType
-
Returns an array containing the constants of this enum type, in the order they are declared.
- values() - Static method in enum org.apache.iceberg.flink.source.assigner.GetSplitResult.Status
-
Returns an array containing the constants of this enum type, in the order they are declared.
- values() - Static method in enum org.apache.iceberg.flink.source.assigner.SplitAssignerType
-
Returns an array containing the constants of this enum type, in the order they are declared.
- values() - Static method in enum org.apache.iceberg.flink.source.split.IcebergSourceSplitStatus
-
Returns an array containing the constants of this enum type, in the order they are declared.
- values() - Static method in enum org.apache.iceberg.flink.source.StreamingStartingStrategy
-
Returns an array containing the constants of this enum type, in the order they are declared.
- version() - Static method in class org.apache.iceberg.flink.util.FlinkPackage
-
Returns Flink version string like x.y.z
- visit(DayTimeIntervalType) - Method in class org.apache.iceberg.flink.FlinkTypeVisitor
- visit(DistinctType) - Method in class org.apache.iceberg.flink.FlinkTypeVisitor
- visit(LogicalType) - Method in class org.apache.iceberg.flink.FlinkTypeVisitor
- visit(LogicalType, Type, ParquetWithFlinkSchemaVisitor<T>) - Static method in class org.apache.iceberg.flink.data.ParquetWithFlinkSchemaVisitor
- visit(NullType) - Method in class org.apache.iceberg.flink.FlinkTypeVisitor
- visit(RawType<?>) - Method in class org.apache.iceberg.flink.FlinkTypeVisitor
- visit(StructuredType) - Method in class org.apache.iceberg.flink.FlinkTypeVisitor
- visit(SymbolType<?>) - Method in class org.apache.iceberg.flink.FlinkTypeVisitor
- visit(YearMonthIntervalType) - Method in class org.apache.iceberg.flink.FlinkTypeVisitor
- visit(ZonedTimestampType) - Method in class org.apache.iceberg.flink.FlinkTypeVisitor
W
- watermark(SplitWatermarkExtractor) - Static method in class org.apache.iceberg.flink.source.split.SplitComparators
-
Comparator which orders the splits based on watermark of the splits
- WATERMARK_COLUMN - Static variable in class org.apache.iceberg.flink.FlinkReadOptions
- WATERMARK_COLUMN_OPTION - Static variable in class org.apache.iceberg.flink.FlinkReadOptions
- WATERMARK_COLUMN_TIME_UNIT - Static variable in class org.apache.iceberg.flink.FlinkReadOptions
- WATERMARK_COLUMN_TIME_UNIT_OPTION - Static variable in class org.apache.iceberg.flink.FlinkReadOptions
- watermarkColumn() - Method in class org.apache.iceberg.flink.FlinkReadConf
- watermarkColumn() - Method in class org.apache.iceberg.flink.source.ScanContext
- watermarkColumn(String) - Method in class org.apache.iceberg.flink.source.IcebergSource.Builder
-
Emits watermarks once per split based on the min value of column statistics from files metadata in the given split.
- watermarkColumn(String) - Method in class org.apache.iceberg.flink.source.ScanContext.Builder
- watermarkColumnTimeUnit() - Method in class org.apache.iceberg.flink.FlinkReadConf
- watermarkColumnTimeUnit() - Method in class org.apache.iceberg.flink.source.ScanContext
- watermarkColumnTimeUnit(TimeUnit) - Method in class org.apache.iceberg.flink.source.IcebergSource.Builder
-
When the type of the
IcebergSource.Builder.watermarkColumn(java.lang.String)isTypes.LongType, then sets theTimeUnitto convert the value. - watermarkColumnTimeUnit(TimeUnit) - Method in class org.apache.iceberg.flink.source.ScanContext.Builder
- workerPoolSize() - Method in class org.apache.iceberg.flink.FlinkReadConf
- workerPoolSize() - Method in class org.apache.iceberg.flink.FlinkWriteConf
- wrap(RowData) - Method in class org.apache.iceberg.flink.data.RowDataProjection
- wrap(RowData) - Method in class org.apache.iceberg.flink.RowDataWrapper
- write(RowData, Encoder) - Method in class org.apache.iceberg.flink.data.FlinkAvroWriter
- write(RowData, VectorizedRowBatch) - Method in class org.apache.iceberg.flink.data.FlinkOrcWriter
- WRITE_FORMAT - Static variable in class org.apache.iceberg.flink.FlinkWriteOptions
- WRITE_PARALLELISM - Static variable in class org.apache.iceberg.flink.FlinkWriteOptions
- WRITE_UPSERT_ENABLED - Static variable in class org.apache.iceberg.flink.FlinkWriteOptions
- writeParallelism() - Method in class org.apache.iceberg.flink.FlinkWriteConf
- writeParallelism(int) - Method in class org.apache.iceberg.flink.sink.FlinkSink.Builder
-
Configuring the write parallel number for iceberg stream writer.
- writeParallelism(int) - Method in class org.apache.iceberg.flink.sink.IcebergSink.Builder
-
Configuring the write parallel number for iceberg stream writer.
- writeResult() - Method in class org.apache.iceberg.flink.sink.FlinkWriteResult
- writers() - Method in class org.apache.iceberg.flink.data.FlinkOrcWriter
All Classes All Packages