Uses of Interface
org.apache.druid.indexing.overlord.DataSourceMetadata
Packages that use DataSourceMetadata
Package
Description
-
Uses of DataSourceMetadata in org.apache.druid.indexing.overlord
Classes in org.apache.druid.indexing.overlord that implement DataSourceMetadataMethods in org.apache.druid.indexing.overlord that return DataSourceMetadataModifier and TypeMethodDescriptionDataSourceMetadata.asStartMetadata()As inIndexerMetadataStorageCoordinator.commitSegments(java.util.Set<org.apache.druid.timeline.DataSegment>, org.apache.druid.segment.SegmentSchemaMapping), this class can represent start and end of a sequence.ObjectMetadata.asStartMetadata()DataSourceMetadata.minus(DataSourceMetadata other) Returns a copy of this instance with "other" subtracted.ObjectMetadata.minus(DataSourceMetadata other) DataSourceMetadata.plus(DataSourceMetadata other) Returns a copy of this instance with "other" merged in.ObjectMetadata.plus(DataSourceMetadata other) IndexerMetadataStorageCoordinator.retrieveDataSourceMetadata(String supervisorId) RetrievesDataSourceMetadataentry forsupervisorIdfrom the metadata store.Methods in org.apache.druid.indexing.overlord with parameters of type DataSourceMetadataModifier and TypeMethodDescriptionIndexerMetadataStorageCoordinator.commitAppendSegmentsAndMetadata(Set<DataSegment> appendSegments, Map<DataSegment, ReplaceTaskLock> appendSegmentToReplaceLock, String supervisorId, DataSourceMetadata startMetadata, DataSourceMetadata endMetadata, String taskAllocatorId, SegmentSchemaMapping segmentSchemaMapping) Commits segments created by an APPEND task.IndexerMetadataStorageCoordinator.commitMetadataOnly(String supervisorId, String dataSource, DataSourceMetadata startMetadata, DataSourceMetadata endMetadata) Similar toIndexerMetadataStorageCoordinator.commitSegments(java.util.Set<org.apache.druid.timeline.DataSegment>, org.apache.druid.segment.SegmentSchemaMapping), but meant for streaming ingestion tasks for handling the case where the task ingested no records and created no segments, but still needs to update the metadata with the progress that the task made.IndexerMetadataStorageCoordinator.commitSegmentsAndMetadata(Set<DataSegment> segments, String supervisorId, DataSourceMetadata startMetadata, DataSourceMetadata endMetadata, SegmentSchemaMapping segmentSchemaMapping) Attempts to insert a set of segments and corresponding schema to the metadata storage.booleanIndexerMetadataStorageCoordinator.insertDataSourceMetadata(String supervisorId, DataSourceMetadata dataSourceMetadata) InsertDataSourceMetadataentry forsupervisorId.booleanDataSourceMetadata.matches(DataSourceMetadata other) Returns true if any information present in this instance matches analogous information from "other" and so they are conflict-free.booleanObjectMetadata.matches(DataSourceMetadata other) DataSourceMetadata.minus(DataSourceMetadata other) Returns a copy of this instance with "other" subtracted.ObjectMetadata.minus(DataSourceMetadata other) DataSourceMetadata.plus(DataSourceMetadata other) Returns a copy of this instance with "other" merged in.ObjectMetadata.plus(DataSourceMetadata other) booleanIndexerMetadataStorageCoordinator.resetDataSourceMetadata(String supervisorId, DataSourceMetadata dataSourceMetadata) ResetsDataSourceMetadataentry forsupervisorIdto the one supplied.static voidIndexerMetadataStorageCoordinator.validateDataSourceMetadata(String supervisorId, DataSourceMetadata startMetadata, DataSourceMetadata endMetadata) Validates the given supervisorId and given metadata to ensure that start/end metadata non-null implies supervisor ID is non-null. -
Uses of DataSourceMetadata in org.apache.druid.indexing.overlord.supervisor
Methods in org.apache.druid.indexing.overlord.supervisor with parameters of type DataSourceMetadataModifier and TypeMethodDescriptionvoidStreamSupervisor.checkpoint(int taskGroupId, DataSourceMetadata checkpointMetadata) The definition of checkpoint is not very strict as currently it does not affect data or control path.voidSupervisor.reset(DataSourceMetadata dataSourceMetadata) Resets any stored metadata by the supervisor.voidStreamSupervisor.resetOffsets(DataSourceMetadata resetDataSourceMetadata) Reset offsets with provided dataSource metadata. -
Uses of DataSourceMetadata in org.apache.druid.metadata
Methods in org.apache.druid.metadata that return DataSourceMetadataModifier and TypeMethodDescriptionIndexerSQLMetadataStorageCoordinator.retrieveDataSourceMetadata(String supervisorId) Read dataSource metadata for the given supervisorId.Methods in org.apache.druid.metadata with parameters of type DataSourceMetadataModifier and TypeMethodDescriptionIndexerSQLMetadataStorageCoordinator.commitAppendSegmentsAndMetadata(Set<DataSegment> appendSegments, Map<DataSegment, ReplaceTaskLock> appendSegmentToReplaceLock, String supervisorId, DataSourceMetadata startMetadata, DataSourceMetadata endMetadata, String taskAllocatorId, SegmentSchemaMapping segmentSchemaMapping) IndexerSQLMetadataStorageCoordinator.commitMetadataOnly(String supervisorId, String dataSource, DataSourceMetadata startMetadata, DataSourceMetadata endMetadata) IndexerSQLMetadataStorageCoordinator.commitSegmentsAndMetadata(Set<DataSegment> segments, String supervisorId, DataSourceMetadata startMetadata, DataSourceMetadata endMetadata, SegmentSchemaMapping segmentSchemaMapping) booleanIndexerSQLMetadataStorageCoordinator.insertDataSourceMetadata(String supervisorId, DataSourceMetadata metadata) booleanIndexerSQLMetadataStorageCoordinator.resetDataSourceMetadata(String supervisorId, DataSourceMetadata dataSourceMetadata) protected SegmentPublishResultIndexerSQLMetadataStorageCoordinator.updateDataSourceMetadataInTransaction(SegmentMetadataTransaction transaction, String supervisorId, String dataSource, DataSourceMetadata startMetadata, DataSourceMetadata endMetadata) Compare-and-swapDataSourceMetadatafor a datasource in a transaction.