Package org.apache.druid.segment.metadata

Class SegmentSchemaManager

java.lang.Object

org.apache.druid.segment.metadata.SegmentSchemaManager

public class SegmentSchemaManager
extends Object

Handles segment schema persistence and cleanup on the Coordinator.

Nested Class Summary

Nested Classes

Modifier and Type	Class	Description
static class	SegmentSchemaManager.SegmentSchemaMetadataPlus	Wrapper over SchemaPayloadPlus class to include segmentId and fingerprint information.

Constructor Summary

Constructors

Constructor	Description
SegmentSchemaManager(MetadataStorageTablesConfig dbTables, com.fasterxml.jackson.databind.ObjectMapper jsonMapper, SQLMetadataConnector connector)

Method Summary

Modifier and Type	Method	Description
int	deleteSchemasOlderThan(long timestamp)
List<String>	findReferencedSchemaMarkedAsUnused()	Finds all schema fingerprints which have been marked as unused but are still referenced by some used segments.
int	markSchemaAsUsed(List<String> schemaFingerprints)	Marks the segment schema entries for the given fingerprints as used.
int	markUnreferencedSchemasAsUnused()
void	persistSchemaAndUpdateSegmentsTable(String dataSource, List<SegmentSchemaManager.SegmentSchemaMetadataPlus> segmentSchemas, int version)	Persist segment schema and update segments in a transaction.
void	persistSegmentSchema(org.skife.jdbi.v2.Handle handle, String dataSource, int version, Map<String,SchemaPayload> fingerprintSchemaPayloadMap, org.joda.time.DateTime updateTime)	Persist unique segment schema in the DB.
void	updateSegmentWithSchemaInformation(org.skife.jdbi.v2.Handle handle, List<SegmentSchemaManager.SegmentSchemaMetadataPlus> batch, org.joda.time.DateTime updateTime)	Update segment with schemaFingerprint and numRows information.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

SegmentSchemaManager

@Inject
public SegmentSchemaManager(MetadataStorageTablesConfig dbTables,
 com.fasterxml.jackson.databind.ObjectMapper jsonMapper,
 SQLMetadataConnector connector)

Method Details

findReferencedSchemaMarkedAsUnused

public List<String> findReferencedSchemaMarkedAsUnused()

Finds all schema fingerprints which have been marked as unused but are still referenced by some used segments.

Returns:

Empty list if no such schema fingerprint exists.

markSchemaAsUsed

public int markSchemaAsUsed(List<String> schemaFingerprints)

Marks the segment schema entries for the given fingerprints as used.

Parameters:

schemaFingerprints - List of fingerprints to mark as used

Returns:

Number of rows updated in the metadata store.

deleteSchemasOlderThan

public int deleteSchemasOlderThan(long timestamp)

markUnreferencedSchemasAsUnused

public int markUnreferencedSchemasAsUnused()

persistSchemaAndUpdateSegmentsTable

public void persistSchemaAndUpdateSegmentsTable(String dataSource,
 List<SegmentSchemaManager.SegmentSchemaMetadataPlus> segmentSchemas,
 int version)

Persist segment schema and update segments in a transaction.

persistSegmentSchema

public void persistSegmentSchema(org.skife.jdbi.v2.Handle handle,
 String dataSource,
 int version,
 Map<String,SchemaPayload> fingerprintSchemaPayloadMap,
 org.joda.time.DateTime updateTime)
                          throws com.fasterxml.jackson.core.JsonProcessingException

Persist unique segment schema in the DB.

Throws:

com.fasterxml.jackson.core.JsonProcessingException

updateSegmentWithSchemaInformation

public void updateSegmentWithSchemaInformation(org.skife.jdbi.v2.Handle handle,
 List<SegmentSchemaManager.SegmentSchemaMetadataPlus> batch,
 org.joda.time.DateTime updateTime)

Update segment with schemaFingerprint and numRows information.