org.apache.hudi.source.prune

Class PartitionPruners.DynamicPartitionPruner

java.lang.Object

org.apache.hudi.source.prune.PartitionPruners.DynamicPartitionPruner

All Implemented Interfaces:

Serializable, PartitionPruners.PartitionPruner

Enclosing class:

PartitionPruners

public static class PartitionPruners.DynamicPartitionPruner
extends Object
implements PartitionPruners.PartitionPruner

Dynamic partition pruner for hoodie table source which partitions list is available in runtime phase.

Note: The data of new partitions created after the job starts could be read if they match the filter conditions.

See Also:

Serialized Form

Method Summary

Modifier and Type	Method and Description
Set<String>	filter(Collection<String> partitions) Applies partition pruning on the given partition list, return remained partitions.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Method Detail

filter

public Set<String> filter(Collection<String> partitions)

Description copied from interface: PartitionPruners.PartitionPruner

Applies partition pruning on the given partition list, return remained partitions.

Specified by:

filter in interface PartitionPruners.PartitionPruner