org.apache.flink.streaming.api.functions.source

Class FilePathFilter

java.lang.Object

org.apache.flink.streaming.api.functions.source.FilePathFilter

All Implemented Interfaces:

Serializable

Direct Known Subclasses:

FilePathFilter.DefaultFilter

@PublicEvolving
public abstract class FilePathFilter
extends Object
implements Serializable

An interface to be implemented by the user when using the ContinuousFileMonitoringFunction. The filterPath(Path) method is responsible for deciding if a path is eligible for further processing or not. This can serve to exclude temporary or partial files that are still being written.

See Also:

Serialized Form

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	FilePathFilter.DefaultFilter The default file path filtering method and is used if no other such function is provided.

Constructor Summary

Constructors

Constructor and Description
FilePathFilter()

Method Summary

Modifier and Type	Method and Description
static FilePathFilter	createDefaultFilter()
abstract boolean	filterPath(org.apache.flink.core.fs.Path filePath) Returns true if the filePath given is to be ignored when processing a directory, e.g.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

FilePathFilter

public FilePathFilter()

Method Detail

createDefaultFilter

public static FilePathFilter createDefaultFilter()

filterPath

public abstract boolean filterPath(org.apache.flink.core.fs.Path filePath)

Returns true if the filePath given is to be ignored when processing a directory, e.g.

 

 public boolean filterPaths(Path filePath) {
     return filePath.getName().startsWith(".") || filePath.getName().contains("_COPYING_");
 }