Serialized Form

Package org.apache.pulsar.io.file

Class org.apache.pulsar.io.file.FileSourceConfig extends java.lang.Object implements Serializable

serialVersionUID:

1L

Serialized Fields

fileFilter

java.lang.String fileFilter

Only files whose names match the given regular expression will be picked up.

ignoreHiddenFiles

java.lang.Boolean ignoreHiddenFiles

Indicates whether or not hidden files should be ignored or not.

inputDirectory

java.lang.String inputDirectory

The input directory from which to pull files.

keepFile

java.lang.Boolean keepFile

If true, the file is not deleted after it has been processed and causes the file to be picked up continually.

maximumFileAge

java.lang.Long maximumFileAge

The maximum age that a file must be in order to be processed; any file older than this amount of time (according to last modification date) will be ignored.

maximumSize

java.lang.Double maximumSize

The maximum size (in bytes) that a file can be in order to be processed.

minimumFileAge

java.lang.Integer minimumFileAge

The minimum age that a file must be in order to be processed; any file younger than this amount of time (according to last modification date) will be ignored.

minimumSize

java.lang.Integer minimumSize

The minimum size (in bytes) that a file must be in order to be processed.

numWorkers

java.lang.Integer numWorkers

The number of worker threads that will be processing the files. This allows you to process a larger number of files concurrently. However, setting this to a value greater than 1 will result in the data from multiple files being "intermingled" in the target topic.

pathFilter

java.lang.String pathFilter

When 'recurse' property is true, then only sub-directories whose path matches the given regular expression will be scanned.

pollingInterval

java.lang.Long pollingInterval

Indicates how long to wait before performing a directory listing.

recurse

java.lang.Boolean recurse

Indicates whether or not to pull files from sub-directories.