Skip navigation links
B C D F G H I N O R S T W 

B

Bucketer - Interface in org.apache.flink.streaming.connectors.fs
A bucketer is used with a RollingSink to put emitted elements into rolling files.

C

Clock - Interface in org.apache.flink.streaming.connectors.fs
A clock that can provide the current time.
close() - Method in class org.apache.flink.streaming.connectors.fs.RollingSink
 
close() - Method in class org.apache.flink.streaming.connectors.fs.SequenceFileWriter
 
close() - Method in class org.apache.flink.streaming.connectors.fs.StringWriter
 
close() - Method in interface org.apache.flink.streaming.connectors.fs.Writer
Closes the Writer.
currentTimeMillis() - Method in interface org.apache.flink.streaming.connectors.fs.Clock
Return the current system time in milliseconds.
currentTimeMillis() - Method in class org.apache.flink.streaming.connectors.fs.SystemClock
 

D

DateTimeBucketer - Class in org.apache.flink.streaming.connectors.fs
A Bucketer that assigns to buckets based on current system time.
DateTimeBucketer() - Constructor for class org.apache.flink.streaming.connectors.fs.DateTimeBucketer
Creates a new DateTimeBucketer with format string "yyyy-MM-dd--HH".
DateTimeBucketer(String) - Constructor for class org.apache.flink.streaming.connectors.fs.DateTimeBucketer
Creates a new DateTimeBucketer with the given date/time format string.
disableCleanupOnOpen() - Method in class org.apache.flink.streaming.connectors.fs.RollingSink
Disable cleanup of leftover in-progress/pending files when the sink is opened.
duplicate() - Method in class org.apache.flink.streaming.connectors.fs.SequenceFileWriter
 
duplicate() - Method in class org.apache.flink.streaming.connectors.fs.StringWriter
 
duplicate() - Method in interface org.apache.flink.streaming.connectors.fs.Writer
Duplicates the Writer.

F

flush() - Method in class org.apache.flink.streaming.connectors.fs.SequenceFileWriter
 
flush() - Method in class org.apache.flink.streaming.connectors.fs.StringWriter
 
flush() - Method in interface org.apache.flink.streaming.connectors.fs.Writer
Flushes out any internally held data.

G

getNextBucketPath(Path) - Method in interface org.apache.flink.streaming.connectors.fs.Bucketer
Returns the Path of a new bucket file.
getNextBucketPath(Path) - Method in class org.apache.flink.streaming.connectors.fs.DateTimeBucketer
 
getNextBucketPath(Path) - Method in class org.apache.flink.streaming.connectors.fs.NonRollingBucketer
 

H

hflushOrSync(FSDataOutputStream) - Method in class org.apache.flink.streaming.connectors.fs.RollingSink
If hflush is available in this version of HDFS, then this method calls hflush, else it calls sync.

I

invoke(T) - Method in class org.apache.flink.streaming.connectors.fs.RollingSink
 

N

NonRollingBucketer - Class in org.apache.flink.streaming.connectors.fs
A Bucketer that does not perform any rolling of files.
NonRollingBucketer() - Constructor for class org.apache.flink.streaming.connectors.fs.NonRollingBucketer
 
notifyCheckpointComplete(long) - Method in class org.apache.flink.streaming.connectors.fs.RollingSink
 

O

open(Configuration) - Method in class org.apache.flink.streaming.connectors.fs.RollingSink
 
open(FSDataOutputStream) - Method in class org.apache.flink.streaming.connectors.fs.SequenceFileWriter
 
open(FSDataOutputStream) - Method in class org.apache.flink.streaming.connectors.fs.StringWriter
 
open(FSDataOutputStream) - Method in interface org.apache.flink.streaming.connectors.fs.Writer
Initializes the Writer for a newly opened bucket file.
org.apache.flink.streaming.connectors.fs - package org.apache.flink.streaming.connectors.fs
 

R

restoreState(RollingSink.BucketState) - Method in class org.apache.flink.streaming.connectors.fs.RollingSink
 
RollingSink<T> - Class in org.apache.flink.streaming.connectors.fs
Sink that emits its input elements to rolling FileSystem files.
RollingSink(String) - Constructor for class org.apache.flink.streaming.connectors.fs.RollingSink
Creates a new RollingSink that writes files to the given base directory.

S

SequenceFileWriter<K extends org.apache.hadoop.io.Writable,V extends org.apache.hadoop.io.Writable> - Class in org.apache.flink.streaming.connectors.fs
A Writer that writes the bucket files as Hadoop SequenceFiles.
SequenceFileWriter() - Constructor for class org.apache.flink.streaming.connectors.fs.SequenceFileWriter
Creates a new SequenceFileWriter that writes sequence files without compression.
SequenceFileWriter(String, SequenceFile.CompressionType) - Constructor for class org.apache.flink.streaming.connectors.fs.SequenceFileWriter
Creates a new SequenceFileWriter that writes sequence with the given compression codec and compression type.
setAsyncTimeout(long) - Method in class org.apache.flink.streaming.connectors.fs.RollingSink
Sets the default timeout for asynchronous operations such as recoverLease and truncate.
setBatchSize(long) - Method in class org.apache.flink.streaming.connectors.fs.RollingSink
Sets the maximum bucket size in bytes.
setBucketer(Bucketer) - Method in class org.apache.flink.streaming.connectors.fs.RollingSink
Sets the Bucketer to use for determining the bucket files to write to.
setClock(Clock) - Static method in class org.apache.flink.streaming.connectors.fs.DateTimeBucketer
This sets the internal Clock implementation.
setInProgressPrefix(String) - Method in class org.apache.flink.streaming.connectors.fs.RollingSink
Sets the prefix of in-progress part files.
setInProgressSuffix(String) - Method in class org.apache.flink.streaming.connectors.fs.RollingSink
Sets the suffix of in-progress part files.
setInputType(TypeInformation<?>, ExecutionConfig) - Method in class org.apache.flink.streaming.connectors.fs.RollingSink
 
setInputType(TypeInformation<?>, ExecutionConfig) - Method in class org.apache.flink.streaming.connectors.fs.SequenceFileWriter
 
setPartPrefix(String) - Method in class org.apache.flink.streaming.connectors.fs.RollingSink
Sets the prefix of part files.
setPendingPrefix(String) - Method in class org.apache.flink.streaming.connectors.fs.RollingSink
Sets the prefix of pending part files.
setPendingSuffix(String) - Method in class org.apache.flink.streaming.connectors.fs.RollingSink
Sets the suffix of pending part files.
setValidLengthPrefix(String) - Method in class org.apache.flink.streaming.connectors.fs.RollingSink
Sets the prefix of valid-length files.
setValidLengthSuffix(String) - Method in class org.apache.flink.streaming.connectors.fs.RollingSink
Sets the suffix of valid-length files.
setWriter(Writer<T>) - Method in class org.apache.flink.streaming.connectors.fs.RollingSink
Sets the Writer to be used for writing the incoming elements to bucket files.
shouldStartNewBucket(Path, Path) - Method in interface org.apache.flink.streaming.connectors.fs.Bucketer
Returns true when a new bucket should be started.
shouldStartNewBucket(Path, Path) - Method in class org.apache.flink.streaming.connectors.fs.DateTimeBucketer
 
shouldStartNewBucket(Path, Path) - Method in class org.apache.flink.streaming.connectors.fs.NonRollingBucketer
 
snapshotState(long, long) - Method in class org.apache.flink.streaming.connectors.fs.RollingSink
 
StringWriter<T> - Class in org.apache.flink.streaming.connectors.fs
A Writer that uses toString() on the input elements and writes them to the output bucket file separated by newline.
StringWriter() - Constructor for class org.apache.flink.streaming.connectors.fs.StringWriter
Creates a new StringWriter that uses "UTF-8" charset to convert strings to bytes.
StringWriter(String) - Constructor for class org.apache.flink.streaming.connectors.fs.StringWriter
Creates a new StringWriter that uses the given charset to convert strings to bytes.
SystemClock - Class in org.apache.flink.streaming.connectors.fs
A Clock that uses System.currentTimeMillis() to determine the system time.
SystemClock() - Constructor for class org.apache.flink.streaming.connectors.fs.SystemClock
 

T

toString() - Method in class org.apache.flink.streaming.connectors.fs.DateTimeBucketer
 
toString() - Method in class org.apache.flink.streaming.connectors.fs.NonRollingBucketer
 

W

write(Tuple2<K, V>) - Method in class org.apache.flink.streaming.connectors.fs.SequenceFileWriter
 
write(T) - Method in class org.apache.flink.streaming.connectors.fs.StringWriter
 
write(T) - Method in interface org.apache.flink.streaming.connectors.fs.Writer
Writes one element to the bucket file.
Writer<T> - Interface in org.apache.flink.streaming.connectors.fs
An implementation of Writer is used in conjunction with a RollingSink to perform the actual writing to the bucket files.
B C D F G H I N O R S T W 
Skip navigation links

Copyright © 2014–2016 The Apache Software Foundation. All rights reserved.