org.apache.flink.contrib.tweetinputformat.io

Class SimpleTweetInputFormat

java.lang.Object

org.apache.flink.api.common.io.RichInputFormat<OT,org.apache.flink.core.fs.FileInputSplit>

org.apache.flink.api.common.io.FileInputFormat<OT>

org.apache.flink.api.common.io.DelimitedInputFormat<Tweet>

org.apache.flink.contrib.tweetinputformat.io.SimpleTweetInputFormat

All Implemented Interfaces:

Serializable, org.apache.flink.api.common.io.CheckpointableInputFormat<org.apache.flink.core.fs.FileInputSplit,Long>, org.apache.flink.api.common.io.InputFormat<Tweet,org.apache.flink.core.fs.FileInputSplit>, org.apache.flink.api.java.typeutils.ResultTypeQueryable<Tweet>, org.apache.flink.core.io.InputSplitSource<org.apache.flink.core.fs.FileInputSplit>

public class SimpleTweetInputFormat
extends org.apache.flink.api.common.io.DelimitedInputFormat<Tweet>
implements org.apache.flink.api.java.typeutils.ResultTypeQueryable<Tweet>

See Also:

Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.flink.api.common.io.FileInputFormat

org.apache.flink.api.common.io.FileInputFormat.FileBaseStatistics, org.apache.flink.api.common.io.FileInputFormat.InputSplitOpenThread

Field Summary

Fields inherited from class org.apache.flink.api.common.io.DelimitedInputFormat

RECORD_DELIMITER

Fields inherited from class org.apache.flink.api.common.io.FileInputFormat

currentSplit, ENUMERATE_NESTED_FILES_FLAG, enumerateNestedFiles, filePath, INFLATER_INPUT_STREAM_FACTORIES, minSplitSize, numSplits, openTimeout, READ_WHOLE_SPLIT_FLAG, splitLength, splitStart, stream, unsplittable

Constructor Summary

Constructors

Constructor and Description
SimpleTweetInputFormat()

Method Summary

Modifier and Type	Method and Description
org.apache.flink.api.common.typeinfo.TypeInformation<Tweet>	getProducedType()
Tweet	nextRecord(Tweet record)
void	open(org.apache.flink.core.fs.FileInputSplit split)
Tweet	readRecord(Tweet reuse, byte[] bytes, int offset, int numBytes)

Methods inherited from class org.apache.flink.api.common.io.DelimitedInputFormat

close, configure, getBufferSize, getCharset, getCurrentState, getDelimiter, getLineLengthLimit, getNumLineSamples, getStatistics, loadConfigParameters, loadGlobalConfigParams, reachedEnd, readLine, reopen, setBufferSize, setCharset, setDelimiter, setDelimiter, setDelimiter, setLineLengthLimit, setNumLineSamples

Methods inherited from class org.apache.flink.api.common.io.FileInputFormat

acceptFile, createInputSplits, decorateInputStream, extractFileExtension, getFilePath, getFileStats, getInflaterInputStreamFactory, getInputSplitAssigner, getMinSplitSize, getNestedFileEnumeration, getNumSplits, getOpenTimeout, getSplitLength, getSplitStart, registerInflaterInputStreamFactory, setFilePath, setFilePath, setFilesFilter, setMinSplitSize, setNestedFileEnumeration, setNumSplits, setOpenTimeout, testForUnsplittable, toString

Methods inherited from class org.apache.flink.api.common.io.RichInputFormat

closeInputFormat, getRuntimeContext, openInputFormat, setRuntimeContext

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Constructor Detail

SimpleTweetInputFormat

public SimpleTweetInputFormat()

Method Detail

open

public void open(org.apache.flink.core.fs.FileInputSplit split)
          throws IOException

Specified by:

open in interface org.apache.flink.api.common.io.InputFormat<Tweet,org.apache.flink.core.fs.FileInputSplit>

Overrides:

open in class org.apache.flink.api.common.io.DelimitedInputFormat<Tweet>

Throws:

IOException

nextRecord

public Tweet nextRecord(Tweet record)
                 throws IOException

Specified by:

nextRecord in interface org.apache.flink.api.common.io.InputFormat<Tweet,org.apache.flink.core.fs.FileInputSplit>

Overrides:

nextRecord in class org.apache.flink.api.common.io.DelimitedInputFormat<Tweet>

Throws:

IOException

readRecord

public Tweet readRecord(Tweet reuse,
                        byte[] bytes,
                        int offset,
                        int numBytes)
                 throws IOException

Specified by:

readRecord in class org.apache.flink.api.common.io.DelimitedInputFormat<Tweet>

Throws:

IOException

getProducedType

public org.apache.flink.api.common.typeinfo.TypeInformation<Tweet> getProducedType()

Specified by:

getProducedType in interface org.apache.flink.api.java.typeutils.ResultTypeQueryable<Tweet>