org.apache.flink.streaming.examples.sideoutput

Class SideOutputExample.Tokenizer

java.lang.Object

org.apache.flink.api.common.functions.AbstractRichFunction

org.apache.flink.streaming.api.functions.ProcessFunction<String,org.apache.flink.api.java.tuple.Tuple2<String,Integer>>

org.apache.flink.streaming.examples.sideoutput.SideOutputExample.Tokenizer

All Implemented Interfaces:

Serializable, org.apache.flink.api.common.functions.Function, org.apache.flink.api.common.functions.RichFunction

Enclosing class:

SideOutputExample

public static final class SideOutputExample.Tokenizer
extends org.apache.flink.streaming.api.functions.ProcessFunction<String,org.apache.flink.api.java.tuple.Tuple2<String,Integer>>

Implements the string tokenizer that splits sentences into words as a user-defined FlatMapFunction. The function takes a line (String) and splits it into multiple pairs in the form of "(word,1)" (Tuple2<String, Integer>).

This rejects words that are longer than 5 characters long.

See Also:

Serialized Form

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.flink.streaming.api.functions.ProcessFunction

org.apache.flink.streaming.api.functions.ProcessFunction.Context, org.apache.flink.streaming.api.functions.ProcessFunction.OnTimerContext

Constructor Summary

Constructors

Constructor and Description
Tokenizer()

Method Summary

Modifier and Type	Method and Description
void	processElement(String value, org.apache.flink.streaming.api.functions.ProcessFunction.Context ctx, org.apache.flink.util.Collector<org.apache.flink.api.java.tuple.Tuple2<String,Integer>> out)

Methods inherited from class org.apache.flink.streaming.api.functions.ProcessFunction

onTimer

Methods inherited from class org.apache.flink.api.common.functions.AbstractRichFunction

close, getIterationRuntimeContext, getRuntimeContext, open, setRuntimeContext

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

Tokenizer

public Tokenizer()

Method Detail

processElement

public void processElement(String value,
                           org.apache.flink.streaming.api.functions.ProcessFunction.Context ctx,
                           org.apache.flink.util.Collector<org.apache.flink.api.java.tuple.Tuple2<String,Integer>> out)
                    throws Exception

Specified by:

processElement in class org.apache.flink.streaming.api.functions.ProcessFunction<String,org.apache.flink.api.java.tuple.Tuple2<String,Integer>>

Throws:

Exception