org.apache.flink.streaming.python.api.functions

Class PythonApplyFunction<W extends org.apache.flink.streaming.api.windowing.windows.Window>

java.lang.Object

org.apache.flink.api.common.functions.AbstractRichFunction

org.apache.flink.streaming.python.api.functions.AbstractPythonUDF<org.apache.flink.streaming.api.functions.windowing.WindowFunction<org.python.core.PyObject,Object,Object,W>>

org.apache.flink.streaming.python.api.functions.PythonApplyFunction<W>

All Implemented Interfaces:

Serializable, org.apache.flink.api.common.functions.Function, org.apache.flink.api.common.functions.RichFunction, org.apache.flink.streaming.api.functions.windowing.WindowFunction<org.python.core.PyObject,org.python.core.PyObject,PyKey,W>

public class PythonApplyFunction<W extends org.apache.flink.streaming.api.windowing.windows.Window>
extends AbstractPythonUDF<org.apache.flink.streaming.api.functions.windowing.WindowFunction<org.python.core.PyObject,Object,Object,W>>
implements org.apache.flink.streaming.api.functions.windowing.WindowFunction<org.python.core.PyObject,org.python.core.PyObject,PyKey,W>

The PythonApplyFunction is a thin wrapper layer over a Python UDF WindowFunction. It receives an WindowFunction as an input and keeps it internally in a serialized form. It is then delivered, as part of job graph, up to the TaskManager, then it is opened and becomes a sort of mediator to the Python UDF WindowFunction.

This function is used internally by the Python thin wrapper layer over the streaming data functionality

See Also:

Serialized Form

Field Summary

Fields inherited from class org.apache.flink.streaming.python.api.functions.AbstractPythonUDF

fun, log

Constructor Summary

Constructors

Constructor and Description
PythonApplyFunction(org.apache.flink.streaming.api.functions.windowing.WindowFunction<org.python.core.PyObject,Object,Object,W> fun)

Method Summary

Modifier and Type	Method and Description
void	apply(PyKey key, W window, Iterable<org.python.core.PyObject> values, org.apache.flink.util.Collector<org.python.core.PyObject> out)
void	open(org.apache.flink.configuration.Configuration config)

Methods inherited from class org.apache.flink.streaming.python.api.functions.AbstractPythonUDF

close

Methods inherited from class org.apache.flink.api.common.functions.AbstractRichFunction

getIterationRuntimeContext, getRuntimeContext, setRuntimeContext

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

PythonApplyFunction

public PythonApplyFunction(org.apache.flink.streaming.api.functions.windowing.WindowFunction<org.python.core.PyObject,Object,Object,W> fun)
                    throws IOException

Throws:

IOException

Method Detail

open

public void open(org.apache.flink.configuration.Configuration config)
          throws Exception

Specified by:

open in interface org.apache.flink.api.common.functions.RichFunction

Overrides:

open in class AbstractPythonUDF<org.apache.flink.streaming.api.functions.windowing.WindowFunction<org.python.core.PyObject,Object,Object,W extends org.apache.flink.streaming.api.windowing.windows.Window>>

Throws:

Exception

apply

public void apply(PyKey key,
                  W window,
                  Iterable<org.python.core.PyObject> values,
                  org.apache.flink.util.Collector<org.python.core.PyObject> out)
           throws Exception

Specified by:

apply in interface org.apache.flink.streaming.api.functions.windowing.WindowFunction<org.python.core.PyObject,org.python.core.PyObject,PyKey,W extends org.apache.flink.streaming.api.windowing.windows.Window>

Throws:

Exception