org.apache.flink.api.java.record.operators

Class CollectionDataSource

java.lang.Object

org.apache.flink.api.common.operators.Operator<OUT>

org.apache.flink.api.common.operators.GenericDataSourceBase<org.apache.flink.types.Record,org.apache.flink.api.common.io.GenericInputFormat<org.apache.flink.types.Record>>

org.apache.flink.api.java.record.operators.CollectionDataSource

All Implemented Interfaces:

org.apache.flink.util.Visitable<org.apache.flink.api.common.operators.Operator<?>>

Deprecated.

@Deprecated
public class CollectionDataSource
extends org.apache.flink.api.common.operators.GenericDataSourceBase<org.apache.flink.types.Record,org.apache.flink.api.common.io.GenericInputFormat<org.apache.flink.types.Record>>

* NOTE: The Record API is marked as deprecated. It is not being developed anymore and will be removed from the code at some point. See FLINK-1106 for more details. Operator for input nodes which reads data from collection or iterator. Use this operator if you want to use a collection of data from the application as an input for a job to the cluster. There are two main ways to use the CollectionDataSource: Using an Iterator that is also Serializable.

 CollectionDataSource source = new CollectionDataSource(mySerializableIterator, "IterSource");
 

Using a Collection of Java Objects.

 CollectionDataSource source2 = new CollectionDataSource(new List<String>(), "Collection source");
 

Note that you can as many elements as you want to the constructor:

 CollectionDataSource("Varargs String source", "some", "strings", "that", "get", "distributed");
 

The only limitation is that the elements need to have the same type.

Nested Class Summary

Nested classes/interfaces inherited from class org.apache.flink.api.common.operators.GenericDataSourceBase

org.apache.flink.api.common.operators.GenericDataSourceBase.SplitDataProperties<T>

Field Summary

Fields inherited from class org.apache.flink.api.common.operators.GenericDataSourceBase

formatWrapper, statisticsKey

Fields inherited from class org.apache.flink.api.common.operators.Operator

compilerHints, name, operatorInfo, parameters

Constructor Summary

Constructors

Constructor and Description
CollectionDataSource(Collection<?> args, String name) Deprecated.
CollectionDataSource(CollectionInputFormat f, Collection<?> data, String name) Deprecated.
CollectionDataSource(CollectionInputFormat f, Object... data) Deprecated.
CollectionDataSource(CollectionInputFormat f, String name, Object... data) Deprecated. Creates a new instance for the given input using the given input format.
CollectionDataSource(CollectionInputFormat f, String name, Object[][] data) Deprecated.
CollectionDataSource(CollectionInputFormat f, T data, String name) Deprecated.
CollectionDataSource(Object... args) Deprecated. for scala compatible, scala-to-java type conversion always has an object wrapper
CollectionDataSource(String name, Object... args) Deprecated. Creates a new instance for the given input using the given input format.
CollectionDataSource(String name, Object[][] args) Deprecated.
CollectionDataSource(T args, String name) Deprecated.

Method Summary

Methods inherited from class org.apache.flink.api.common.operators.GenericDataSourceBase

accept, executeOnCollections, getFormatWrapper, getSplitDataProperties, getStatisticsKey, getUserCodeWrapper, setSplitDataProperties, setStatisticsKey, toString

Methods inherited from class org.apache.flink.api.common.operators.Operator

createUnionCascade, createUnionCascade, createUnionCascade, getCompilerHints, getDegreeOfParallelism, getName, getOperatorInfo, getParallelism, getParameters, setDegreeOfParallelism, setName, setParallelism, setParameter, setParameter, setParameter

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, wait, wait, wait

Constructor Detail

CollectionDataSource

public CollectionDataSource(CollectionInputFormat f,
                            String name,
                            Object... data)

Deprecated.

Creates a new instance for the given input using the given input format.

Parameters:

f - The CollectionInputFormat implementation used to read the data.

data - The input data. It should be a collection, an array or a serializable iterator.

name - The given name for the Pact, used in plans, logs and progress messages.

CollectionDataSource

public CollectionDataSource(CollectionInputFormat f,
                            String name,
                            Object[][] data)

Deprecated.

CollectionDataSource

public CollectionDataSource(CollectionInputFormat f,
                            Collection<?> data,
                            String name)

Deprecated.

CollectionDataSource

public CollectionDataSource(CollectionInputFormat f,
                            T data,
                            String name)

Deprecated.

CollectionDataSource

public CollectionDataSource(String name,
                            Object... args)

Deprecated.

Creates a new instance for the given input using the given input format. The contract has the default name. The input types will be checked. If the input types don't agree, an exception will occur.

Parameters:

args - The input data. It should be a collection, an array or a serializable iterator.

name - The given name for the Pact, used in plans, logs and progress messages.

CollectionDataSource

public CollectionDataSource(String name,
                            Object[][] args)

Deprecated.

CollectionDataSource

public CollectionDataSource(Collection<?> args,
                            String name)

Deprecated.

CollectionDataSource

public CollectionDataSource(T args,
                            String name)

Deprecated.

CollectionDataSource

public CollectionDataSource(Object... args)

Deprecated.

for scala compatible, scala-to-java type conversion always has an object wrapper

CollectionDataSource

public CollectionDataSource(CollectionInputFormat f,
                            Object... data)

Deprecated.