io.warp10.spark.common

Class SparkUtils

java.lang.Object

io.warp10.spark.common.SparkUtils

public class SparkUtils
extends java.lang.Object

Constructor Summary

Constructors

Constructor and Description
SparkUtils()

Method Summary

Modifier and Type	Method and Description
static java.lang.Object	fromSpark(java.lang.Object o)
static java.lang.String	parseScript(java.lang.String warpscriptFile) Parse Warpscript file and return its content as String
static void	saveAsNewAPIHadoopFile(org.apache.spark.api.java.JavaRDD rdd, java.lang.String path, java.lang.String kc, java.lang.String vc, java.lang.String ofc, java.util.Map<java.lang.String,java.lang.String> cf)
static java.lang.Object	toSpark(java.lang.Object o)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

SparkUtils

public SparkUtils()

Method Detail

fromSpark

public static java.lang.Object fromSpark(java.lang.Object o)

toSpark

public static java.lang.Object toSpark(java.lang.Object o)

parseScript

public static java.lang.String parseScript(java.lang.String warpscriptFile)
                                    throws java.io.IOException,
                                           io.warp10.script.WarpScriptException

Parse Warpscript file and return its content as String

Parameters:

warpscriptFile - name of the script to parse

Returns:

String

Throws:

java.io.IOException

io.warp10.script.WarpScriptException

saveAsNewAPIHadoopFile

public static void saveAsNewAPIHadoopFile(org.apache.spark.api.java.JavaRDD rdd,
                                          java.lang.String path,
                                          java.lang.String kc,
                                          java.lang.String vc,
                                          java.lang.String ofc,
                                          java.util.Map<java.lang.String,java.lang.String> cf)
                                   throws java.lang.Exception

Throws:

java.lang.Exception