org.apache.hudi.cli.commands

Class HDFSParquetImportCommand

java.lang.Object

org.apache.hudi.cli.commands.HDFSParquetImportCommand

Deprecated.

This utility is deprecated in 0.10.0 and will be removed in 0.11.0. Use HoodieStreamer.Config#runBootstrap instead.

@ShellComponent
public class HDFSParquetImportCommand
extends Object

CLI command for importing parquet table to hudi table.

See Also:

HoodieStreamer

Constructor Summary

Constructors

Constructor and Description
HDFSParquetImportCommand() Deprecated.

Method Summary

Modifier and Type	Method and Description
String	convert(boolean useUpsert, String srcPath, String targetPath, String tableName, String tableType, String rowKeyField, String partitionPathField, String parallelism, String schemaFilePath, String format, String master, String sparkMemory, String retry, String propsFilePath, String[] configs) Deprecated.

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

HDFSParquetImportCommand

public HDFSParquetImportCommand()

Deprecated.

Method Detail

convert

@ShellMethod(key="hdfsparquetimport",
             value="Imports Parquet table to a hoodie table")
public String convert(@ShellOption(value="--upsert",defaultValue="false",help="Uses upsert API instead of the default insert API of WriteClient")
                                                                                                                          boolean useUpsert,
                                                                                                                          @ShellOption(value="--srcPath",help="Base path for the input table")
                                                                                                                          String srcPath,
                                                                                                                          @ShellOption(value="--targetPath",help="Base path for the target hoodie table")
                                                                                                                          String targetPath,
                                                                                                                          @ShellOption(value="--tableName",help="Table name")
                                                                                                                          String tableName,
                                                                                                                          @ShellOption(value="--tableType",help="Table type")
                                                                                                                          String tableType,
                                                                                                                          @ShellOption(value="--rowKeyField",help="Row key field name")
                                                                                                                          String rowKeyField,
                                                                                                                          @ShellOption(value="--partitionPathField",defaultValue="",help="Partition path field name")
                                                                                                                          String partitionPathField,
                                                                                                                          @ShellOption(value="--parallelism",help="Parallelism for hoodie insert")
                                                                                                                          String parallelism,
                                                                                                                          @ShellOption(value="--schemaFilePath",help="Path for Avro schema file")
                                                                                                                          String schemaFilePath,
                                                                                                                          @ShellOption(value="--format",help="Format for the input data")
                                                                                                                          String format,
                                                                                                                          @ShellOption(value="--sparkMaster",defaultValue="",help="Spark Master")
                                                                                                                          String master,
                                                                                                                          @ShellOption(value="--sparkMemory",help="Spark executor memory")
                                                                                                                          String sparkMemory,
                                                                                                                          @ShellOption(value="--retry",help="Number of retries")
                                                                                                                          String retry,
                                                                                                                          @ShellOption(value="--propsFilePath",help="path to properties file on localfs or dfs with configurations for hoodie client for importing",defaultValue="")
                                                                                                                          String propsFilePath,
                                                                                                                          @ShellOption(value="--hoodieConfigs",help="Any configuration that can be set in the properties file can be passed here in the form of an array",defaultValue="")
                                                                                                                          String[] configs)
                                                                                                                   throws Exception

Deprecated.

Throws:

Exception