org.apache.flink.table.runtime.arrow

类 ArrowUtils

java.lang.Object

org.apache.flink.table.runtime.arrow.ArrowUtils

@Internal
public final class ArrowUtils
extends Object

Utilities for Arrow.

构造器概要

构造器

构造器和说明
ArrowUtils()

方法概要

限定符和类型	方法和说明
static void	checkArrowUsable()
static org.apache.flink.table.runtime.arrow.ArrowUtils.CustomIterator<byte[]>	collectAsPandasDataFrame(org.apache.flink.table.api.Table table, int maxArrowBatchSize) Convert Flink table to Pandas DataFrame.
static ArrowReader	createArrowReader(org.apache.arrow.vector.VectorSchemaRoot root, org.apache.flink.table.types.logical.RowType rowType) Creates an ArrowReader for the specified VectorSchemaRoot.
static ArrowTableSource	createArrowTableSource(org.apache.flink.table.types.DataType dataType, String fileName)
static org.apache.flink.table.data.columnar.vector.ColumnVector	createColumnVector(org.apache.arrow.vector.ValueVector vector, org.apache.flink.table.types.logical.LogicalType fieldType)
static ArrowWriter<org.apache.flink.table.data.RowData>	createRowDataArrowWriter(org.apache.arrow.vector.VectorSchemaRoot root, org.apache.flink.table.types.logical.RowType rowType) Creates an ArrowWriter for the specified VectorSchemaRoot.
static org.apache.arrow.memory.RootAllocator	getRootAllocator()
static byte[][]	readArrowBatches(ReadableByteChannel channel)
static org.apache.arrow.vector.types.pojo.Schema	toArrowSchema(org.apache.flink.table.types.logical.RowType rowType) Returns the Arrow schema of the specified type.

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

构造器详细资料

ArrowUtils

public ArrowUtils()

方法详细资料

getRootAllocator

public static org.apache.arrow.memory.RootAllocator getRootAllocator()

checkArrowUsable

public static void checkArrowUsable()

toArrowSchema

public static org.apache.arrow.vector.types.pojo.Schema toArrowSchema(org.apache.flink.table.types.logical.RowType rowType)

Returns the Arrow schema of the specified type.

createRowDataArrowWriter

public static ArrowWriter<org.apache.flink.table.data.RowData> createRowDataArrowWriter(org.apache.arrow.vector.VectorSchemaRoot root,
                                                                                        org.apache.flink.table.types.logical.RowType rowType)

Creates an ArrowWriter for the specified VectorSchemaRoot.

createArrowReader

public static ArrowReader createArrowReader(org.apache.arrow.vector.VectorSchemaRoot root,
                                            org.apache.flink.table.types.logical.RowType rowType)

Creates an ArrowReader for the specified VectorSchemaRoot.

createColumnVector

public static org.apache.flink.table.data.columnar.vector.ColumnVector createColumnVector(org.apache.arrow.vector.ValueVector vector,
                                                                                          org.apache.flink.table.types.logical.LogicalType fieldType)

createArrowTableSource

public static ArrowTableSource createArrowTableSource(org.apache.flink.table.types.DataType dataType,
                                                      String fileName)
                                               throws IOException

抛出:

IOException

readArrowBatches

public static byte[][] readArrowBatches(ReadableByteChannel channel)
                                 throws IOException

抛出:

IOException

collectAsPandasDataFrame

public static org.apache.flink.table.runtime.arrow.ArrowUtils.CustomIterator<byte[]> collectAsPandasDataFrame(org.apache.flink.table.api.Table table,
                                                                                                              int maxArrowBatchSize)
                                                                                                       throws Exception

Convert Flink table to Pandas DataFrame.

抛出:

Exception