ml.dmlc.xgboost4j.java.spark.rapids

Class GpuColumnBatch

java.lang.Object

ml.dmlc.xgboost4j.java.spark.rapids.GpuColumnBatch

public class GpuColumnBatch
extends Object

Constructor Summary

Constructors

Constructor and Description
GpuColumnBatch(ai.rapids.cudf.Table table, org.apache.spark.sql.types.StructType schema)

Method Summary

Modifier and Type	Method and Description
long	getColumn(int index)
ai.rapids.cudf.ColumnVector	getColumnVector(int index)
int	getNumColumns()
long	getNumRows()
static ai.rapids.cudf.DType	getRapidsType(org.apache.spark.sql.types.DataType type)
org.apache.spark.sql.types.StructType	getSchema()
long[]	groupByColumnWithAggregation(int groupIndex, int oneIndex, boolean checkEqual) This is used to group the CUDF Dataset by column 'groupIndex', and merge all the rows into one row in each group based on column 'oneIndex'.
int[]	groupByColumnWithCountHost(int groupIndex)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

GpuColumnBatch

public GpuColumnBatch(ai.rapids.cudf.Table table,
                      org.apache.spark.sql.types.StructType schema)

Method Detail

getSchema

public org.apache.spark.sql.types.StructType getSchema()

getNumRows

public long getNumRows()

getNumColumns

public int getNumColumns()

getColumnVector

public ai.rapids.cudf.ColumnVector getColumnVector(int index)

getColumn

public long getColumn(int index)

groupByColumnWithCountHost

public int[] groupByColumnWithCountHost(int groupIndex)

groupByColumnWithAggregation

public long[] groupByColumnWithAggregation(int groupIndex,
                                           int oneIndex,
                                           boolean checkEqual)

This is used to group the CUDF Dataset by column 'groupIndex', and merge all the rows into one row in each group based on column 'oneIndex'. For example 1 0 2 3 (0, 1, true) 0 2 3 => 3 5 6 6 5 6 And the last row in each group is selected.

Parameters:

groupIndex - The index of column to group by

oneIndex - The index of column to get one value in each group

checkEqual - Whether to check all the values in one group are the same

Returns:

The native handle of the result column containing the merged data.

getRapidsType

public static ai.rapids.cudf.DType getRapidsType(org.apache.spark.sql.types.DataType type)