cn.smartjavaai.translation.entity

类 GreedyBatchTensorList

java.lang.Object

cn.smartjavaai.translation.entity.BatchTensorList

cn.smartjavaai.translation.entity.GreedyBatchTensorList

public class GreedyBatchTensorList
extends BatchTensorList

贪婪搜索张量对象列表

作者:

Calvin

构造器概要

构造器

构造器和说明
GreedyBatchTensorList()
GreedyBatchTensorList(ai.djl.ndarray.NDArray nextInputIds, ai.djl.ndarray.NDArray pastOutputIds, ai.djl.ndarray.NDList pastKeyValues, ai.djl.ndarray.NDArray encoderHiddenStates, ai.djl.ndarray.NDArray attentionMask)

方法概要

限定符和类型	方法和说明
BatchTensorList	fromList(ai.djl.ndarray.NDList inputList, long[] seqDimOrder) Constructs a new BatchTensorList instance from the serialized version of the batch tensors.
ai.djl.ndarray.NDArray	getAttentionMask()
ai.djl.ndarray.NDArray	getEncoderHiddenStates()
ai.djl.ndarray.NDList	getList() Returns the serialized version of the BatchTensorList.
ai.djl.ndarray.NDArray	getNextInputIds()
ai.djl.ndarray.NDList	getPastKeyValues() Returns the value of the pastKeyValues.
ai.djl.ndarray.NDArray	getPastOutputIds() Returns the value of the pastOutputIds.
void	setAttentionMask(ai.djl.ndarray.NDArray attentionMask)
void	setEncoderHiddenStates(ai.djl.ndarray.NDArray encoderHiddenStates)
void	setNextInputIds(ai.djl.ndarray.NDArray nextInputIds)
void	setPastKeyValues(ai.djl.ndarray.NDList pastKeyValues) Sets the kv cache.
void	setPastOutputIds(ai.djl.ndarray.NDArray pastOutputIds) Sets the past output token ids.

从类继承的方法 cn.smartjavaai.translation.entity.BatchTensorList

getPastAttentionMask, getSeqDimOrder, setPastAttentionMask, setSeqDimOrder

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

构造器详细资料

GreedyBatchTensorList

public GreedyBatchTensorList(ai.djl.ndarray.NDArray nextInputIds,
                             ai.djl.ndarray.NDArray pastOutputIds,
                             ai.djl.ndarray.NDList pastKeyValues,
                             ai.djl.ndarray.NDArray encoderHiddenStates,
                             ai.djl.ndarray.NDArray attentionMask)

GreedyBatchTensorList

public GreedyBatchTensorList()

方法详细资料

fromList

public BatchTensorList fromList(ai.djl.ndarray.NDList inputList,
                                long[] seqDimOrder)

从类复制的说明: BatchTensorList

Constructs a new BatchTensorList instance from the serialized version of the batch tensors.

The pastOutputIds has to be the first in the output list.

指定者:

fromList 在类中 BatchTensorList

参数:

inputList - the serialized version of the batch tensors

seqDimOrder - the sequence dimension order that specifies where the sequence dimension is in a tensor's shape

返回:

BatchTensorList

getList

public ai.djl.ndarray.NDList getList()

从类复制的说明: BatchTensorList

Returns the serialized version of the BatchTensorList. The pastOutputIds has to be the first in the output list.

指定者:

getList 在类中 BatchTensorList

返回:

the NDList that contains the serialized BatchTensorList

getNextInputIds

public ai.djl.ndarray.NDArray getNextInputIds()

setNextInputIds

public void setNextInputIds(ai.djl.ndarray.NDArray nextInputIds)

getPastOutputIds

public ai.djl.ndarray.NDArray getPastOutputIds()

从类复制的说明: BatchTensorList

Returns the value of the pastOutputIds.

覆盖:

getPastOutputIds 在类中 BatchTensorList

返回:

the value of pastOutputIds

setPastOutputIds

public void setPastOutputIds(ai.djl.ndarray.NDArray pastOutputIds)

从类复制的说明: BatchTensorList

Sets the past output token ids.

覆盖:

setPastOutputIds 在类中 BatchTensorList

参数:

pastOutputIds - the past output token ids

getPastKeyValues

public ai.djl.ndarray.NDList getPastKeyValues()

从类复制的说明: BatchTensorList

Returns the value of the pastKeyValues.

覆盖:

getPastKeyValues 在类中 BatchTensorList

返回:

the value of pastKeyValues

setPastKeyValues

public void setPastKeyValues(ai.djl.ndarray.NDList pastKeyValues)

从类复制的说明: BatchTensorList

Sets the kv cache.

覆盖:

setPastKeyValues 在类中 BatchTensorList

参数:

pastKeyValues - the kv cache

getEncoderHiddenStates

public ai.djl.ndarray.NDArray getEncoderHiddenStates()

setEncoderHiddenStates

public void setEncoderHiddenStates(ai.djl.ndarray.NDArray encoderHiddenStates)

getAttentionMask

public ai.djl.ndarray.NDArray getAttentionMask()

setAttentionMask

public void setAttentionMask(ai.djl.ndarray.NDArray attentionMask)