Package inference
Class GrpcPredictV2.ModelInferRequest
java.lang.Object
com.google.protobuf.AbstractMessageLite
com.google.protobuf.AbstractMessage
com.google.protobuf.GeneratedMessageV3
inference.GrpcPredictV2.ModelInferRequest
- All Implemented Interfaces:
com.google.protobuf.Message,com.google.protobuf.MessageLite,com.google.protobuf.MessageLiteOrBuilder,com.google.protobuf.MessageOrBuilder,GrpcPredictV2.ModelInferRequestOrBuilder,Serializable
- Enclosing class:
GrpcPredictV2
public static final class GrpcPredictV2.ModelInferRequest
extends com.google.protobuf.GeneratedMessageV3
implements GrpcPredictV2.ModelInferRequestOrBuilder
Protobuf type
inference.ModelInferRequest- See Also:
-
Nested Class Summary
Nested ClassesModifier and TypeClassDescriptionstatic final classProtobuf typeinference.ModelInferRequeststatic final classAn input tensor for an inference request.static interfacestatic final classAn output tensor requested for an inference request.static interfaceNested classes/interfaces inherited from class com.google.protobuf.GeneratedMessageV3
com.google.protobuf.GeneratedMessageV3.BuilderParent, com.google.protobuf.GeneratedMessageV3.ExtendableBuilder<MessageT extends com.google.protobuf.GeneratedMessageV3.ExtendableMessage<MessageT>,BuilderT extends com.google.protobuf.GeneratedMessageV3.ExtendableBuilder<MessageT, BuilderT>>, com.google.protobuf.GeneratedMessageV3.ExtendableMessage<MessageT extends com.google.protobuf.GeneratedMessageV3.ExtendableMessage<MessageT>>, com.google.protobuf.GeneratedMessageV3.ExtendableMessageOrBuilder<MessageT extends com.google.protobuf.GeneratedMessageV3.ExtendableMessage<MessageT>>, com.google.protobuf.GeneratedMessageV3.FieldAccessorTable, com.google.protobuf.GeneratedMessageV3.UnusedPrivateParameter Nested classes/interfaces inherited from class com.google.protobuf.AbstractMessageLite
com.google.protobuf.AbstractMessageLite.InternalOneOfEnum -
Field Summary
FieldsModifier and TypeFieldDescriptionstatic final intstatic final intstatic final intstatic final intstatic final intstatic final intstatic final intFields inherited from class com.google.protobuf.GeneratedMessageV3
alwaysUseFieldBuilders, unknownFieldsFields inherited from class com.google.protobuf.AbstractMessage
memoizedSizeFields inherited from class com.google.protobuf.AbstractMessageLite
memoizedHashCode -
Method Summary
Modifier and TypeMethodDescriptionbooleancontainsParameters(String key) Optional inference parameters.booleanstatic final com.google.protobuf.Descriptors.DescriptorgetId()Optional identifier for the request.com.google.protobuf.ByteStringOptional identifier for the request.getInputs(int index) The input tensors for the inference.intThe input tensors for the inference.The input tensors for the inference.getInputsOrBuilder(int index) The input tensors for the inference.The input tensors for the inference.The name of the model to use for inferencing.com.google.protobuf.ByteStringThe name of the model to use for inferencing.The version of the model to use for inference.com.google.protobuf.ByteStringThe version of the model to use for inference.getOutputs(int index) The requested output tensors for the inference.intThe requested output tensors for the inference.The requested output tensors for the inference.getOutputsOrBuilder(int index) The requested output tensors for the inference.The requested output tensors for the inference.Deprecated.intOptional inference parameters.Optional inference parameters.getParametersOrDefault(String key, GrpcPredictV2.InferParameter defaultValue) Optional inference parameters.Optional inference parameters.com.google.protobuf.Parser<GrpcPredictV2.ModelInferRequest> com.google.protobuf.ByteStringgetRawInputContents(int index) The data contained in an input tensor can be represented in "raw" bytes form or in the repeated type that matches the tensor's data type.intThe data contained in an input tensor can be represented in "raw" bytes form or in the repeated type that matches the tensor's data type.List<com.google.protobuf.ByteString> The data contained in an input tensor can be represented in "raw" bytes form or in the repeated type that matches the tensor's data type.intinthashCode()protected com.google.protobuf.GeneratedMessageV3.FieldAccessorTableprotected com.google.protobuf.MapFieldReflectionAccessorinternalGetMapFieldReflection(int number) final booleannewBuilder(GrpcPredictV2.ModelInferRequest prototype) protected GrpcPredictV2.ModelInferRequest.BuildernewBuilderForType(com.google.protobuf.GeneratedMessageV3.BuilderParent parent) protected ObjectnewInstance(com.google.protobuf.GeneratedMessageV3.UnusedPrivateParameter unused) parseDelimitedFrom(InputStream input) parseDelimitedFrom(InputStream input, com.google.protobuf.ExtensionRegistryLite extensionRegistry) parseFrom(byte[] data) parseFrom(byte[] data, com.google.protobuf.ExtensionRegistryLite extensionRegistry) parseFrom(com.google.protobuf.ByteString data) parseFrom(com.google.protobuf.ByteString data, com.google.protobuf.ExtensionRegistryLite extensionRegistry) parseFrom(com.google.protobuf.CodedInputStream input) parseFrom(com.google.protobuf.CodedInputStream input, com.google.protobuf.ExtensionRegistryLite extensionRegistry) parseFrom(InputStream input) parseFrom(InputStream input, com.google.protobuf.ExtensionRegistryLite extensionRegistry) parseFrom(ByteBuffer data) parseFrom(ByteBuffer data, com.google.protobuf.ExtensionRegistryLite extensionRegistry) static com.google.protobuf.Parser<GrpcPredictV2.ModelInferRequest> parser()voidwriteTo(com.google.protobuf.CodedOutputStream output) Methods inherited from class com.google.protobuf.GeneratedMessageV3
canUseUnsafe, computeStringSize, computeStringSizeNoTag, emptyBooleanList, emptyDoubleList, emptyFloatList, emptyIntList, emptyList, emptyLongList, getAllFields, getDescriptorForType, getField, getOneofFieldDescriptor, getRepeatedField, getRepeatedFieldCount, getUnknownFields, hasField, hasOneof, internalGetMapField, isStringEmpty, makeExtensionsImmutable, makeMutableCopy, makeMutableCopy, mergeFromAndMakeImmutableInternal, mutableCopy, mutableCopy, mutableCopy, mutableCopy, mutableCopy, newBooleanList, newBuilderForType, newDoubleList, newFloatList, newIntList, newLongList, parseDelimitedWithIOException, parseDelimitedWithIOException, parseUnknownField, parseUnknownFieldProto3, parseWithIOException, parseWithIOException, parseWithIOException, parseWithIOException, serializeBooleanMapTo, serializeIntegerMapTo, serializeLongMapTo, serializeStringMapTo, writeReplace, writeString, writeStringNoTagMethods inherited from class com.google.protobuf.AbstractMessage
findInitializationErrors, getInitializationErrorString, hashBoolean, hashEnum, hashEnumList, hashFields, hashLong, toStringMethods inherited from class com.google.protobuf.AbstractMessageLite
addAll, addAll, checkByteStringIsUtf8, toByteArray, toByteString, writeDelimitedTo, writeToMethods inherited from class java.lang.Object
clone, finalize, getClass, notify, notifyAll, wait, wait, waitMethods inherited from interface com.google.protobuf.MessageLite
toByteArray, toByteString, writeDelimitedTo, writeToMethods inherited from interface com.google.protobuf.MessageOrBuilder
findInitializationErrors, getAllFields, getDescriptorForType, getField, getInitializationErrorString, getOneofFieldDescriptor, getRepeatedField, getRepeatedFieldCount, getUnknownFields, hasField, hasOneof
-
Field Details
-
MODEL_NAME_FIELD_NUMBER
public static final int MODEL_NAME_FIELD_NUMBER- See Also:
-
MODEL_VERSION_FIELD_NUMBER
public static final int MODEL_VERSION_FIELD_NUMBER- See Also:
-
ID_FIELD_NUMBER
public static final int ID_FIELD_NUMBER- See Also:
-
PARAMETERS_FIELD_NUMBER
public static final int PARAMETERS_FIELD_NUMBER- See Also:
-
INPUTS_FIELD_NUMBER
public static final int INPUTS_FIELD_NUMBER- See Also:
-
OUTPUTS_FIELD_NUMBER
public static final int OUTPUTS_FIELD_NUMBER- See Also:
-
RAW_INPUT_CONTENTS_FIELD_NUMBER
public static final int RAW_INPUT_CONTENTS_FIELD_NUMBER- See Also:
-
-
Method Details
-
newInstance
- Overrides:
newInstancein classcom.google.protobuf.GeneratedMessageV3
-
getDescriptor
public static final com.google.protobuf.Descriptors.Descriptor getDescriptor() -
internalGetMapFieldReflection
protected com.google.protobuf.MapFieldReflectionAccessor internalGetMapFieldReflection(int number) - Overrides:
internalGetMapFieldReflectionin classcom.google.protobuf.GeneratedMessageV3
-
internalGetFieldAccessorTable
protected com.google.protobuf.GeneratedMessageV3.FieldAccessorTable internalGetFieldAccessorTable()- Specified by:
internalGetFieldAccessorTablein classcom.google.protobuf.GeneratedMessageV3
-
getModelName
The name of the model to use for inferencing.
string model_name = 1;- Specified by:
getModelNamein interfaceGrpcPredictV2.ModelInferRequestOrBuilder- Returns:
- The modelName.
-
getModelNameBytes
public com.google.protobuf.ByteString getModelNameBytes()The name of the model to use for inferencing.
string model_name = 1;- Specified by:
getModelNameBytesin interfaceGrpcPredictV2.ModelInferRequestOrBuilder- Returns:
- The bytes for modelName.
-
getModelVersion
The version of the model to use for inference. If not given the server will choose a version based on the model and internal policy.
string model_version = 2;- Specified by:
getModelVersionin interfaceGrpcPredictV2.ModelInferRequestOrBuilder- Returns:
- The modelVersion.
-
getModelVersionBytes
public com.google.protobuf.ByteString getModelVersionBytes()The version of the model to use for inference. If not given the server will choose a version based on the model and internal policy.
string model_version = 2;- Specified by:
getModelVersionBytesin interfaceGrpcPredictV2.ModelInferRequestOrBuilder- Returns:
- The bytes for modelVersion.
-
getId
Optional identifier for the request. If specified will be returned in the response.
string id = 3;- Specified by:
getIdin interfaceGrpcPredictV2.ModelInferRequestOrBuilder- Returns:
- The id.
-
getIdBytes
public com.google.protobuf.ByteString getIdBytes()Optional identifier for the request. If specified will be returned in the response.
string id = 3;- Specified by:
getIdBytesin interfaceGrpcPredictV2.ModelInferRequestOrBuilder- Returns:
- The bytes for id.
-
getParametersCount
public int getParametersCount()Description copied from interface:GrpcPredictV2.ModelInferRequestOrBuilderOptional inference parameters.
map<string, .inference.InferParameter> parameters = 4;- Specified by:
getParametersCountin interfaceGrpcPredictV2.ModelInferRequestOrBuilder
-
containsParameters
Optional inference parameters.
map<string, .inference.InferParameter> parameters = 4;- Specified by:
containsParametersin interfaceGrpcPredictV2.ModelInferRequestOrBuilder
-
getParameters
Deprecated.UsegetParametersMap()instead.- Specified by:
getParametersin interfaceGrpcPredictV2.ModelInferRequestOrBuilder
-
getParametersMap
Optional inference parameters.
map<string, .inference.InferParameter> parameters = 4;- Specified by:
getParametersMapin interfaceGrpcPredictV2.ModelInferRequestOrBuilder
-
getParametersOrDefault
public GrpcPredictV2.InferParameter getParametersOrDefault(String key, GrpcPredictV2.InferParameter defaultValue) Optional inference parameters.
map<string, .inference.InferParameter> parameters = 4;- Specified by:
getParametersOrDefaultin interfaceGrpcPredictV2.ModelInferRequestOrBuilder
-
getParametersOrThrow
Optional inference parameters.
map<string, .inference.InferParameter> parameters = 4;- Specified by:
getParametersOrThrowin interfaceGrpcPredictV2.ModelInferRequestOrBuilder
-
getInputsList
The input tensors for the inference.
repeated .inference.ModelInferRequest.InferInputTensor inputs = 5;- Specified by:
getInputsListin interfaceGrpcPredictV2.ModelInferRequestOrBuilder
-
getInputsOrBuilderList
public List<? extends GrpcPredictV2.ModelInferRequest.InferInputTensorOrBuilder> getInputsOrBuilderList()The input tensors for the inference.
repeated .inference.ModelInferRequest.InferInputTensor inputs = 5;- Specified by:
getInputsOrBuilderListin interfaceGrpcPredictV2.ModelInferRequestOrBuilder
-
getInputsCount
public int getInputsCount()The input tensors for the inference.
repeated .inference.ModelInferRequest.InferInputTensor inputs = 5;- Specified by:
getInputsCountin interfaceGrpcPredictV2.ModelInferRequestOrBuilder
-
getInputs
The input tensors for the inference.
repeated .inference.ModelInferRequest.InferInputTensor inputs = 5;- Specified by:
getInputsin interfaceGrpcPredictV2.ModelInferRequestOrBuilder
-
getInputsOrBuilder
The input tensors for the inference.
repeated .inference.ModelInferRequest.InferInputTensor inputs = 5;- Specified by:
getInputsOrBuilderin interfaceGrpcPredictV2.ModelInferRequestOrBuilder
-
getOutputsList
The requested output tensors for the inference. Optional, if not specified all outputs produced by the model will be returned.
repeated .inference.ModelInferRequest.InferRequestedOutputTensor outputs = 6;- Specified by:
getOutputsListin interfaceGrpcPredictV2.ModelInferRequestOrBuilder
-
getOutputsOrBuilderList
public List<? extends GrpcPredictV2.ModelInferRequest.InferRequestedOutputTensorOrBuilder> getOutputsOrBuilderList()The requested output tensors for the inference. Optional, if not specified all outputs produced by the model will be returned.
repeated .inference.ModelInferRequest.InferRequestedOutputTensor outputs = 6;- Specified by:
getOutputsOrBuilderListin interfaceGrpcPredictV2.ModelInferRequestOrBuilder
-
getOutputsCount
public int getOutputsCount()The requested output tensors for the inference. Optional, if not specified all outputs produced by the model will be returned.
repeated .inference.ModelInferRequest.InferRequestedOutputTensor outputs = 6;- Specified by:
getOutputsCountin interfaceGrpcPredictV2.ModelInferRequestOrBuilder
-
getOutputs
The requested output tensors for the inference. Optional, if not specified all outputs produced by the model will be returned.
repeated .inference.ModelInferRequest.InferRequestedOutputTensor outputs = 6;- Specified by:
getOutputsin interfaceGrpcPredictV2.ModelInferRequestOrBuilder
-
getOutputsOrBuilder
public GrpcPredictV2.ModelInferRequest.InferRequestedOutputTensorOrBuilder getOutputsOrBuilder(int index) The requested output tensors for the inference. Optional, if not specified all outputs produced by the model will be returned.
repeated .inference.ModelInferRequest.InferRequestedOutputTensor outputs = 6;- Specified by:
getOutputsOrBuilderin interfaceGrpcPredictV2.ModelInferRequestOrBuilder
-
getRawInputContentsList
The data contained in an input tensor can be represented in "raw" bytes form or in the repeated type that matches the tensor's data type. To use the raw representation 'raw_input_contents' must be initialized with data for each tensor in the same order as 'inputs'. For each tensor, the size of this content must match what is expected by the tensor's shape and data type. The raw data must be the flattened, one-dimensional, row-major order of the tensor elements without any stride or padding between the elements. Note that the FP16 and BF16 data types must be represented as raw content as there is no specific data type for a 16-bit float type. If this field is specified then InferInputTensor::contents must not be specified for any input tensor.
repeated bytes raw_input_contents = 7;- Specified by:
getRawInputContentsListin interfaceGrpcPredictV2.ModelInferRequestOrBuilder- Returns:
- A list containing the rawInputContents.
-
getRawInputContentsCount
public int getRawInputContentsCount()The data contained in an input tensor can be represented in "raw" bytes form or in the repeated type that matches the tensor's data type. To use the raw representation 'raw_input_contents' must be initialized with data for each tensor in the same order as 'inputs'. For each tensor, the size of this content must match what is expected by the tensor's shape and data type. The raw data must be the flattened, one-dimensional, row-major order of the tensor elements without any stride or padding between the elements. Note that the FP16 and BF16 data types must be represented as raw content as there is no specific data type for a 16-bit float type. If this field is specified then InferInputTensor::contents must not be specified for any input tensor.
repeated bytes raw_input_contents = 7;- Specified by:
getRawInputContentsCountin interfaceGrpcPredictV2.ModelInferRequestOrBuilder- Returns:
- The count of rawInputContents.
-
getRawInputContents
public com.google.protobuf.ByteString getRawInputContents(int index) The data contained in an input tensor can be represented in "raw" bytes form or in the repeated type that matches the tensor's data type. To use the raw representation 'raw_input_contents' must be initialized with data for each tensor in the same order as 'inputs'. For each tensor, the size of this content must match what is expected by the tensor's shape and data type. The raw data must be the flattened, one-dimensional, row-major order of the tensor elements without any stride or padding between the elements. Note that the FP16 and BF16 data types must be represented as raw content as there is no specific data type for a 16-bit float type. If this field is specified then InferInputTensor::contents must not be specified for any input tensor.
repeated bytes raw_input_contents = 7;- Specified by:
getRawInputContentsin interfaceGrpcPredictV2.ModelInferRequestOrBuilder- Parameters:
index- The index of the element to return.- Returns:
- The rawInputContents at the given index.
-
isInitialized
public final boolean isInitialized()- Specified by:
isInitializedin interfacecom.google.protobuf.MessageLiteOrBuilder- Overrides:
isInitializedin classcom.google.protobuf.GeneratedMessageV3
-
writeTo
- Specified by:
writeToin interfacecom.google.protobuf.MessageLite- Overrides:
writeToin classcom.google.protobuf.GeneratedMessageV3- Throws:
IOException
-
getSerializedSize
public int getSerializedSize()- Specified by:
getSerializedSizein interfacecom.google.protobuf.MessageLite- Overrides:
getSerializedSizein classcom.google.protobuf.GeneratedMessageV3
-
equals
- Specified by:
equalsin interfacecom.google.protobuf.Message- Overrides:
equalsin classcom.google.protobuf.AbstractMessage
-
hashCode
public int hashCode()- Specified by:
hashCodein interfacecom.google.protobuf.Message- Overrides:
hashCodein classcom.google.protobuf.AbstractMessage
-
parseFrom
public static GrpcPredictV2.ModelInferRequest parseFrom(ByteBuffer data) throws com.google.protobuf.InvalidProtocolBufferException - Throws:
com.google.protobuf.InvalidProtocolBufferException
-
parseFrom
public static GrpcPredictV2.ModelInferRequest parseFrom(ByteBuffer data, com.google.protobuf.ExtensionRegistryLite extensionRegistry) throws com.google.protobuf.InvalidProtocolBufferException - Throws:
com.google.protobuf.InvalidProtocolBufferException
-
parseFrom
public static GrpcPredictV2.ModelInferRequest parseFrom(com.google.protobuf.ByteString data) throws com.google.protobuf.InvalidProtocolBufferException - Throws:
com.google.protobuf.InvalidProtocolBufferException
-
parseFrom
public static GrpcPredictV2.ModelInferRequest parseFrom(com.google.protobuf.ByteString data, com.google.protobuf.ExtensionRegistryLite extensionRegistry) throws com.google.protobuf.InvalidProtocolBufferException - Throws:
com.google.protobuf.InvalidProtocolBufferException
-
parseFrom
public static GrpcPredictV2.ModelInferRequest parseFrom(byte[] data) throws com.google.protobuf.InvalidProtocolBufferException - Throws:
com.google.protobuf.InvalidProtocolBufferException
-
parseFrom
public static GrpcPredictV2.ModelInferRequest parseFrom(byte[] data, com.google.protobuf.ExtensionRegistryLite extensionRegistry) throws com.google.protobuf.InvalidProtocolBufferException - Throws:
com.google.protobuf.InvalidProtocolBufferException
-
parseFrom
- Throws:
IOException
-
parseFrom
public static GrpcPredictV2.ModelInferRequest parseFrom(InputStream input, com.google.protobuf.ExtensionRegistryLite extensionRegistry) throws IOException - Throws:
IOException
-
parseDelimitedFrom
public static GrpcPredictV2.ModelInferRequest parseDelimitedFrom(InputStream input) throws IOException - Throws:
IOException
-
parseDelimitedFrom
public static GrpcPredictV2.ModelInferRequest parseDelimitedFrom(InputStream input, com.google.protobuf.ExtensionRegistryLite extensionRegistry) throws IOException - Throws:
IOException
-
parseFrom
public static GrpcPredictV2.ModelInferRequest parseFrom(com.google.protobuf.CodedInputStream input) throws IOException - Throws:
IOException
-
parseFrom
public static GrpcPredictV2.ModelInferRequest parseFrom(com.google.protobuf.CodedInputStream input, com.google.protobuf.ExtensionRegistryLite extensionRegistry) throws IOException - Throws:
IOException
-
newBuilderForType
- Specified by:
newBuilderForTypein interfacecom.google.protobuf.Message- Specified by:
newBuilderForTypein interfacecom.google.protobuf.MessageLite
-
newBuilder
-
newBuilder
public static GrpcPredictV2.ModelInferRequest.Builder newBuilder(GrpcPredictV2.ModelInferRequest prototype) -
toBuilder
- Specified by:
toBuilderin interfacecom.google.protobuf.Message- Specified by:
toBuilderin interfacecom.google.protobuf.MessageLite
-
newBuilderForType
protected GrpcPredictV2.ModelInferRequest.Builder newBuilderForType(com.google.protobuf.GeneratedMessageV3.BuilderParent parent) - Specified by:
newBuilderForTypein classcom.google.protobuf.GeneratedMessageV3
-
getDefaultInstance
-
parser
-
getParserForType
- Specified by:
getParserForTypein interfacecom.google.protobuf.Message- Specified by:
getParserForTypein interfacecom.google.protobuf.MessageLite- Overrides:
getParserForTypein classcom.google.protobuf.GeneratedMessageV3
-
getDefaultInstanceForType
- Specified by:
getDefaultInstanceForTypein interfacecom.google.protobuf.MessageLiteOrBuilder- Specified by:
getDefaultInstanceForTypein interfacecom.google.protobuf.MessageOrBuilder
-