Package dev.langchain4j.model.scoring.onnx

Class OnnxScoringModel

java.lang.Object

dev.langchain4j.model.scoring.onnx.OnnxScoringModel

All Implemented Interfaces:

dev.langchain4j.model.scoring.ScoringModel

public class OnnxScoringModel
extends Object

Constructor Summary

Constructors

Constructor	Description
OnnxScoringModel(String pathToModel, ai.onnxruntime.OrtSession.SessionOptions options, String pathToTokenizer)
OnnxScoringModel(String pathToModel, ai.onnxruntime.OrtSession.SessionOptions options, String pathToTokenizer, int modelMaxLength, boolean normalize)
OnnxScoringModel(String pathToModel, String pathToTokenizer)
OnnxScoringModel(String pathToModel, String pathToTokenizer, int modelMaxLength)

Method Summary

Modifier and Type	Method	Description
protected dev.langchain4j.model.scoring.onnx.OnnxScoringBertCrossEncoder	model()
dev.langchain4j.model.output.Response<List<Double>>	scoreAll(List<dev.langchain4j.data.segment.TextSegment> segments, String query)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface dev.langchain4j.model.scoring.ScoringModel

score, score

Constructor Details

OnnxScoringModel

public OnnxScoringModel(String pathToModel,
 String pathToTokenizer)

OnnxScoringModel

public OnnxScoringModel(String pathToModel,
 ai.onnxruntime.OrtSession.SessionOptions options,
 String pathToTokenizer)

OnnxScoringModel

public OnnxScoringModel(String pathToModel,
 String pathToTokenizer,
 int modelMaxLength)

OnnxScoringModel

public OnnxScoringModel(String pathToModel,
 ai.onnxruntime.OrtSession.SessionOptions options,
 String pathToTokenizer,
 int modelMaxLength,
 boolean normalize)

Method Details

model

protected dev.langchain4j.model.scoring.onnx.OnnxScoringBertCrossEncoder model()

scoreAll

public dev.langchain4j.model.output.Response<List<Double>> scoreAll(List<dev.langchain4j.data.segment.TextSegment> segments,
 String query)

Specified by:

scoreAll in interface dev.langchain4j.model.scoring.ScoringModel