Class OnnxScoringModel

java.lang.Object
dev.langchain4j.model.scoring.onnx.OnnxScoringModel
All Implemented Interfaces:
dev.langchain4j.model.scoring.ScoringModel

public class OnnxScoringModel extends Object
  • Constructor Details

    • OnnxScoringModel

      public OnnxScoringModel(String pathToModel, String pathToTokenizer)
    • OnnxScoringModel

      public OnnxScoringModel(String pathToModel, ai.onnxruntime.OrtSession.SessionOptions options, String pathToTokenizer)
    • OnnxScoringModel

      public OnnxScoringModel(String pathToModel, String pathToTokenizer, int modelMaxLength)
    • OnnxScoringModel

      public OnnxScoringModel(String pathToModel, ai.onnxruntime.OrtSession.SessionOptions options, String pathToTokenizer, int modelMaxLength, boolean normalize)
  • Method Details

    • model

      protected dev.langchain4j.model.scoring.onnx.OnnxScoringBertCrossEncoder model()
    • scoreAll

      public dev.langchain4j.model.output.Response<List<Double>> scoreAll(List<dev.langchain4j.data.segment.TextSegment> segments, String query)
      Specified by:
      scoreAll in interface dev.langchain4j.model.scoring.ScoringModel