de.datexis.encoder.bert

Class BertRESTEncoder

java.lang.Object

de.datexis.annotator.AnnotatorComponent

de.datexis.encoder.Encoder

de.datexis.encoder.AbstractRESTEncoder

de.datexis.encoder.bert.BertRESTEncoder

All Implemented Interfaces:

IComponent, IEncoder

public class BertRESTEncoder
extends AbstractRESTEncoder

Field Summary

Fields inherited from class de.datexis.encoder.AbstractRESTEncoder

restAdapter

Fields inherited from class de.datexis.encoder.Encoder

enableCache

Fields inherited from class de.datexis.annotator.AnnotatorComponent

id, log, model, modelAvailable, name, timer

Constructor Summary

Constructors

Modifier	Constructor and Description
protected	BertRESTEncoder()
	BertRESTEncoder(RESTAdapter restAdapter)

Method Summary

Modifier and Type	Method and Description
static BertRESTEncoder	create(String domain, int port, int embeddingDimension)
org.nd4j.linalg.api.ndarray.INDArray	encode(Span span)
org.nd4j.linalg.api.ndarray.INDArray	encode(String word)
ArrayList<double[][][]>	encodeDocumentsParallel(Collection<Document> documents, int maxSequenceLength, org.nd4j.linalg.api.ndarray.INDArray toFill)
org.nd4j.linalg.api.ndarray.INDArray	encodeDocumentsParallelNoTokenization(List<Document> documents, int maxSequenceLength)
org.nd4j.linalg.api.ndarray.INDArray	encodeMatrix(List<Document> input, int maxTimeSteps, Class<? extends Span> timeStepClass)

Methods inherited from class de.datexis.encoder.AbstractRESTEncoder

getEmbeddingVectorSize, getRestAdapter, loadModel, saveModel, setRestAdapter, trainModel, trainModel

Methods inherited from class de.datexis.encoder.Encoder

encode, encodeEach, encodeEach, encodeEach, isCachingEnabled, setCachingEnabled

Methods inherited from class de.datexis.annotator.AnnotatorComponent

appendTestLog, appendTestLog, appendTrainLog, appendTrainLog, clearTestLog, clearTrainLog, getConf, getId, getModel, getName, getTestLog, getTrainLog, isModelAvailable, isModelAvailableInChildren, setConf, setId, setModel, setModelAvailable, setModelFilename, setName

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface de.datexis.annotator.IComponent

getEncoders, getId, getName, isModelAvailable, setEncoders

Constructor Detail

BertRESTEncoder

protected BertRESTEncoder()

BertRESTEncoder

public BertRESTEncoder(RESTAdapter restAdapter)

Method Detail

create

public static BertRESTEncoder create(String domain,
                                     int port,
                                     int embeddingDimension)

encode

public org.nd4j.linalg.api.ndarray.INDArray encode(String word)

encode

public org.nd4j.linalg.api.ndarray.INDArray encode(Span span)

encodeMatrix

public org.nd4j.linalg.api.ndarray.INDArray encodeMatrix(List<Document> input,
                                                         int maxTimeSteps,
                                                         Class<? extends Span> timeStepClass)

Overrides:

encodeMatrix in class Encoder

encodeDocumentsParallelNoTokenization

public org.nd4j.linalg.api.ndarray.INDArray encodeDocumentsParallelNoTokenization(List<Document> documents,
                                                                                  int maxSequenceLength)

encodeDocumentsParallel

public ArrayList<double[][][]> encodeDocumentsParallel(Collection<Document> documents,
                                                       int maxSequenceLength,
                                                       org.nd4j.linalg.api.ndarray.INDArray toFill)
                                                throws InterruptedException

Throws:

InterruptedException