de.datexis.parvec.encoder

Class ParVecWordsEncoder

java.lang.Object

de.datexis.annotator.AnnotatorComponent

de.datexis.encoder.Encoder

de.datexis.encoder.LookupCacheEncoder

de.datexis.parvec.encoder.ParVecEncoder

de.datexis.parvec.encoder.ParVecWordsEncoder

All Implemented Interfaces:

IComponent, IEncoder

public class ParVecWordsEncoder
extends ParVecEncoder

Encodes a sentence as mean of individual Word Vectors.

Author:

Sebastian Arnold

Field Summary

Fields

Modifier and Type	Field and Description
protected static org.slf4j.Logger	log

Fields inherited from class de.datexis.parvec.encoder.ParVecEncoder

batchSize, iterations, labelsList, layerSize, learningRate, minLearningRate, model, numEpochs, preprocessor, stopwords, targetSize, tokenizerFactory, windowSize, word2Vec

Fields inherited from class de.datexis.encoder.LookupCacheEncoder

totalWords, vocab

Fields inherited from class de.datexis.encoder.Encoder

enableCache

Fields inherited from class de.datexis.annotator.AnnotatorComponent

id, modelAvailable, name, timer

Constructor Summary

Constructors

Constructor and Description
ParVecWordsEncoder()

Method Summary

Modifier and Type	Method and Description
org.nd4j.linalg.api.ndarray.INDArray	encode(Span span)
long	getEmbeddingVectorSize()

Methods inherited from class de.datexis.parvec.encoder.ParVecEncoder

encode, encode, getIndex, getInputVectorSize, getNearestNeighbour, getNearestNeighbours, getOutputVectorSize, getPredictions, getTotalWords, getWord, getWords, load, loadModel, oneHot, saveModel, setModelParams, setStopWords, setTrainingParams, trainModel, trainModel, withWordEmbedding, writeBinaryW2VModel

Methods inherited from class de.datexis.encoder.LookupCacheEncoder

getConfidence, getFrequency, getMaxConfidence, getNearestNeighbours, getProbability, isUnknown, setTotalWords

Methods inherited from class de.datexis.encoder.Encoder

encode, encodeEach, encodeEach, encodeEach, encodeMatrix, isCachingEnabled, setCachingEnabled, trainModel

Methods inherited from class de.datexis.annotator.AnnotatorComponent

appendTestLog, appendTestLog, appendTrainLog, appendTrainLog, clearTestLog, clearTrainLog, getConf, getId, getModel, getName, getTestLog, getTrainLog, isModelAvailable, isModelAvailableInChildren, setConf, setId, setModel, setModelAvailable, setModelFilename, setName

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface de.datexis.annotator.IComponent

getEncoders, getId, getName, isModelAvailable, setEncoders

Field Detail

log

protected static final org.slf4j.Logger log

Constructor Detail

ParVecWordsEncoder

public ParVecWordsEncoder()

Method Detail

getEmbeddingVectorSize

public long getEmbeddingVectorSize()

Specified by:

getEmbeddingVectorSize in interface IEncoder

Overrides:

getEmbeddingVectorSize in class ParVecEncoder

encode

public org.nd4j.linalg.api.ndarray.INDArray encode(Span span)

Specified by:

encode in interface IEncoder

Overrides:

encode in class ParVecEncoder