de.datexis.sector.exec

Class TrainSectorAnnotator

java.lang.Object

de.datexis.sector.exec.TrainSectorAnnotator

public class TrainSectorAnnotator
extends Object

Main Controller for training of SECTOR models.

Author:

Sebastian Arnold

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
protected static class	TrainSectorAnnotator.ExecParams

Field Summary

Fields

Modifier and Type	Field and Description
protected static org.slf4j.Logger	log

Constructor Summary

Constructors

Constructor and Description
TrainSectorAnnotator()

Method Summary

Modifier and Type	Method and Description
protected SectorAnnotator.Builder	initializeClassLabelsTarget(SectorAnnotator.Builder builder, Dataset train) Initialize target encoder for the class labels task (single-label classification)
protected SectorAnnotator.Builder	initializeHeadingsTarget(SectorAnnotator.Builder builder, Dataset train, WordHelpers.Language lang) Initialize target encoder for the headings prediction task (multi-label classification)
protected SectorAnnotator.Builder	initializeInputEncodings_bloom(SectorAnnotator.Builder builder, Dataset train, WordHelpers.Language lang)
protected SectorAnnotator.Builder	initializeInputEncodings_wemb(SectorAnnotator.Builder builder, Resource embeddingModel)
static void	main(String[] args)
protected void	runTraining(TrainSectorAnnotator.ExecParams params)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

log

protected static final org.slf4j.Logger log

Constructor Detail

TrainSectorAnnotator

public TrainSectorAnnotator()

Method Detail

main

public static void main(String[] args)
                 throws IOException

Throws:

IOException

runTraining

protected void runTraining(TrainSectorAnnotator.ExecParams params)
                    throws IOException

Throws:

IOException

initializeInputEncodings_bloom

protected SectorAnnotator.Builder initializeInputEncodings_bloom(SectorAnnotator.Builder builder,
                                                                 Dataset train,
                                                                 WordHelpers.Language lang)

initializeInputEncodings_wemb

protected SectorAnnotator.Builder initializeInputEncodings_wemb(SectorAnnotator.Builder builder,
                                                                Resource embeddingModel)
                                                         throws IOException

Throws:

IOException

initializeClassLabelsTarget

protected SectorAnnotator.Builder initializeClassLabelsTarget(SectorAnnotator.Builder builder,
                                                              Dataset train)

Initialize target encoder for the class labels task (single-label classification)

initializeHeadingsTarget

protected SectorAnnotator.Builder initializeHeadingsTarget(SectorAnnotator.Builder builder,
                                                           Dataset train,
                                                           WordHelpers.Language lang)

Initialize target encoder for the headings prediction task (multi-label classification)