Skip navigation links
A B C D E F G H I J K L M N O P Q R S T U V W 

A

abort() - Method in class de.gerdiproject.harvest.etls.rest.ETLRestResource
Aborts an ongoing harvest.
ABORT_FINISHED - Static variable in class de.gerdiproject.harvest.etls.constants.ETLConstants
 
ABORT_HARVEST_FAILED_NO_HARVEST - Static variable in class de.gerdiproject.harvest.etls.constants.ETLConstants
 
ABORT_INVALID_STATE - Static variable in class de.gerdiproject.harvest.etls.constants.ETLConstants
 
ABORT_START - Static variable in class de.gerdiproject.harvest.etls.constants.ETLConstants
 
abortHarvest() - Method in class de.gerdiproject.harvest.etls.AbstractETL
Aborts the harvesting process, allowing a new harvest to be started.
abortHarvest() - Method in class de.gerdiproject.harvest.etls.utils.ETLManager
Attempts to abort an ongoing harvest.
AbstractETL<T,S> - Class in de.gerdiproject.harvest.etls
This class offers a skeleton for harvesting a repository to retrieve all of its metadata.
AbstractETL() - Constructor for class de.gerdiproject.harvest.etls.AbstractETL
Constructor that initializes helper classes and fields.
AbstractETL(String) - Constructor for class de.gerdiproject.harvest.etls.AbstractETL
Constructor that initializes helper classes and fields.
AbstractIteratorETL<T,S> - Class in de.gerdiproject.harvest.etls
This ETL harvests data via Iterators and creates a document for each iterated element.
AbstractIteratorETL() - Constructor for class de.gerdiproject.harvest.etls.AbstractIteratorETL
Forwarding super class constructor.
AbstractIteratorETL(String) - Constructor for class de.gerdiproject.harvest.etls.AbstractIteratorETL
Forwarding super class constructor.
AbstractIteratorExtractor<T> - Class in de.gerdiproject.harvest.etls.extractors
This IExtractor can extract an Iterator in order to be able to iterate lists or similar constructs.
AbstractIteratorExtractor() - Constructor for class de.gerdiproject.harvest.etls.extractors.AbstractIteratorExtractor
 
AbstractIteratorLoader<S> - Class in de.gerdiproject.harvest.etls.loaders
This loader can load multiple documents.
AbstractIteratorLoader() - Constructor for class de.gerdiproject.harvest.etls.loaders.AbstractIteratorLoader
 
AbstractIteratorTransformer<T,S> - Class in de.gerdiproject.harvest.etls.transformers
This transformer can transform multiple documents.
AbstractIteratorTransformer() - Constructor for class de.gerdiproject.harvest.etls.transformers.AbstractIteratorTransformer
 
AbstractParameter<V> - Class in de.gerdiproject.harvest.config.parameters
Parameters are part of the Configuration.
AbstractParameter(String, String, V, Function<String, V>) - Constructor for class de.gerdiproject.harvest.config.parameters.AbstractParameter
Constructor that uses a custom mapping function.
AbstractRestObject<T extends AbstractRestObject<T,P>,P> - Class in de.gerdiproject.harvest.rest
This abstract class represents a singleton that is to be manipulated by an AbstractRestResource.
AbstractRestObject(String, Class<? extends GetRestObjectEvent<T>>) - Constructor for class de.gerdiproject.harvest.rest.AbstractRestObject
Constructor that requires the moduleName for pretty printing and the class of the GetRestObjectEvent that is used to retrieve the singleton instance of this object.
AbstractRestResource<T extends AbstractRestObject<T,?>,S extends GetRestObjectEvent<T>> - Class in de.gerdiproject.harvest.rest
This abstract class represents the interface between HTTP requests and a singleton object that can be manipulated by such.
AbstractRestResource(Gson) - Constructor for class de.gerdiproject.harvest.rest.AbstractRestResource
This constructor constructs and dispatches an instance of the generic GetRestObjectEvent in order to retrieve the singleton object.
AbstractRestResource() - Constructor for class de.gerdiproject.harvest.rest.AbstractRestResource
This constructor constructs and dispatches an instance of the generic GetRestObjectEvent in order to retrieve the singleton object.
AbstractSucceededOrFailedEvent - Class in de.gerdiproject.harvest.event
This event marks something that can either succeed or fail.
AbstractSucceededOrFailedEvent(boolean) - Constructor for class de.gerdiproject.harvest.event.AbstractSucceededOrFailedEvent
 
AbstractURLLoader<S extends de.gerdiproject.harvest.IDocument> - Class in de.gerdiproject.harvest.etls.loaders
This abstract class offers a basis for sending documents to a search index via a REST request.
AbstractURLLoader() - Constructor for class de.gerdiproject.harvest.etls.loaders.AbstractURLLoader
Constructor that initializes the Logger.
ADD_OK - Static variable in class de.gerdiproject.harvest.scheduler.constants.SchedulerConstants
 
addAllSorted(Collection<TimestampedEntry<T>>) - Method in class de.gerdiproject.harvest.etls.utils.TimestampedList
Adds elements of another TimestampedList to the bottom of this list.
addEventListeners() - Method in class de.gerdiproject.harvest.config.Configuration
 
addEventListeners() - Method in class de.gerdiproject.harvest.etls.AbstractETL
 
addEventListeners() - Method in class de.gerdiproject.harvest.etls.loaders.utils.LoaderRegistry
 
addEventListeners() - Method in class de.gerdiproject.harvest.etls.utils.ETLManager
 
addEventListeners() - Method in interface de.gerdiproject.harvest.event.IEventListener
Adds event listeners.
addEventListeners() - Method in class de.gerdiproject.harvest.rest.AbstractRestObject
 
addEventListeners() - Method in class de.gerdiproject.harvest.scheduler.Scheduler
 
addListener(Class<T>, Consumer<T>) - Static method in class de.gerdiproject.harvest.event.EventSystem
Adds a callback function that is to be executed when a specified event is dispatched.
addSynchronousListener(Class<T>, Function<T, R>) - Static method in class de.gerdiproject.harvest.event.EventSystem
Adds a callback function that executes and returns a value when a specified synchronous event is dispatched.
addSynchronousListener(Class<T>, Supplier<R>) - Static method in class de.gerdiproject.harvest.event.EventSystem
Adds a callback function that executes and returns a value when a specified synchronous event is dispatched.
addTask(String) - Method in class de.gerdiproject.harvest.scheduler.rest.SchedulerRestResource
Adds a harvesting task with a specified cron tab to the schedule.
addTask(ChangeSchedulerRequest) - Method in class de.gerdiproject.harvest.scheduler.Scheduler
Adds a new task to the scheduler.
addValue(T) - Method in class de.gerdiproject.harvest.etls.utils.TimestampedList
Adds a new value and the current timestamp to the list.
ALLOWED_REQUESTS - Static variable in class de.gerdiproject.harvest.config.constants.ConfigurationConstants
 
ALLOWED_REQUESTS - Static variable in class de.gerdiproject.harvest.etls.constants.ETLConstants
 
ALLOWED_REQUESTS - Static variable in class de.gerdiproject.harvest.scheduler.constants.SchedulerConstants
 
ALLOWED_VALUES - Static variable in class de.gerdiproject.harvest.config.parameters.constants.ParameterConstants
 
andThen(Procedure) - Method in interface de.gerdiproject.harvest.utils.Procedure
Runs a specified Procedure after this one.
ApplicationConstants - Class in de.gerdiproject.harvest.application.constants
This static class is a collection of constants that are used for ContextListeners and application related classes.

B

BASIC_AUTH_PREFIX - Static variable in class de.gerdiproject.harvest.etls.loaders.constants.ElasticSearchConstants
 
BASIC_PARAMETER_FORMAT - Static variable in class de.gerdiproject.harvest.config.constants.ConfigurationConstants
 
BATCH_DELETE_INSTRUCTION - Static variable in class de.gerdiproject.harvest.etls.loaders.constants.ElasticSearchConstants
 
BATCH_INDEX_INSTRUCTION - Static variable in class de.gerdiproject.harvest.etls.loaders.constants.ElasticSearchConstants
 
batchMap - Variable in class de.gerdiproject.harvest.etls.loaders.AbstractURLLoader
 
BOOLEAN_ALLOWED_VALUES - Static variable in class de.gerdiproject.harvest.config.parameters.constants.ParameterConstants
 
BOOLEAN_VALID_VALUES_LIST - Static variable in class de.gerdiproject.harvest.config.parameters.constants.ParameterConstants
 
BooleanParameter - Class in de.gerdiproject.harvest.config.parameters
This parameter represents a boolean flag.
BooleanParameter(String, String, boolean, Function<String, Boolean>) - Constructor for class de.gerdiproject.harvest.config.parameters.BooleanParameter
Constructor that uses a custom mapping function.
BooleanParameter(String, String, boolean) - Constructor for class de.gerdiproject.harvest.config.parameters.BooleanParameter
Constructor that uses the default mapping function.
BULK_SUBMISSION_URL_SUFFIX - Static variable in class de.gerdiproject.harvest.etls.loaders.constants.ElasticSearchConstants
 
BUSY_ERROR_MESSAGE - Static variable in class de.gerdiproject.harvest.etls.constants.ETLConstants
 
BUSY_HARVESTING - Static variable in class de.gerdiproject.harvest.etls.constants.ETLConstants
 

C

CACHE_DIR_JETTY - Static variable in class de.gerdiproject.harvest.application.constants.ApplicationConstants
 
CACHE_DIR_OTHER - Static variable in class de.gerdiproject.harvest.application.constants.ApplicationConstants
 
CACHE_DIR_UNIT_TESTS - Static variable in class de.gerdiproject.harvest.application.constants.ApplicationConstants
 
CACHE_ENTRY_STREAM_PATH - Static variable in class de.gerdiproject.harvest.utils.file.constants.FileConstants
 
CACHE_FOLDER_PATH - Static variable in class de.gerdiproject.harvest.utils.data.constants.DataOperationConstants
 
CACHE_FOLDER_PATH - Static variable in class de.gerdiproject.harvest.utils.file.constants.FileConstants
 
CACHE_PATH - Static variable in class de.gerdiproject.harvest.scheduler.constants.SchedulerConstants
 
CACHE_ROOT_DIR_OTHER - Static variable in class de.gerdiproject.harvest.application.constants.ApplicationConstants
 
cancel(boolean) - Method in class de.gerdiproject.harvest.utils.CancelableFuture
 
CancelableFuture<T> - Class in de.gerdiproject.harvest.utils
An extension of CompletableFuture with the option to cancel a running task.
CancelableFuture(Callable<T>, ExecutorService) - Constructor for class de.gerdiproject.harvest.utils.CancelableFuture
Creates a new CancelableFuture which will be completed by calling the given Callable via the provided ExecutorService.
CancelableFuture(Callable<T>) - Constructor for class de.gerdiproject.harvest.utils.CancelableFuture
Creates a new CancelableFuture which will be completed by calling the given Callable via the provided ExecutorService.
cancelHarvest() - Method in class de.gerdiproject.harvest.etls.AbstractETL
Cancels the ETL if it is queued to harvest, cleaning up readers and writers if necessary.
canEqual(Object) - Method in class de.gerdiproject.harvest.etls.events.HarvestFinishedEvent
 
canEqual(Object) - Method in class de.gerdiproject.harvest.etls.json.ETLInfosJson
 
CANNOT_CHANGE_PARAM - Static variable in class de.gerdiproject.harvest.config.parameters.constants.ParameterConstants
 
CANNOT_FIX_INVALID_DOCUMENT_ERROR - Static variable in class de.gerdiproject.harvest.etls.loaders.constants.ElasticSearchConstants
 
CANNOT_PROCESS_PREFIX - Static variable in class de.gerdiproject.harvest.rest.constants.RestConstants
 
category - Variable in class de.gerdiproject.harvest.config.parameters.AbstractParameter
 
CATEGORY_FORMAT - Static variable in class de.gerdiproject.harvest.config.constants.ConfigurationConstants
 
ChangeConfigurationRequest - Class in de.gerdiproject.harvest.config.json
This class represents a JSON object used for changing the Configuration.
ChangeConfigurationRequest() - Constructor for class de.gerdiproject.harvest.config.json.ChangeConfigurationRequest
 
CHANGED_PARAM - Static variable in class de.gerdiproject.harvest.config.parameters.constants.ParameterConstants
 
changeObject(Function<P, R>, String, Class<P>) - Method in class de.gerdiproject.harvest.rest.AbstractRestResource
Parses the required JSON object from a specified string and calls a string returning function using the parsed object as argument.
changeParameters(Map<String, String>) - Method in class de.gerdiproject.harvest.config.Configuration
Changes multiple parameters, returning a status message about the change.
ChangeSchedulerRequest - Class in de.gerdiproject.harvest.scheduler.json
This JSON object represents a REST request that can delete/add/change a crontab of the Scheduler.
ChangeSchedulerRequest(String) - Constructor for class de.gerdiproject.harvest.scheduler.json.ChangeSchedulerRequest
 
charset - Variable in class de.gerdiproject.harvest.etls.loaders.AbstractURLLoader
 
checkIfEtlIssOutdated() - Method in class de.gerdiproject.harvest.etls.rest.ETLRestResource
Checks if the harvester should be triggered again.
checkPreconditionErrors() - Method in class de.gerdiproject.harvest.etls.loaders.AbstractURLLoader
Checks if the loader can start
CLEAN_LOAD_ERROR - Static variable in class de.gerdiproject.harvest.etls.loaders.constants.LoaderConstants
 
clear() - Method in interface de.gerdiproject.harvest.etls.extractors.IExtractor
Closes potentially open readers/writers and finishes the Extraction process if it is still ongoing.
clear() - Method in class de.gerdiproject.harvest.etls.extractors.JsonArrayExtractor
 
clear() - Method in class de.gerdiproject.harvest.etls.loaders.AbstractURLLoader
 
clear() - Method in class de.gerdiproject.harvest.etls.loaders.DiskLoader
Attempts to close the writer.
clear() - Method in interface de.gerdiproject.harvest.etls.loaders.ILoader
Closes potentially open readers/writers and finishes the Load process if it is still ongoing.
clear() - Method in interface de.gerdiproject.harvest.etls.transformers.ITransformer
Closes potentially open readers/writers and finishes the Transformation process if it is still ongoing.
clearLog() - Method in class de.gerdiproject.harvest.utils.logger.HarvesterLog
Deletes the log file.
compare(TimestampedEntry<?>, TimestampedEntry<?>) - Method in class de.gerdiproject.harvest.etls.utils.TimestampedEntryComparator
 
compose(Procedure) - Method in interface de.gerdiproject.harvest.utils.Procedure
Runs a specified Procedure before this one.
COMPOSITE_KEY - Static variable in class de.gerdiproject.harvest.config.parameters.constants.ParameterConstants
 
CONCURRENT_PARAM - Static variable in class de.gerdiproject.harvest.etls.constants.ETLConstants
 
CONFIG_FOLDER_PATH - Static variable in class de.gerdiproject.harvest.utils.file.constants.FileConstants
 
CONFIG_PATH - Static variable in class de.gerdiproject.harvest.config.constants.ConfigurationConstants
 
Configuration - Class in de.gerdiproject.harvest.config
This class manages all application AbstractParameters.
Configuration(String, AbstractParameter<?>...) - Constructor for class de.gerdiproject.harvest.config.Configuration
Constructor that requires a list of parameters.
ConfigurationAdapter - Class in de.gerdiproject.harvest.config.json.adapters
This adapter defines the (de-)serialization behavior of Configuration objects.
ConfigurationAdapter() - Constructor for class de.gerdiproject.harvest.config.json.adapters.ConfigurationAdapter
 
ConfigurationConstants - Class in de.gerdiproject.harvest.config.constants
This static class is a collection of constants, commonly used for classes that deal with the Configuration.
ConfigurationRestResource - Class in de.gerdiproject.harvest.config.rest
This facade serves as an interface between REST and the Configuration.
ConfigurationRestResource() - Constructor for class de.gerdiproject.harvest.config.rest.ConfigurationRestResource
Constructor
CONTEXT_DESTROYED - Static variable in class de.gerdiproject.harvest.application.constants.ApplicationConstants
 
CONTEXT_RESET - Static variable in class de.gerdiproject.harvest.application.constants.ApplicationConstants
 
contextDestroyed(ServletContextEvent) - Method in class de.gerdiproject.harvest.application.ContextListener
This method is called when the server shuts down.
ContextDestroyedEvent - Class in de.gerdiproject.harvest.application.events
This event is fired when the WAR file of this harvester service is undeployed from a server.
ContextDestroyedEvent() - Constructor for class de.gerdiproject.harvest.application.events.ContextDestroyedEvent
 
contextInitialized(ServletContextEvent) - Method in class de.gerdiproject.harvest.application.ContextListener
This method is called when the server is set up.
ContextInitializedEvent - Class in de.gerdiproject.harvest.application.events
This event is fired when the WAR file of this harvester service is deployed on a server.
ContextInitializedEvent() - Constructor for class de.gerdiproject.harvest.application.events.ContextInitializedEvent
 
ContextListener - Class in de.gerdiproject.harvest.application
This class registers a Logger and Harvester when the server is started.
ContextListener() - Constructor for class de.gerdiproject.harvest.application.ContextListener
 
copy() - Method in class de.gerdiproject.harvest.config.parameters.AbstractParameter
Creates an unregistered copy of this parameter.
copy() - Method in class de.gerdiproject.harvest.config.parameters.BooleanParameter
 
copy() - Method in class de.gerdiproject.harvest.config.parameters.IntegerParameter
 
copy() - Method in class de.gerdiproject.harvest.config.parameters.PasswordParameter
 
copy() - Method in class de.gerdiproject.harvest.config.parameters.StringParameter
 
COPY_FILE_FAILED - Static variable in class de.gerdiproject.harvest.utils.file.constants.FileConstants
 
COPY_FILE_FAILED_NO_FILE - Static variable in class de.gerdiproject.harvest.utils.file.constants.FileConstants
 
COPY_FILE_SUCCESS - Static variable in class de.gerdiproject.harvest.utils.file.constants.FileConstants
 
copyFile(File, File) - Static method in class de.gerdiproject.harvest.utils.file.FileUtils
Copies a single file to a target destination and logs any errors.
CREATE_DIR_FAILED - Static variable in class de.gerdiproject.harvest.utils.file.constants.FileConstants
 
CREATE_DIR_SUCCESS - Static variable in class de.gerdiproject.harvest.utils.file.constants.FileConstants
 
CREATE_FILE_FAILED - Static variable in class de.gerdiproject.harvest.utils.file.constants.FileConstants
 
CREATE_FILE_SUCCESS - Static variable in class de.gerdiproject.harvest.utils.file.constants.FileConstants
 
createAcceptedResponse(String) - Static method in class de.gerdiproject.harvest.rest.HttpResponseFactory
Creates a HTTP-202 response for signalling that a process was started.
createBadRequestResponse() - Static method in class de.gerdiproject.harvest.rest.HttpResponseFactory
Creates a HTTP-400 response with "N/A" as message.
createBadRequestResponse(String) - Static method in class de.gerdiproject.harvest.rest.HttpResponseFactory
Creates a HTTP-400 response with a specified message.
createBusyResponse(String, long) - Static method in class de.gerdiproject.harvest.rest.HttpResponseFactory
Creates a response, replying that the service is not available at the moment.
createClassNameListMapper(Collection<Class<?>>) - Static method in class de.gerdiproject.harvest.config.parameters.constants.ParameterMappingFunctions
Creates a mapping function that forwards an input string if it is a simple class name of a specified collection.
createDirectories(File) - Static method in class de.gerdiproject.harvest.utils.file.FileUtils
Attempts to create all directories of a given directory path.
createEmptyFile(File) - Static method in class de.gerdiproject.harvest.utils.file.FileUtils
Creates a new cache file, replacing any file that already exists.
createETLs() - Method in class de.gerdiproject.harvest.application.ContextListener
Creates a list of AbstractETL implementations that can be chosen to extract, transform and load data from the targeted repository.
createExtractor() - Method in class de.gerdiproject.harvest.etls.AbstractETL
Creates an IExtractor for retrieving elements from the harvested repository to be used by the ITransformer.
createExtractor() - Method in class de.gerdiproject.harvest.etls.StaticIteratorETL
 
createFubarResponse() - Static method in class de.gerdiproject.harvest.rest.HttpResponseFactory
Creates a HTTP-500 response for the case that the service is broken beyond all repair.
createInitResponse() - Static method in class de.gerdiproject.harvest.rest.HttpResponseFactory
Creates a HTTP-503 response that should be returned during the initialization state of the harvester.
createKnownErrorResponse(String) - Static method in class de.gerdiproject.harvest.rest.HttpResponseFactory
Creates a HTTP-500 response for a known but unexpected server error.
createLoader() - Method in class de.gerdiproject.harvest.etls.AbstractETL
Creates an ILoader for sending the harvested documents to a search index.
CreateLoaderEvent - Class in de.gerdiproject.harvest.etls.loaders.events
This event aims to instantiate an ILoader.
CreateLoaderEvent() - Constructor for class de.gerdiproject.harvest.etls.loaders.events.CreateLoaderEvent
 
createMapperForETL(Function<String, V>, AbstractETL<?, ?>) - Static method in class de.gerdiproject.harvest.config.parameters.constants.ParameterMappingFunctions
Creates a mapping function that executes another mapping function while throwing an exception if a specified ETL is currently busy.
createMapperForETLs(Function<String, V>) - Static method in class de.gerdiproject.harvest.config.parameters.constants.ParameterMappingFunctions
Creates a mapping function that executes another mapping function while throwing an exception if any ETL is currently busy.
createMethodNotAllowedResponse() - Static method in class de.gerdiproject.harvest.rest.HttpResponseFactory
Creates a HTTP-405 response.
createOkResponse(Object) - Static method in class de.gerdiproject.harvest.rest.HttpResponseFactory
Creates a HTTP-200 message with a specified entity.
createPlainTextOkResponse(String) - Static method in class de.gerdiproject.harvest.rest.HttpResponseFactory
Creates a HTTP-200 plain text response.
createServerErrorResponse() - Static method in class de.gerdiproject.harvest.rest.HttpResponseFactory
Creates an error message depending on the current state of the harvester.
createStringListMapper(Collection<String>) - Static method in class de.gerdiproject.harvest.config.parameters.constants.ParameterMappingFunctions
Creates a mapping function that forwards input string values to the output only if they are in a collection of valid values or if the input values are null.
createSynchronousEventResponse(ISynchronousEvent<?>) - Static method in class de.gerdiproject.harvest.rest.HttpResponseFactory
Creates a server response for an ISynchronousEvent.
createTargetFile(String) - Method in class de.gerdiproject.harvest.etls.loaders.DiskLoader
Returns the file to which the documents are saved.
createTransformer() - Method in class de.gerdiproject.harvest.etls.AbstractETL
Creates an ITransformer for transforming source elements to documents that can be used by the ILoader.
createTransformer() - Method in class de.gerdiproject.harvest.etls.StaticIteratorETL
 
createUnknownErrorResponse() - Static method in class de.gerdiproject.harvest.rest.HttpResponseFactory
Creates a HTTP-500 response for unknown server errors.
createValueResponse(Response.Status, JsonElement) - Static method in class de.gerdiproject.harvest.rest.HttpResponseFactory
Creates a response with a specified status code and entity.
CronConstants - Class in de.gerdiproject.harvest.scheduler.constants
This class offers constants that are used for parsing cron tabs.
CronMonth - Enum in de.gerdiproject.harvest.scheduler.enums
This enumeration represents month names as they appear in cron tabs.
CronParser - Class in de.gerdiproject.harvest.scheduler.utils
This class provides static functions for parsing cron tabs.
CronUtils - Class in de.gerdiproject.harvest.scheduler.utils
This class contains static utility functions that work on cron tabs and cron related date.
CronWeekDay - Enum in de.gerdiproject.harvest.scheduler.enums
This enumeration represents week days as they appear in cron tabs.

D

DataOperationConstants - Class in de.gerdiproject.harvest.utils.data.constants
This static class contains constants for the HttpRequester and related classes.
DATE_RANGE_REGEX - Static variable in class de.gerdiproject.harvest.etls.loaders.constants.ElasticSearchConstants
 
DATE_RANGE_REPLACEMENT - Static variable in class de.gerdiproject.harvest.etls.loaders.constants.ElasticSearchConstants
 
DATE_REGEX - Static variable in class de.gerdiproject.harvest.etls.loaders.constants.ElasticSearchConstants
 
DATE_REPLACEMENT - Static variable in class de.gerdiproject.harvest.etls.loaders.constants.ElasticSearchConstants
 
DAYS_MAX_CRON - Static variable in class de.gerdiproject.harvest.scheduler.constants.CronConstants
 
DAYS_MIN_CRON - Static variable in class de.gerdiproject.harvest.scheduler.constants.CronConstants
 
de.gerdiproject.harvest.application - package de.gerdiproject.harvest.application
This package contains classes and packages that are related to server and application settings.
de.gerdiproject.harvest.application.constants - package de.gerdiproject.harvest.application.constants
This package contains application wide constants.
de.gerdiproject.harvest.application.enums - package de.gerdiproject.harvest.application.enums
This package contains enumerations that are related to the application in general.
de.gerdiproject.harvest.application.events - package de.gerdiproject.harvest.application.events
This package contains application specific events.
de.gerdiproject.harvest.config - package de.gerdiproject.harvest.config
This package contains classes and packages that are related to the global harvester Configuration.
de.gerdiproject.harvest.config.constants - package de.gerdiproject.harvest.config.constants
This package contains static classes of constants concerning the Configuration.
de.gerdiproject.harvest.config.events - package de.gerdiproject.harvest.config.events
This package contains sub-classes of IEvent that are related to the harvester configuration and parameters.
de.gerdiproject.harvest.config.json - package de.gerdiproject.harvest.config.json
This package contains JSON objects related to the Configuration.
de.gerdiproject.harvest.config.json.adapters - package de.gerdiproject.harvest.config.json.adapters
This package contains GSON JsonSerializers and JsonDeserializers for parsing and writing JSON objects that are related to the configuration and parameters.
de.gerdiproject.harvest.config.parameters - package de.gerdiproject.harvest.config.parameters
This package contains classes of parameters that are used by the Configuration and the AbstractETL.
de.gerdiproject.harvest.config.parameters.constants - package de.gerdiproject.harvest.config.parameters.constants
This package contains constants and static method collections concerning AbstractParameters.
de.gerdiproject.harvest.config.rest - package de.gerdiproject.harvest.config.rest
This package contains facades that map incoming REST requests to internal functions concerning the Configuration.
de.gerdiproject.harvest.etls - package de.gerdiproject.harvest.etls
This package contains classes and packages that are related to the AbstractETL and its sub-classes.
de.gerdiproject.harvest.etls.adapters - package de.gerdiproject.harvest.etls.adapters
This package contains JSON (de-) serializers concerning AbstractETLs.
de.gerdiproject.harvest.etls.constants - package de.gerdiproject.harvest.etls.constants
This package contains static classes of constants concerning AbstractETLs.
de.gerdiproject.harvest.etls.enums - package de.gerdiproject.harvest.etls.enums
This package contains enumerations regarding AbstractETLs.
de.gerdiproject.harvest.etls.events - package de.gerdiproject.harvest.etls.events
This package contains sub-classes of IEvent that are related to the harvesting-process.
de.gerdiproject.harvest.etls.extractors - package de.gerdiproject.harvest.etls.extractors
This package contains constants concerning IExtractor components.
de.gerdiproject.harvest.etls.json - package de.gerdiproject.harvest.etls.json
This package contains JSON objects of AbstractETLs and related classes.
de.gerdiproject.harvest.etls.loaders - package de.gerdiproject.harvest.etls.loaders
This package contains classes concerning ILoaders.
de.gerdiproject.harvest.etls.loaders.constants - package de.gerdiproject.harvest.etls.loaders.constants
This package contains constants concerning ILoader components.
de.gerdiproject.harvest.etls.loaders.events - package de.gerdiproject.harvest.etls.loaders.events
This package contains sub-classes of IEvent that are related to ILoaders.
de.gerdiproject.harvest.etls.loaders.json - package de.gerdiproject.harvest.etls.loaders.json
This package contains JSON objects concerning ILoaders.
de.gerdiproject.harvest.etls.loaders.utils - package de.gerdiproject.harvest.etls.loaders.utils
This package contains utility classes concerning ILoaders.
de.gerdiproject.harvest.etls.rest - package de.gerdiproject.harvest.etls.rest
This package contains facades that map incoming REST requests to internal functions concerning the AbstractETL.
de.gerdiproject.harvest.etls.transformers - package de.gerdiproject.harvest.etls.transformers
This package contains classes concerning the ITransformer.
de.gerdiproject.harvest.etls.utils - package de.gerdiproject.harvest.etls.utils
This package contains utility classes concerning AbstractETLs.
de.gerdiproject.harvest.event - package de.gerdiproject.harvest.event
This package contains classes and packages that are related to the EventSystem.
de.gerdiproject.harvest.rest - package de.gerdiproject.harvest.rest
This package contains generic classes used by HTTP requests.
de.gerdiproject.harvest.rest.constants - package de.gerdiproject.harvest.rest.constants
This package contains constants classes regarding REST requests.
de.gerdiproject.harvest.rest.events - package de.gerdiproject.harvest.rest.events
This package contains Events concerning HTTP requests.
de.gerdiproject.harvest.scheduler - package de.gerdiproject.harvest.scheduler
This package contains classes for setting up a schedule for the harvester.
de.gerdiproject.harvest.scheduler.constants - package de.gerdiproject.harvest.scheduler.constants
This package contains constants classes that are used by the Scheduler and related classes.
de.gerdiproject.harvest.scheduler.enums - package de.gerdiproject.harvest.scheduler.enums
This package contains enumerations that are used for parsing cron fields.
de.gerdiproject.harvest.scheduler.events - package de.gerdiproject.harvest.scheduler.events
This package contains events that modify the Scheduler.
de.gerdiproject.harvest.scheduler.json - package de.gerdiproject.harvest.scheduler.json
This package contains JSON classes related to the Scheduler.
de.gerdiproject.harvest.scheduler.rest - package de.gerdiproject.harvest.scheduler.rest
This package contains REST interface classes for setting the Scheduler.
de.gerdiproject.harvest.scheduler.utils - package de.gerdiproject.harvest.scheduler.utils
This package contains utility classes that deal with cron and scheduling related problems.
de.gerdiproject.harvest.utils - package de.gerdiproject.harvest.utils
This package contains classes and packages that provide utilities, tools, and helper functions.
de.gerdiproject.harvest.utils.data - package de.gerdiproject.harvest.utils.data
This package contains classes for reading and writing data to- and from disk, as well as classes for retrieving data from the web.
de.gerdiproject.harvest.utils.data.constants - package de.gerdiproject.harvest.utils.data.constants
This package contains static classes of constants concerning the retrieval of data from the web and from disk.
de.gerdiproject.harvest.utils.data.enums - package de.gerdiproject.harvest.utils.data.enums
This package contains enumerations of data retrieval utilities.
de.gerdiproject.harvest.utils.file - package de.gerdiproject.harvest.utils.file
This package contains constants classes for manipulating files.
de.gerdiproject.harvest.utils.file.constants - package de.gerdiproject.harvest.utils.file.constants
This package contains static classes of constants concerning file operations.
de.gerdiproject.harvest.utils.logger - package de.gerdiproject.harvest.utils.logger
This package contains constants related to HarvesterLog and logging in general.
de.gerdiproject.harvest.utils.logger.constants - package de.gerdiproject.harvest.utils.logger.constants
This package contains constants that are related to Loggers.
de.gerdiproject.harvest.utils.logger.events - package de.gerdiproject.harvest.utils.logger.events
This package contains events that concern logging.
de.gerdiproject.harvest.utils.maven - package de.gerdiproject.harvest.utils.maven
This package contains utility classes for retrieving Maven related information.
de.gerdiproject.harvest.utils.maven.constants - package de.gerdiproject.harvest.utils.maven.constants
This package contains Maven related constants.
de.gerdiproject.harvest.utils.maven.events - package de.gerdiproject.harvest.utils.maven.events
This package contains events that concern Maven utilities.
DEBUG_CATEGORY - Static variable in class de.gerdiproject.harvest.config.constants.ConfigurationConstants
 
dedicatedEtl - Variable in class de.gerdiproject.harvest.etls.loaders.AbstractIteratorLoader
 
DEFAULT_GERDI_NAMESPACE - Static variable in class de.gerdiproject.harvest.utils.maven.constants.MavenConstants
 
DEFAULT_LOG_LEVEL - Static variable in class de.gerdiproject.harvest.utils.logger.constants.LoggerConstants
 
DELETE_ALL - Static variable in class de.gerdiproject.harvest.scheduler.constants.SchedulerConstants
 
DELETE_FAILED - Static variable in class de.gerdiproject.harvest.scheduler.constants.SchedulerConstants
 
DELETE_FILE_FAILED - Static variable in class de.gerdiproject.harvest.utils.file.constants.FileConstants
 
DELETE_FILE_SUCCESS - Static variable in class de.gerdiproject.harvest.utils.file.constants.FileConstants
 
DELETE_OK - Static variable in class de.gerdiproject.harvest.scheduler.constants.SchedulerConstants
 
deleteAllTasks() - Method in class de.gerdiproject.harvest.scheduler.rest.SchedulerRestResource
Deletes a harvesting task with a specified cron tab from the schedule.
deleteAllTasks() - Method in class de.gerdiproject.harvest.scheduler.Scheduler
Deletes all tasks.
deleteFile(File) - Static method in class de.gerdiproject.harvest.utils.file.FileUtils
Attempts to delete a file from disk if it exists and logs any errors.
deleteTask(String) - Method in class de.gerdiproject.harvest.scheduler.rest.SchedulerRestResource
Deletes a harvesting task with a specified cron tab from the schedule.
deleteTask(ChangeSchedulerRequest) - Method in class de.gerdiproject.harvest.scheduler.Scheduler
This method deletes a single crontab.
DEPENDENCY_LIST_FORMAT - Static variable in class de.gerdiproject.harvest.utils.maven.constants.MavenConstants
 
DEPLOYMENT_TYPE - Static variable in class de.gerdiproject.harvest.application.constants.ApplicationConstants
 
DeploymentType - Enum in de.gerdiproject.harvest.application.enums
This enumeration depicts how the harvester service is being deployed.
deserialize(JsonElement, Type, JsonDeserializationContext) - Method in class de.gerdiproject.harvest.config.json.adapters.ConfigurationAdapter
 
deserialize(JsonElement, Type, JsonDeserializationContext) - Method in class de.gerdiproject.harvest.etls.adapters.ETLJsonAdapter
 
destroy() - Static method in class de.gerdiproject.harvest.application.MainContext
Clears the current Singleton instance if it exists and nullifies it.
DIR_MERGE_FAILED - Static variable in class de.gerdiproject.harvest.utils.file.constants.FileConstants
 
DIR_MERGE_FAILED_NO_SOURCE_DIR - Static variable in class de.gerdiproject.harvest.utils.file.constants.FileConstants
 
DIR_MERGE_FAILED_NOT_DIRS - Static variable in class de.gerdiproject.harvest.utils.file.constants.FileConstants
 
DIR_MERGE_SUCCESS - Static variable in class de.gerdiproject.harvest.utils.file.constants.FileConstants
 
DiskIO - Class in de.gerdiproject.harvest.utils.data
This class provides methods for reading files from disk.
DiskIO(Gson, Charset) - Constructor for class de.gerdiproject.harvest.utils.data.DiskIO
Constructor that sets the GSON (de-)serializer for reading and writing JSON objects.
DiskIO(DiskIO) - Constructor for class de.gerdiproject.harvest.utils.data.DiskIO
Constructor that copies over settings from another DiskIO.
DiskLoader - Class in de.gerdiproject.harvest.etls.loaders
This class offers functions for saving a harvest result to disk.
DiskLoader() - Constructor for class de.gerdiproject.harvest.etls.loaders.DiskLoader
Constructor that sets the parser and save folder.
DiskLoaderConstants - Class in de.gerdiproject.harvest.etls.loaders.constants
This static class is a collection of constants that are used by the DiskLoader.
DOCUMENT_TOO_LARGE - Static variable in class de.gerdiproject.harvest.etls.loaders.constants.LoaderConstants
 
DOCUMENTS_JSON - Static variable in class de.gerdiproject.harvest.etls.loaders.constants.DiskLoaderConstants
 
DOCUMENTS_RESUBMIT - Static variable in class de.gerdiproject.harvest.etls.loaders.constants.ElasticSearchConstants
 
DUPLICATE_ETL_REGISTERED_ERROR - Static variable in class de.gerdiproject.harvest.etls.constants.ETLConstants
 

E

ElasticSearchConstants - Class in de.gerdiproject.harvest.etls.loaders.constants
This static class is a collection of constants that are related to the ElasticSearchLoader.
ElasticSearchError - Class in de.gerdiproject.harvest.etls.loaders.json
This JSON object is part of an ElasticSearch submission response if an error appears.
ElasticSearchError(String, String, ElasticSearchErrorCause) - Constructor for class de.gerdiproject.harvest.etls.loaders.json.ElasticSearchError
 
ElasticSearchErrorCause - Class in de.gerdiproject.harvest.etls.loaders.json
This JSON object is part of an ElasticSearch submission response if an error appears.
ElasticSearchErrorCause(String, String) - Constructor for class de.gerdiproject.harvest.etls.loaders.json.ElasticSearchErrorCause
 
ElasticSearchIndex - Class in de.gerdiproject.harvest.etls.loaders.json
This JSON object is part of an ElasticSearch submission response.
ElasticSearchIndex(String, String, String, int, ElasticSearchShard, String, String, boolean, ElasticSearchError) - Constructor for class de.gerdiproject.harvest.etls.loaders.json.ElasticSearchIndex
 
ElasticSearchIndexWrapper - Class in de.gerdiproject.harvest.etls.loaders.json
This JSON object is part of an ElasticSearch submission response.
ElasticSearchIndexWrapper(ElasticSearchIndex) - Constructor for class de.gerdiproject.harvest.etls.loaders.json.ElasticSearchIndexWrapper
 
ElasticSearchLoader - Class in de.gerdiproject.harvest.etls.loaders
This class serves as a communicator for an Elastic Search node.
ElasticSearchLoader() - Constructor for class de.gerdiproject.harvest.etls.loaders.ElasticSearchLoader
Constructor that initializes a Json parser for server responses.
ElasticSearchResponse - Class in de.gerdiproject.harvest.etls.loaders.json
This JSON object represents the response of an ElasticSearch submission.
ElasticSearchResponse(int, boolean, List<ElasticSearchIndexWrapper>) - Constructor for class de.gerdiproject.harvest.etls.loaders.json.ElasticSearchResponse
 
ElasticSearchShard - Class in de.gerdiproject.harvest.etls.loaders.json
This JSON object is part of an ElasticSearch submission response.
ElasticSearchShard(int, int, int) - Constructor for class de.gerdiproject.harvest.etls.loaders.json.ElasticSearchShard
 
elementsToList(Collection<Element>, Function<Element, T>) - Static method in class de.gerdiproject.harvest.utils.HtmlUtils
Applies a specified mapping function to every Element of a Collection, to generate a List of mapped objects.
elementsToStringList(Collection<Element>) - Static method in class de.gerdiproject.harvest.utils.HtmlUtils
Maps a Collection of Elements to a List of Strings by retrieving the text of the Elements.
EMPTY_DATE_RANGE_REGEX - Static variable in class de.gerdiproject.harvest.etls.loaders.constants.ElasticSearchConstants
 
EMPTY_DATE_RANGE_REPLACEMENT - Static variable in class de.gerdiproject.harvest.etls.loaders.constants.ElasticSearchConstants
 
ENABLED_PARAM - Static variable in class de.gerdiproject.harvest.etls.constants.ETLConstants
 
enabledParameter - Variable in class de.gerdiproject.harvest.etls.AbstractETL
 
END_INDEX_PARAM_DEFAULT_VALUE - Static variable in class de.gerdiproject.harvest.etls.constants.ETLConstants
 
END_INDEX_PARAM_KEY - Static variable in class de.gerdiproject.harvest.etls.constants.ETLConstants
 
endIndex - Variable in class de.gerdiproject.harvest.etls.extractors.AbstractIteratorExtractor
 
endIndexParameter - Variable in class de.gerdiproject.harvest.etls.AbstractIteratorETL
 
ENTRY_STREAM_WRITE_ERROR - Static variable in class de.gerdiproject.harvest.utils.file.constants.FileConstants
 
ENVIRONMENT_VARIABLE - Static variable in class de.gerdiproject.harvest.config.parameters.constants.ParameterConstants
 
ENVIRONMENT_VARIABLE_SET_START - Static variable in class de.gerdiproject.harvest.config.constants.ConfigurationConstants
 
equals(Object) - Method in class de.gerdiproject.harvest.application.MainContext
 
equals(Object) - Method in class de.gerdiproject.harvest.config.events.ParameterChangedEvent
 
equals(Object) - Method in class de.gerdiproject.harvest.config.events.RegisterParameterEvent
 
equals(Object) - Method in class de.gerdiproject.harvest.config.events.UnregisterParameterEvent
 
equals(Object) - Method in class de.gerdiproject.harvest.etls.events.HarvestFinishedEvent
 
equals(Object) - Method in class de.gerdiproject.harvest.etls.events.HarvestStartedEvent
 
equals(Object) - Method in class de.gerdiproject.harvest.etls.json.ETLInfosJson
 
equals(Object) - Method in class de.gerdiproject.harvest.etls.json.ETLJson
 
equals(Object) - Method in class de.gerdiproject.harvest.etls.json.ETLManagerJson
 
equals(Object) - Method in class de.gerdiproject.harvest.etls.loaders.json.ElasticSearchError
 
equals(Object) - Method in class de.gerdiproject.harvest.etls.loaders.json.ElasticSearchErrorCause
 
equals(Object) - Method in class de.gerdiproject.harvest.etls.loaders.json.ElasticSearchIndex
 
equals(Object) - Method in class de.gerdiproject.harvest.etls.loaders.json.ElasticSearchIndexWrapper
 
equals(Object) - Method in class de.gerdiproject.harvest.etls.loaders.json.ElasticSearchResponse
 
equals(Object) - Method in class de.gerdiproject.harvest.etls.loaders.json.ElasticSearchShard
 
equals(Object) - Method in class de.gerdiproject.harvest.etls.utils.TimestampedEntry
 
equals(Object) - Method in class de.gerdiproject.harvest.scheduler.events.ScheduledTaskExecutedEvent
 
equals(Object) - Method in class de.gerdiproject.harvest.scheduler.json.ChangeSchedulerRequest
 
equals(Object) - Method in class de.gerdiproject.harvest.scheduler.json.SchedulerResponse
 
ERROR_ADD_ALREADY_EXISTS - Static variable in class de.gerdiproject.harvest.scheduler.constants.SchedulerConstants
 
ERROR_CANNOT_PARSE - Static variable in class de.gerdiproject.harvest.scheduler.constants.CronConstants
 
ERROR_CRON_FORMAT - Static variable in class de.gerdiproject.harvest.scheduler.constants.CronConstants
 
ERROR_LOAD - Static variable in class de.gerdiproject.harvest.scheduler.constants.SchedulerConstants
 
ERROR_NO_ENTRIES - Static variable in class de.gerdiproject.harvest.etls.constants.ETLConstants
 
ERROR_NO_MONTHS - Static variable in class de.gerdiproject.harvest.scheduler.constants.CronConstants
 
ERROR_OUT_OF_RANGE - Static variable in class de.gerdiproject.harvest.scheduler.constants.CronConstants
 
ERROR_PARSE_FREQUENCY - Static variable in class de.gerdiproject.harvest.scheduler.constants.CronConstants
 
ERROR_PARSE_RANGE - Static variable in class de.gerdiproject.harvest.scheduler.constants.CronConstants
 
ERROR_READING_LOG - Static variable in class de.gerdiproject.harvest.utils.logger.constants.LoggerConstants
 
ERROR_RESCHEDULE - Static variable in class de.gerdiproject.harvest.scheduler.constants.SchedulerConstants
 
ERROR_SET_NULL - Static variable in class de.gerdiproject.harvest.scheduler.constants.SchedulerConstants
 
estimateRemainingHarvestTime() - Method in class de.gerdiproject.harvest.etls.utils.ETLManager
Estimates the remaining harvesting duration in milliseconds.
estimateRemainingHarvestTime(long, ETLState, int, int) - Static method in class de.gerdiproject.harvest.etls.utils.EtlUtils
Estimates the remaining harvesting duration in milliseconds.
ETL_ABORTED - Static variable in class de.gerdiproject.harvest.etls.constants.ETLConstants
 
ETL_DISABLED - Static variable in class de.gerdiproject.harvest.etls.constants.ETLConstants
 
ETL_FAILED - Static variable in class de.gerdiproject.harvest.etls.constants.ETLConstants
 
ETL_FINISHED - Static variable in class de.gerdiproject.harvest.etls.constants.ETLConstants
 
ETL_INIT_FAILED - Static variable in class de.gerdiproject.harvest.etls.constants.ETLConstants
 
ETL_LOADING_FAILED - Static variable in class de.gerdiproject.harvest.etls.constants.ETLConstants
 
ETL_MANAGER_CACHE_PATH - Static variable in class de.gerdiproject.harvest.etls.constants.ETLConstants
 
ETL_MANAGER_LOAD_ERROR - Static variable in class de.gerdiproject.harvest.etls.constants.ETLConstants
 
ETL_MANAGER_LOADED - Static variable in class de.gerdiproject.harvest.etls.constants.ETLConstants
 
ETL_NAME_QUERY - Static variable in class de.gerdiproject.harvest.etls.constants.ETLConstants
 
ETL_NAME_QUERY_ERROR_EMPTY - Static variable in class de.gerdiproject.harvest.etls.constants.ETLConstants
 
ETL_NAME_QUERY_ERROR_UNKNOWN - Static variable in class de.gerdiproject.harvest.etls.constants.ETLConstants
 
ETL_PARAM_INVALID_STATE - Static variable in class de.gerdiproject.harvest.config.parameters.constants.ParameterConstants
 
ETL_PRETTY - Static variable in class de.gerdiproject.harvest.etls.constants.ETLConstants
 
ETL_PROCESSING_ERROR - Static variable in class de.gerdiproject.harvest.etls.constants.ETLConstants
 
ETL_REGISTRY_PARAM_INVALID_STATE - Static variable in class de.gerdiproject.harvest.config.parameters.constants.ParameterConstants
 
ETL_SKIPPED_DISABLED - Static variable in class de.gerdiproject.harvest.etls.constants.ETLConstants
 
ETL_SKIPPED_NO_CHANGES - Static variable in class de.gerdiproject.harvest.etls.constants.ETLConstants
 
ETL_SKIPPED_OUT_OF_RANGE - Static variable in class de.gerdiproject.harvest.etls.constants.ETLConstants
 
ETL_START_FAILED - Static variable in class de.gerdiproject.harvest.etls.constants.ETLConstants
 
ETL_STARTED - Static variable in class de.gerdiproject.harvest.etls.constants.ETLConstants
 
ETLConstants - Class in de.gerdiproject.harvest.etls.constants
This static class is a collection of constants that are used by harvesters.
ETLHealth - Enum in de.gerdiproject.harvest.etls.enums
This enumeration represents a simplified health status of the harvester service.
ETLInfosJson - Class in de.gerdiproject.harvest.etls.json
This class serves as the JSON representation of the ETLManager.
ETLInfosJson(ETLJson, List<AbstractETL<?, ?>>) - Constructor for class de.gerdiproject.harvest.etls.json.ETLInfosJson
Constructor that requires all fields.
ETLJson - Class in de.gerdiproject.harvest.etls.json
This class represents a JSON object containing details of an AbstractETL or the ETLManager.
ETLJson(String, List<TimestampedEntry<ETLState>>, List<TimestampedEntry<ETLHealth>>, int, int, String) - Constructor for class de.gerdiproject.harvest.etls.json.ETLJson
 
ETLJsonAdapter - Class in de.gerdiproject.harvest.etls.adapters
This adapter defines the (de-)serialization behavior of ETLJson objects.
ETLJsonAdapter() - Constructor for class de.gerdiproject.harvest.etls.adapters.ETLJsonAdapter
 
ETLManager - Class in de.gerdiproject.harvest.etls.utils
This class serves as an interface for all AbstractETLs that are required to harvest the repository.
ETLManager(String, File) - Constructor for class de.gerdiproject.harvest.etls.utils.ETLManager
Constructor.
ETLManagerJson - Class in de.gerdiproject.harvest.etls.json
This class represents a JSON object containing details of the ETLManager.
ETLManagerJson(String, ETLState, ETLHealth, int, Integer, Long, String, String, boolean) - Constructor for class de.gerdiproject.harvest.etls.json.ETLManagerJson
 
ETLPreconditionException - Exception in de.gerdiproject.harvest.etls
This exception signifies that a harvester has not started harvesting, because a pre-condition failed.
ETLPreconditionException(String) - Constructor for exception de.gerdiproject.harvest.etls.ETLPreconditionException
Constructor that requires a message.
ETLPreconditionException(Throwable) - Constructor for exception de.gerdiproject.harvest.etls.ETLPreconditionException
Constructor that requires another exception.
ETLPreconditionException(String, Throwable) - Constructor for exception de.gerdiproject.harvest.etls.ETLPreconditionException
Constructor that requires a message and another exception.
ETLRestResource - Class in de.gerdiproject.harvest.etls.rest
A facade for the harvester that serves as a RESTful interface.
ETLRestResource() - Constructor for class de.gerdiproject.harvest.etls.rest.ETLRestResource
 
ETLS_FAILED_UNKNOWN_ERROR - Static variable in class de.gerdiproject.harvest.etls.constants.ETLConstants
 
ETLState - Enum in de.gerdiproject.harvest.etls.enums
 
EtlUtils - Class in de.gerdiproject.harvest.etls.utils
This class contains static helper functions for processing multiple AbstractETLs.
EventSystem - Class in de.gerdiproject.harvest.event
This singleton class provides a means to dispatch and listen to IEvents.
extract() - Method in class de.gerdiproject.harvest.etls.extractors.AbstractIteratorExtractor
 
extract() - Method in interface de.gerdiproject.harvest.etls.extractors.IExtractor
Extracts elements from a source repository.
extractAll() - Method in class de.gerdiproject.harvest.etls.extractors.AbstractIteratorExtractor
This method extracts everything there is to extract.
extractAll() - Method in class de.gerdiproject.harvest.etls.extractors.JsonArrayExtractor
 
extractor - Variable in class de.gerdiproject.harvest.etls.AbstractETL
 
EXTRACTOR_CREATE_ERROR - Static variable in class de.gerdiproject.harvest.etls.constants.ETLConstants
 
ExtractorException - Exception in de.gerdiproject.harvest.etls.extractors
This exception is thrown when an IExtractor fails to extract elements.
ExtractorException(String) - Constructor for exception de.gerdiproject.harvest.etls.extractors.ExtractorException
Forwarded super-class constructor
ExtractorException(Throwable) - Constructor for exception de.gerdiproject.harvest.etls.extractors.ExtractorException
Constructor that forwards a super class constructor.
ExtractorException(String, Throwable) - Constructor for exception de.gerdiproject.harvest.etls.extractors.ExtractorException
Constructor that requires a message and another exception.

F

FEEDBACK_JSON - Static variable in class de.gerdiproject.harvest.rest.constants.RestConstants
 
FILE_PATH_PARAM - Static variable in class de.gerdiproject.harvest.etls.loaders.constants.DiskLoaderConstants
 
FileConstants - Class in de.gerdiproject.harvest.utils.file.constants
This static class is a collection of constants, used by file operations.
FileUtils - Class in de.gerdiproject.harvest.utils.file
A small class with helper functions that are used for file operations.
finishHarvestExceptionally(Throwable) - Method in class de.gerdiproject.harvest.etls.AbstractETL
This method is called after an ongoing harvest failed due to an exception.
FORCED_PARAM - Static variable in class de.gerdiproject.harvest.etls.constants.ETLConstants
 
formatHarvestTime(long) - Static method in class de.gerdiproject.harvest.etls.utils.EtlUtils
Creates a duration string out of a specified number of seconds

G

GET_UNKNOWN_PARAM_ERROR - Static variable in class de.gerdiproject.harvest.config.constants.ConfigurationConstants
 
getAllETLInfos() - Method in class de.gerdiproject.harvest.etls.rest.ETLRestResource
A HTTP GET request that returns a JSON representation of a all ETLs.
getAllowedRequests() - Method in class de.gerdiproject.harvest.config.rest.ConfigurationRestResource
 
getAllowedRequests() - Method in class de.gerdiproject.harvest.etls.rest.ETLRestResource
 
getAllowedRequests() - Method in class de.gerdiproject.harvest.rest.AbstractRestResource
This method returns a string that offers a description of viable HTTP requests.
getAllowedRequests() - Method in class de.gerdiproject.harvest.scheduler.rest.SchedulerRestResource
 
getAllVersions() - Method in class de.gerdiproject.harvest.etls.rest.ETLRestResource
Displays the artifactIds and versions of all Maven libraries used in this service.
getAsJson(MultivaluedMap<String, String>) - Method in class de.gerdiproject.harvest.config.Configuration
 
getAsJson() - Method in class de.gerdiproject.harvest.etls.AbstractETL
Returns a simplified JSON representation of the ETL.
getAsJson(MultivaluedMap<String, String>) - Method in class de.gerdiproject.harvest.etls.utils.ETLManager
 
getAsJson(MultivaluedMap<String, String>) - Method in class de.gerdiproject.harvest.rest.AbstractRestObject
Returns a JSON representation of this object.
getAsJson(MultivaluedMap<String, String>) - Method in class de.gerdiproject.harvest.scheduler.Scheduler
 
getAsPlainText() - Method in class de.gerdiproject.harvest.rest.AbstractRestObject
Returns a pretty print representation of this object along with a title.
getAttribute(Element, String) - Static method in class de.gerdiproject.harvest.utils.HtmlUtils
Retrieves an attribute value of an HTML Element.
getCacheFolder() - Method in class de.gerdiproject.harvest.application.MainContext
 
getCacheFolder() - Method in class de.gerdiproject.harvest.utils.data.HttpRequester
 
GetCacheFolderEvent - Class in de.gerdiproject.harvest.application.events
This event returns the root directory wherein all service generated files are stored.
GetCacheFolderEvent() - Constructor for class de.gerdiproject.harvest.application.events.GetCacheFolderEvent
 
getCategory() - Method in class de.gerdiproject.harvest.config.parameters.AbstractParameter
Retrieves the name of the category to which the parameter belongs.
getCausedBy() - Method in class de.gerdiproject.harvest.etls.loaders.json.ElasticSearchError
 
getCharset() - Method in class de.gerdiproject.harvest.etls.AbstractETL
Returns the charset of the harvested data.
getClasses() - Method in class de.gerdiproject.harvest.rest.RestResourceConfig
 
getCombinedHashes(Collection<AbstractETL<?, ?>>) - Static method in class de.gerdiproject.harvest.etls.utils.EtlUtils
Generates a combined hash over the concatenated hashes of a specified Collection of enabled AbstractETLs.
getCombinedHealth(Collection<AbstractETL<?, ?>>) - Static method in class de.gerdiproject.harvest.etls.utils.EtlUtils
Retrieves the combined health status of a specified Collection of AbstractETLs.
getCompositeKey() - Method in class de.gerdiproject.harvest.config.parameters.AbstractParameter
Returns a unique key consisting of the category and the parameter key.
getConfiguration() - Method in class de.gerdiproject.harvest.application.MainContext
 
GetConfigurationEvent - Class in de.gerdiproject.harvest.config.events
This event aims to retrieve the singleton Configuration.
GetConfigurationEvent() - Constructor for class de.gerdiproject.harvest.config.events.GetConfigurationEvent
 
getCredentials() - Method in class de.gerdiproject.harvest.etls.loaders.AbstractURLLoader
Retrieves the credentials that may be necessary for to authenticate the loader with the URL.
getCredentials() - Method in class de.gerdiproject.harvest.etls.loaders.ElasticSearchLoader
 
getCronTab() - Method in class de.gerdiproject.harvest.scheduler.json.ChangeSchedulerRequest
Returns the crontab that is to be changed.
getDaysInMonth(byte, int) - Static method in class de.gerdiproject.harvest.scheduler.utils.CronUtils
Calculates the amount of days of a month in a specified year.
getDeploymentType() - Method in class de.gerdiproject.harvest.application.MainContext
 
getDocumentChecksum() - Method in class de.gerdiproject.harvest.etls.events.HarvestFinishedEvent
Returns a hash value over all harvested documents.
getEndIndex() - Method in class de.gerdiproject.harvest.etls.AbstractIteratorETL
Returns the end index 'b' of the harvesting range [a,b).
getEndTimestamp() - Method in class de.gerdiproject.harvest.etls.events.HarvestFinishedEvent
Returns the unix timestamp at which the event was created.
getEnumAttribute(Element, String, Class<T>) - Static method in class de.gerdiproject.harvest.utils.HtmlUtils
Retrieves an attribute value of an HTML Element and attempts to map it to an Enum.
getError() - Method in class de.gerdiproject.harvest.etls.loaders.json.ElasticSearchIndex
 
getErrorText() - Method in class de.gerdiproject.harvest.etls.loaders.json.ElasticSearchIndex
Returns a human readable version of a possible error.
getETLAsJson(MultivaluedMap<String, String>) - Method in class de.gerdiproject.harvest.etls.utils.ETLManager
Returns a specified ETL as JSON object.
getETLInfo(UriInfo) - Method in class de.gerdiproject.harvest.etls.rest.ETLRestResource
A HTTP GET request that returns a JSON representation of a single ETL.
getEtlInfos() - Method in class de.gerdiproject.harvest.etls.json.ETLInfosJson
Returns a map of ETL names to ETLJsons of all registered AbstractETLs.
getEtlManager() - Method in class de.gerdiproject.harvest.application.MainContext
 
GetETLManagerEvent - Class in de.gerdiproject.harvest.etls.events
This event is used to retrieve the ETLManager from the MainContext.
GetETLManagerEvent() - Constructor for class de.gerdiproject.harvest.etls.events.GetETLManagerEvent
 
getETLsAsJson() - Method in class de.gerdiproject.harvest.etls.utils.ETLManager
Returns an info JSON object with detailed information about all ETLs.
getExecutedTask() - Method in class de.gerdiproject.harvest.scheduler.events.ScheduledTaskExecutedEvent
Returns the task that finished executing.
getFailed() - Method in class de.gerdiproject.harvest.etls.loaders.json.ElasticSearchShard
 
getHarvestedCount() - Method in class de.gerdiproject.harvest.etls.AbstractETL
Retrieves the number of documents that have been loaded.
getHarvestedCount() - Method in class de.gerdiproject.harvest.etls.AbstractIteratorETL
 
getHarvestedCount() - Method in class de.gerdiproject.harvest.etls.json.ETLJson
 
getHarvestedCount() - Method in class de.gerdiproject.harvest.etls.json.ETLManagerJson
 
getHarvestedCount() - Method in class de.gerdiproject.harvest.etls.utils.ETLManager
Retrieves the number of documents that have been loaded.
getHarvesterHash() - Method in class de.gerdiproject.harvest.etls.events.HarvestStartedEvent
Returns the version hash of the harvested documents.
getHarvesterJarName() - Method in class de.gerdiproject.harvest.utils.maven.MavenUtils
Returns the name of the main jar of this service.
getHash() - Method in class de.gerdiproject.harvest.etls.AbstractETL
Returns the checksum hash of the documents which are to be harvested.
getHashFromJson(JsonElement) - Method in class de.gerdiproject.harvest.etls.extractors.JsonArrayExtractor
Retrieves a hash value from a JSON object.
getHealth() - Method in class de.gerdiproject.harvest.etls.AbstractETL
Returns an enum that represents the health status of the ETL.
getHealth() - Method in class de.gerdiproject.harvest.etls.json.ETLManagerJson
 
getHealth() - Method in class de.gerdiproject.harvest.etls.rest.ETLRestResource
Checks the health of the harvester.
getHealth() - Method in class de.gerdiproject.harvest.etls.utils.ETLManager
Retrieves an overall health status.
getHealthHistory() - Method in class de.gerdiproject.harvest.etls.json.ETLJson
 
getHtml(String) - Method in class de.gerdiproject.harvest.utils.data.DiskIO
 
getHtml(String) - Method in interface de.gerdiproject.harvest.utils.data.IDataRetriever
Tries to parse the content from a specified path as a HTML document.
getHtml(String) - Method in class de.gerdiproject.harvest.utils.data.WebDataRetriever
 
getHtmlFromUrl(String) - Method in class de.gerdiproject.harvest.utils.data.HttpRequester
Sends a GET request to a specified URL and tries to retrieve the HTML response.
getId() - Method in class de.gerdiproject.harvest.etls.loaders.json.ElasticSearchIndex
 
getIndex() - Method in class de.gerdiproject.harvest.etls.loaders.json.ElasticSearchIndex
 
getIndex() - Method in class de.gerdiproject.harvest.etls.loaders.json.ElasticSearchIndexWrapper
 
getInfoText(UriInfo) - Method in class de.gerdiproject.harvest.config.rest.ConfigurationRestResource
 
getInfoText(UriInfo) - Method in class de.gerdiproject.harvest.rest.AbstractRestResource
A HTTP GET request that returns a plain-text representation of the singleton object, as well as some help text that shows which HTTP requests are possible.
getInputStream(HttpURLConnection) - Method in class de.gerdiproject.harvest.utils.data.WebDataRetriever
Returns the correct InputStream based on the Content-Encoding header of a connection.
getItems() - Method in class de.gerdiproject.harvest.etls.loaders.json.ElasticSearchResponse
 
getKey() - Method in class de.gerdiproject.harvest.config.parameters.AbstractParameter
Retrieves the key of the parameter.
getLastHarvestDate() - Method in class de.gerdiproject.harvest.etls.json.ETLManagerJson
 
getLatestTimestamp() - Method in class de.gerdiproject.harvest.etls.utils.TimestampedList
Returns the timestamp of the latest value of the list.
getLatestValue() - Method in class de.gerdiproject.harvest.etls.utils.TimestampedList
Returns the latest value of the list.
getListFromJson(JsonElement) - Method in class de.gerdiproject.harvest.etls.extractors.JsonArrayExtractor
Parses a JSON object to retrieve a JSON array and converts the array to a LinkedList.
getLoaderClasses() - Method in class de.gerdiproject.harvest.application.ContextListener
Creates a list of ILoader implementations that can be chosen to transfer data to the search index.
getLoaderRegistry() - Method in class de.gerdiproject.harvest.application.MainContext
 
getLog() - Method in class de.gerdiproject.harvest.application.MainContext
 
getLog(String, String, String) - Method in class de.gerdiproject.harvest.etls.rest.ETLRestResource
Attempts to retrieve the log of the harvester service.
getLog(List<String>, List<String>, List<String>) - Method in class de.gerdiproject.harvest.utils.logger.HarvesterLog
Retrieves filtered log messages from the harvester service log file.
getLogFile() - Method in class de.gerdiproject.harvest.application.MainContext
 
GetMainLogEvent - Class in de.gerdiproject.harvest.utils.logger.events
This synchronous event returns the HarvesterLog that is attached to the MainContext.
GetMainLogEvent() - Constructor for class de.gerdiproject.harvest.utils.logger.events.GetMainLogEvent
 
getMappingFunction() - Method in class de.gerdiproject.harvest.config.parameters.AbstractParameter
Retrieves a function that maps a String value to V.
getMavenUtils() - Method in class de.gerdiproject.harvest.application.MainContext
 
GetMavenUtilsEvent - Class in de.gerdiproject.harvest.utils.maven.events
This synchronous event returns the MavenUtils that is attached to the MainContext.
GetMavenUtilsEvent() - Constructor for class de.gerdiproject.harvest.utils.maven.events.GetMavenUtilsEvent
 
getMavenVersionInfo(String) - Method in class de.gerdiproject.harvest.utils.maven.MavenUtils
Returns a list of dependencies of this service's classpath.
getMaxDocumentCount() - Method in class de.gerdiproject.harvest.etls.json.ETLJson
 
getMaxDocumentCount() - Method in class de.gerdiproject.harvest.etls.json.ETLManagerJson
 
getMaxHarvestableDocuments() - Method in class de.gerdiproject.harvest.etls.events.HarvestStartedEvent
Returns the maximum number of harvestable documents.
getMaxNumberOfDocuments() - Method in class de.gerdiproject.harvest.etls.AbstractETL
Returns the total number of documents that can possibly be harvested.
getMaxNumberOfDocuments() - Method in class de.gerdiproject.harvest.etls.AbstractIteratorETL
Returns the total number of documents that are harvested, considering the range parameters.
getMaxNumberOfDocuments() - Method in class de.gerdiproject.harvest.etls.utils.ETLManager
Sums up the expected number of harvestable documents of all registered ETLs.
getModuleName() - Method in class de.gerdiproject.harvest.application.MainContext
 
getName() - Method in class de.gerdiproject.harvest.etls.AbstractETL
Returns the name of the ETL.
getName() - Method in class de.gerdiproject.harvest.etls.json.ETLJson
 
getNextHarvestDate() - Method in class de.gerdiproject.harvest.etls.json.ETLManagerJson
 
getNextHarvestDate() - Method in class de.gerdiproject.harvest.scheduler.Scheduler
Returns the date of the earliest scheduled harvest.
getNextMatchingDate(String) - Static method in class de.gerdiproject.harvest.scheduler.utils.CronUtils
Uses the cron tab to calculate the first matching date after the current date + one minute.
getNextMatchingDate(String, Date) - Static method in class de.gerdiproject.harvest.scheduler.utils.CronUtils
Uses the cron tab to calculate the first date that is equal or later than a specified date.
getObject(File, Class<T>) - Method in class de.gerdiproject.harvest.utils.data.DiskIO
Tries to parse the content of a specified file as an object.
getObject(File, Type) - Method in class de.gerdiproject.harvest.utils.data.DiskIO
Tries to parse the content of a specified file as an object.
getObject(String, Class<T>) - Method in class de.gerdiproject.harvest.utils.data.DiskIO
 
getObject(String, Type) - Method in class de.gerdiproject.harvest.utils.data.DiskIO
 
getObject(String, Class<T>) - Method in interface de.gerdiproject.harvest.utils.data.IDataRetriever
Tries to parse the content from a specified path as a JSON object.
getObject(String, Type) - Method in interface de.gerdiproject.harvest.utils.data.IDataRetriever
Tries to parse the content from a specified path as a JSON object.
getObject(String, Class<T>) - Method in class de.gerdiproject.harvest.utils.data.WebDataRetriever
 
getObject(String, Type) - Method in class de.gerdiproject.harvest.utils.data.WebDataRetriever
 
getObject(Element, String, Function<Element, T>) - Static method in class de.gerdiproject.harvest.utils.HtmlUtils
Retrieves the first occurrence of an Element with a specified tag and maps it to an object via a specified mapping function.
getObjectFromUrl(String, Class<T>) - Method in class de.gerdiproject.harvest.utils.data.HttpRequester
Sends a GET request to a specified URL and tries to retrieve the JSON response, mapping it to a Java object.
getObjectFromUrl(String, Type) - Method in class de.gerdiproject.harvest.utils.data.HttpRequester
Sends a GET request to a specified URL and tries to retrieve the JSON response, mapping it to a Java object.
getObjects(Element, String, Function<Element, T>) - Static method in class de.gerdiproject.harvest.utils.HtmlUtils
Retrieves all occurrences of Elements with specified tags and maps them to a List of objects via a specified mapping function.
getObjectsFromParent(Element, String, Function<Element, T>) - Static method in class de.gerdiproject.harvest.utils.HtmlUtils
Retrieves all child Elements of a specified parent tag and maps them to a List of objects via a specified mapping function.
getOldValue() - Method in class de.gerdiproject.harvest.config.events.ParameterChangedEvent
Retrieves the value of the parameter prior to its change.
getOverallInfo() - Method in class de.gerdiproject.harvest.etls.json.ETLInfosJson
Returns an info summary of all registered ETLs combined.
getParameter() - Method in class de.gerdiproject.harvest.config.events.ParameterChangedEvent
Retrieves the parameter that has changed.
getParameter() - Method in class de.gerdiproject.harvest.config.events.RegisterParameterEvent
Returns the parameter that is to be registered in the Configuration.
getParameter() - Method in class de.gerdiproject.harvest.config.events.UnregisterParameterEvent
Returns the parameter that is to be unregistered from the Configuration.
getParameters() - Method in class de.gerdiproject.harvest.config.Configuration
Retrieves a collection of all parameters.
getParameterStringValue(String) - Method in class de.gerdiproject.harvest.config.Configuration
Returns the human readable value of the parameter with a specified key.
getParameterValue(String) - Method in class de.gerdiproject.harvest.config.Configuration
Returns the value of the parameter with a specified key.
getPrettyPlainText() - Method in class de.gerdiproject.harvest.config.Configuration
 
getPrettyPlainText() - Method in class de.gerdiproject.harvest.etls.utils.ETLManager
 
getPrettyPlainText() - Method in class de.gerdiproject.harvest.rest.AbstractRestObject
Returns a pretty print representation of this object.
getPrettyPlainText() - Method in class de.gerdiproject.harvest.scheduler.Scheduler
 
getReader(String, Charset) - Static method in class de.gerdiproject.harvest.utils.file.FileUtils
Opens an InputStream to a specified file and wraps it in a BufferedReader using a specified Charset.
getReader(File, Charset) - Static method in class de.gerdiproject.harvest.utils.file.FileUtils
Opens an InputStream to a specified file and wraps it in a BufferedReader using a specified Charset.
getReason() - Method in class de.gerdiproject.harvest.etls.loaders.json.ElasticSearchError
 
getReason() - Method in class de.gerdiproject.harvest.etls.loaders.json.ElasticSearchErrorCause
 
getRemainingHarvestTime() - Method in class de.gerdiproject.harvest.etls.json.ETLManagerJson
 
getRepositoryName() - Method in class de.gerdiproject.harvest.application.ContextListener
Retrieves the name of the repository that is to be harvested.
getRepositoryName() - Method in class de.gerdiproject.harvest.etls.json.ETLInfosJson
Returns the name of the harvested repository, or null if it is unknown.
getRepositoryName() - Method in class de.gerdiproject.harvest.etls.json.ETLManagerJson
 
GetRepositoryNameEvent - Class in de.gerdiproject.harvest.etls.events
This synchronous event returns the name of the harvested data provider.
GetRepositoryNameEvent() - Constructor for class de.gerdiproject.harvest.etls.events.GetRepositoryNameEvent
 
getRestHeader(RestRequestType, String, String) - Method in class de.gerdiproject.harvest.utils.data.HttpRequester
Sends a REST request with a plain-text body and returns the header fields.
getRestHeader(RestRequestType, String, String, String, String) - Method in class de.gerdiproject.harvest.utils.data.HttpRequester
Sends an authorized REST request with a specified body and returns the header fields.
getRestHeader(RestRequestType, String, String, String, String) - Method in class de.gerdiproject.harvest.utils.data.WebDataRetriever
Sends an authorized REST request with a specified body and returns the header fields.
GetRestObjectEvent<T extends AbstractRestObject<T,?>> - Class in de.gerdiproject.harvest.rest.events
This class is a stricted version of ISynchronousEvents that only allow AbstractRestObjects to be returned.
GetRestObjectEvent() - Constructor for class de.gerdiproject.harvest.rest.events.GetRestObjectEvent
 
getRestResponse(RestRequestType, String, String) - Method in class de.gerdiproject.harvest.utils.data.HttpRequester
Sends an REST request with a plain-text body.
getRestResponse(RestRequestType, String, String, String, String) - Method in class de.gerdiproject.harvest.utils.data.HttpRequester
Sends an authorized REST request with a specified body and returns the response as a string.
getRestResponse(RestRequestType, String, String, String, String) - Method in class de.gerdiproject.harvest.utils.data.WebDataRetriever
Sends an authorized REST request with a specified body and returns the response as a string.
getResult() - Method in class de.gerdiproject.harvest.etls.loaders.json.ElasticSearchIndex
 
getScheduledHarvests() - Method in class de.gerdiproject.harvest.scheduler.json.SchedulerResponse
Returns all cron tabs of scheduled harvests.
getScheduler() - Method in class de.gerdiproject.harvest.application.MainContext
 
GetSchedulerEvent - Class in de.gerdiproject.harvest.scheduler.events
Synchronous event for retrieving the Scheduler.
GetSchedulerEvent() - Constructor for class de.gerdiproject.harvest.scheduler.events.GetSchedulerEvent
 
getServiceName() - Method in class de.gerdiproject.harvest.application.ContextListener
Retrieves the name of this harvester service.
getShaHash(String) - Method in class de.gerdiproject.harvest.utils.HashGenerator
Generates a hexadecimal string representing the hash value of a specified input string.
getShards() - Method in class de.gerdiproject.harvest.etls.loaders.json.ElasticSearchIndex
 
getSizeOfDocument(String, IDocument) - Method in class de.gerdiproject.harvest.etls.loaders.AbstractURLLoader
Calculates the size of a single document within the batch in bytes.
getSizeOfDocument(String, IDocument) - Method in class de.gerdiproject.harvest.etls.loaders.ElasticSearchLoader
 
getStartIndex() - Method in class de.gerdiproject.harvest.etls.AbstractIteratorETL
Returns start index 'a' of the harvesting range [a,b).
getStartTimestamp() - Method in class de.gerdiproject.harvest.etls.events.HarvestStartedEvent
Returns the unix timestamp at which the event was created.
getState() - Method in class de.gerdiproject.harvest.etls.AbstractETL
Returns an enum that represents what the ETL is currently doing.
getState() - Method in class de.gerdiproject.harvest.etls.json.ETLManagerJson
 
getState() - Method in class de.gerdiproject.harvest.etls.utils.ETLManager
Returns a status representing the entirety of all registered ETL statuses.
getStateHistory() - Method in class de.gerdiproject.harvest.etls.json.ETLJson
 
getStatus() - Method in class de.gerdiproject.harvest.etls.loaders.json.ElasticSearchIndex
 
getString(File) - Method in class de.gerdiproject.harvest.utils.data.DiskIO
Tries to parse the content of a specified file as a string.
getString(String) - Method in class de.gerdiproject.harvest.utils.data.DiskIO
 
getString(String) - Method in interface de.gerdiproject.harvest.utils.data.IDataRetriever
Tries to parse the content from a specified path as a string.
getString(String) - Method in class de.gerdiproject.harvest.utils.data.WebDataRetriever
 
getString(Element, String) - Static method in class de.gerdiproject.harvest.utils.HtmlUtils
Retrieves the text of the first occurrence of a specified tag derived from a specified Element.
getStrings(Element, String) - Static method in class de.gerdiproject.harvest.utils.HtmlUtils
Retrieves the texts of all occurrences of Elements with a specified tag name.
getStringsFromParent(Element, String) - Static method in class de.gerdiproject.harvest.utils.HtmlUtils
Retrieves the texts of all children of a specified parent Element.
getStringValue() - Method in class de.gerdiproject.harvest.config.parameters.AbstractParameter
Returns a human readable String of the parameter value.
getStringValue() - Method in class de.gerdiproject.harvest.config.parameters.IntegerParameter
 
getStringValue() - Method in class de.gerdiproject.harvest.config.parameters.PasswordParameter
 
getSuccessful() - Method in class de.gerdiproject.harvest.etls.loaders.json.ElasticSearchShard
 
getTimestamp() - Method in class de.gerdiproject.harvest.etls.utils.TimestampedEntry
Retrieves the time at which the value was stored.
getTook() - Method in class de.gerdiproject.harvest.etls.loaders.json.ElasticSearchResponse
 
getTotal() - Method in class de.gerdiproject.harvest.etls.loaders.json.ElasticSearchShard
 
getType() - Method in class de.gerdiproject.harvest.etls.loaders.json.ElasticSearchError
 
getType() - Method in class de.gerdiproject.harvest.etls.loaders.json.ElasticSearchErrorCause
 
getType() - Method in class de.gerdiproject.harvest.etls.loaders.json.ElasticSearchIndex
 
getUniqueVersionString() - Method in interface de.gerdiproject.harvest.etls.extractors.IExtractor
Returns a string that can be hashed to generate a unique identifier for the current version of the extractable elements.
getUniqueVersionString() - Method in class de.gerdiproject.harvest.etls.extractors.JsonArrayExtractor
 
getUrl() - Method in class de.gerdiproject.harvest.etls.extractors.JsonArrayExtractor
Retrieves the URL that is used to retrieve the JSON response.
getUrl() - Method in class de.gerdiproject.harvest.etls.loaders.AbstractURLLoader
Returns the loader target URL as a string.
getUrl() - Method in class de.gerdiproject.harvest.etls.loaders.ElasticSearchLoader
 
getValue() - Method in class de.gerdiproject.harvest.config.parameters.AbstractParameter
Retrieves the parameter value.
getValue() - Method in class de.gerdiproject.harvest.etls.utils.TimestampedEntry
Retrieves the stored value.
getVersion() - Method in class de.gerdiproject.harvest.etls.loaders.json.ElasticSearchIndex
 
getVersionHash() - Method in class de.gerdiproject.harvest.etls.json.ETLJson
 
getVersions() - Method in class de.gerdiproject.harvest.etls.rest.ETLRestResource
Displays the artifactIds and versions of GeRDI Maven libraries used in this service.
getWriter(String, Charset) - Static method in class de.gerdiproject.harvest.utils.file.FileUtils
Opens an OutputStream to a specified file and wraps it in a BufferedWriter using a specified Charset.
getWriter(File, Charset) - Static method in class de.gerdiproject.harvest.utils.file.FileUtils
Opens an OutputStream to a specified file and wraps it in a BufferedWriter using a specified Charset.
gson - Variable in class de.gerdiproject.harvest.rest.AbstractRestResource
 
GZIP_ENCODING - Static variable in class de.gerdiproject.harvest.utils.data.constants.DataOperationConstants
 

H

harvest() - Method in class de.gerdiproject.harvest.etls.AbstractETL
Starts the harvest.
harvest() - Method in class de.gerdiproject.harvest.etls.utils.ETLManager
Attempts to start a harvest, signaling all registered ETLs to start
HARVEST_DATE_JSON - Static variable in class de.gerdiproject.harvest.etls.loaders.constants.DiskLoaderConstants
 
HARVEST_FAILED - Static variable in class de.gerdiproject.harvest.etls.constants.ETLConstants
 
HARVEST_FINISHED - Static variable in class de.gerdiproject.harvest.etls.constants.ETLConstants
 
HARVEST_IN_PROGRESS - Static variable in class de.gerdiproject.harvest.etls.constants.ETLConstants
 
HARVEST_STARTED - Static variable in class de.gerdiproject.harvest.etls.constants.ETLConstants
 
HARVEST_TIME_KEEPER_CACHE_FILE_PATH - Static variable in class de.gerdiproject.harvest.utils.file.constants.FileConstants
 
harvestedCount - Variable in class de.gerdiproject.harvest.etls.AbstractIteratorETL
 
HARVESTER_NAME_SUB_STRING - Static variable in class de.gerdiproject.harvest.application.constants.ApplicationConstants
 
HARVESTER_SERVICE_NAME_SUFFIX - Static variable in class de.gerdiproject.harvest.application.constants.ApplicationConstants
 
HarvesterLog - Class in de.gerdiproject.harvest.utils.logger
This class creates a log file to which logs are being appended.
HarvesterLog(String) - Constructor for class de.gerdiproject.harvest.utils.logger.HarvesterLog
Creates a logger that logs to a specified file and assigns a standard logging pattern to it.
HarvestFinishedEvent - Class in de.gerdiproject.harvest.etls.events
This event signifies that a harvest has been completed.
HarvestFinishedEvent(boolean, String) - Constructor for class de.gerdiproject.harvest.etls.events.HarvestFinishedEvent
Constructor that sets up the payload and uses the current time as the end timestamp.
HarvestFinishedEvent(boolean, String, long) - Constructor for class de.gerdiproject.harvest.etls.events.HarvestFinishedEvent
Constructor that sets up the payload and allows the current time as the end timestamp.
HARVESTING_TASK - Static variable in class de.gerdiproject.harvest.scheduler.constants.SchedulerConstants
 
HarvestingTimerTask - Class in de.gerdiproject.harvest.scheduler
This task is used by the Scheduler in order to run a harvest in a specified schedule.
HarvestingTimerTask() - Constructor for class de.gerdiproject.harvest.scheduler.HarvestingTimerTask
 
HarvestStartedEvent - Class in de.gerdiproject.harvest.etls.events
This event signifies that a harvest has been started.
HarvestStartedEvent(String, int) - Constructor for class de.gerdiproject.harvest.etls.events.HarvestStartedEvent
Constructor that sets up the payload, and uses the current time as the start timestamp.
HarvestStartedEvent(String, int, long) - Constructor for class de.gerdiproject.harvest.etls.events.HarvestStartedEvent
 
hasAsynchronousEventListeners() - Static method in class de.gerdiproject.harvest.event.EventSystem
Checks if there are registered event listeners.
hasErrors() - Method in class de.gerdiproject.harvest.etls.loaders.json.ElasticSearchResponse
Returns true if the Elasticsearch response was erroneous.
hasFailed() - Static method in class de.gerdiproject.harvest.application.MainContext
Checks if the initialization of the MainContext has failed.
hash - Variable in class de.gerdiproject.harvest.etls.AbstractETL
 
hashCode() - Method in class de.gerdiproject.harvest.application.MainContext
 
hashCode() - Method in class de.gerdiproject.harvest.config.events.ParameterChangedEvent
 
hashCode() - Method in class de.gerdiproject.harvest.config.events.RegisterParameterEvent
 
hashCode() - Method in class de.gerdiproject.harvest.config.events.UnregisterParameterEvent
 
hashCode() - Method in class de.gerdiproject.harvest.etls.events.HarvestFinishedEvent
 
hashCode() - Method in class de.gerdiproject.harvest.etls.events.HarvestStartedEvent
 
hashCode() - Method in class de.gerdiproject.harvest.etls.json.ETLInfosJson
 
hashCode() - Method in class de.gerdiproject.harvest.etls.json.ETLJson
 
hashCode() - Method in class de.gerdiproject.harvest.etls.json.ETLManagerJson
 
hashCode() - Method in class de.gerdiproject.harvest.etls.loaders.json.ElasticSearchError
 
hashCode() - Method in class de.gerdiproject.harvest.etls.loaders.json.ElasticSearchErrorCause
 
hashCode() - Method in class de.gerdiproject.harvest.etls.loaders.json.ElasticSearchIndex
 
hashCode() - Method in class de.gerdiproject.harvest.etls.loaders.json.ElasticSearchIndexWrapper
 
hashCode() - Method in class de.gerdiproject.harvest.etls.loaders.json.ElasticSearchResponse
 
hashCode() - Method in class de.gerdiproject.harvest.etls.loaders.json.ElasticSearchShard
 
hashCode() - Method in class de.gerdiproject.harvest.etls.utils.TimestampedEntry
 
hashCode() - Method in class de.gerdiproject.harvest.scheduler.events.ScheduledTaskExecutedEvent
 
hashCode() - Method in class de.gerdiproject.harvest.scheduler.json.ChangeSchedulerRequest
 
hashCode() - Method in class de.gerdiproject.harvest.scheduler.json.SchedulerResponse
 
hashGenerator - Variable in class de.gerdiproject.harvest.etls.loaders.AbstractURLLoader
 
HashGenerator - Class in de.gerdiproject.harvest.utils
This class generates hash values of strings.

https://stackoverflow.com/questions/9655181/how-to-convert-a-byte-array-to-a-hex-string-in-java
HashGenerator(Charset) - Constructor for class de.gerdiproject.harvest.utils.HashGenerator
Constructs a hash generator using a specified charset.
hasLoadedDocuments - Variable in class de.gerdiproject.harvest.etls.loaders.AbstractIteratorLoader
 
hasOutdatedETLs() - Method in class de.gerdiproject.harvest.etls.utils.ETLManager
Updates all registered ETLs and checks if they are outdated.
hasSynchronousEventListeners() - Static method in class de.gerdiproject.harvest.event.EventSystem
Checks if there are registered synchronous event listeners.
HEAD_REQUEST - Static variable in class de.gerdiproject.harvest.utils.data.constants.DataOperationConstants
 
healthHistory - Variable in class de.gerdiproject.harvest.etls.AbstractETL
 
HOURS_MAX_CRON - Static variable in class de.gerdiproject.harvest.scheduler.constants.CronConstants
 
HOURS_MIN_CRON - Static variable in class de.gerdiproject.harvest.scheduler.constants.CronConstants
 
HtmlUtils - Class in de.gerdiproject.harvest.utils
A collection of static methods for processing HTML Elements.
HTTP - Static variable in class de.gerdiproject.harvest.utils.data.constants.DataOperationConstants
 
HTTP_CATEGORY - Static variable in class de.gerdiproject.harvest.utils.data.constants.DataOperationConstants
 
HttpRequester - Class in de.gerdiproject.harvest.utils.data
This class serves as a facade for HTTP requests.
HttpRequester() - Constructor for class de.gerdiproject.harvest.utils.data.HttpRequester
Constructor that uses an UTF-8 charset, and a Gson implementation that can parse Geometry objects.
HttpRequester(Gson, Charset) - Constructor for class de.gerdiproject.harvest.utils.data.HttpRequester
Constructor that allows to customize the behavior.
HttpRequester(HttpRequester) - Constructor for class de.gerdiproject.harvest.utils.data.HttpRequester
Constructor that copies the settings from another HttpRequester.
HttpResponseFactory - Class in de.gerdiproject.harvest.rest
This factory creates common server responses to HTTP requests.
HTTPS - Static variable in class de.gerdiproject.harvest.utils.data.constants.DataOperationConstants
 

I

ICachedObject - Interface in de.gerdiproject.harvest.utils.file
This interface represents objects that can be cached on disk.
IDataRetriever - Interface in de.gerdiproject.harvest.utils.data
This interface describes a means for retrieving data from an arbitrary source.
IEvent - Interface in de.gerdiproject.harvest.event
This is an interface for all asynchronous events that can be registered and dispatched via the EventSystem.
IEventListener - Interface in de.gerdiproject.harvest.event
This interface provides methods for (un-) registering one or more event listeners.
IExtractor<T> - Interface in de.gerdiproject.harvest.etls.extractors
This class represents the Extractor of an ETL process.
ILoader<S> - Interface in de.gerdiproject.harvest.etls.loaders
This class represents the Loader of an ETL process.
incrementHarvestedDocuments() - Method in class de.gerdiproject.harvest.etls.AbstractIteratorETL
This function increments the document counter.
init(Class<? extends ContextListener>, Supplier<String>, Supplier<List<? extends AbstractETL<?, ?>>>, List<Class<? extends ILoader<?>>>) - Static method in class de.gerdiproject.harvest.application.MainContext
Constructs an instance of the MainContext in a dedicated thread.
init(String) - Method in class de.gerdiproject.harvest.etls.AbstractETL
Initializes the ETL, calculating the hash and maximum number of harvestable documents.
init(AbstractETL<?, ?>) - Method in class de.gerdiproject.harvest.etls.extractors.AbstractIteratorExtractor
 
init(AbstractETL<?, ?>) - Method in interface de.gerdiproject.harvest.etls.extractors.IExtractor
Initializes the extractor for a new harvest.
init(AbstractETL<?, ?>) - Method in class de.gerdiproject.harvest.etls.extractors.JsonArrayExtractor
 
init(AbstractETL<?, ?>) - Method in class de.gerdiproject.harvest.etls.loaders.AbstractIteratorLoader
 
init(AbstractETL<?, ?>) - Method in class de.gerdiproject.harvest.etls.loaders.AbstractURLLoader
 
init(AbstractETL<?, ?>) - Method in class de.gerdiproject.harvest.etls.loaders.DiskLoader
 
init(AbstractETL<?, ?>) - Method in interface de.gerdiproject.harvest.etls.loaders.ILoader
Initializes the loader for a new harvest.
init(AbstractETL<?, ?>) - Method in interface de.gerdiproject.harvest.etls.transformers.ITransformer
Initializes the transformer for a new harvest.
INIT_ERROR_DETAILED - Static variable in class de.gerdiproject.harvest.rest.constants.RestConstants
 
INIT_FIELD - Static variable in class de.gerdiproject.harvest.application.constants.ApplicationConstants
 
INIT_FIELD_SUCCESS - Static variable in class de.gerdiproject.harvest.application.constants.ApplicationConstants
 
INIT_INVALID_STATE - Static variable in class de.gerdiproject.harvest.etls.constants.ETLConstants
 
INIT_SERVICE - Static variable in class de.gerdiproject.harvest.application.constants.ApplicationConstants
 
INIT_SERVICE_FAILED - Static variable in class de.gerdiproject.harvest.application.constants.ApplicationConstants
 
INIT_SERVICE_SUCCESS - Static variable in class de.gerdiproject.harvest.application.constants.ApplicationConstants
 
initHash() - Method in class de.gerdiproject.harvest.etls.AbstractETL
Computes a hash value of the files that are to be harvested, which is used for checking if the files have changed.
initMaxNumberOfDocuments() - Method in class de.gerdiproject.harvest.etls.AbstractETL
Calculates the total number of harvested documents.
INTEGER_ALLOWED_VALUES - Static variable in class de.gerdiproject.harvest.config.parameters.constants.ParameterConstants
 
INTEGER_RANGE_ALLOWED_VALUES - Static variable in class de.gerdiproject.harvest.config.parameters.constants.ParameterConstants
 
INTEGER_VALUE_MAX - Static variable in class de.gerdiproject.harvest.config.parameters.constants.ParameterConstants
 
INTEGER_VALUE_MIN - Static variable in class de.gerdiproject.harvest.config.parameters.constants.ParameterConstants
 
IntegerParameter - Class in de.gerdiproject.harvest.config.parameters
This parameter holds an integer value.
IntegerParameter(String, String, int, Function<String, Integer>) - Constructor for class de.gerdiproject.harvest.config.parameters.IntegerParameter
Constructor that uses a custom mapping function.
IntegerParameter(String, String, int) - Constructor for class de.gerdiproject.harvest.config.parameters.IntegerParameter
Constructor that uses the default mapping function.
integrateDirectory(File, File, boolean) - Static method in class de.gerdiproject.harvest.utils.file.FileUtils
Merges one directory into another one.
INVALID_CATEGORY_NAME - Static variable in class de.gerdiproject.harvest.config.parameters.constants.ParameterConstants
 
INVALID_ITER_EXTRACTOR_ERROR - Static variable in class de.gerdiproject.harvest.etls.constants.ETLConstants
 
INVALID_ITER_LOADER_ERROR - Static variable in class de.gerdiproject.harvest.etls.constants.ETLConstants
 
INVALID_ITER_TRANSFORMER_ERROR - Static variable in class de.gerdiproject.harvest.etls.constants.ETLConstants
 
INVALID_PARAM_NAME_REGEX - Static variable in class de.gerdiproject.harvest.config.parameters.constants.ParameterConstants
 
INVALID_PARAMETER_KEY - Static variable in class de.gerdiproject.harvest.config.parameters.constants.ParameterConstants
 
INVALID_REQUEST_ERROR - Static variable in class de.gerdiproject.harvest.rest.constants.RestConstants
 
INVALID_URL_ERROR - Static variable in class de.gerdiproject.harvest.etls.loaders.constants.ElasticSearchConstants
 
isCreated() - Method in class de.gerdiproject.harvest.etls.loaders.json.ElasticSearchIndex
 
isEnabled() - Method in class de.gerdiproject.harvest.etls.AbstractETL
Returns true if this ETL is enabled and initialized.
isEnabled() - Method in class de.gerdiproject.harvest.etls.json.ETLManagerJson
 
isInitialized() - Static method in class de.gerdiproject.harvest.application.MainContext
Checks if the initialization phase of the MainContext has finished.
isReadingFromDisk() - Method in class de.gerdiproject.harvest.utils.data.HttpRequester
Returns true if HTTP responses are read from a cache on disk.
isRegistered() - Method in class de.gerdiproject.harvest.config.parameters.AbstractParameter
Returns true if the parameter is registered at the Configuration.
isSuccessful() - Method in class de.gerdiproject.harvest.event.AbstractSucceededOrFailedEvent
Returns true if the event marks something that succeeded.
isWritingToDisk() - Method in class de.gerdiproject.harvest.utils.data.HttpRequester
Returns true if HTTP responses are written to a cache on disk.
ISynchronousEvent<T> - Interface in de.gerdiproject.harvest.event
Interface for synchronous events.
ITransformer<T,S> - Interface in de.gerdiproject.harvest.etls.transformers
This class represents the Transformer of an ETL process.

J

JAR_PREFIX - Static variable in class de.gerdiproject.harvest.utils.maven.constants.MavenConstants
 
JSON_EXTENSION - Static variable in class de.gerdiproject.harvest.etls.loaders.constants.DiskLoaderConstants
 
JSON_FILE_EXTENSION - Static variable in class de.gerdiproject.harvest.utils.file.constants.FileConstants
 
JSON_INVALID_FORMAT_ERROR - Static variable in class de.gerdiproject.harvest.rest.constants.RestConstants
 
JsonArrayExtractor<T> - Class in de.gerdiproject.harvest.etls.extractors
This class represents the Extractor of an ETL process that parses a JSON array from a HTTP response.
JsonArrayExtractor(Gson, String) - Constructor for class de.gerdiproject.harvest.etls.extractors.JsonArrayExtractor
Constructor that expects a JSON array to be contained in the HTTP response, navigating through the response via a specified query.
JsonArrayExtractor(Gson) - Constructor for class de.gerdiproject.harvest.etls.extractors.JsonArrayExtractor
Constructor that expects a JSON array to be returned directly as response from a specified URL.

K

key - Variable in class de.gerdiproject.harvest.config.parameters.AbstractParameter
 

L

LINE_START_REGEX - Static variable in class de.gerdiproject.harvest.rest.constants.RestConstants
 
LINE_START_REPLACEMENT - Static variable in class de.gerdiproject.harvest.rest.constants.RestConstants
 
load(Iterator<S>) - Method in class de.gerdiproject.harvest.etls.loaders.AbstractIteratorLoader
 
load(Iterator<S>) - Method in class de.gerdiproject.harvest.etls.loaders.AbstractURLLoader
 
load(Iterator<DataCiteJson>) - Method in class de.gerdiproject.harvest.etls.loaders.DiskLoader
 
load(S) - Method in interface de.gerdiproject.harvest.etls.loaders.ILoader
Loads the document to a targeted search index.
LOAD_DOCUMENT_ERROR - Static variable in class de.gerdiproject.harvest.etls.loaders.constants.ElasticSearchConstants
 
LOAD_DOCUMENT_ERROR_CAUSE - Static variable in class de.gerdiproject.harvest.etls.loaders.constants.ElasticSearchConstants
 
LOAD_DOCUMENT_ERROR_REASON - Static variable in class de.gerdiproject.harvest.etls.loaders.constants.ElasticSearchConstants
 
LOAD_ERROR - Static variable in class de.gerdiproject.harvest.config.constants.ConfigurationConstants
 
LOAD_FAILED - Static variable in class de.gerdiproject.harvest.utils.data.constants.DataOperationConstants
 
LOAD_OK - Static variable in class de.gerdiproject.harvest.config.constants.ConfigurationConstants
 
LOAD_OK - Static variable in class de.gerdiproject.harvest.scheduler.constants.SchedulerConstants
 
loadBatch(Map<String, IDocument>) - Method in class de.gerdiproject.harvest.etls.loaders.AbstractURLLoader
The core of the loading function which is to be implemented by subclasses.
loadBatch(Map<String, IDocument>) - Method in class de.gerdiproject.harvest.etls.loaders.ElasticSearchLoader
 
LOADED_PARAM - Static variable in class de.gerdiproject.harvest.config.constants.ConfigurationConstants
 
LOADED_PARTIAL_OK - Static variable in class de.gerdiproject.harvest.etls.loaders.constants.LoaderConstants
 
loadElement(S) - Method in class de.gerdiproject.harvest.etls.loaders.AbstractIteratorLoader
Loads a single element of the Iterator.
loadElement(S) - Method in class de.gerdiproject.harvest.etls.loaders.AbstractURLLoader
 
loadElement(DataCiteJson) - Method in class de.gerdiproject.harvest.etls.loaders.DiskLoader
 
loadElementAndIncrement(S) - Method in class de.gerdiproject.harvest.etls.loaders.AbstractIteratorLoader
Loads a single element of the Iterator and increments the number of harvested documents of the dedicated harvester, regardless of whether the loading succeeded or not.
loader - Variable in class de.gerdiproject.harvest.etls.AbstractETL
 
LOADER_CREATE_ERROR - Static variable in class de.gerdiproject.harvest.etls.constants.ETLConstants
 
LOADER_TYPE_PARAM_KEY - Static variable in class de.gerdiproject.harvest.etls.loaders.constants.LoaderConstants
 
LoaderConstants - Class in de.gerdiproject.harvest.etls.loaders.constants
This static class is a collection of constants that relate to ILoaders.
LoaderException - Exception in de.gerdiproject.harvest.etls.loaders
This exception is thrown when an ILoader fails to load documents.
LoaderException(String) - Constructor for exception de.gerdiproject.harvest.etls.loaders.LoaderException
Constructor that forwards a super class constructor.
LoaderException(Throwable) - Constructor for exception de.gerdiproject.harvest.etls.loaders.LoaderException
Constructor that forwards a super class constructor.
LoaderException(String, Throwable) - Constructor for exception de.gerdiproject.harvest.etls.loaders.LoaderException
Constructor that requires a message and another exception.
LoaderRegistry - Class in de.gerdiproject.harvest.etls.loaders.utils
This class maps loader names to ILoaders at runtime.
LoaderRegistry() - Constructor for class de.gerdiproject.harvest.etls.loaders.utils.LoaderRegistry
Constructor that defines a default active loader.
loadFromDisk() - Method in class de.gerdiproject.harvest.config.Configuration
Attempts to load a configuration file from disk, overwriting the values of existing parameters, but not adding them if they did not exist before.
loadFromDisk() - Method in class de.gerdiproject.harvest.etls.utils.ETLManager
 
loadFromDisk() - Method in class de.gerdiproject.harvest.scheduler.Scheduler
Attempts to load a schedule from disk.
loadFromDisk() - Method in interface de.gerdiproject.harvest.utils.file.ICachedObject
Attempts to load and set values from a cached file.
loadFromEnvironmentVariables() - Method in class de.gerdiproject.harvest.config.parameters.AbstractParameter
Looks for an environment variable that contains the category and key of this parameter and sets the value to that of the environment variable.
loadFromJson(ETLJson) - Method in class de.gerdiproject.harvest.etls.AbstractETL
Loads the state from a JSON representation of this ETL.
loadFromJson(ETLJson) - Method in class de.gerdiproject.harvest.etls.AbstractIteratorETL
 
LOG_DEPLOYMENT_TYPE - Static variable in class de.gerdiproject.harvest.application.constants.ApplicationConstants
 
LOG_PATH_DOCKER - Static variable in class de.gerdiproject.harvest.utils.logger.constants.LoggerConstants
 
LOG_PATH_JETTY - Static variable in class de.gerdiproject.harvest.utils.logger.constants.LoggerConstants
 
LOG_PATH_OTHER - Static variable in class de.gerdiproject.harvest.utils.logger.constants.LoggerConstants
 
LOG_PATH_UNIT_TESTS - Static variable in class de.gerdiproject.harvest.utils.logger.constants.LoggerConstants
 
LOG_PATTERN - Static variable in class de.gerdiproject.harvest.utils.logger.constants.LoggerConstants
 
LOGGER - Static variable in class de.gerdiproject.harvest.application.ContextListener
 
LOGGER - Static variable in class de.gerdiproject.harvest.config.parameters.AbstractParameter
 
logger - Variable in class de.gerdiproject.harvest.etls.AbstractETL
 
logger - Variable in class de.gerdiproject.harvest.etls.loaders.AbstractURLLoader
 
LoggerConstants - Class in de.gerdiproject.harvest.utils.logger.constants
This static class is a collection of constants, used by the HarvesterLog.

M

MainContext - Class in de.gerdiproject.harvest.application
This class provides static methods for retrieving application singleton utility and configuration classes.
mappingFunction - Variable in class de.gerdiproject.harvest.config.parameters.AbstractParameter
 
mapToBoolean(String) - Static method in class de.gerdiproject.harvest.config.parameters.constants.ParameterMappingFunctions
This function checks if a string represents a boolean value and throws an exception if it does not.
mapToInteger(String) - Static method in class de.gerdiproject.harvest.config.parameters.constants.ParameterMappingFunctions
This function checks if a string represents an Integer value and throws an exception if it does not.
mapToNonEmptyString(String) - Static method in class de.gerdiproject.harvest.config.parameters.constants.ParameterMappingFunctions
This function checks if the string value is neither null nor empty and throws an exception if this check fails.
mapToString(String) - Static method in class de.gerdiproject.harvest.config.parameters.constants.ParameterMappingFunctions
This function simply forwards the string parameter that was passed to it.
mapToUnsignedInteger(String) - Static method in class de.gerdiproject.harvest.config.parameters.constants.ParameterMappingFunctions
This function checks if a string represents a positive Integer value and throws an exception if it does not.
mapToUrlString(String) - Static method in class de.gerdiproject.harvest.config.parameters.constants.ParameterMappingFunctions
This function checks if a string represents a valid URL and returns the value if it does.
MAVEN_JAR_FILE_NAME_REPLACEMENT - Static variable in class de.gerdiproject.harvest.utils.maven.constants.MavenConstants
 
MAVEN_JAR_FILE_PATTERN - Static variable in class de.gerdiproject.harvest.utils.maven.constants.MavenConstants
 
MAVEN_JAR_META_INF_FOLDER - Static variable in class de.gerdiproject.harvest.utils.maven.constants.MavenConstants
 
MavenConstants - Class in de.gerdiproject.harvest.utils.maven.constants
This class contains Maven and pom.xml related constants.
MavenUtils - Class in de.gerdiproject.harvest.utils.maven
This class contains utility functions for retrieving Maven values.
MavenUtils(Class<?>) - Constructor for class de.gerdiproject.harvest.utils.maven.MavenUtils
Initializes the class by retrieving the jar name of the jar that contains a specified class.
MAX_BATCH_SIZE_PARAM - Static variable in class de.gerdiproject.harvest.etls.loaders.constants.LoaderConstants
 
MAX_DAYS_IN_MONTH_MAP - Static variable in class de.gerdiproject.harvest.scheduler.constants.CronConstants
 
MAX_RANGE_NUMBER - Static variable in class de.gerdiproject.harvest.etls.constants.ETLConstants
 
maxBatchSizeParam - Variable in class de.gerdiproject.harvest.etls.loaders.AbstractURLLoader
 
MINUTES_MAX_CRON - Static variable in class de.gerdiproject.harvest.scheduler.constants.CronConstants
 
MINUTES_MIN_CRON - Static variable in class de.gerdiproject.harvest.scheduler.constants.CronConstants
 
moduleName - Variable in class de.gerdiproject.harvest.rest.AbstractRestObject
 
MONTHS_MAX_CRON - Static variable in class de.gerdiproject.harvest.scheduler.constants.CronConstants
 
MONTHS_MIN_CRON - Static variable in class de.gerdiproject.harvest.scheduler.constants.CronConstants
 

N

name - Variable in class de.gerdiproject.harvest.etls.AbstractETL
 
NAME_TOTAL - Static variable in class de.gerdiproject.harvest.etls.constants.ETLConstants
 
NEXT_DATE - Static variable in class de.gerdiproject.harvest.scheduler.constants.SchedulerConstants
 
NO_CHANGES - Static variable in class de.gerdiproject.harvest.config.constants.ConfigurationConstants
 
NO_CONFIG_FILE_ERROR - Static variable in class de.gerdiproject.harvest.config.constants.ConfigurationConstants
 
NO_DOCS_ERROR - Static variable in class de.gerdiproject.harvest.etls.loaders.constants.LoaderConstants
 
NO_FORM_PARAMETERS_BODY_ERROR - Static variable in class de.gerdiproject.harvest.rest.constants.RestConstants
 
NO_ITER_ETL_ERROR - Static variable in class de.gerdiproject.harvest.etls.loaders.constants.LoaderConstants
 
NO_JSON_BODY_ERROR - Static variable in class de.gerdiproject.harvest.rest.constants.RestConstants
 
NO_PATH - Static variable in class de.gerdiproject.harvest.config.constants.ConfigurationConstants
 
NO_TIMEOUT - Static variable in class de.gerdiproject.harvest.utils.data.constants.DataOperationConstants
 
NO_URL_ERROR - Static variable in class de.gerdiproject.harvest.etls.loaders.constants.LoaderConstants
 
NON_EMPTY_STRING_PARAM_INVALID - Static variable in class de.gerdiproject.harvest.config.parameters.constants.ParameterConstants
 
NOT_AVAILABLE - Static variable in class de.gerdiproject.harvest.rest.constants.RestConstants
 

O

OCTET_FORMAT - Static variable in class de.gerdiproject.harvest.etls.constants.ETLConstants
 
onContextDestroyed(ContextDestroyedEvent) - Method in class de.gerdiproject.harvest.etls.AbstractETL
The implementation of the context destroyed callback.
onContextDestroyed(ContextDestroyedEvent) - Method in class de.gerdiproject.harvest.rest.AbstractRestObject
Cleans up all objects that are used by this object and removes event listeners.
onContextDestroyed(ContextDestroyedEvent) - Method in class de.gerdiproject.harvest.scheduler.Scheduler
Removes event listeners, cancels the timer and removes all registered tasks.
onHarvestFinished(HarvestFinishedEvent) - Method in class de.gerdiproject.harvest.etls.AbstractETL
The implementation of the harvest finished callback.
onParameterChanged(ParameterChangedEvent) - Method in class de.gerdiproject.harvest.etls.AbstractETL
The implementation of the parameter changed callback.
onParameterChanged(ParameterChangedEvent) - Method in class de.gerdiproject.harvest.etls.AbstractIteratorETL
 
onResetContext(ResetContextEvent) - Method in class de.gerdiproject.harvest.application.ContextListener
This event listener is called when the harvester service is reset.
onResetContext(ResetContextEvent) - Method in class de.gerdiproject.harvest.etls.AbstractETL
The implementation of the service reset callback.
OUTDATED_CONFIG_FILE_ERROR - Static variable in class de.gerdiproject.harvest.config.constants.ConfigurationConstants
 

P

PARAMETER_CATEGORY - Static variable in class de.gerdiproject.harvest.etls.constants.ETLConstants
 
PARAMETER_CATEGORY - Static variable in class de.gerdiproject.harvest.etls.loaders.constants.LoaderConstants
 
ParameterChangedEvent - Class in de.gerdiproject.harvest.config.events
This event is dispatched when the value of a parameter has changed.
ParameterChangedEvent(AbstractParameter<?>, Object) - Constructor for class de.gerdiproject.harvest.config.events.ParameterChangedEvent
 
ParameterConstants - Class in de.gerdiproject.harvest.config.parameters.constants
This static class is a collection of constants, commonly used for classes that deal with the Configuration.
ParameterMappingFunctions - Class in de.gerdiproject.harvest.config.parameters.constants
This class provides functions for mapping string values to specific AbstractParameter values.
PARSE_ERROR - Static variable in class de.gerdiproject.harvest.config.constants.ConfigurationConstants
 
PARSE_ERROR_REASON_PATTERN - Static variable in class de.gerdiproject.harvest.etls.loaders.constants.ElasticSearchConstants
 
PARSE_LOG_PATTERN - Static variable in class de.gerdiproject.harvest.utils.logger.constants.LoggerConstants
 
parseHours(String) - Static method in class de.gerdiproject.harvest.scheduler.utils.CronParser
This method parses the "hours" of a cron tab and generates a byte array of all viable hours.
parseMinutes(String) - Static method in class de.gerdiproject.harvest.scheduler.utils.CronParser
This method parses the "minutes" of a cron tab and generates a byte array of all viable minutes.
parseMonthDays(String) - Static method in class de.gerdiproject.harvest.scheduler.utils.CronParser
This method parses the "days" of a cron tab and generates a byte array of all viable month days.
parseMonths(String, byte[], byte[]) - Static method in class de.gerdiproject.harvest.scheduler.utils.CronParser
This method parses the "months" of a cron tab and generates a byte array of all viable months.
parseWeekDays(String) - Static method in class de.gerdiproject.harvest.scheduler.utils.CronParser
This method parses the "week days" of a cron tab and generates a byte array of all viable week days, converting any 7 to a 0 to enforce the range of 0-6 even tough 1-7 is also viable.
PASSWORD_PARAM - Static variable in class de.gerdiproject.harvest.etls.loaders.constants.LoaderConstants
 
PASSWORD_STRING_TEXT - Static variable in class de.gerdiproject.harvest.config.parameters.constants.ParameterConstants
 
PasswordParameter - Class in de.gerdiproject.harvest.config.parameters
This parameter holds a String value used for passwords.
PasswordParameter(String, String, String, Function<String, String>) - Constructor for class de.gerdiproject.harvest.config.parameters.PasswordParameter
Constructor that uses a custom mapping function.
PasswordParameter(String, String, String) - Constructor for class de.gerdiproject.harvest.config.parameters.PasswordParameter
Constructor that uses the default mapping function.
postConfiguration(String) - Method in class de.gerdiproject.harvest.config.rest.ConfigurationRestResource
Changes parameters of the configuration.
PREPARE_ETLS - Static variable in class de.gerdiproject.harvest.etls.constants.ETLConstants
 
PREPARE_ETLS_FAILED - Static variable in class de.gerdiproject.harvest.etls.constants.ETLConstants
 
prepareHarvest() - Method in class de.gerdiproject.harvest.etls.AbstractETL
Checks pre-conditions required for starting a harvest and updates the data that is to be extracted.
prepareHarvest() - Method in class de.gerdiproject.harvest.etls.AbstractIteratorETL
 
PRETTY_QUERY_PARAM - Static variable in class de.gerdiproject.harvest.rest.constants.RestConstants
 
Procedure - Interface in de.gerdiproject.harvest.utils
This interface represents a lambda expression that accepts no arguments and returns nothing.
processETLs(Collection<AbstractETL<?, ?>>, Consumer<AbstractETL<?, ?>>) - Static method in class de.gerdiproject.harvest.etls.utils.EtlUtils
Sequentially processes a Collection of AbstractETLs and executes a specified Consumer on each one.
processETLsAsList(Collection<AbstractETL<?, ?>>, Function<AbstractETL<?, ?>, T>) - Static method in class de.gerdiproject.harvest.etls.utils.EtlUtils
Processes a Collection of AbstractETLs sequentially and stores the return values of a specified Function in a List.
PROGRESS - Static variable in class de.gerdiproject.harvest.etls.constants.ETLConstants
 
PROGRESS_NO_BOUNDS - Static variable in class de.gerdiproject.harvest.etls.constants.ETLConstants
 
putParameters(MultivaluedMap<String, String>) - Method in class de.gerdiproject.harvest.config.rest.ConfigurationRestResource
Changes parameters of the configuration.

Q

QUERY_KEY - Static variable in class de.gerdiproject.harvest.config.constants.ConfigurationConstants
 

R

READ_FROM_DISK_PARAM - Static variable in class de.gerdiproject.harvest.utils.data.constants.DataOperationConstants
 
REDIRECT_LOCATION_HEADER - Static variable in class de.gerdiproject.harvest.utils.data.constants.DataOperationConstants
 
register(AbstractETL<?, ?>) - Method in class de.gerdiproject.harvest.etls.utils.ETLManager
Registers an AbstractETL, adding it to the list of ETLs that can be controlled via REST.
REGISTER_ERROR - Static variable in class de.gerdiproject.harvest.config.constants.ConfigurationConstants
 
REGISTERED_PARAM - Static variable in class de.gerdiproject.harvest.config.constants.ConfigurationConstants
 
registerLoader(Class<? extends ILoader<?>>) - Method in class de.gerdiproject.harvest.etls.loaders.utils.LoaderRegistry
Registers an ILoader class via its class name.
registerLogger() - Method in class de.gerdiproject.harvest.utils.logger.HarvesterLog
Registers the logger at the list of loggers.
registerParameter(T) - Static method in class de.gerdiproject.harvest.config.Configuration
Convenience function for registering a parameter at the configuration.
RegisterParameterEvent - Class in de.gerdiproject.harvest.config.events
This event aims to register a new parameter in the Configuration.
RegisterParameterEvent(AbstractParameter<?>) - Constructor for class de.gerdiproject.harvest.config.events.RegisterParameterEvent
 
registerParameters() - Method in class de.gerdiproject.harvest.etls.AbstractETL
Registers all configurable parameters.
registerParameters() - Method in class de.gerdiproject.harvest.etls.AbstractIteratorETL
 
REMAINING_TIME - Static variable in class de.gerdiproject.harvest.etls.constants.ETLConstants
 
REMAINING_TIME_UNKNOWN - Static variable in class de.gerdiproject.harvest.etls.constants.ETLConstants
 
removeAllListeners(Class<T>) - Static method in class de.gerdiproject.harvest.event.EventSystem
Removes all event listeners of a specified event.
removeEventListeners() - Method in class de.gerdiproject.harvest.config.Configuration
 
removeEventListeners() - Method in class de.gerdiproject.harvest.etls.AbstractETL
 
removeEventListeners() - Method in class de.gerdiproject.harvest.etls.loaders.utils.LoaderRegistry
 
removeEventListeners() - Method in class de.gerdiproject.harvest.etls.utils.ETLManager
 
removeEventListeners() - Method in interface de.gerdiproject.harvest.event.IEventListener
Removes all event listeners of this class.
removeEventListeners() - Method in class de.gerdiproject.harvest.rest.AbstractRestObject
 
removeEventListeners() - Method in class de.gerdiproject.harvest.scheduler.Scheduler
 
removeListener(Class<T>, Consumer<T>) - Static method in class de.gerdiproject.harvest.event.EventSystem
Removes a callback function for a specified event.
removeSynchronousListener(Class<T>) - Static method in class de.gerdiproject.harvest.event.EventSystem
Removes the callback function of a synchronous event.
REPLACE_FILE_FAILED - Static variable in class de.gerdiproject.harvest.utils.file.constants.FileConstants
 
REPLACE_FILE_FAILED_CANNOT_BACKUP - Static variable in class de.gerdiproject.harvest.utils.file.constants.FileConstants
 
REPLACE_FILE_FAILED_CANNOT_RESTORE - Static variable in class de.gerdiproject.harvest.utils.file.constants.FileConstants
 
REPLACE_FILE_FAILED_NO_FILE - Static variable in class de.gerdiproject.harvest.utils.file.constants.FileConstants
 
REPLACE_FILE_FAILED_NO_TARGET_DIR - Static variable in class de.gerdiproject.harvest.utils.file.constants.FileConstants
 
REPLACE_FILE_SUCCESS - Static variable in class de.gerdiproject.harvest.utils.file.constants.FileConstants
 
replaceFile(File, File) - Static method in class de.gerdiproject.harvest.utils.file.FileUtils
Replaces one file with another and logs any errors.
REQUEST_PROPERTY_CHARSET - Static variable in class de.gerdiproject.harvest.utils.data.constants.DataOperationConstants
 
reset() - Method in class de.gerdiproject.harvest.etls.rest.ETLRestResource
Attempts to completely reset the harvester service
reset() - Static method in class de.gerdiproject.harvest.event.EventSystem
Removes all listeners and clears the queue.
reset() - Method in class de.gerdiproject.harvest.utils.HashGenerator
Resets the fields of the singleton instance to default values.
RESET_STARTED - Static variable in class de.gerdiproject.harvest.rest.constants.RestConstants
 
ResetContextEvent - Class in de.gerdiproject.harvest.application.events
This event is fired when the harvester service is to be reset and re-initialized.
ResetContextEvent() - Constructor for class de.gerdiproject.harvest.application.events.ResetContextEvent
 
RESPONSE_FILE_ENDING - Static variable in class de.gerdiproject.harvest.utils.data.constants.DataOperationConstants
 
REST_GET_TEXT - Static variable in class de.gerdiproject.harvest.rest.constants.RestConstants
 
RestConstants - Class in de.gerdiproject.harvest.rest.constants
This class provides constants that are used by generic REST requests.
restObject - Variable in class de.gerdiproject.harvest.rest.AbstractRestResource
 
RestRequestType - Enum in de.gerdiproject.harvest.utils.data.enums
The type of REST requests that can be sent via the HttpRequester.
RestResourceConfig - Class in de.gerdiproject.harvest.rest
Configuration file that registers all rest classes.
RestResourceConfig() - Constructor for class de.gerdiproject.harvest.rest.RestResourceConfig
 
RETRIES_PARAM - Static variable in class de.gerdiproject.harvest.utils.data.constants.DataOperationConstants
 
RETRY - Static variable in class de.gerdiproject.harvest.utils.data.constants.DataOperationConstants
 
RETRY_AFTER_HEADER - Static variable in class de.gerdiproject.harvest.rest.constants.RestConstants
 
ROOT_LOGGER - Static variable in class de.gerdiproject.harvest.utils.logger.constants.LoggerConstants
 
run() - Method in class de.gerdiproject.harvest.scheduler.HarvestingTimerTask
 
run() - Method in interface de.gerdiproject.harvest.utils.Procedure
Executes the code specified by a lambda expression.

S

SAVE_FAILED - Static variable in class de.gerdiproject.harvest.utils.data.constants.DataOperationConstants
 
SAVE_FAILED_CANNOT_CREATE - Static variable in class de.gerdiproject.harvest.etls.loaders.constants.DiskLoaderConstants
 
SAVE_FAILED_NO_FOLDERS - Static variable in class de.gerdiproject.harvest.utils.data.constants.DataOperationConstants
 
SAVE_FOLDER_NAME - Static variable in class de.gerdiproject.harvest.etls.loaders.constants.DiskLoaderConstants
 
SAVE_NO_PATH_ERROR - Static variable in class de.gerdiproject.harvest.config.constants.ConfigurationConstants
 
SAVE_OK - Static variable in class de.gerdiproject.harvest.utils.data.constants.DataOperationConstants
 
saveToDisk() - Method in class de.gerdiproject.harvest.config.Configuration
Saves the configuration as a Json file.
saveToDisk() - Method in class de.gerdiproject.harvest.etls.utils.ETLManager
 
saveToDisk() - Method in class de.gerdiproject.harvest.scheduler.Scheduler
Saves all cron tabs to disk as a JSON array.
saveToDisk() - Method in interface de.gerdiproject.harvest.utils.file.ICachedObject
Saves the object to a cache file on disk, which can be loaded via loadFromDisk().
SCHEDULED_HARVESTS_TITLE - Static variable in class de.gerdiproject.harvest.scheduler.constants.SchedulerConstants
 
ScheduledTaskExecutedEvent - Class in de.gerdiproject.harvest.scheduler.events
This event singnifies that a task has finished executing.
ScheduledTaskExecutedEvent(TimerTask) - Constructor for class de.gerdiproject.harvest.scheduler.events.ScheduledTaskExecutedEvent
 
Scheduler - Class in de.gerdiproject.harvest.scheduler
This class manages a schedule of cron tabs that trigger harvests.
Scheduler(String, String) - Constructor for class de.gerdiproject.harvest.scheduler.Scheduler
Constructor that initializes the timer and task registry.
SchedulerConstants - Class in de.gerdiproject.harvest.scheduler.constants
This class offers constants that are related to scheduling.
SchedulerResponse - Class in de.gerdiproject.harvest.scheduler.json
This class represents a JSON response from a .json GET request of the SchedulerRestResource.
SchedulerResponse(Set<String>) - Constructor for class de.gerdiproject.harvest.scheduler.json.SchedulerResponse
 
SchedulerRestResource - Class in de.gerdiproject.harvest.scheduler.rest
This class serves as a REST interface to the Scheduler.
SchedulerRestResource() - Constructor for class de.gerdiproject.harvest.scheduler.rest.SchedulerRestResource
 
sendEvent(T) - Static method in class de.gerdiproject.harvest.event.EventSystem
Dispatches a specified asynchronous event by adding it to a queue.
sendSynchronousEvent(T) - Static method in class de.gerdiproject.harvest.event.EventSystem
Dispatches a synchronous event that executes a unique callback function and returns its calculated value.
sendWebRequest(RestRequestType, String, String, String, String, int) - Method in class de.gerdiproject.harvest.utils.data.WebDataRetriever
Sends a REST request with a specified body and returns the connection.
serialize(Configuration, Type, JsonSerializationContext) - Method in class de.gerdiproject.harvest.config.json.adapters.ConfigurationAdapter
 
ServiceInitializedEvent - Class in de.gerdiproject.harvest.application.events
This event signifies that the harvester service initialization process is over.
ServiceInitializedEvent(boolean) - Constructor for class de.gerdiproject.harvest.application.events.ServiceInitializedEvent
Simple Constructor.
SET_NO_PAYLOAD_ERROR - Static variable in class de.gerdiproject.harvest.config.constants.ConfigurationConstants
 
SET_UNKNOWN_PARAM_ERROR - Static variable in class de.gerdiproject.harvest.config.constants.ConfigurationConstants
 
setCacheFilePath(String) - Method in class de.gerdiproject.harvest.config.Configuration
Sets the file path to which the configuration can be saved.
setCacheFolder(File) - Method in class de.gerdiproject.harvest.utils.data.HttpRequester
 
setCharset(Charset) - Method in class de.gerdiproject.harvest.utils.data.DiskIO
 
setCharset(Charset) - Method in class de.gerdiproject.harvest.utils.data.HttpRequester
Changes the charset that is used for reading and writing responses.
setCharset(Charset) - Method in interface de.gerdiproject.harvest.utils.data.IDataRetriever
Changes the charset used for (de-)serializing requests.
setCharset(Charset) - Method in class de.gerdiproject.harvest.utils.data.WebDataRetriever
 
setHealth(ETLHealth) - Method in class de.gerdiproject.harvest.etls.AbstractETL
Changes the health status.
setMappingFunction(Function<String, V>) - Method in class de.gerdiproject.harvest.config.parameters.AbstractParameter
Sets the function that maps a String value to V.
setName(String) - Method in class de.gerdiproject.harvest.etls.AbstractETL
Changes the name of the ETL.
setParameter(String, String) - Method in class de.gerdiproject.harvest.config.Configuration
Changes a configuration parameter, returning a status message about the change.
setRegistered(boolean) - Method in class de.gerdiproject.harvest.config.parameters.AbstractParameter
Determines if the parameter is registered at the Configuration.
setStatus(ETLState) - Method in class de.gerdiproject.harvest.etls.AbstractETL
Changes the status that represents what the ETL is currently doing.
setTimeout(int) - Method in class de.gerdiproject.harvest.utils.data.HttpRequester
Changes the request timeout for web requests.
setTimeout(int) - Method in class de.gerdiproject.harvest.utils.data.WebDataRetriever
 
setUrl(String) - Method in class de.gerdiproject.harvest.etls.extractors.JsonArrayExtractor
Changes the URL that is used to retrieve the JSON response.
setValue(String) - Method in class de.gerdiproject.harvest.config.parameters.AbstractParameter
Changes the stored value by parsing a String argument.
SHA_HASH_ALGORITHM - Static variable in class de.gerdiproject.harvest.etls.constants.ETLConstants
 
size() - Method in class de.gerdiproject.harvest.etls.extractors.AbstractIteratorExtractor
 
size() - Method in interface de.gerdiproject.harvest.etls.extractors.IExtractor
Returns the number of extractable documents, or -1 if they cannot be estimated.
size() - Method in class de.gerdiproject.harvest.etls.extractors.JsonArrayExtractor
 
size() - Method in class de.gerdiproject.harvest.scheduler.Scheduler
Returns the number of registered cron tabs.
skipHarvest() - Method in class de.gerdiproject.harvest.etls.AbstractETL
Marks the harvest as done.
SOURCE_HASH_JSON - Static variable in class de.gerdiproject.harvest.etls.loaders.constants.DiskLoaderConstants
 
START_ETLS - Static variable in class de.gerdiproject.harvest.etls.constants.ETLConstants
 
START_INDEX_PARAM_DEFAULT_VALUE - Static variable in class de.gerdiproject.harvest.etls.constants.ETLConstants
 
START_INDEX_PARAM_KEY - Static variable in class de.gerdiproject.harvest.etls.constants.ETLConstants
 
startHarvest(MultivaluedMap<String, String>) - Method in class de.gerdiproject.harvest.etls.rest.ETLRestResource
Starts a harvest using the harvester that is registered in the MainContext.
startIndex - Variable in class de.gerdiproject.harvest.etls.extractors.AbstractIteratorExtractor
 
startIndexParameter - Variable in class de.gerdiproject.harvest.etls.AbstractIteratorETL
 
stateHistory - Variable in class de.gerdiproject.harvest.etls.AbstractETL
 
StaticIteratorETL<T,S> - Class in de.gerdiproject.harvest.etls
This ETL harvests data via Iterators and creates a document for each iterated element.
StaticIteratorETL(AbstractIteratorExtractor<T>, AbstractIteratorTransformer<T, S>) - Constructor for class de.gerdiproject.harvest.etls.StaticIteratorETL
Constructor that initializes the extractor and transformer.
StaticIteratorETL(String, AbstractIteratorExtractor<T>, AbstractIteratorTransformer<T, S>) - Constructor for class de.gerdiproject.harvest.etls.StaticIteratorETL
Constructor that initializes the extractor and transformer.
STATUS_FAILED - Static variable in class de.gerdiproject.harvest.rest.constants.RestConstants
 
STATUS_OK - Static variable in class de.gerdiproject.harvest.rest.constants.RestConstants
 
StringParameter - Class in de.gerdiproject.harvest.config.parameters
This parameter holds a String value.
StringParameter(String, String, String, Function<String, String>) - Constructor for class de.gerdiproject.harvest.config.parameters.StringParameter
Constructor that uses a custom mapping function.
StringParameter(String, String, String) - Constructor for class de.gerdiproject.harvest.config.parameters.StringParameter
Constructor that uses the default mapping function.
sumUpETLValues(Collection<AbstractETL<?, ?>>, Function<AbstractETL<?, ?>, Integer>) - Static method in class de.gerdiproject.harvest.etls.utils.EtlUtils
Iterates a Collection of AbstractETLs sequentially and sums up the return values of a specified Function.

T

TARGET_FOLDER - Static variable in class de.gerdiproject.harvest.utils.maven.constants.MavenConstants
 
TASK_ENTRY - Static variable in class de.gerdiproject.harvest.scheduler.constants.SchedulerConstants
 
TASK_MESSAGE - Static variable in class de.gerdiproject.harvest.scheduler.constants.SchedulerConstants
 
TEMP_FILE_EXTENSION - Static variable in class de.gerdiproject.harvest.utils.file.constants.FileConstants
 
TimestampedEntry<T> - Class in de.gerdiproject.harvest.etls.utils
This class serves as an entry in the TimestampedList.
TimestampedEntry(T) - Constructor for class de.gerdiproject.harvest.etls.utils.TimestampedEntry
Constructor that sets the timestamp to the current time.
TimestampedEntry(T, long) - Constructor for class de.gerdiproject.harvest.etls.utils.TimestampedEntry
 
TimestampedEntryComparator - Class in de.gerdiproject.harvest.etls.utils
This class is a comparator for TimestampedEntrys.
TimestampedEntryComparator() - Constructor for class de.gerdiproject.harvest.etls.utils.TimestampedEntryComparator
 
TimestampedList<T> - Class in de.gerdiproject.harvest.etls.utils
This class stores a list of values and timestamps that indicate when the values were added.
TimestampedList(int) - Constructor for class de.gerdiproject.harvest.etls.utils.TimestampedList
Constructor that allows to set the max amount of items in the list.
TimestampedList(T, int) - Constructor for class de.gerdiproject.harvest.etls.utils.TimestampedList
Constructor that allows to set the max amount of items in the list and the initial value.
toString() - Method in class de.gerdiproject.harvest.application.MainContext
 
toString() - Method in class de.gerdiproject.harvest.config.events.ParameterChangedEvent
 
toString() - Method in class de.gerdiproject.harvest.config.events.RegisterParameterEvent
 
toString() - Method in class de.gerdiproject.harvest.config.events.UnregisterParameterEvent
 
toString() - Method in class de.gerdiproject.harvest.config.parameters.AbstractParameter
 
toString() - Method in class de.gerdiproject.harvest.etls.AbstractETL
 
toString() - Method in class de.gerdiproject.harvest.etls.events.HarvestFinishedEvent
 
toString() - Method in class de.gerdiproject.harvest.etls.events.HarvestStartedEvent
 
toString() - Method in class de.gerdiproject.harvest.etls.json.ETLInfosJson
 
toString() - Method in class de.gerdiproject.harvest.etls.json.ETLJson
 
toString() - Method in class de.gerdiproject.harvest.etls.json.ETLManagerJson
 
toString() - Method in class de.gerdiproject.harvest.etls.loaders.json.ElasticSearchError
 
toString() - Method in class de.gerdiproject.harvest.etls.loaders.json.ElasticSearchErrorCause
 
toString() - Method in class de.gerdiproject.harvest.etls.loaders.json.ElasticSearchIndex
 
toString() - Method in class de.gerdiproject.harvest.etls.loaders.json.ElasticSearchIndexWrapper
 
toString() - Method in class de.gerdiproject.harvest.etls.loaders.json.ElasticSearchResponse
 
toString() - Method in class de.gerdiproject.harvest.etls.loaders.json.ElasticSearchShard
 
toString() - Method in class de.gerdiproject.harvest.etls.utils.TimestampedEntry
 
toString() - Method in class de.gerdiproject.harvest.etls.utils.TimestampedList
 
toString() - Method in class de.gerdiproject.harvest.scheduler.events.ScheduledTaskExecutedEvent
 
toString() - Method in class de.gerdiproject.harvest.scheduler.json.ChangeSchedulerRequest
 
toString() - Method in class de.gerdiproject.harvest.scheduler.json.SchedulerResponse
 
transform(Iterator<T>) - Method in class de.gerdiproject.harvest.etls.transformers.AbstractIteratorTransformer
 
transform(T) - Method in interface de.gerdiproject.harvest.etls.transformers.ITransformer
Transforms an extracted element to a document that can be loaded.
transformElement(T) - Method in class de.gerdiproject.harvest.etls.transformers.AbstractIteratorTransformer
Transforms a single element.
transformer - Variable in class de.gerdiproject.harvest.etls.AbstractETL
 
TRANSFORMER_CREATE_ERROR - Static variable in class de.gerdiproject.harvest.etls.constants.ETLConstants
 
TransformerException - Exception in de.gerdiproject.harvest.etls.transformers
This exception is thrown when an ITransformer fails to transform elements.
TransformerException(String) - Constructor for exception de.gerdiproject.harvest.etls.transformers.TransformerException
Forwarded super-class constructor
TransformerException(Throwable) - Constructor for exception de.gerdiproject.harvest.etls.transformers.TransformerException
Constructor that forwards a super class constructor.
TransformerException(String, Throwable) - Constructor for exception de.gerdiproject.harvest.etls.transformers.TransformerException
Constructor that requires a message and another exception.
tryLoadingBatch() - Method in class de.gerdiproject.harvest.etls.loaders.AbstractURLLoader
Sends documents to an external place.

U

UNKNOWN_DOCUMENT_COUNT - Static variable in class de.gerdiproject.harvest.etls.loaders.constants.LoaderConstants
 
UNKNOWN_ERROR - Static variable in class de.gerdiproject.harvest.rest.constants.RestConstants
 
UNKNOWN_NUMBER - Static variable in class de.gerdiproject.harvest.etls.constants.ETLConstants
 
unregisterLogger() - Method in class de.gerdiproject.harvest.utils.logger.HarvesterLog
Unregisters the logger from the list of loggers.
unregisterParameter(AbstractParameter<?>) - Static method in class de.gerdiproject.harvest.config.Configuration
Convenience function for unregistering a parameter from the configuration.
UnregisterParameterEvent - Class in de.gerdiproject.harvest.config.events
This event aims to unregister a parameter from the Configuration.
UnregisterParameterEvent(AbstractParameter<?>) - Constructor for class de.gerdiproject.harvest.config.events.UnregisterParameterEvent
 
unregisterParameters() - Method in class de.gerdiproject.harvest.etls.loaders.AbstractURLLoader
 
unregisterParameters() - Method in class de.gerdiproject.harvest.etls.loaders.DiskLoader
 
unregisterParameters() - Method in interface de.gerdiproject.harvest.etls.loaders.ILoader
If the Loader created parameters in the Configuration, this method should unregister all of them.
update() - Method in class de.gerdiproject.harvest.etls.AbstractETL
Updates the harvested source documents, calculating the hash and maximum number of harvestable documents.
UPDATE_ERROR - Static variable in class de.gerdiproject.harvest.etls.constants.ETLConstants
 
URL_PARAM - Static variable in class de.gerdiproject.harvest.etls.loaders.constants.LoaderConstants
 
URL_PARAM_INVALID - Static variable in class de.gerdiproject.harvest.config.parameters.constants.ParameterConstants
 
urlParam - Variable in class de.gerdiproject.harvest.etls.loaders.AbstractURLLoader
 
USER_NAME_PARAM - Static variable in class de.gerdiproject.harvest.etls.loaders.constants.LoaderConstants
 

V

VALID_PARAM_NAME_REGEX - Static variable in class de.gerdiproject.harvest.config.parameters.constants.ParameterConstants
 
value - Variable in class de.gerdiproject.harvest.config.parameters.AbstractParameter
 
VALUE_JSON - Static variable in class de.gerdiproject.harvest.rest.constants.RestConstants
 
valueOf(String) - Static method in enum de.gerdiproject.harvest.application.enums.DeploymentType
Returns the enum constant of this type with the specified name.
valueOf(String) - Static method in enum de.gerdiproject.harvest.etls.enums.ETLHealth
Returns the enum constant of this type with the specified name.
valueOf(String) - Static method in enum de.gerdiproject.harvest.etls.enums.ETLState
Returns the enum constant of this type with the specified name.
valueOf(String) - Static method in enum de.gerdiproject.harvest.scheduler.enums.CronMonth
Returns the enum constant of this type with the specified name.
valueOf(String) - Static method in enum de.gerdiproject.harvest.scheduler.enums.CronWeekDay
Returns the enum constant of this type with the specified name.
valueOf(String) - Static method in enum de.gerdiproject.harvest.utils.data.enums.RestRequestType
Returns the enum constant of this type with the specified name.
values() - Static method in enum de.gerdiproject.harvest.application.enums.DeploymentType
Returns an array containing the constants of this enum type, in the order they are declared.
values() - Static method in enum de.gerdiproject.harvest.etls.enums.ETLHealth
Returns an array containing the constants of this enum type, in the order they are declared.
values() - Static method in enum de.gerdiproject.harvest.etls.enums.ETLState
Returns an array containing the constants of this enum type, in the order they are declared.
values() - Static method in enum de.gerdiproject.harvest.scheduler.enums.CronMonth
Returns an array containing the constants of this enum type, in the order they are declared.
values() - Static method in enum de.gerdiproject.harvest.scheduler.enums.CronWeekDay
Returns an array containing the constants of this enum type, in the order they are declared.
values() - Static method in enum de.gerdiproject.harvest.utils.data.enums.RestRequestType
Returns an array containing the constants of this enum type, in the order they are declared.

W

WAIT_FOR_INIT - Static variable in class de.gerdiproject.harvest.rest.constants.RestConstants
 
WEB_ERROR_HEADER - Static variable in class de.gerdiproject.harvest.utils.data.constants.DataOperationConstants
 
WEB_ERROR_JSON - Static variable in class de.gerdiproject.harvest.utils.data.constants.DataOperationConstants
 
WEB_ERROR_REST_HTTP - Static variable in class de.gerdiproject.harvest.utils.data.constants.DataOperationConstants
 
WEB_ERROR_REST_RESPONSE - Static variable in class de.gerdiproject.harvest.utils.data.constants.DataOperationConstants
 
WebDataRetriever - Class in de.gerdiproject.harvest.utils.data
This class provides methods for reading files from the web.
WebDataRetriever(Gson, Charset, int) - Constructor for class de.gerdiproject.harvest.utils.data.WebDataRetriever
Constructor that sets the GSON (de-)serializer for reading and writing JSON objects, as well as the charset and timeout.
WebDataRetriever(Gson, Charset) - Constructor for class de.gerdiproject.harvest.utils.data.WebDataRetriever
Constructor that sets the GSON (de-)serializer for reading and writing JSON objects, as well as the charset.
WebDataRetriever(WebDataRetriever) - Constructor for class de.gerdiproject.harvest.utils.data.WebDataRetriever
Constructor that copies settings from another WebDataRetriever.
WEEK_DAYS_MAX_CRON - Static variable in class de.gerdiproject.harvest.scheduler.constants.CronConstants
 
WEEK_DAYS_MIN_CRON - Static variable in class de.gerdiproject.harvest.scheduler.constants.CronConstants
 
WRITE_TO_DISK_PARAM - Static variable in class de.gerdiproject.harvest.utils.data.constants.DataOperationConstants
 
writeObjectToFile(String, Object) - Method in class de.gerdiproject.harvest.utils.data.DiskIO
Attempts to transform an object to a JSON object and writes it to a file on disk.
writeObjectToFile(File, Object) - Method in class de.gerdiproject.harvest.utils.data.DiskIO
Attempts to transform an object to a JSON object and writes it to a file on disk.
writeStringToFile(String, String) - Method in class de.gerdiproject.harvest.utils.data.DiskIO
Writes a string to a file on disk.
writeStringToFile(File, String) - Method in class de.gerdiproject.harvest.utils.data.DiskIO
Writes a string to a file on disk.
A B C D E F G H I J K L M N O P Q R S T U V W 
Skip navigation links

Copyright © 2017–2019. All rights reserved.