- abort() - Method in class de.gerdiproject.harvest.etls.rest.ETLRestResource
-
Aborts an ongoing harvest.
- ABORT_FINISHED - Static variable in class de.gerdiproject.harvest.etls.constants.ETLConstants
-
- ABORT_HARVEST_FAILED_NO_HARVEST - Static variable in class de.gerdiproject.harvest.etls.constants.ETLConstants
-
- ABORT_INVALID_STATE - Static variable in class de.gerdiproject.harvest.etls.constants.ETLConstants
-
- ABORT_START - Static variable in class de.gerdiproject.harvest.etls.constants.ETLConstants
-
- abortHarvest() - Method in class de.gerdiproject.harvest.etls.AbstractETL
-
Aborts the harvesting process, allowing a new harvest to be started.
- abortHarvest() - Method in class de.gerdiproject.harvest.etls.utils.ETLManager
-
Attempts to abort an ongoing harvest.
- AbstractETL<T,S> - Class in de.gerdiproject.harvest.etls
-
This class offers a skeleton for harvesting a repository to
retrieve all of its metadata.
- AbstractETL() - Constructor for class de.gerdiproject.harvest.etls.AbstractETL
-
Constructor that initializes helper classes and fields.
- AbstractETL(String) - Constructor for class de.gerdiproject.harvest.etls.AbstractETL
-
Constructor that initializes helper classes and fields.
- AbstractIteratorETL<T,S> - Class in de.gerdiproject.harvest.etls
-
This ETL harvests data via
Iterators and creates a
document for each iterated element.
- AbstractIteratorETL() - Constructor for class de.gerdiproject.harvest.etls.AbstractIteratorETL
-
Forwarding super class constructor.
- AbstractIteratorETL(String) - Constructor for class de.gerdiproject.harvest.etls.AbstractIteratorETL
-
Forwarding super class constructor.
- AbstractIteratorExtractor<T> - Class in de.gerdiproject.harvest.etls.extractors
-
This
IExtractor can extract an
Iterator in order
to be able to iterate lists or similar constructs.
- AbstractIteratorExtractor() - Constructor for class de.gerdiproject.harvest.etls.extractors.AbstractIteratorExtractor
-
- AbstractIteratorLoader<S> - Class in de.gerdiproject.harvest.etls.loaders
-
This loader can load multiple documents.
- AbstractIteratorLoader() - Constructor for class de.gerdiproject.harvest.etls.loaders.AbstractIteratorLoader
-
- AbstractIteratorTransformer<T,S> - Class in de.gerdiproject.harvest.etls.transformers
-
This transformer can transform multiple documents.
- AbstractIteratorTransformer() - Constructor for class de.gerdiproject.harvest.etls.transformers.AbstractIteratorTransformer
-
- AbstractParameter<V> - Class in de.gerdiproject.harvest.config.parameters
-
- AbstractParameter(String, String, V, Function<String, V>) - Constructor for class de.gerdiproject.harvest.config.parameters.AbstractParameter
-
Constructor that uses a custom mapping function.
- AbstractRestObject<T extends AbstractRestObject<T,P>,P> - Class in de.gerdiproject.harvest.rest
-
- AbstractRestObject(String, Class<? extends GetRestObjectEvent<T>>) - Constructor for class de.gerdiproject.harvest.rest.AbstractRestObject
-
Constructor that requires the moduleName for pretty printing and the class
of the
GetRestObjectEvent that is used to retrieve the singleton instance of this object.
- AbstractRestResource<T extends AbstractRestObject<T,?>,S extends GetRestObjectEvent<T>> - Class in de.gerdiproject.harvest.rest
-
This abstract class represents the interface between HTTP requests
and a singleton object that can be manipulated by such.
- AbstractRestResource(Gson) - Constructor for class de.gerdiproject.harvest.rest.AbstractRestResource
-
This constructor constructs and dispatches an instance of the generic
GetRestObjectEvent
in order to retrieve the singleton object.
- AbstractRestResource() - Constructor for class de.gerdiproject.harvest.rest.AbstractRestResource
-
This constructor constructs and dispatches an instance of the generic
GetRestObjectEvent
in order to retrieve the singleton object.
- AbstractSucceededOrFailedEvent - Class in de.gerdiproject.harvest.event
-
This event marks something that can either succeed or fail.
- AbstractSucceededOrFailedEvent(boolean) - Constructor for class de.gerdiproject.harvest.event.AbstractSucceededOrFailedEvent
-
- AbstractURLLoader<S extends de.gerdiproject.harvest.IDocument> - Class in de.gerdiproject.harvest.etls.loaders
-
This abstract class offers a basis for sending documents to a search index
via a REST request.
- AbstractURLLoader() - Constructor for class de.gerdiproject.harvest.etls.loaders.AbstractURLLoader
-
Constructor that initializes the Logger.
- ADD_OK - Static variable in class de.gerdiproject.harvest.scheduler.constants.SchedulerConstants
-
- addAllSorted(Collection<TimestampedEntry<T>>) - Method in class de.gerdiproject.harvest.etls.utils.TimestampedList
-
- addEventListeners() - Method in class de.gerdiproject.harvest.config.Configuration
-
- addEventListeners() - Method in class de.gerdiproject.harvest.etls.AbstractETL
-
- addEventListeners() - Method in class de.gerdiproject.harvest.etls.loaders.utils.LoaderRegistry
-
- addEventListeners() - Method in class de.gerdiproject.harvest.etls.utils.ETLManager
-
- addEventListeners() - Method in interface de.gerdiproject.harvest.event.IEventListener
-
Adds event listeners.
- addEventListeners() - Method in class de.gerdiproject.harvest.rest.AbstractRestObject
-
- addEventListeners() - Method in class de.gerdiproject.harvest.scheduler.Scheduler
-
- addListener(Class<T>, Consumer<T>) - Static method in class de.gerdiproject.harvest.event.EventSystem
-
Adds a callback function that is to be executed when a specified event is
dispatched.
- addSynchronousListener(Class<T>, Function<T, R>) - Static method in class de.gerdiproject.harvest.event.EventSystem
-
Adds a callback function that executes and returns a value when a
specified synchronous event is dispatched.
- addSynchronousListener(Class<T>, Supplier<R>) - Static method in class de.gerdiproject.harvest.event.EventSystem
-
Adds a callback function that executes and returns a value when a
specified synchronous event is dispatched.
- addTask(String) - Method in class de.gerdiproject.harvest.scheduler.rest.SchedulerRestResource
-
Adds a harvesting task with a specified cron tab to the schedule.
- addTask(ChangeSchedulerRequest) - Method in class de.gerdiproject.harvest.scheduler.Scheduler
-
Adds a new task to the scheduler.
- addValue(T) - Method in class de.gerdiproject.harvest.etls.utils.TimestampedList
-
Adds a new value and the current timestamp to the list.
- ALLOWED_REQUESTS - Static variable in class de.gerdiproject.harvest.config.constants.ConfigurationConstants
-
- ALLOWED_REQUESTS - Static variable in class de.gerdiproject.harvest.etls.constants.ETLConstants
-
- ALLOWED_REQUESTS - Static variable in class de.gerdiproject.harvest.scheduler.constants.SchedulerConstants
-
- ALLOWED_VALUES - Static variable in class de.gerdiproject.harvest.config.parameters.constants.ParameterConstants
-
- andThen(Procedure) - Method in interface de.gerdiproject.harvest.utils.Procedure
-
- ApplicationConstants - Class in de.gerdiproject.harvest.application.constants
-
This static class is a collection of constants that are used for ContextListeners and application related classes.
- CACHE_DIR_JETTY - Static variable in class de.gerdiproject.harvest.application.constants.ApplicationConstants
-
- CACHE_DIR_OTHER - Static variable in class de.gerdiproject.harvest.application.constants.ApplicationConstants
-
- CACHE_DIR_UNIT_TESTS - Static variable in class de.gerdiproject.harvest.application.constants.ApplicationConstants
-
- CACHE_ENTRY_STREAM_PATH - Static variable in class de.gerdiproject.harvest.utils.file.constants.FileConstants
-
- CACHE_FOLDER_PATH - Static variable in class de.gerdiproject.harvest.utils.data.constants.DataOperationConstants
-
- CACHE_FOLDER_PATH - Static variable in class de.gerdiproject.harvest.utils.file.constants.FileConstants
-
- CACHE_PATH - Static variable in class de.gerdiproject.harvest.scheduler.constants.SchedulerConstants
-
- CACHE_ROOT_DIR_OTHER - Static variable in class de.gerdiproject.harvest.application.constants.ApplicationConstants
-
- cancel(boolean) - Method in class de.gerdiproject.harvest.utils.CancelableFuture
-
- CancelableFuture<T> - Class in de.gerdiproject.harvest.utils
-
- CancelableFuture(Callable<T>, ExecutorService) - Constructor for class de.gerdiproject.harvest.utils.CancelableFuture
-
Creates a new CancelableFuture which will be completed by calling the
given
Callable via the provided
ExecutorService.
- CancelableFuture(Callable<T>) - Constructor for class de.gerdiproject.harvest.utils.CancelableFuture
-
Creates a new CancelableFuture which will be completed by calling the
given
Callable via the provided
ExecutorService.
- cancelHarvest() - Method in class de.gerdiproject.harvest.etls.AbstractETL
-
Cancels the ETL if it is queued to harvest,
cleaning up readers and writers if necessary.
- canEqual(Object) - Method in class de.gerdiproject.harvest.etls.events.HarvestFinishedEvent
-
- canEqual(Object) - Method in class de.gerdiproject.harvest.etls.json.ETLInfosJson
-
- CANNOT_CHANGE_PARAM - Static variable in class de.gerdiproject.harvest.config.parameters.constants.ParameterConstants
-
- CANNOT_FIX_INVALID_DOCUMENT_ERROR - Static variable in class de.gerdiproject.harvest.etls.loaders.constants.ElasticSearchConstants
-
- CANNOT_PROCESS_PREFIX - Static variable in class de.gerdiproject.harvest.rest.constants.RestConstants
-
- category - Variable in class de.gerdiproject.harvest.config.parameters.AbstractParameter
-
- CATEGORY_FORMAT - Static variable in class de.gerdiproject.harvest.config.constants.ConfigurationConstants
-
- ChangeConfigurationRequest - Class in de.gerdiproject.harvest.config.json
-
This class represents a JSON object used for changing the
Configuration.
- ChangeConfigurationRequest() - Constructor for class de.gerdiproject.harvest.config.json.ChangeConfigurationRequest
-
- CHANGED_PARAM - Static variable in class de.gerdiproject.harvest.config.parameters.constants.ParameterConstants
-
- changeObject(Function<P, R>, String, Class<P>) - Method in class de.gerdiproject.harvest.rest.AbstractRestResource
-
Parses the required JSON object from a specified string and calls
a string returning function using the parsed object as argument.
- changeParameters(Map<String, String>) - Method in class de.gerdiproject.harvest.config.Configuration
-
Changes multiple parameters, returning a status message about the change.
- ChangeSchedulerRequest - Class in de.gerdiproject.harvest.scheduler.json
-
This JSON object represents a REST request that can delete/add/change
a crontab of the
Scheduler.
- ChangeSchedulerRequest(String) - Constructor for class de.gerdiproject.harvest.scheduler.json.ChangeSchedulerRequest
-
- charset - Variable in class de.gerdiproject.harvest.etls.loaders.AbstractURLLoader
-
- checkIfEtlIssOutdated() - Method in class de.gerdiproject.harvest.etls.rest.ETLRestResource
-
Checks if the harvester should be triggered again.
- checkPreconditionErrors() - Method in class de.gerdiproject.harvest.etls.loaders.AbstractURLLoader
-
Checks if the loader can start
- CLEAN_LOAD_ERROR - Static variable in class de.gerdiproject.harvest.etls.loaders.constants.LoaderConstants
-
- clear() - Method in interface de.gerdiproject.harvest.etls.extractors.IExtractor
-
Closes potentially open readers/writers and finishes the Extraction process
if it is still ongoing.
- clear() - Method in class de.gerdiproject.harvest.etls.extractors.JsonArrayExtractor
-
- clear() - Method in class de.gerdiproject.harvest.etls.loaders.AbstractURLLoader
-
- clear() - Method in class de.gerdiproject.harvest.etls.loaders.DiskLoader
-
Attempts to close the writer.
- clear() - Method in interface de.gerdiproject.harvest.etls.loaders.ILoader
-
Closes potentially open readers/writers and finishes the Load process
if it is still ongoing.
- clear() - Method in interface de.gerdiproject.harvest.etls.transformers.ITransformer
-
Closes potentially open readers/writers and finishes the Transformation process
if it is still ongoing.
- clearLog() - Method in class de.gerdiproject.harvest.utils.logger.HarvesterLog
-
Deletes the log file.
- compare(TimestampedEntry<?>, TimestampedEntry<?>) - Method in class de.gerdiproject.harvest.etls.utils.TimestampedEntryComparator
-
- compose(Procedure) - Method in interface de.gerdiproject.harvest.utils.Procedure
-
- COMPOSITE_KEY - Static variable in class de.gerdiproject.harvest.config.parameters.constants.ParameterConstants
-
- CONCURRENT_PARAM - Static variable in class de.gerdiproject.harvest.etls.constants.ETLConstants
-
- CONFIG_FOLDER_PATH - Static variable in class de.gerdiproject.harvest.utils.file.constants.FileConstants
-
- CONFIG_PATH - Static variable in class de.gerdiproject.harvest.config.constants.ConfigurationConstants
-
- Configuration - Class in de.gerdiproject.harvest.config
-
- Configuration(String, AbstractParameter<?>...) - Constructor for class de.gerdiproject.harvest.config.Configuration
-
Constructor that requires a list of parameters.
- ConfigurationAdapter - Class in de.gerdiproject.harvest.config.json.adapters
-
This adapter defines the (de-)serialization behavior of
Configuration objects.
- ConfigurationAdapter() - Constructor for class de.gerdiproject.harvest.config.json.adapters.ConfigurationAdapter
-
- ConfigurationConstants - Class in de.gerdiproject.harvest.config.constants
-
This static class is a collection of constants, commonly used for classes
that deal with the
Configuration.
- ConfigurationRestResource - Class in de.gerdiproject.harvest.config.rest
-
This facade serves as an interface between REST and the
Configuration.
- ConfigurationRestResource() - Constructor for class de.gerdiproject.harvest.config.rest.ConfigurationRestResource
-
Constructor
- CONTEXT_DESTROYED - Static variable in class de.gerdiproject.harvest.application.constants.ApplicationConstants
-
- CONTEXT_RESET - Static variable in class de.gerdiproject.harvest.application.constants.ApplicationConstants
-
- contextDestroyed(ServletContextEvent) - Method in class de.gerdiproject.harvest.application.ContextListener
-
This method is called when the server shuts down.
- ContextDestroyedEvent - Class in de.gerdiproject.harvest.application.events
-
This event is fired when the WAR file of this harvester service is undeployed from a server.
- ContextDestroyedEvent() - Constructor for class de.gerdiproject.harvest.application.events.ContextDestroyedEvent
-
- contextInitialized(ServletContextEvent) - Method in class de.gerdiproject.harvest.application.ContextListener
-
This method is called when the server is set up.
- ContextInitializedEvent - Class in de.gerdiproject.harvest.application.events
-
This event is fired when the WAR file of this harvester service is deployed on a server.
- ContextInitializedEvent() - Constructor for class de.gerdiproject.harvest.application.events.ContextInitializedEvent
-
- ContextListener - Class in de.gerdiproject.harvest.application
-
This class registers a Logger and Harvester when the server is started.
- ContextListener() - Constructor for class de.gerdiproject.harvest.application.ContextListener
-
- copy() - Method in class de.gerdiproject.harvest.config.parameters.AbstractParameter
-
Creates an unregistered copy of this parameter.
- copy() - Method in class de.gerdiproject.harvest.config.parameters.BooleanParameter
-
- copy() - Method in class de.gerdiproject.harvest.config.parameters.IntegerParameter
-
- copy() - Method in class de.gerdiproject.harvest.config.parameters.PasswordParameter
-
- copy() - Method in class de.gerdiproject.harvest.config.parameters.StringParameter
-
- COPY_FILE_FAILED - Static variable in class de.gerdiproject.harvest.utils.file.constants.FileConstants
-
- COPY_FILE_FAILED_NO_FILE - Static variable in class de.gerdiproject.harvest.utils.file.constants.FileConstants
-
- COPY_FILE_SUCCESS - Static variable in class de.gerdiproject.harvest.utils.file.constants.FileConstants
-
- copyFile(File, File) - Static method in class de.gerdiproject.harvest.utils.file.FileUtils
-
Copies a single file to a target destination and logs any errors.
- CREATE_DIR_FAILED - Static variable in class de.gerdiproject.harvest.utils.file.constants.FileConstants
-
- CREATE_DIR_SUCCESS - Static variable in class de.gerdiproject.harvest.utils.file.constants.FileConstants
-
- CREATE_FILE_FAILED - Static variable in class de.gerdiproject.harvest.utils.file.constants.FileConstants
-
- CREATE_FILE_SUCCESS - Static variable in class de.gerdiproject.harvest.utils.file.constants.FileConstants
-
- createAcceptedResponse(String) - Static method in class de.gerdiproject.harvest.rest.HttpResponseFactory
-
Creates a HTTP-202 response for signalling that a process was started.
- createBadRequestResponse() - Static method in class de.gerdiproject.harvest.rest.HttpResponseFactory
-
Creates a HTTP-400 response with "N/A" as message.
- createBadRequestResponse(String) - Static method in class de.gerdiproject.harvest.rest.HttpResponseFactory
-
Creates a HTTP-400 response with a specified message.
- createBusyResponse(String, long) - Static method in class de.gerdiproject.harvest.rest.HttpResponseFactory
-
Creates a response, replying that the service is not available at the moment.
- createClassNameListMapper(Collection<Class<?>>) - Static method in class de.gerdiproject.harvest.config.parameters.constants.ParameterMappingFunctions
-
Creates a mapping function that forwards an input string if it is a simple class name
of a specified collection.
- createDirectories(File) - Static method in class de.gerdiproject.harvest.utils.file.FileUtils
-
Attempts to create all directories of a given directory path.
- createEmptyFile(File) - Static method in class de.gerdiproject.harvest.utils.file.FileUtils
-
Creates a new cache file, replacing any file that already exists.
- createETLs() - Method in class de.gerdiproject.harvest.application.ContextListener
-
Creates a list of
AbstractETL implementations that can be chosen to extract, transform and load
data from the targeted repository.
- createExtractor() - Method in class de.gerdiproject.harvest.etls.AbstractETL
-
- createExtractor() - Method in class de.gerdiproject.harvest.etls.StaticIteratorETL
-
- createFubarResponse() - Static method in class de.gerdiproject.harvest.rest.HttpResponseFactory
-
Creates a HTTP-500 response for the case that the service is broken
beyond all repair.
- createInitResponse() - Static method in class de.gerdiproject.harvest.rest.HttpResponseFactory
-
Creates a HTTP-503 response that should be returned during
the initialization state of the harvester.
- createKnownErrorResponse(String) - Static method in class de.gerdiproject.harvest.rest.HttpResponseFactory
-
Creates a HTTP-500 response for a known but unexpected server error.
- createLoader() - Method in class de.gerdiproject.harvest.etls.AbstractETL
-
Creates an
ILoader for sending the harvested documents
to a search index.
- CreateLoaderEvent - Class in de.gerdiproject.harvest.etls.loaders.events
-
This event aims to instantiate an
ILoader.
- CreateLoaderEvent() - Constructor for class de.gerdiproject.harvest.etls.loaders.events.CreateLoaderEvent
-
- createMapperForETL(Function<String, V>, AbstractETL<?, ?>) - Static method in class de.gerdiproject.harvest.config.parameters.constants.ParameterMappingFunctions
-
Creates a mapping function that executes another mapping function while throwing an exception if a specified ETL
is currently busy.
- createMapperForETLs(Function<String, V>) - Static method in class de.gerdiproject.harvest.config.parameters.constants.ParameterMappingFunctions
-
Creates a mapping function that executes another mapping function while throwing an exception if any ETL
is currently busy.
- createMethodNotAllowedResponse() - Static method in class de.gerdiproject.harvest.rest.HttpResponseFactory
-
Creates a HTTP-405 response.
- createOkResponse(Object) - Static method in class de.gerdiproject.harvest.rest.HttpResponseFactory
-
Creates a HTTP-200 message with a specified entity.
- createPlainTextOkResponse(String) - Static method in class de.gerdiproject.harvest.rest.HttpResponseFactory
-
Creates a HTTP-200 plain text response.
- createServerErrorResponse() - Static method in class de.gerdiproject.harvest.rest.HttpResponseFactory
-
Creates an error message depending on the current state of the harvester.
- createStringListMapper(Collection<String>) - Static method in class de.gerdiproject.harvest.config.parameters.constants.ParameterMappingFunctions
-
Creates a mapping function that forwards input string values to the output only if they are
in a collection of valid values or if the input values are null.
- createSynchronousEventResponse(ISynchronousEvent<?>) - Static method in class de.gerdiproject.harvest.rest.HttpResponseFactory
-
- createTargetFile(String) - Method in class de.gerdiproject.harvest.etls.loaders.DiskLoader
-
Returns the file to which the documents are saved.
- createTransformer() - Method in class de.gerdiproject.harvest.etls.AbstractETL
-
Creates an
ITransformer for transforming source elements
to documents that can be used by the
ILoader.
- createTransformer() - Method in class de.gerdiproject.harvest.etls.StaticIteratorETL
-
- createUnknownErrorResponse() - Static method in class de.gerdiproject.harvest.rest.HttpResponseFactory
-
Creates a HTTP-500 response for unknown server errors.
- createValueResponse(Response.Status, JsonElement) - Static method in class de.gerdiproject.harvest.rest.HttpResponseFactory
-
Creates a response with a specified status code and entity.
- CronConstants - Class in de.gerdiproject.harvest.scheduler.constants
-
This class offers constants that are used for parsing cron tabs.
- CronMonth - Enum in de.gerdiproject.harvest.scheduler.enums
-
This enumeration represents month names as they appear in cron tabs.
- CronParser - Class in de.gerdiproject.harvest.scheduler.utils
-
This class provides static functions for parsing cron tabs.
- CronUtils - Class in de.gerdiproject.harvest.scheduler.utils
-
This class contains static utility functions that work on cron tabs and cron
related date.
- CronWeekDay - Enum in de.gerdiproject.harvest.scheduler.enums
-
This enumeration represents week days as they appear in cron tabs.
- DataOperationConstants - Class in de.gerdiproject.harvest.utils.data.constants
-
This static class contains constants for the
HttpRequester and related classes.
- DATE_RANGE_REGEX - Static variable in class de.gerdiproject.harvest.etls.loaders.constants.ElasticSearchConstants
-
- DATE_RANGE_REPLACEMENT - Static variable in class de.gerdiproject.harvest.etls.loaders.constants.ElasticSearchConstants
-
- DATE_REGEX - Static variable in class de.gerdiproject.harvest.etls.loaders.constants.ElasticSearchConstants
-
- DATE_REPLACEMENT - Static variable in class de.gerdiproject.harvest.etls.loaders.constants.ElasticSearchConstants
-
- DAYS_MAX_CRON - Static variable in class de.gerdiproject.harvest.scheduler.constants.CronConstants
-
- DAYS_MIN_CRON - Static variable in class de.gerdiproject.harvest.scheduler.constants.CronConstants
-
- de.gerdiproject.harvest.application - package de.gerdiproject.harvest.application
-
This package contains classes and packages that are related to server and application settings.
- de.gerdiproject.harvest.application.constants - package de.gerdiproject.harvest.application.constants
-
This package contains application wide constants.
- de.gerdiproject.harvest.application.enums - package de.gerdiproject.harvest.application.enums
-
This package contains enumerations that are related to the application
in general.
- de.gerdiproject.harvest.application.events - package de.gerdiproject.harvest.application.events
-
This package contains application specific events.
- de.gerdiproject.harvest.config - package de.gerdiproject.harvest.config
-
This package contains classes and packages that are related to the global harvester
Configuration.
- de.gerdiproject.harvest.config.constants - package de.gerdiproject.harvest.config.constants
-
This package contains static classes of constants concerning
the
Configuration.
- de.gerdiproject.harvest.config.events - package de.gerdiproject.harvest.config.events
-
This package contains sub-classes of
IEvent that are related to
the harvester configuration and parameters.
- de.gerdiproject.harvest.config.json - package de.gerdiproject.harvest.config.json
-
- de.gerdiproject.harvest.config.json.adapters - package de.gerdiproject.harvest.config.json.adapters
-
This package contains GSON JsonSerializers and JsonDeserializers
for parsing and writing JSON objects that are related to the configuration and parameters.
- de.gerdiproject.harvest.config.parameters - package de.gerdiproject.harvest.config.parameters
-
- de.gerdiproject.harvest.config.parameters.constants - package de.gerdiproject.harvest.config.parameters.constants
-
This package contains constants and static method collections concerning
AbstractParameters.
- de.gerdiproject.harvest.config.rest - package de.gerdiproject.harvest.config.rest
-
This package contains facades that map incoming REST requests
to internal functions concerning the
Configuration.
- de.gerdiproject.harvest.etls - package de.gerdiproject.harvest.etls
-
This package contains classes and packages that are related to the
AbstractETL and its sub-classes.
- de.gerdiproject.harvest.etls.adapters - package de.gerdiproject.harvest.etls.adapters
-
This package contains JSON (de-) serializers concerning
AbstractETLs.
- de.gerdiproject.harvest.etls.constants - package de.gerdiproject.harvest.etls.constants
-
This package contains static classes of constants concerning
AbstractETLs.
- de.gerdiproject.harvest.etls.enums - package de.gerdiproject.harvest.etls.enums
-
This package contains enumerations regarding
AbstractETLs.
- de.gerdiproject.harvest.etls.events - package de.gerdiproject.harvest.etls.events
-
This package contains sub-classes of
IEvent that are related to
the harvesting-process.
- de.gerdiproject.harvest.etls.extractors - package de.gerdiproject.harvest.etls.extractors
-
This package contains constants concerning
IExtractor components.
- de.gerdiproject.harvest.etls.json - package de.gerdiproject.harvest.etls.json
-
This package contains JSON objects of
AbstractETLs and related classes.
- de.gerdiproject.harvest.etls.loaders - package de.gerdiproject.harvest.etls.loaders
-
This package contains classes concerning
ILoaders.
- de.gerdiproject.harvest.etls.loaders.constants - package de.gerdiproject.harvest.etls.loaders.constants
-
This package contains constants concerning
ILoader components.
- de.gerdiproject.harvest.etls.loaders.events - package de.gerdiproject.harvest.etls.loaders.events
-
This package contains sub-classes of
IEvent that are related to
ILoaders.
- de.gerdiproject.harvest.etls.loaders.json - package de.gerdiproject.harvest.etls.loaders.json
-
This package contains JSON objects concerning
ILoaders.
- de.gerdiproject.harvest.etls.loaders.utils - package de.gerdiproject.harvest.etls.loaders.utils
-
This package contains utility classes concerning
ILoaders.
- de.gerdiproject.harvest.etls.rest - package de.gerdiproject.harvest.etls.rest
-
This package contains facades that map incoming REST requests
to internal functions concerning the
AbstractETL.
- de.gerdiproject.harvest.etls.transformers - package de.gerdiproject.harvest.etls.transformers
-
- de.gerdiproject.harvest.etls.utils - package de.gerdiproject.harvest.etls.utils
-
This package contains utility classes concerning
AbstractETLs.
- de.gerdiproject.harvest.event - package de.gerdiproject.harvest.event
-
This package contains classes and packages that are related to the
EventSystem.
- de.gerdiproject.harvest.rest - package de.gerdiproject.harvest.rest
-
This package contains generic classes used by HTTP requests.
- de.gerdiproject.harvest.rest.constants - package de.gerdiproject.harvest.rest.constants
-
This package contains constants classes regarding REST requests.
- de.gerdiproject.harvest.rest.events - package de.gerdiproject.harvest.rest.events
-
This package contains Events concerning HTTP requests.
- de.gerdiproject.harvest.scheduler - package de.gerdiproject.harvest.scheduler
-
This package contains classes for setting up a schedule for the harvester.
- de.gerdiproject.harvest.scheduler.constants - package de.gerdiproject.harvest.scheduler.constants
-
This package contains constants classes that are used by the
Scheduler and related classes.
- de.gerdiproject.harvest.scheduler.enums - package de.gerdiproject.harvest.scheduler.enums
-
This package contains enumerations that are used for parsing cron fields.
- de.gerdiproject.harvest.scheduler.events - package de.gerdiproject.harvest.scheduler.events
-
This package contains events that modify the
Scheduler.
- de.gerdiproject.harvest.scheduler.json - package de.gerdiproject.harvest.scheduler.json
-
This package contains JSON classes related to the
Scheduler.
- de.gerdiproject.harvest.scheduler.rest - package de.gerdiproject.harvest.scheduler.rest
-
This package contains REST interface classes for setting the
Scheduler.
- de.gerdiproject.harvest.scheduler.utils - package de.gerdiproject.harvest.scheduler.utils
-
This package contains utility classes that deal with cron and scheduling
related problems.
- de.gerdiproject.harvest.utils - package de.gerdiproject.harvest.utils
-
This package contains classes and packages that provide utilities, tools, and helper functions.
- de.gerdiproject.harvest.utils.data - package de.gerdiproject.harvest.utils.data
-
This package contains classes for reading and writing data to- and from disk, as well as classes
for retrieving data from the web.
- de.gerdiproject.harvest.utils.data.constants - package de.gerdiproject.harvest.utils.data.constants
-
This package contains static classes of constants concerning
the retrieval of data from the web and from disk.
- de.gerdiproject.harvest.utils.data.enums - package de.gerdiproject.harvest.utils.data.enums
-
This package contains enumerations of data retrieval utilities.
- de.gerdiproject.harvest.utils.file - package de.gerdiproject.harvest.utils.file
-
This package contains constants classes for manipulating files.
- de.gerdiproject.harvest.utils.file.constants - package de.gerdiproject.harvest.utils.file.constants
-
This package contains static classes of constants concerning
file operations.
- de.gerdiproject.harvest.utils.logger - package de.gerdiproject.harvest.utils.logger
-
This package contains constants related to
HarvesterLog
and logging in general.
- de.gerdiproject.harvest.utils.logger.constants - package de.gerdiproject.harvest.utils.logger.constants
-
This package contains constants that are related to Loggers.
- de.gerdiproject.harvest.utils.logger.events - package de.gerdiproject.harvest.utils.logger.events
-
This package contains events that concern logging.
- de.gerdiproject.harvest.utils.maven - package de.gerdiproject.harvest.utils.maven
-
This package contains utility classes for retrieving Maven related information.
- de.gerdiproject.harvest.utils.maven.constants - package de.gerdiproject.harvest.utils.maven.constants
-
This package contains Maven related constants.
- de.gerdiproject.harvest.utils.maven.events - package de.gerdiproject.harvest.utils.maven.events
-
This package contains events that concern Maven utilities.
- DEBUG_CATEGORY - Static variable in class de.gerdiproject.harvest.config.constants.ConfigurationConstants
-
- dedicatedEtl - Variable in class de.gerdiproject.harvest.etls.loaders.AbstractIteratorLoader
-
- DEFAULT_GERDI_NAMESPACE - Static variable in class de.gerdiproject.harvest.utils.maven.constants.MavenConstants
-
- DEFAULT_LOG_LEVEL - Static variable in class de.gerdiproject.harvest.utils.logger.constants.LoggerConstants
-
- DELETE_ALL - Static variable in class de.gerdiproject.harvest.scheduler.constants.SchedulerConstants
-
- DELETE_FAILED - Static variable in class de.gerdiproject.harvest.scheduler.constants.SchedulerConstants
-
- DELETE_FILE_FAILED - Static variable in class de.gerdiproject.harvest.utils.file.constants.FileConstants
-
- DELETE_FILE_SUCCESS - Static variable in class de.gerdiproject.harvest.utils.file.constants.FileConstants
-
- DELETE_OK - Static variable in class de.gerdiproject.harvest.scheduler.constants.SchedulerConstants
-
- deleteAllTasks() - Method in class de.gerdiproject.harvest.scheduler.rest.SchedulerRestResource
-
Deletes a harvesting task with a specified cron tab from the schedule.
- deleteAllTasks() - Method in class de.gerdiproject.harvest.scheduler.Scheduler
-
Deletes all tasks.
- deleteFile(File) - Static method in class de.gerdiproject.harvest.utils.file.FileUtils
-
Attempts to delete a file from disk if it exists and logs any errors.
- deleteTask(String) - Method in class de.gerdiproject.harvest.scheduler.rest.SchedulerRestResource
-
Deletes a harvesting task with a specified cron tab from the schedule.
- deleteTask(ChangeSchedulerRequest) - Method in class de.gerdiproject.harvest.scheduler.Scheduler
-
This method deletes a single crontab.
- DEPENDENCY_LIST_FORMAT - Static variable in class de.gerdiproject.harvest.utils.maven.constants.MavenConstants
-
- DEPLOYMENT_TYPE - Static variable in class de.gerdiproject.harvest.application.constants.ApplicationConstants
-
- DeploymentType - Enum in de.gerdiproject.harvest.application.enums
-
This enumeration depicts how the harvester service is being deployed.
- deserialize(JsonElement, Type, JsonDeserializationContext) - Method in class de.gerdiproject.harvest.config.json.adapters.ConfigurationAdapter
-
- deserialize(JsonElement, Type, JsonDeserializationContext) - Method in class de.gerdiproject.harvest.etls.adapters.ETLJsonAdapter
-
- destroy() - Static method in class de.gerdiproject.harvest.application.MainContext
-
Clears the current Singleton instance if it exists and nullifies it.
- DIR_MERGE_FAILED - Static variable in class de.gerdiproject.harvest.utils.file.constants.FileConstants
-
- DIR_MERGE_FAILED_NO_SOURCE_DIR - Static variable in class de.gerdiproject.harvest.utils.file.constants.FileConstants
-
- DIR_MERGE_FAILED_NOT_DIRS - Static variable in class de.gerdiproject.harvest.utils.file.constants.FileConstants
-
- DIR_MERGE_SUCCESS - Static variable in class de.gerdiproject.harvest.utils.file.constants.FileConstants
-
- DiskIO - Class in de.gerdiproject.harvest.utils.data
-
This class provides methods for reading files from disk.
- DiskIO(Gson, Charset) - Constructor for class de.gerdiproject.harvest.utils.data.DiskIO
-
Constructor that sets the GSON (de-)serializer for reading and
writing JSON objects.
- DiskIO(DiskIO) - Constructor for class de.gerdiproject.harvest.utils.data.DiskIO
-
Constructor that copies over settings from another
DiskIO.
- DiskLoader - Class in de.gerdiproject.harvest.etls.loaders
-
This class offers functions for saving a harvest result to disk.
- DiskLoader() - Constructor for class de.gerdiproject.harvest.etls.loaders.DiskLoader
-
Constructor that sets the parser and save folder.
- DiskLoaderConstants - Class in de.gerdiproject.harvest.etls.loaders.constants
-
This static class is a collection of constants that are used by the
DiskLoader.
- DOCUMENT_TOO_LARGE - Static variable in class de.gerdiproject.harvest.etls.loaders.constants.LoaderConstants
-
- DOCUMENTS_JSON - Static variable in class de.gerdiproject.harvest.etls.loaders.constants.DiskLoaderConstants
-
- DOCUMENTS_RESUBMIT - Static variable in class de.gerdiproject.harvest.etls.loaders.constants.ElasticSearchConstants
-
- DUPLICATE_ETL_REGISTERED_ERROR - Static variable in class de.gerdiproject.harvest.etls.constants.ETLConstants
-
- GET_UNKNOWN_PARAM_ERROR - Static variable in class de.gerdiproject.harvest.config.constants.ConfigurationConstants
-
- getAllETLInfos() - Method in class de.gerdiproject.harvest.etls.rest.ETLRestResource
-
A HTTP GET request that returns a JSON representation of a all ETLs.
- getAllowedRequests() - Method in class de.gerdiproject.harvest.config.rest.ConfigurationRestResource
-
- getAllowedRequests() - Method in class de.gerdiproject.harvest.etls.rest.ETLRestResource
-
- getAllowedRequests() - Method in class de.gerdiproject.harvest.rest.AbstractRestResource
-
This method returns a string that offers a description of viable HTTP requests.
- getAllowedRequests() - Method in class de.gerdiproject.harvest.scheduler.rest.SchedulerRestResource
-
- getAllVersions() - Method in class de.gerdiproject.harvest.etls.rest.ETLRestResource
-
Displays the artifactIds and versions of all Maven libraries used in this service.
- getAsJson(MultivaluedMap<String, String>) - Method in class de.gerdiproject.harvest.config.Configuration
-
- getAsJson() - Method in class de.gerdiproject.harvest.etls.AbstractETL
-
Returns a simplified JSON representation of the ETL.
- getAsJson(MultivaluedMap<String, String>) - Method in class de.gerdiproject.harvest.etls.utils.ETLManager
-
- getAsJson(MultivaluedMap<String, String>) - Method in class de.gerdiproject.harvest.rest.AbstractRestObject
-
Returns a JSON representation of this object.
- getAsJson(MultivaluedMap<String, String>) - Method in class de.gerdiproject.harvest.scheduler.Scheduler
-
- getAsPlainText() - Method in class de.gerdiproject.harvest.rest.AbstractRestObject
-
Returns a pretty print representation of this object along
with a title.
- getAttribute(Element, String) - Static method in class de.gerdiproject.harvest.utils.HtmlUtils
-
Retrieves an attribute value of an HTML Element.
- getCacheFolder() - Method in class de.gerdiproject.harvest.application.MainContext
-
- getCacheFolder() - Method in class de.gerdiproject.harvest.utils.data.HttpRequester
-
- GetCacheFolderEvent - Class in de.gerdiproject.harvest.application.events
-
This event returns the root directory wherein all service generated
files are stored.
- GetCacheFolderEvent() - Constructor for class de.gerdiproject.harvest.application.events.GetCacheFolderEvent
-
- getCategory() - Method in class de.gerdiproject.harvest.config.parameters.AbstractParameter
-
Retrieves the name of the category to which the parameter belongs.
- getCausedBy() - Method in class de.gerdiproject.harvest.etls.loaders.json.ElasticSearchError
-
- getCharset() - Method in class de.gerdiproject.harvest.etls.AbstractETL
-
Returns the charset of the harvested data.
- getClasses() - Method in class de.gerdiproject.harvest.rest.RestResourceConfig
-
- getCombinedHashes(Collection<AbstractETL<?, ?>>) - Static method in class de.gerdiproject.harvest.etls.utils.EtlUtils
-
Generates a combined hash over the concatenated hashes of a specified
Collection of enabled
AbstractETLs.
- getCombinedHealth(Collection<AbstractETL<?, ?>>) - Static method in class de.gerdiproject.harvest.etls.utils.EtlUtils
-
- getCompositeKey() - Method in class de.gerdiproject.harvest.config.parameters.AbstractParameter
-
Returns a unique key consisting of the category and the parameter key.
- getConfiguration() - Method in class de.gerdiproject.harvest.application.MainContext
-
- GetConfigurationEvent - Class in de.gerdiproject.harvest.config.events
-
- GetConfigurationEvent() - Constructor for class de.gerdiproject.harvest.config.events.GetConfigurationEvent
-
- getCredentials() - Method in class de.gerdiproject.harvest.etls.loaders.AbstractURLLoader
-
Retrieves the credentials that may be necessary for to authenticate the loader
with the URL.
- getCredentials() - Method in class de.gerdiproject.harvest.etls.loaders.ElasticSearchLoader
-
- getCronTab() - Method in class de.gerdiproject.harvest.scheduler.json.ChangeSchedulerRequest
-
Returns the crontab that is to be changed.
- getDaysInMonth(byte, int) - Static method in class de.gerdiproject.harvest.scheduler.utils.CronUtils
-
Calculates the amount of days of a month in a specified year.
- getDeploymentType() - Method in class de.gerdiproject.harvest.application.MainContext
-
- getDocumentChecksum() - Method in class de.gerdiproject.harvest.etls.events.HarvestFinishedEvent
-
Returns a hash value over all harvested documents.
- getEndIndex() - Method in class de.gerdiproject.harvest.etls.AbstractIteratorETL
-
Returns the end index 'b' of the harvesting range [a,b).
- getEndTimestamp() - Method in class de.gerdiproject.harvest.etls.events.HarvestFinishedEvent
-
Returns the unix timestamp at which the event was created.
- getEnumAttribute(Element, String, Class<T>) - Static method in class de.gerdiproject.harvest.utils.HtmlUtils
-
Retrieves an attribute value of an HTML Element
and attempts to map it to an
Enum.
- getError() - Method in class de.gerdiproject.harvest.etls.loaders.json.ElasticSearchIndex
-
- getErrorText() - Method in class de.gerdiproject.harvest.etls.loaders.json.ElasticSearchIndex
-
Returns a human readable version of a possible error.
- getETLAsJson(MultivaluedMap<String, String>) - Method in class de.gerdiproject.harvest.etls.utils.ETLManager
-
Returns a specified ETL as JSON object.
- getETLInfo(UriInfo) - Method in class de.gerdiproject.harvest.etls.rest.ETLRestResource
-
A HTTP GET request that returns a JSON representation of a single ETL.
- getEtlInfos() - Method in class de.gerdiproject.harvest.etls.json.ETLInfosJson
-
- getEtlManager() - Method in class de.gerdiproject.harvest.application.MainContext
-
- GetETLManagerEvent - Class in de.gerdiproject.harvest.etls.events
-
- GetETLManagerEvent() - Constructor for class de.gerdiproject.harvest.etls.events.GetETLManagerEvent
-
- getETLsAsJson() - Method in class de.gerdiproject.harvest.etls.utils.ETLManager
-
Returns an info JSON object with detailed information about all
ETLs.
- getExecutedTask() - Method in class de.gerdiproject.harvest.scheduler.events.ScheduledTaskExecutedEvent
-
Returns the task that finished executing.
- getFailed() - Method in class de.gerdiproject.harvest.etls.loaders.json.ElasticSearchShard
-
- getHarvestedCount() - Method in class de.gerdiproject.harvest.etls.AbstractETL
-
Retrieves the number of documents that have been loaded.
- getHarvestedCount() - Method in class de.gerdiproject.harvest.etls.AbstractIteratorETL
-
- getHarvestedCount() - Method in class de.gerdiproject.harvest.etls.json.ETLJson
-
- getHarvestedCount() - Method in class de.gerdiproject.harvest.etls.json.ETLManagerJson
-
- getHarvestedCount() - Method in class de.gerdiproject.harvest.etls.utils.ETLManager
-
Retrieves the number of documents that have been loaded.
- getHarvesterHash() - Method in class de.gerdiproject.harvest.etls.events.HarvestStartedEvent
-
Returns the version hash of the harvested documents.
- getHarvesterJarName() - Method in class de.gerdiproject.harvest.utils.maven.MavenUtils
-
Returns the name of the main jar of this service.
- getHash() - Method in class de.gerdiproject.harvest.etls.AbstractETL
-
Returns the checksum hash of the documents which are to be harvested.
- getHashFromJson(JsonElement) - Method in class de.gerdiproject.harvest.etls.extractors.JsonArrayExtractor
-
Retrieves a hash value from a JSON object.
- getHealth() - Method in class de.gerdiproject.harvest.etls.AbstractETL
-
Returns an enum that represents the health status of the ETL.
- getHealth() - Method in class de.gerdiproject.harvest.etls.json.ETLManagerJson
-
- getHealth() - Method in class de.gerdiproject.harvest.etls.rest.ETLRestResource
-
Checks the health of the harvester.
- getHealth() - Method in class de.gerdiproject.harvest.etls.utils.ETLManager
-
Retrieves an overall health status.
- getHealthHistory() - Method in class de.gerdiproject.harvest.etls.json.ETLJson
-
- getHtml(String) - Method in class de.gerdiproject.harvest.utils.data.DiskIO
-
- getHtml(String) - Method in interface de.gerdiproject.harvest.utils.data.IDataRetriever
-
Tries to parse the content from a specified path as a
HTML document.
- getHtml(String) - Method in class de.gerdiproject.harvest.utils.data.WebDataRetriever
-
- getHtmlFromUrl(String) - Method in class de.gerdiproject.harvest.utils.data.HttpRequester
-
Sends a GET request to a specified URL and tries to retrieve the HTML
response.
- getId() - Method in class de.gerdiproject.harvest.etls.loaders.json.ElasticSearchIndex
-
- getIndex() - Method in class de.gerdiproject.harvest.etls.loaders.json.ElasticSearchIndex
-
- getIndex() - Method in class de.gerdiproject.harvest.etls.loaders.json.ElasticSearchIndexWrapper
-
- getInfoText(UriInfo) - Method in class de.gerdiproject.harvest.config.rest.ConfigurationRestResource
-
- getInfoText(UriInfo) - Method in class de.gerdiproject.harvest.rest.AbstractRestResource
-
A HTTP GET request that returns a plain-text representation of the singleton object,
as well as some help text that shows which HTTP requests are possible.
- getInputStream(HttpURLConnection) - Method in class de.gerdiproject.harvest.utils.data.WebDataRetriever
-
Returns the correct InputStream based on the Content-Encoding header of
a connection.
- getItems() - Method in class de.gerdiproject.harvest.etls.loaders.json.ElasticSearchResponse
-
- getKey() - Method in class de.gerdiproject.harvest.config.parameters.AbstractParameter
-
Retrieves the key of the parameter.
- getLastHarvestDate() - Method in class de.gerdiproject.harvest.etls.json.ETLManagerJson
-
- getLatestTimestamp() - Method in class de.gerdiproject.harvest.etls.utils.TimestampedList
-
Returns the timestamp of the latest value of the list.
- getLatestValue() - Method in class de.gerdiproject.harvest.etls.utils.TimestampedList
-
Returns the latest value of the list.
- getListFromJson(JsonElement) - Method in class de.gerdiproject.harvest.etls.extractors.JsonArrayExtractor
-
Parses a JSON object to retrieve a JSON array
and converts the array to a
LinkedList.
- getLoaderClasses() - Method in class de.gerdiproject.harvest.application.ContextListener
-
Creates a list of
ILoader implementations that can be chosen to transfer data to the search index.
- getLoaderRegistry() - Method in class de.gerdiproject.harvest.application.MainContext
-
- getLog() - Method in class de.gerdiproject.harvest.application.MainContext
-
- getLog(String, String, String) - Method in class de.gerdiproject.harvest.etls.rest.ETLRestResource
-
Attempts to retrieve the log of the harvester service.
- getLog(List<String>, List<String>, List<String>) - Method in class de.gerdiproject.harvest.utils.logger.HarvesterLog
-
Retrieves filtered log messages from the harvester service log file.
- getLogFile() - Method in class de.gerdiproject.harvest.application.MainContext
-
- GetMainLogEvent - Class in de.gerdiproject.harvest.utils.logger.events
-
This synchronous event returns the
HarvesterLog that is attached
to the MainContext.
- GetMainLogEvent() - Constructor for class de.gerdiproject.harvest.utils.logger.events.GetMainLogEvent
-
- getMappingFunction() - Method in class de.gerdiproject.harvest.config.parameters.AbstractParameter
-
Retrieves a function that maps a
String value to V.
- getMavenUtils() - Method in class de.gerdiproject.harvest.application.MainContext
-
- GetMavenUtilsEvent - Class in de.gerdiproject.harvest.utils.maven.events
-
This synchronous event returns the
MavenUtils that is attached
to the MainContext.
- GetMavenUtilsEvent() - Constructor for class de.gerdiproject.harvest.utils.maven.events.GetMavenUtilsEvent
-
- getMavenVersionInfo(String) - Method in class de.gerdiproject.harvest.utils.maven.MavenUtils
-
Returns a list of dependencies of this service's classpath.
- getMaxDocumentCount() - Method in class de.gerdiproject.harvest.etls.json.ETLJson
-
- getMaxDocumentCount() - Method in class de.gerdiproject.harvest.etls.json.ETLManagerJson
-
- getMaxHarvestableDocuments() - Method in class de.gerdiproject.harvest.etls.events.HarvestStartedEvent
-
Returns the maximum number of harvestable documents.
- getMaxNumberOfDocuments() - Method in class de.gerdiproject.harvest.etls.AbstractETL
-
Returns the total number of documents that can possibly be harvested.
- getMaxNumberOfDocuments() - Method in class de.gerdiproject.harvest.etls.AbstractIteratorETL
-
Returns the total number of documents that are harvested,
considering the range parameters.
- getMaxNumberOfDocuments() - Method in class de.gerdiproject.harvest.etls.utils.ETLManager
-
Sums up the expected number of harvestable documents of all registered ETLs.
- getModuleName() - Method in class de.gerdiproject.harvest.application.MainContext
-
- getName() - Method in class de.gerdiproject.harvest.etls.AbstractETL
-
Returns the name of the ETL.
- getName() - Method in class de.gerdiproject.harvest.etls.json.ETLJson
-
- getNextHarvestDate() - Method in class de.gerdiproject.harvest.etls.json.ETLManagerJson
-
- getNextHarvestDate() - Method in class de.gerdiproject.harvest.scheduler.Scheduler
-
Returns the date of the earliest scheduled harvest.
- getNextMatchingDate(String) - Static method in class de.gerdiproject.harvest.scheduler.utils.CronUtils
-
Uses the cron tab to calculate the first matching date after the current
date + one minute.
- getNextMatchingDate(String, Date) - Static method in class de.gerdiproject.harvest.scheduler.utils.CronUtils
-
Uses the cron tab to calculate the first date that is equal or later than
a specified date.
- getObject(File, Class<T>) - Method in class de.gerdiproject.harvest.utils.data.DiskIO
-
Tries to parse the content of a specified file as an object.
- getObject(File, Type) - Method in class de.gerdiproject.harvest.utils.data.DiskIO
-
Tries to parse the content of a specified file as an object.
- getObject(String, Class<T>) - Method in class de.gerdiproject.harvest.utils.data.DiskIO
-
- getObject(String, Type) - Method in class de.gerdiproject.harvest.utils.data.DiskIO
-
- getObject(String, Class<T>) - Method in interface de.gerdiproject.harvest.utils.data.IDataRetriever
-
Tries to parse the content from a specified path as a
JSON object.
- getObject(String, Type) - Method in interface de.gerdiproject.harvest.utils.data.IDataRetriever
-
Tries to parse the content from a specified path as a
JSON object.
- getObject(String, Class<T>) - Method in class de.gerdiproject.harvest.utils.data.WebDataRetriever
-
- getObject(String, Type) - Method in class de.gerdiproject.harvest.utils.data.WebDataRetriever
-
- getObject(Element, String, Function<Element, T>) - Static method in class de.gerdiproject.harvest.utils.HtmlUtils
-
Retrieves the first occurrence of an Element with a specified
tag and maps it to an object via a specified mapping function.
- getObjectFromUrl(String, Class<T>) - Method in class de.gerdiproject.harvest.utils.data.HttpRequester
-
Sends a GET request to a specified URL and tries to retrieve the JSON
response, mapping it to a Java object.
- getObjectFromUrl(String, Type) - Method in class de.gerdiproject.harvest.utils.data.HttpRequester
-
Sends a GET request to a specified URL and tries to retrieve the JSON
response, mapping it to a Java object.
- getObjects(Element, String, Function<Element, T>) - Static method in class de.gerdiproject.harvest.utils.HtmlUtils
-
Retrieves all occurrences of Elements with specified tags
and maps them to a
List of objects via a specified mapping function.
- getObjectsFromParent(Element, String, Function<Element, T>) - Static method in class de.gerdiproject.harvest.utils.HtmlUtils
-
Retrieves all child Elements of a specified parent tag and
maps them to a
List of objects via a specified mapping function.
- getOldValue() - Method in class de.gerdiproject.harvest.config.events.ParameterChangedEvent
-
Retrieves the value of the parameter prior to its change.
- getOverallInfo() - Method in class de.gerdiproject.harvest.etls.json.ETLInfosJson
-
Returns an info summary of all registered ETLs combined.
- getParameter() - Method in class de.gerdiproject.harvest.config.events.ParameterChangedEvent
-
Retrieves the parameter that has changed.
- getParameter() - Method in class de.gerdiproject.harvest.config.events.RegisterParameterEvent
-
Returns the parameter that is to be registered in the
Configuration.
- getParameter() - Method in class de.gerdiproject.harvest.config.events.UnregisterParameterEvent
-
Returns the parameter that is to be unregistered from the
Configuration.
- getParameters() - Method in class de.gerdiproject.harvest.config.Configuration
-
Retrieves a collection of all parameters.
- getParameterStringValue(String) - Method in class de.gerdiproject.harvest.config.Configuration
-
Returns the human readable value of the parameter with a specified key.
- getParameterValue(String) - Method in class de.gerdiproject.harvest.config.Configuration
-
Returns the value of the parameter with a specified key.
- getPrettyPlainText() - Method in class de.gerdiproject.harvest.config.Configuration
-
- getPrettyPlainText() - Method in class de.gerdiproject.harvest.etls.utils.ETLManager
-
- getPrettyPlainText() - Method in class de.gerdiproject.harvest.rest.AbstractRestObject
-
Returns a pretty print representation of this object.
- getPrettyPlainText() - Method in class de.gerdiproject.harvest.scheduler.Scheduler
-
- getReader(String, Charset) - Static method in class de.gerdiproject.harvest.utils.file.FileUtils
-
- getReader(File, Charset) - Static method in class de.gerdiproject.harvest.utils.file.FileUtils
-
- getReason() - Method in class de.gerdiproject.harvest.etls.loaders.json.ElasticSearchError
-
- getReason() - Method in class de.gerdiproject.harvest.etls.loaders.json.ElasticSearchErrorCause
-
- getRemainingHarvestTime() - Method in class de.gerdiproject.harvest.etls.json.ETLManagerJson
-
- getRepositoryName() - Method in class de.gerdiproject.harvest.application.ContextListener
-
Retrieves the name of the repository that is to be harvested.
- getRepositoryName() - Method in class de.gerdiproject.harvest.etls.json.ETLInfosJson
-
Returns the name of the harvested repository, or null if it is unknown.
- getRepositoryName() - Method in class de.gerdiproject.harvest.etls.json.ETLManagerJson
-
- GetRepositoryNameEvent - Class in de.gerdiproject.harvest.etls.events
-
This synchronous event returns the name of the harvested data provider.
- GetRepositoryNameEvent() - Constructor for class de.gerdiproject.harvest.etls.events.GetRepositoryNameEvent
-
- getRestHeader(RestRequestType, String, String) - Method in class de.gerdiproject.harvest.utils.data.HttpRequester
-
Sends a REST request with a plain-text body and returns the header
fields.
- getRestHeader(RestRequestType, String, String, String, String) - Method in class de.gerdiproject.harvest.utils.data.HttpRequester
-
Sends an authorized REST request with a specified body and returns the
header fields.
- getRestHeader(RestRequestType, String, String, String, String) - Method in class de.gerdiproject.harvest.utils.data.WebDataRetriever
-
Sends an authorized REST request with a specified body and returns the
header fields.
- GetRestObjectEvent<T extends AbstractRestObject<T,?>> - Class in de.gerdiproject.harvest.rest.events
-
- GetRestObjectEvent() - Constructor for class de.gerdiproject.harvest.rest.events.GetRestObjectEvent
-
- getRestResponse(RestRequestType, String, String) - Method in class de.gerdiproject.harvest.utils.data.HttpRequester
-
Sends an REST request with a plain-text body.
- getRestResponse(RestRequestType, String, String, String, String) - Method in class de.gerdiproject.harvest.utils.data.HttpRequester
-
Sends an authorized REST request with a specified body and returns the
response as a string.
- getRestResponse(RestRequestType, String, String, String, String) - Method in class de.gerdiproject.harvest.utils.data.WebDataRetriever
-
Sends an authorized REST request with a specified body and returns the
response as a string.
- getResult() - Method in class de.gerdiproject.harvest.etls.loaders.json.ElasticSearchIndex
-
- getScheduledHarvests() - Method in class de.gerdiproject.harvest.scheduler.json.SchedulerResponse
-
Returns all cron tabs of scheduled harvests.
- getScheduler() - Method in class de.gerdiproject.harvest.application.MainContext
-
- GetSchedulerEvent - Class in de.gerdiproject.harvest.scheduler.events
-
Synchronous event for retrieving the
Scheduler.
- GetSchedulerEvent() - Constructor for class de.gerdiproject.harvest.scheduler.events.GetSchedulerEvent
-
- getServiceName() - Method in class de.gerdiproject.harvest.application.ContextListener
-
Retrieves the name of this harvester service.
- getShaHash(String) - Method in class de.gerdiproject.harvest.utils.HashGenerator
-
Generates a hexadecimal string representing the hash value of a specified
input string.
- getShards() - Method in class de.gerdiproject.harvest.etls.loaders.json.ElasticSearchIndex
-
- getSizeOfDocument(String, IDocument) - Method in class de.gerdiproject.harvest.etls.loaders.AbstractURLLoader
-
Calculates the size of a single document within the batch in bytes.
- getSizeOfDocument(String, IDocument) - Method in class de.gerdiproject.harvest.etls.loaders.ElasticSearchLoader
-
- getStartIndex() - Method in class de.gerdiproject.harvest.etls.AbstractIteratorETL
-
Returns start index 'a' of the harvesting range [a,b).
- getStartTimestamp() - Method in class de.gerdiproject.harvest.etls.events.HarvestStartedEvent
-
Returns the unix timestamp at which the event was created.
- getState() - Method in class de.gerdiproject.harvest.etls.AbstractETL
-
Returns an enum that represents what the ETL is currently doing.
- getState() - Method in class de.gerdiproject.harvest.etls.json.ETLManagerJson
-
- getState() - Method in class de.gerdiproject.harvest.etls.utils.ETLManager
-
Returns a status representing the entirety of all registered ETL statuses.
- getStateHistory() - Method in class de.gerdiproject.harvest.etls.json.ETLJson
-
- getStatus() - Method in class de.gerdiproject.harvest.etls.loaders.json.ElasticSearchIndex
-
- getString(File) - Method in class de.gerdiproject.harvest.utils.data.DiskIO
-
Tries to parse the content of a specified file as a string.
- getString(String) - Method in class de.gerdiproject.harvest.utils.data.DiskIO
-
- getString(String) - Method in interface de.gerdiproject.harvest.utils.data.IDataRetriever
-
Tries to parse the content from a specified path as a string.
- getString(String) - Method in class de.gerdiproject.harvest.utils.data.WebDataRetriever
-
- getString(Element, String) - Static method in class de.gerdiproject.harvest.utils.HtmlUtils
-
Retrieves the text of the first occurrence of a specified tag
derived from a specified Element.
- getStrings(Element, String) - Static method in class de.gerdiproject.harvest.utils.HtmlUtils
-
Retrieves the texts of all occurrences of Elements with a specified tag name.
- getStringsFromParent(Element, String) - Static method in class de.gerdiproject.harvest.utils.HtmlUtils
-
Retrieves the texts of all children of a specified parent Element.
- getStringValue() - Method in class de.gerdiproject.harvest.config.parameters.AbstractParameter
-
Returns a human readable String of the parameter value.
- getStringValue() - Method in class de.gerdiproject.harvest.config.parameters.IntegerParameter
-
- getStringValue() - Method in class de.gerdiproject.harvest.config.parameters.PasswordParameter
-
- getSuccessful() - Method in class de.gerdiproject.harvest.etls.loaders.json.ElasticSearchShard
-
- getTimestamp() - Method in class de.gerdiproject.harvest.etls.utils.TimestampedEntry
-
Retrieves the time at which the value was stored.
- getTook() - Method in class de.gerdiproject.harvest.etls.loaders.json.ElasticSearchResponse
-
- getTotal() - Method in class de.gerdiproject.harvest.etls.loaders.json.ElasticSearchShard
-
- getType() - Method in class de.gerdiproject.harvest.etls.loaders.json.ElasticSearchError
-
- getType() - Method in class de.gerdiproject.harvest.etls.loaders.json.ElasticSearchErrorCause
-
- getType() - Method in class de.gerdiproject.harvest.etls.loaders.json.ElasticSearchIndex
-
- getUniqueVersionString() - Method in interface de.gerdiproject.harvest.etls.extractors.IExtractor
-
Returns a string that can be hashed to generate a unique
identifier for the current version of the extractable elements.
- getUniqueVersionString() - Method in class de.gerdiproject.harvest.etls.extractors.JsonArrayExtractor
-
- getUrl() - Method in class de.gerdiproject.harvest.etls.extractors.JsonArrayExtractor
-
Retrieves the URL that is used to retrieve the JSON response.
- getUrl() - Method in class de.gerdiproject.harvest.etls.loaders.AbstractURLLoader
-
Returns the loader target URL as a string.
- getUrl() - Method in class de.gerdiproject.harvest.etls.loaders.ElasticSearchLoader
-
- getValue() - Method in class de.gerdiproject.harvest.config.parameters.AbstractParameter
-
Retrieves the parameter value.
- getValue() - Method in class de.gerdiproject.harvest.etls.utils.TimestampedEntry
-
Retrieves the stored value.
- getVersion() - Method in class de.gerdiproject.harvest.etls.loaders.json.ElasticSearchIndex
-
- getVersionHash() - Method in class de.gerdiproject.harvest.etls.json.ETLJson
-
- getVersions() - Method in class de.gerdiproject.harvest.etls.rest.ETLRestResource
-
Displays the artifactIds and versions of GeRDI Maven libraries used in this service.
- getWriter(String, Charset) - Static method in class de.gerdiproject.harvest.utils.file.FileUtils
-
- getWriter(File, Charset) - Static method in class de.gerdiproject.harvest.utils.file.FileUtils
-
- gson - Variable in class de.gerdiproject.harvest.rest.AbstractRestResource
-
- GZIP_ENCODING - Static variable in class de.gerdiproject.harvest.utils.data.constants.DataOperationConstants
-
- harvest() - Method in class de.gerdiproject.harvest.etls.AbstractETL
-
Starts the harvest.
- harvest() - Method in class de.gerdiproject.harvest.etls.utils.ETLManager
-
Attempts to start a harvest, signaling all registered ETLs to start
- HARVEST_DATE_JSON - Static variable in class de.gerdiproject.harvest.etls.loaders.constants.DiskLoaderConstants
-
- HARVEST_FAILED - Static variable in class de.gerdiproject.harvest.etls.constants.ETLConstants
-
- HARVEST_FINISHED - Static variable in class de.gerdiproject.harvest.etls.constants.ETLConstants
-
- HARVEST_IN_PROGRESS - Static variable in class de.gerdiproject.harvest.etls.constants.ETLConstants
-
- HARVEST_STARTED - Static variable in class de.gerdiproject.harvest.etls.constants.ETLConstants
-
- HARVEST_TIME_KEEPER_CACHE_FILE_PATH - Static variable in class de.gerdiproject.harvest.utils.file.constants.FileConstants
-
- harvestedCount - Variable in class de.gerdiproject.harvest.etls.AbstractIteratorETL
-
- HARVESTER_NAME_SUB_STRING - Static variable in class de.gerdiproject.harvest.application.constants.ApplicationConstants
-
- HARVESTER_SERVICE_NAME_SUFFIX - Static variable in class de.gerdiproject.harvest.application.constants.ApplicationConstants
-
- HarvesterLog - Class in de.gerdiproject.harvest.utils.logger
-
This class creates a log file to which logs are being appended.
- HarvesterLog(String) - Constructor for class de.gerdiproject.harvest.utils.logger.HarvesterLog
-
Creates a logger that logs to a specified file and assigns
a standard logging pattern to it.
- HarvestFinishedEvent - Class in de.gerdiproject.harvest.etls.events
-
This event signifies that a harvest has been completed.
- HarvestFinishedEvent(boolean, String) - Constructor for class de.gerdiproject.harvest.etls.events.HarvestFinishedEvent
-
Constructor that sets up the payload and uses the current time as the end timestamp.
- HarvestFinishedEvent(boolean, String, long) - Constructor for class de.gerdiproject.harvest.etls.events.HarvestFinishedEvent
-
Constructor that sets up the payload and allows the current time as the end timestamp.
- HARVESTING_TASK - Static variable in class de.gerdiproject.harvest.scheduler.constants.SchedulerConstants
-
- HarvestingTimerTask - Class in de.gerdiproject.harvest.scheduler
-
This task is used by the
Scheduler in order to run a harvest in
a specified schedule.
- HarvestingTimerTask() - Constructor for class de.gerdiproject.harvest.scheduler.HarvestingTimerTask
-
- HarvestStartedEvent - Class in de.gerdiproject.harvest.etls.events
-
This event signifies that a harvest has been started.
- HarvestStartedEvent(String, int) - Constructor for class de.gerdiproject.harvest.etls.events.HarvestStartedEvent
-
Constructor that sets up the payload, and uses the current time as the start timestamp.
- HarvestStartedEvent(String, int, long) - Constructor for class de.gerdiproject.harvest.etls.events.HarvestStartedEvent
-
- hasAsynchronousEventListeners() - Static method in class de.gerdiproject.harvest.event.EventSystem
-
Checks if there are registered event listeners.
- hasErrors() - Method in class de.gerdiproject.harvest.etls.loaders.json.ElasticSearchResponse
-
Returns true if the Elasticsearch response was erroneous.
- hasFailed() - Static method in class de.gerdiproject.harvest.application.MainContext
-
Checks if the initialization of the MainContext has failed.
- hash - Variable in class de.gerdiproject.harvest.etls.AbstractETL
-
- hashCode() - Method in class de.gerdiproject.harvest.application.MainContext
-
- hashCode() - Method in class de.gerdiproject.harvest.config.events.ParameterChangedEvent
-
- hashCode() - Method in class de.gerdiproject.harvest.config.events.RegisterParameterEvent
-
- hashCode() - Method in class de.gerdiproject.harvest.config.events.UnregisterParameterEvent
-
- hashCode() - Method in class de.gerdiproject.harvest.etls.events.HarvestFinishedEvent
-
- hashCode() - Method in class de.gerdiproject.harvest.etls.events.HarvestStartedEvent
-
- hashCode() - Method in class de.gerdiproject.harvest.etls.json.ETLInfosJson
-
- hashCode() - Method in class de.gerdiproject.harvest.etls.json.ETLJson
-
- hashCode() - Method in class de.gerdiproject.harvest.etls.json.ETLManagerJson
-
- hashCode() - Method in class de.gerdiproject.harvest.etls.loaders.json.ElasticSearchError
-
- hashCode() - Method in class de.gerdiproject.harvest.etls.loaders.json.ElasticSearchErrorCause
-
- hashCode() - Method in class de.gerdiproject.harvest.etls.loaders.json.ElasticSearchIndex
-
- hashCode() - Method in class de.gerdiproject.harvest.etls.loaders.json.ElasticSearchIndexWrapper
-
- hashCode() - Method in class de.gerdiproject.harvest.etls.loaders.json.ElasticSearchResponse
-
- hashCode() - Method in class de.gerdiproject.harvest.etls.loaders.json.ElasticSearchShard
-
- hashCode() - Method in class de.gerdiproject.harvest.etls.utils.TimestampedEntry
-
- hashCode() - Method in class de.gerdiproject.harvest.scheduler.events.ScheduledTaskExecutedEvent
-
- hashCode() - Method in class de.gerdiproject.harvest.scheduler.json.ChangeSchedulerRequest
-
- hashCode() - Method in class de.gerdiproject.harvest.scheduler.json.SchedulerResponse
-
- hashGenerator - Variable in class de.gerdiproject.harvest.etls.loaders.AbstractURLLoader
-
- HashGenerator - Class in de.gerdiproject.harvest.utils
-
This class generates hash values of strings.
https://stackoverflow.com/questions/9655181/how-to-convert-a-byte-array-to-a-hex-string-in-java
- HashGenerator(Charset) - Constructor for class de.gerdiproject.harvest.utils.HashGenerator
-
Constructs a hash generator using a specified charset.
- hasLoadedDocuments - Variable in class de.gerdiproject.harvest.etls.loaders.AbstractIteratorLoader
-
- hasOutdatedETLs() - Method in class de.gerdiproject.harvest.etls.utils.ETLManager
-
Updates all registered ETLs and checks if they are outdated.
- hasSynchronousEventListeners() - Static method in class de.gerdiproject.harvest.event.EventSystem
-
Checks if there are registered synchronous event listeners.
- HEAD_REQUEST - Static variable in class de.gerdiproject.harvest.utils.data.constants.DataOperationConstants
-
- healthHistory - Variable in class de.gerdiproject.harvest.etls.AbstractETL
-
- HOURS_MAX_CRON - Static variable in class de.gerdiproject.harvest.scheduler.constants.CronConstants
-
- HOURS_MIN_CRON - Static variable in class de.gerdiproject.harvest.scheduler.constants.CronConstants
-
- HtmlUtils - Class in de.gerdiproject.harvest.utils
-
A collection of static methods for processing HTML Elements.
- HTTP - Static variable in class de.gerdiproject.harvest.utils.data.constants.DataOperationConstants
-
- HTTP_CATEGORY - Static variable in class de.gerdiproject.harvest.utils.data.constants.DataOperationConstants
-
- HttpRequester - Class in de.gerdiproject.harvest.utils.data
-
This class serves as a facade for HTTP requests.
- HttpRequester() - Constructor for class de.gerdiproject.harvest.utils.data.HttpRequester
-
Constructor that uses an UTF-8 charset, and a Gson
implementation that can parse Geometry objects.
- HttpRequester(Gson, Charset) - Constructor for class de.gerdiproject.harvest.utils.data.HttpRequester
-
Constructor that allows to customize the behavior.
- HttpRequester(HttpRequester) - Constructor for class de.gerdiproject.harvest.utils.data.HttpRequester
-
- HttpResponseFactory - Class in de.gerdiproject.harvest.rest
-
This factory creates common server responses to HTTP requests.
- HTTPS - Static variable in class de.gerdiproject.harvest.utils.data.constants.DataOperationConstants
-
- ICachedObject - Interface in de.gerdiproject.harvest.utils.file
-
This interface represents objects that can be cached on disk.
- IDataRetriever - Interface in de.gerdiproject.harvest.utils.data
-
This interface describes a means for retrieving data from an arbitrary source.
- IEvent - Interface in de.gerdiproject.harvest.event
-
This is an interface for all asynchronous events that can be registered and dispatched via the
EventSystem.
- IEventListener - Interface in de.gerdiproject.harvest.event
-
This interface provides methods for (un-) registering one or more event listeners.
- IExtractor<T> - Interface in de.gerdiproject.harvest.etls.extractors
-
This class represents the Extractor of an ETL process.
- ILoader<S> - Interface in de.gerdiproject.harvest.etls.loaders
-
This class represents the Loader of an ETL process.
- incrementHarvestedDocuments() - Method in class de.gerdiproject.harvest.etls.AbstractIteratorETL
-
This function increments the document counter.
- init(Class<? extends ContextListener>, Supplier<String>, Supplier<List<? extends AbstractETL<?, ?>>>, List<Class<? extends ILoader<?>>>) - Static method in class de.gerdiproject.harvest.application.MainContext
-
Constructs an instance of the MainContext in a dedicated thread.
- init(String) - Method in class de.gerdiproject.harvest.etls.AbstractETL
-
Initializes the ETL, calculating the hash and maximum number of
harvestable documents.
- init(AbstractETL<?, ?>) - Method in class de.gerdiproject.harvest.etls.extractors.AbstractIteratorExtractor
-
- init(AbstractETL<?, ?>) - Method in interface de.gerdiproject.harvest.etls.extractors.IExtractor
-
Initializes the extractor for a new harvest.
- init(AbstractETL<?, ?>) - Method in class de.gerdiproject.harvest.etls.extractors.JsonArrayExtractor
-
- init(AbstractETL<?, ?>) - Method in class de.gerdiproject.harvest.etls.loaders.AbstractIteratorLoader
-
- init(AbstractETL<?, ?>) - Method in class de.gerdiproject.harvest.etls.loaders.AbstractURLLoader
-
- init(AbstractETL<?, ?>) - Method in class de.gerdiproject.harvest.etls.loaders.DiskLoader
-
- init(AbstractETL<?, ?>) - Method in interface de.gerdiproject.harvest.etls.loaders.ILoader
-
Initializes the loader for a new harvest.
- init(AbstractETL<?, ?>) - Method in interface de.gerdiproject.harvest.etls.transformers.ITransformer
-
Initializes the transformer for a new harvest.
- INIT_ERROR_DETAILED - Static variable in class de.gerdiproject.harvest.rest.constants.RestConstants
-
- INIT_FIELD - Static variable in class de.gerdiproject.harvest.application.constants.ApplicationConstants
-
- INIT_FIELD_SUCCESS - Static variable in class de.gerdiproject.harvest.application.constants.ApplicationConstants
-
- INIT_INVALID_STATE - Static variable in class de.gerdiproject.harvest.etls.constants.ETLConstants
-
- INIT_SERVICE - Static variable in class de.gerdiproject.harvest.application.constants.ApplicationConstants
-
- INIT_SERVICE_FAILED - Static variable in class de.gerdiproject.harvest.application.constants.ApplicationConstants
-
- INIT_SERVICE_SUCCESS - Static variable in class de.gerdiproject.harvest.application.constants.ApplicationConstants
-
- initHash() - Method in class de.gerdiproject.harvest.etls.AbstractETL
-
Computes a hash value of the files that are to be harvested, which is
used for checking if the files have changed.
- initMaxNumberOfDocuments() - Method in class de.gerdiproject.harvest.etls.AbstractETL
-
Calculates the total number of harvested documents.
- INTEGER_ALLOWED_VALUES - Static variable in class de.gerdiproject.harvest.config.parameters.constants.ParameterConstants
-
- INTEGER_RANGE_ALLOWED_VALUES - Static variable in class de.gerdiproject.harvest.config.parameters.constants.ParameterConstants
-
- INTEGER_VALUE_MAX - Static variable in class de.gerdiproject.harvest.config.parameters.constants.ParameterConstants
-
- INTEGER_VALUE_MIN - Static variable in class de.gerdiproject.harvest.config.parameters.constants.ParameterConstants
-
- IntegerParameter - Class in de.gerdiproject.harvest.config.parameters
-
This parameter holds an integer value.
- IntegerParameter(String, String, int, Function<String, Integer>) - Constructor for class de.gerdiproject.harvest.config.parameters.IntegerParameter
-
Constructor that uses a custom mapping function.
- IntegerParameter(String, String, int) - Constructor for class de.gerdiproject.harvest.config.parameters.IntegerParameter
-
Constructor that uses the default mapping function.
- integrateDirectory(File, File, boolean) - Static method in class de.gerdiproject.harvest.utils.file.FileUtils
-
Merges one directory into another one.
- INVALID_CATEGORY_NAME - Static variable in class de.gerdiproject.harvest.config.parameters.constants.ParameterConstants
-
- INVALID_ITER_EXTRACTOR_ERROR - Static variable in class de.gerdiproject.harvest.etls.constants.ETLConstants
-
- INVALID_ITER_LOADER_ERROR - Static variable in class de.gerdiproject.harvest.etls.constants.ETLConstants
-
- INVALID_ITER_TRANSFORMER_ERROR - Static variable in class de.gerdiproject.harvest.etls.constants.ETLConstants
-
- INVALID_PARAM_NAME_REGEX - Static variable in class de.gerdiproject.harvest.config.parameters.constants.ParameterConstants
-
- INVALID_PARAMETER_KEY - Static variable in class de.gerdiproject.harvest.config.parameters.constants.ParameterConstants
-
- INVALID_REQUEST_ERROR - Static variable in class de.gerdiproject.harvest.rest.constants.RestConstants
-
- INVALID_URL_ERROR - Static variable in class de.gerdiproject.harvest.etls.loaders.constants.ElasticSearchConstants
-
- isCreated() - Method in class de.gerdiproject.harvest.etls.loaders.json.ElasticSearchIndex
-
- isEnabled() - Method in class de.gerdiproject.harvest.etls.AbstractETL
-
Returns true if this ETL is enabled and initialized.
- isEnabled() - Method in class de.gerdiproject.harvest.etls.json.ETLManagerJson
-
- isInitialized() - Static method in class de.gerdiproject.harvest.application.MainContext
-
Checks if the initialization phase of the MainContext has finished.
- isReadingFromDisk() - Method in class de.gerdiproject.harvest.utils.data.HttpRequester
-
Returns true if HTTP responses are read from a cache on disk.
- isRegistered() - Method in class de.gerdiproject.harvest.config.parameters.AbstractParameter
-
Returns true if the parameter is registered at the
Configuration.
- isSuccessful() - Method in class de.gerdiproject.harvest.event.AbstractSucceededOrFailedEvent
-
Returns true if the event marks something that succeeded.
- isWritingToDisk() - Method in class de.gerdiproject.harvest.utils.data.HttpRequester
-
Returns true if HTTP responses are written to a cache on disk.
- ISynchronousEvent<T> - Interface in de.gerdiproject.harvest.event
-
Interface for synchronous events.
- ITransformer<T,S> - Interface in de.gerdiproject.harvest.etls.transformers
-
This class represents the Transformer of an ETL process.
- SAVE_FAILED - Static variable in class de.gerdiproject.harvest.utils.data.constants.DataOperationConstants
-
- SAVE_FAILED_CANNOT_CREATE - Static variable in class de.gerdiproject.harvest.etls.loaders.constants.DiskLoaderConstants
-
- SAVE_FAILED_NO_FOLDERS - Static variable in class de.gerdiproject.harvest.utils.data.constants.DataOperationConstants
-
- SAVE_FOLDER_NAME - Static variable in class de.gerdiproject.harvest.etls.loaders.constants.DiskLoaderConstants
-
- SAVE_NO_PATH_ERROR - Static variable in class de.gerdiproject.harvest.config.constants.ConfigurationConstants
-
- SAVE_OK - Static variable in class de.gerdiproject.harvest.utils.data.constants.DataOperationConstants
-
- saveToDisk() - Method in class de.gerdiproject.harvest.config.Configuration
-
Saves the configuration as a Json file.
- saveToDisk() - Method in class de.gerdiproject.harvest.etls.utils.ETLManager
-
- saveToDisk() - Method in class de.gerdiproject.harvest.scheduler.Scheduler
-
Saves all cron tabs to disk as a JSON array.
- saveToDisk() - Method in interface de.gerdiproject.harvest.utils.file.ICachedObject
-
Saves the object to a cache file on disk, which can be loaded
via loadFromDisk().
- SCHEDULED_HARVESTS_TITLE - Static variable in class de.gerdiproject.harvest.scheduler.constants.SchedulerConstants
-
- ScheduledTaskExecutedEvent - Class in de.gerdiproject.harvest.scheduler.events
-
This event singnifies that a task has finished executing.
- ScheduledTaskExecutedEvent(TimerTask) - Constructor for class de.gerdiproject.harvest.scheduler.events.ScheduledTaskExecutedEvent
-
- Scheduler - Class in de.gerdiproject.harvest.scheduler
-
This class manages a schedule of cron tabs that trigger harvests.
- Scheduler(String, String) - Constructor for class de.gerdiproject.harvest.scheduler.Scheduler
-
Constructor that initializes the timer and task registry.
- SchedulerConstants - Class in de.gerdiproject.harvest.scheduler.constants
-
This class offers constants that are related to scheduling.
- SchedulerResponse - Class in de.gerdiproject.harvest.scheduler.json
-
- SchedulerResponse(Set<String>) - Constructor for class de.gerdiproject.harvest.scheduler.json.SchedulerResponse
-
- SchedulerRestResource - Class in de.gerdiproject.harvest.scheduler.rest
-
This class serves as a REST interface to the
Scheduler.
- SchedulerRestResource() - Constructor for class de.gerdiproject.harvest.scheduler.rest.SchedulerRestResource
-
- sendEvent(T) - Static method in class de.gerdiproject.harvest.event.EventSystem
-
Dispatches a specified asynchronous event by adding it to a queue.
- sendSynchronousEvent(T) - Static method in class de.gerdiproject.harvest.event.EventSystem
-
Dispatches a synchronous event that executes a unique callback function
and returns its calculated value.
- sendWebRequest(RestRequestType, String, String, String, String, int) - Method in class de.gerdiproject.harvest.utils.data.WebDataRetriever
-
Sends a REST request with a specified body and returns the connection.
- serialize(Configuration, Type, JsonSerializationContext) - Method in class de.gerdiproject.harvest.config.json.adapters.ConfigurationAdapter
-
- ServiceInitializedEvent - Class in de.gerdiproject.harvest.application.events
-
This event signifies that the harvester service initialization process is over.
- ServiceInitializedEvent(boolean) - Constructor for class de.gerdiproject.harvest.application.events.ServiceInitializedEvent
-
Simple Constructor.
- SET_NO_PAYLOAD_ERROR - Static variable in class de.gerdiproject.harvest.config.constants.ConfigurationConstants
-
- SET_UNKNOWN_PARAM_ERROR - Static variable in class de.gerdiproject.harvest.config.constants.ConfigurationConstants
-
- setCacheFilePath(String) - Method in class de.gerdiproject.harvest.config.Configuration
-
Sets the file path to which the configuration can be saved.
- setCacheFolder(File) - Method in class de.gerdiproject.harvest.utils.data.HttpRequester
-
- setCharset(Charset) - Method in class de.gerdiproject.harvest.utils.data.DiskIO
-
- setCharset(Charset) - Method in class de.gerdiproject.harvest.utils.data.HttpRequester
-
Changes the charset that is used for reading and writing responses.
- setCharset(Charset) - Method in interface de.gerdiproject.harvest.utils.data.IDataRetriever
-
Changes the charset used for (de-)serializing requests.
- setCharset(Charset) - Method in class de.gerdiproject.harvest.utils.data.WebDataRetriever
-
- setHealth(ETLHealth) - Method in class de.gerdiproject.harvest.etls.AbstractETL
-
Changes the health status.
- setMappingFunction(Function<String, V>) - Method in class de.gerdiproject.harvest.config.parameters.AbstractParameter
-
Sets the function that maps a
String value to V.
- setName(String) - Method in class de.gerdiproject.harvest.etls.AbstractETL
-
Changes the name of the ETL.
- setParameter(String, String) - Method in class de.gerdiproject.harvest.config.Configuration
-
Changes a configuration parameter, returning a status message about the change.
- setRegistered(boolean) - Method in class de.gerdiproject.harvest.config.parameters.AbstractParameter
-
- setStatus(ETLState) - Method in class de.gerdiproject.harvest.etls.AbstractETL
-
Changes the status that represents what the ETL is currently doing.
- setTimeout(int) - Method in class de.gerdiproject.harvest.utils.data.HttpRequester
-
Changes the request timeout for web requests.
- setTimeout(int) - Method in class de.gerdiproject.harvest.utils.data.WebDataRetriever
-
- setUrl(String) - Method in class de.gerdiproject.harvest.etls.extractors.JsonArrayExtractor
-
Changes the URL that is used to retrieve the JSON response.
- setValue(String) - Method in class de.gerdiproject.harvest.config.parameters.AbstractParameter
-
Changes the stored value by parsing a String argument.
- SHA_HASH_ALGORITHM - Static variable in class de.gerdiproject.harvest.etls.constants.ETLConstants
-
- size() - Method in class de.gerdiproject.harvest.etls.extractors.AbstractIteratorExtractor
-
- size() - Method in interface de.gerdiproject.harvest.etls.extractors.IExtractor
-
Returns the number of extractable documents, or -1 if they cannot
be estimated.
- size() - Method in class de.gerdiproject.harvest.etls.extractors.JsonArrayExtractor
-
- size() - Method in class de.gerdiproject.harvest.scheduler.Scheduler
-
Returns the number of registered cron tabs.
- skipHarvest() - Method in class de.gerdiproject.harvest.etls.AbstractETL
-
Marks the harvest as done.
- SOURCE_HASH_JSON - Static variable in class de.gerdiproject.harvest.etls.loaders.constants.DiskLoaderConstants
-
- START_ETLS - Static variable in class de.gerdiproject.harvest.etls.constants.ETLConstants
-
- START_INDEX_PARAM_DEFAULT_VALUE - Static variable in class de.gerdiproject.harvest.etls.constants.ETLConstants
-
- START_INDEX_PARAM_KEY - Static variable in class de.gerdiproject.harvest.etls.constants.ETLConstants
-
- startHarvest(MultivaluedMap<String, String>) - Method in class de.gerdiproject.harvest.etls.rest.ETLRestResource
-
Starts a harvest using the harvester that is registered in the
MainContext.
- startIndex - Variable in class de.gerdiproject.harvest.etls.extractors.AbstractIteratorExtractor
-
- startIndexParameter - Variable in class de.gerdiproject.harvest.etls.AbstractIteratorETL
-
- stateHistory - Variable in class de.gerdiproject.harvest.etls.AbstractETL
-
- StaticIteratorETL<T,S> - Class in de.gerdiproject.harvest.etls
-
This ETL harvests data via
Iterators and creates a
document for each iterated element.
- StaticIteratorETL(AbstractIteratorExtractor<T>, AbstractIteratorTransformer<T, S>) - Constructor for class de.gerdiproject.harvest.etls.StaticIteratorETL
-
Constructor that initializes the extractor and transformer.
- StaticIteratorETL(String, AbstractIteratorExtractor<T>, AbstractIteratorTransformer<T, S>) - Constructor for class de.gerdiproject.harvest.etls.StaticIteratorETL
-
Constructor that initializes the extractor and transformer.
- STATUS_FAILED - Static variable in class de.gerdiproject.harvest.rest.constants.RestConstants
-
- STATUS_OK - Static variable in class de.gerdiproject.harvest.rest.constants.RestConstants
-
- StringParameter - Class in de.gerdiproject.harvest.config.parameters
-
This parameter holds a String value.
- StringParameter(String, String, String, Function<String, String>) - Constructor for class de.gerdiproject.harvest.config.parameters.StringParameter
-
Constructor that uses a custom mapping function.
- StringParameter(String, String, String) - Constructor for class de.gerdiproject.harvest.config.parameters.StringParameter
-
Constructor that uses the default mapping function.
- sumUpETLValues(Collection<AbstractETL<?, ?>>, Function<AbstractETL<?, ?>, Integer>) - Static method in class de.gerdiproject.harvest.etls.utils.EtlUtils
-