Class PDS3FileCrawler
- java.lang.Object
-
- gov.nasa.jpl.oodt.cas.crawl.config.ProductCrawlerBean
-
- gov.nasa.jpl.oodt.cas.crawl.ProductCrawler
-
- gov.nasa.pds.harvest.search.crawler.PDSProductCrawler
-
- gov.nasa.pds.harvest.search.crawler.PDS3ProductCrawler
-
- gov.nasa.pds.harvest.search.crawler.PDS3FileCrawler
-
- All Implemented Interfaces:
gov.nasa.jpl.oodt.cas.commons.spring.SpringSetIdInjectionType,gov.nasa.jpl.oodt.cas.filemgr.metadata.CoreMetKeys
public class PDS3FileCrawler extends PDS3ProductCrawler
Crawler class intended to be used for registering PDS3 files as Product_File_Repository products.- Author:
- mcayanan
-
-
Field Summary
-
Fields inherited from class gov.nasa.pds.harvest.search.crawler.PDSProductCrawler
inPersistanceMode, touchedFiles
-
-
Constructor Summary
Constructors Constructor Description PDS3FileCrawler()
-
Method Summary
All Methods Instance Methods Concrete Methods Modifier and Type Method Description protected gov.nasa.jpl.oodt.cas.metadata.MetadatagetMetadataForProduct(File product)Extracts metadata from the given product.protected booleanpassesPreconditions(File product)Determines whether the supplied file passes the necessary pre-conditions for the file to be registered.voidsetChecksumManifest(Map<File,String> manifest)Set the map to represent the checksum manifest file.voidsetFileFilter(FileFilter filter)Sets the file filter for the crawler.voidsetGenerateChecksums(boolean value)Set the flag for checksum generation.-
Methods inherited from class gov.nasa.pds.harvest.search.crawler.PDS3ProductCrawler
getPDS3MetExtractorConfig, setPDS3MetExtractorConfig
-
Methods inherited from class gov.nasa.pds.harvest.search.crawler.PDSProductCrawler
addAction, addActions, addKnownMetadata, crawl, getActions, getMetExtractorConfig, setCounter, setDirectoryFilter, setInPersistanceMode, setMetExtractorConfig, setSearchUrl
-
Methods inherited from class gov.nasa.jpl.oodt.cas.crawl.ProductCrawler
clearIngestStatus, crawl, getIngestStatus, handleFile, setActionRepo
-
Methods inherited from class gov.nasa.jpl.oodt.cas.crawl.config.ProductCrawlerBean
addRequiredMetadata, getActionIds, getApplicationContext, getDaemonPort, getDaemonWait, getFilemgrUrl, getGlobalMetadata, getId, getIngester, getProductPath, getRequiredMetadata, isCrawlForDirs, isNoRecur, isSkipIngest, setActionIds, setApplicationContext, setCrawlForDirs, setDaemonPort, setDaemonWait, setFilemgrUrl, setGlobalMetadata, setId, setIngester, setNoRecur, setProductPath, setRequiredMetadata, setSkipIngest
-
-
-
-
Method Detail
-
setFileFilter
public void setFileFilter(FileFilter filter)
Description copied from class:PDSProductCrawlerSets the file filter for the crawler.- Overrides:
setFileFilterin classPDSProductCrawler- Parameters:
filter- A File Filter defined in the Harvest policy config.
-
getMetadataForProduct
protected gov.nasa.jpl.oodt.cas.metadata.Metadata getMetadataForProduct(File product)
Description copied from class:PDS3ProductCrawlerExtracts metadata from the given product.- Overrides:
getMetadataForProductin classPDS3ProductCrawler- Parameters:
product- A PDS file.- Returns:
- A Metadata object, which holds metadata from the product.
-
passesPreconditions
protected boolean passesPreconditions(File product)
Description copied from class:PDS3ProductCrawlerDetermines whether the supplied file passes the necessary pre-conditions for the file to be registered.- Overrides:
passesPreconditionsin classPDS3ProductCrawler- Parameters:
product- A file.- Returns:
- true if the file passes.
-
setGenerateChecksums
public void setGenerateChecksums(boolean value)
Set the flag for checksum generation.- Parameters:
value- 'true' to turn on, 'false' to turn off.
-
-