Class PDS3FileCrawler
- java.lang.Object
-
- gov.nasa.jpl.oodt.cas.crawl.config.ProductCrawlerBean
-
- gov.nasa.jpl.oodt.cas.crawl.ProductCrawler
-
- gov.nasa.pds.harvest.search.crawler.PDSProductCrawler
-
- gov.nasa.pds.harvest.search.crawler.PDS3ProductCrawler
-
- gov.nasa.pds.harvest.search.crawler.PDS3FileCrawler
-
- All Implemented Interfaces:
gov.nasa.jpl.oodt.cas.commons.spring.SpringSetIdInjectionType
,gov.nasa.jpl.oodt.cas.filemgr.metadata.CoreMetKeys
public class PDS3FileCrawler extends PDS3ProductCrawler
Crawler class intended to be used for registering PDS3 files as Product_File_Repository products.- Author:
- mcayanan
-
-
Field Summary
-
Fields inherited from class gov.nasa.pds.harvest.search.crawler.PDSProductCrawler
inPersistanceMode, touchedFiles
-
-
Constructor Summary
Constructors Constructor Description PDS3FileCrawler()
-
Method Summary
All Methods Instance Methods Concrete Methods Modifier and Type Method Description protected gov.nasa.jpl.oodt.cas.metadata.Metadata
getMetadataForProduct(File product)
Extracts metadata from the given product.protected boolean
passesPreconditions(File product)
Determines whether the supplied file passes the necessary pre-conditions for the file to be registered.void
setChecksumManifest(Map<File,String> manifest)
Set the map to represent the checksum manifest file.void
setFileFilter(FileFilter filter)
Sets the file filter for the crawler.void
setGenerateChecksums(boolean value)
Set the flag for checksum generation.-
Methods inherited from class gov.nasa.pds.harvest.search.crawler.PDS3ProductCrawler
getPDS3MetExtractorConfig, setPDS3MetExtractorConfig
-
Methods inherited from class gov.nasa.pds.harvest.search.crawler.PDSProductCrawler
addAction, addActions, addKnownMetadata, crawl, getActions, getMetExtractorConfig, setCounter, setDirectoryFilter, setInPersistanceMode, setMetExtractorConfig, setSearchUrl
-
Methods inherited from class gov.nasa.jpl.oodt.cas.crawl.ProductCrawler
clearIngestStatus, crawl, getIngestStatus, handleFile, setActionRepo
-
Methods inherited from class gov.nasa.jpl.oodt.cas.crawl.config.ProductCrawlerBean
addRequiredMetadata, getActionIds, getApplicationContext, getDaemonPort, getDaemonWait, getFilemgrUrl, getGlobalMetadata, getId, getIngester, getProductPath, getRequiredMetadata, isCrawlForDirs, isNoRecur, isSkipIngest, setActionIds, setApplicationContext, setCrawlForDirs, setDaemonPort, setDaemonWait, setFilemgrUrl, setGlobalMetadata, setId, setIngester, setNoRecur, setProductPath, setRequiredMetadata, setSkipIngest
-
-
-
-
Method Detail
-
setFileFilter
public void setFileFilter(FileFilter filter)
Description copied from class:PDSProductCrawler
Sets the file filter for the crawler.- Overrides:
setFileFilter
in classPDSProductCrawler
- Parameters:
filter
- A File Filter defined in the Harvest policy config.
-
getMetadataForProduct
protected gov.nasa.jpl.oodt.cas.metadata.Metadata getMetadataForProduct(File product)
Description copied from class:PDS3ProductCrawler
Extracts metadata from the given product.- Overrides:
getMetadataForProduct
in classPDS3ProductCrawler
- Parameters:
product
- A PDS file.- Returns:
- A Metadata object, which holds metadata from the product.
-
passesPreconditions
protected boolean passesPreconditions(File product)
Description copied from class:PDS3ProductCrawler
Determines whether the supplied file passes the necessary pre-conditions for the file to be registered.- Overrides:
passesPreconditions
in classPDS3ProductCrawler
- Parameters:
product
- A file.- Returns:
- true if the file passes.
-
setGenerateChecksums
public void setGenerateChecksums(boolean value)
Set the flag for checksum generation.- Parameters:
value
- 'true' to turn on, 'false' to turn off.
-
-