de.l3s.icrawl.crawler.yarn

Class AppMaster

java.lang.Object

de.l3s.icrawl.crawler.yarn.BaseAppMaster

de.l3s.icrawl.crawler.yarn.AppMaster

public class AppMaster
extends BaseAppMaster

Field Summary

Fields inherited from class de.l3s.icrawl.crawler.yarn.BaseAppMaster

conf, progress

Constructor Summary

Constructors

Constructor and Description
AppMaster()

Method Summary

Modifier and Type	Method and Description
protected void	addDefaultProps(com.google.common.collect.ImmutableMap.Builder<String,Object> defaultProps)
protected void	crawl(org.springframework.context.ApplicationContext context, Crawler crawler)
protected Set<String>	getProfiles()
static void	main(String[] args)

Methods inherited from class de.l3s.icrawl.crawler.yarn.BaseAppMaster

getMaxUrls, run

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

AppMaster

public AppMaster()

Method Detail

addDefaultProps

protected void addDefaultProps(com.google.common.collect.ImmutableMap.Builder<String,Object> defaultProps)

Overrides:

addDefaultProps in class BaseAppMaster

crawl

protected void crawl(org.springframework.context.ApplicationContext context,
                     Crawler crawler)
              throws IOException

Specified by:

crawl in class BaseAppMaster

Throws:

IOException

getProfiles

protected Set<String> getProfiles()

Overrides:

getProfiles in class BaseAppMaster

main

public static void main(String[] args)
                 throws Exception

Throws:

Exception