| Package | Description |
|---|---|
| org.apache.hadoop.resourceestimator.service |
Resource estimator service.
|
| org.apache.hadoop.resourceestimator.skylinestore.api |
APIs for the
SkylineStore. |
| org.apache.hadoop.resourceestimator.skylinestore.exceptions |
SkylineStore exception module.
|
| org.apache.hadoop.resourceestimator.skylinestore.impl |
Implementation for
SkylineStore. |
| org.apache.hadoop.resourceestimator.skylinestore.validator |
Validator for
SkylineStore. |
| org.apache.hadoop.resourceestimator.solver.api |
API for
Solver. |
| org.apache.hadoop.resourceestimator.solver.impl |
Implementation for
Solver. |
| org.apache.hadoop.resourceestimator.translator.api |
API for
Translator. |
| org.apache.hadoop.resourceestimator.translator.impl |
Implementation for
Translator. |
| Modifier and Type | Method and Description |
|---|---|
void |
ResourceEstimatorService.deleteHistoryResourceSkyline(String pipelineId,
String runId)
Delete history
ResourceSkylines from SkylineStore. |
String |
ResourceEstimatorService.getEstimatedResourceAllocation(String pipelineId)
Get estimated {code Resource} allocation for the pipeline.
|
String |
ResourceEstimatorService.getHistoryResourceSkyline(String pipelineId,
String runId)
Get history
ResourceSkyline from SkylineStore. |
String |
ResourceEstimatorService.getPrediction(String pipelineId)
Get predicted {code Resource} allocation for the pipeline.
|
void |
ResourceEstimatorService.parseFile(String logFile)
Parse the log file.
|
| Modifier and Type | Method and Description |
|---|---|
void |
PredictionSkylineStore.addEstimation(String pipelineId,
org.apache.hadoop.yarn.server.resourcemanager.reservation.RLESparseResourceAllocation resourceOverTime)
Add job's predicted
Resource allocation to the store
indexed by the pipelineId. |
void |
HistorySkylineStore.addHistory(RecurrenceId recurrenceId,
List<ResourceSkyline> resourceSkylines)
Add job's resource skyline to the store indexed by the job's
RecurrenceId. |
void |
HistorySkylineStore.deleteHistory(RecurrenceId recurrenceId)
Delete all
ResourceSkylines belonging to given
RecurrenceId. |
org.apache.hadoop.yarn.server.resourcemanager.reservation.RLESparseResourceAllocation |
PredictionSkylineStore.getEstimation(String pipelineId)
Return the predicted
Resource allocation for the pipeline. |
Map<RecurrenceId,List<ResourceSkyline>> |
HistorySkylineStore.getHistory(RecurrenceId recurrenceId)
Return all
ResourceSkylines belonging to RecurrenceId. |
void |
HistorySkylineStore.updateHistory(RecurrenceId recurrenceId,
List<ResourceSkyline> resourceSkylines)
Update
RecurrenceId with given ResourceSkylines. |
| Modifier and Type | Class and Description |
|---|---|
class |
DuplicateRecurrenceIdException
Exception thrown the
RecurrenceId already exists in the
SkylineStore. |
class |
EmptyResourceSkylineException
Exception thrown if the @link{ResourceSkyline}s to be added to the
SkylineStore is empty. |
class |
NullPipelineIdException
Exception thrown when pipelineId to be added is null.
|
class |
NullRecurrenceIdException
Exception thrown the
RecurrenceId to be added is null. |
class |
NullResourceSkylineException
Exception thrown if the
ResourceSkyline to be added is null. |
class |
NullRLESparseResourceAllocationException
Exception thrown if the
ResourceSkyline to be added is null. |
class |
RecurrenceIdNotFoundException
Exception thrown if
RecurrenceId is not found in the
SkylineStore. |
| Modifier and Type | Method and Description |
|---|---|
void |
InMemoryStore.addEstimation(String pipelineId,
org.apache.hadoop.yarn.server.resourcemanager.reservation.RLESparseResourceAllocation resourceSkyline) |
void |
InMemoryStore.addHistory(RecurrenceId recurrenceId,
List<ResourceSkyline> resourceSkylines) |
void |
InMemoryStore.deleteHistory(RecurrenceId recurrenceId) |
org.apache.hadoop.yarn.server.resourcemanager.reservation.RLESparseResourceAllocation |
InMemoryStore.getEstimation(String pipelineId) |
Map<RecurrenceId,List<ResourceSkyline>> |
InMemoryStore.getHistory(RecurrenceId recurrenceId) |
void |
InMemoryStore.updateHistory(RecurrenceId recurrenceId,
List<ResourceSkyline> resourceSkylines) |
| Modifier and Type | Method and Description |
|---|---|
void |
SkylineStoreValidator.validate(RecurrenceId recurrenceId)
Check if recurrenceId is null.
|
void |
SkylineStoreValidator.validate(RecurrenceId recurrenceId,
List<ResourceSkyline> resourceSkylines)
Check if recurrenceId is null or resourceSkylines is
null.
|
void |
SkylineStoreValidator.validate(String pipelineId)
Check if pipelineId is null.
|
void |
SkylineStoreValidator.validate(String pipelineId,
org.apache.hadoop.yarn.server.resourcemanager.reservation.RLESparseResourceAllocation resourceOverTime)
Check if pipelineId is null or resourceOverTime is null.
|
| Modifier and Type | Method and Description |
|---|---|
org.apache.hadoop.yarn.server.resourcemanager.reservation.RLESparseResourceAllocation |
Solver.solve(Map<RecurrenceId,List<ResourceSkyline>> jobHistory)
The Solver reads recurring pipeline's
ResourceSkyline history, and
precits its ResourceSkyline requirements for the next run. |
| Modifier and Type | Method and Description |
|---|---|
org.apache.hadoop.yarn.server.resourcemanager.reservation.RLESparseResourceAllocation |
LpSolver.solve(Map<RecurrenceId,List<ResourceSkyline>> jobHistory) |
| Modifier and Type | Method and Description |
|---|---|
void |
LogParser.parseStream(InputStream logs)
Parses each line in the log stream, and adds extracted
ResourceSkylines to the SkylineStore. |
| Modifier and Type | Method and Description |
|---|---|
void |
LogParserUtil.parseLog(String logFile)
Parse the log file/directory.
|
void |
BaseLogParser.parseStream(InputStream logs) |
Copyright © 2019 Apache Software Foundation. All Rights Reserved.