| Modifier and Type | Method and Description |
|---|---|
abstract HoodieWriteMetadata<O> |
BaseHoodieWriteClient.cluster(String clusteringInstant,
boolean shouldComplete)
Ensures clustering instant is in expected state and performs clustering for the plan stored in metadata.
|
HoodieWriteMetadata<O> |
BaseHoodieWriteClient.compact(String compactionInstantTime)
Performs Compaction for the workload stored in instant-time.
|
protected abstract HoodieWriteMetadata<O> |
BaseHoodieWriteClient.compact(String compactionInstantTime,
boolean shouldComplete)
Ensures compaction instant is in expected state and performs Compaction for the workload stored in instant-time.
|
| Modifier and Type | Method and Description |
|---|---|
protected abstract O |
BaseHoodieWriteClient.postWrite(HoodieWriteMetadata<O> result,
String instantTime,
HoodieTable hoodieTable)
Common method containing steps to be performed after write (upsert/insert/..) operations including auto-commit.
|
| Modifier and Type | Method and Description |
|---|---|
abstract HoodieWriteMetadata<O> |
HoodieTable.bulkInsert(HoodieEngineContext context,
String instantTime,
I records,
Option<BulkInsertPartitioner> bulkInsertPartitioner)
Bulk Insert a batch of new records into Hoodie table at the supplied instantTime.
|
abstract HoodieWriteMetadata<O> |
HoodieTable.bulkInsertPrepped(HoodieEngineContext context,
String instantTime,
I preppedRecords,
Option<BulkInsertPartitioner> bulkInsertPartitioner)
Bulk Insert the given prepared records into the Hoodie table, at the supplied instantTime.
|
abstract HoodieWriteMetadata<O> |
HoodieTable.cluster(HoodieEngineContext context,
String clusteringInstantTime)
Execute Clustering on the table.
|
abstract HoodieWriteMetadata<O> |
HoodieTable.compact(HoodieEngineContext context,
String compactionInstantTime)
Run Compaction on the table.
|
abstract HoodieWriteMetadata<O> |
HoodieTable.delete(HoodieEngineContext context,
String instantTime,
K keys)
|
abstract HoodieWriteMetadata |
HoodieTable.deletePartitions(HoodieEngineContext context,
String instantTime,
List<String> partitions)
Deletes all data of partitions.
|
abstract HoodieWriteMetadata<O> |
HoodieTable.insert(HoodieEngineContext context,
String instantTime,
I records)
Insert a batch of new records into Hoodie table at the supplied instantTime.
|
abstract HoodieWriteMetadata<O> |
HoodieTable.insertOverwrite(HoodieEngineContext context,
String instantTime,
I records)
Replaces all the existing records and inserts the specified new records into Hoodie table at the supplied instantTime,
for the partition paths contained in input records.
|
abstract HoodieWriteMetadata<O> |
HoodieTable.insertOverwriteTable(HoodieEngineContext context,
String instantTime,
I records)
Delete all the existing records of the Hoodie table and inserts the specified new records into Hoodie table at the supplied instantTime,
for the partition paths contained in input records.
|
abstract HoodieWriteMetadata<O> |
HoodieTable.insertPrepped(HoodieEngineContext context,
String instantTime,
I preppedRecords)
Inserts the given prepared records into the Hoodie table, at the supplied instantTime.
|
abstract HoodieWriteMetadata<O> |
HoodieTable.upsert(HoodieEngineContext context,
String instantTime,
I records)
Upsert a batch of new records into Hoodie table at the supplied instantTime.
|
abstract HoodieWriteMetadata<O> |
HoodieTable.upsertPrepped(HoodieEngineContext context,
String instantTime,
I preppedRecords)
Upserts the given prepared records into the Hoodie table, at the supplied instantTime.
|
| Modifier and Type | Method and Description |
|---|---|
<T> HoodieWriteMetadata<T> |
HoodieWriteMetadata.clone(T transformedWriteStatuses)
Clones the write metadata with transformed write statuses.
|
| Modifier and Type | Method and Description |
|---|---|
Option<HoodieWriteMetadata<O>> |
HoodieBootstrapWriteMetadata.getFullBootstrapResult() |
Option<HoodieWriteMetadata<O>> |
HoodieBootstrapWriteMetadata.getMetadataBootstrapResult() |
| Constructor and Description |
|---|
HoodieBootstrapWriteMetadata(Option<HoodieWriteMetadata<O>> metadataBootstrapResult,
Option<HoodieWriteMetadata<O>> fullBootstrapResult) |
HoodieBootstrapWriteMetadata(Option<HoodieWriteMetadata<O>> metadataBootstrapResult,
Option<HoodieWriteMetadata<O>> fullBootstrapResult) |
| Modifier and Type | Method and Description |
|---|---|
abstract HoodieWriteMetadata<O> |
ClusteringExecutionStrategy.performClustering(HoodieClusteringPlan clusteringPlan,
org.apache.avro.Schema schema,
String instantTime)
Execute clustering to write inputRecords into new files as defined by rules in strategy parameters.
|
| Modifier and Type | Method and Description |
|---|---|
abstract HoodieWriteMetadata<O> |
BaseBulkInsertHelper.bulkInsert(I inputRecords,
String instantTime,
HoodieTable<T,I,K,O> table,
HoodieWriteConfig config,
BaseCommitActionExecutor<T,I,K,O,R> executor,
boolean performDedupe,
Option<BulkInsertPartitioner> userDefinedBulkInsertPartitioner)
Mark instant as inflight, write input records, update index and return result.
|
abstract HoodieWriteMetadata<O> |
BaseCommitActionExecutor.execute(I inputRecords) |
HoodieWriteMetadata<HoodieData<WriteStatus>> |
HoodieDeleteHelper.execute(String instantTime,
HoodieData<HoodieKey> keys,
HoodieEngineContext context,
HoodieWriteConfig config,
HoodieTable<T,HoodieData<HoodieRecord<T>>,HoodieData<HoodieKey>,HoodieData<WriteStatus>> table,
BaseCommitActionExecutor<T,HoodieData<HoodieRecord<T>>,HoodieData<HoodieKey>,HoodieData<WriteStatus>,R> deleteExecutor) |
abstract HoodieWriteMetadata<O> |
BaseDeleteHelper.execute(String instantTime,
K keys,
HoodieEngineContext context,
HoodieWriteConfig config,
HoodieTable<T,I,K,O> table,
BaseCommitActionExecutor<T,I,K,O,R> deleteExecutor) |
protected HoodieWriteMetadata<HoodieData<WriteStatus>> |
BaseCommitActionExecutor.executeClustering(HoodieClusteringPlan clusteringPlan) |
HoodieWriteMetadata<O> |
BaseWriteHelper.write(String instantTime,
I inputRecords,
HoodieEngineContext context,
HoodieTable<T,I,K,O> table,
boolean shouldCombine,
int shuffleParallelism,
BaseCommitActionExecutor<T,I,K,O,R> executor,
WriteOperationType operationType) |
| Modifier and Type | Method and Description |
|---|---|
protected void |
BaseCommitActionExecutor.autoCommit(Option<Map<String,String>> extraMetadata,
HoodieWriteMetadata<O> result) |
protected abstract void |
BaseCommitActionExecutor.commit(Option<Map<String,String>> extraMetadata,
HoodieWriteMetadata<O> result) |
protected void |
BaseCommitActionExecutor.commitOnAutoCommit(HoodieWriteMetadata result) |
protected void |
BaseCommitActionExecutor.finalizeWrite(String instantTime,
List<HoodieWriteStat> stats,
HoodieWriteMetadata result)
Finalize Write operation.
|
protected void |
BaseCommitActionExecutor.runPrecommitValidators(HoodieWriteMetadata<O> writeMetadata)
Check if any validators are configured and run those validations.
|
protected abstract void |
BaseCommitActionExecutor.setCommitMetadata(HoodieWriteMetadata<O> result) |
| Modifier and Type | Method and Description |
|---|---|
HoodieWriteMetadata<HoodieData<WriteStatus>> |
RunCompactionActionExecutor.execute() |
Copyright © 2022 The Apache Software Foundation. All rights reserved.