| Modifier and Type | Method and Description |
|---|---|
static ParquetReaderUtility.DateCorruptionStatus |
ParquetReaderUtility.checkForCorruptDateValuesInStatistics(org.apache.parquet.hadoop.metadata.ParquetMetadata footer,
List<SchemaPath> columns,
boolean autoCorrectCorruptDates)
Detect corrupt date values by looking at the min/max values in the metadata.
|
static ParquetReaderUtility.DateCorruptionStatus |
ParquetReaderUtility.detectCorruptDates(org.apache.parquet.hadoop.metadata.ParquetMetadata footer,
List<SchemaPath> columns,
boolean autoCorrectCorruptDates)
Check for corrupted dates in a parquet file.
|
static ParquetReaderUtility.DateCorruptionStatus |
ParquetReaderUtility.DateCorruptionStatus.valueOf(String name)
Returns the enum constant of this type with the specified name.
|
static ParquetReaderUtility.DateCorruptionStatus[] |
ParquetReaderUtility.DateCorruptionStatus.values()
Returns an array containing the constants of this enum type, in
the order they are declared.
|
| Modifier and Type | Method and Description |
|---|---|
ParquetReaderUtility.DateCorruptionStatus |
ParquetRecordReader.getDateCorruptionStatus()
Flag indicating if the old non-standard data format appears
in this file, see DRILL-4203.
|
| Constructor and Description |
|---|
ParquetRecordReader(FragmentContext fragmentContext,
long batchSize,
long numRecordsToRead,
String path,
int rowGroupIndex,
org.apache.hadoop.fs.FileSystem fs,
org.apache.parquet.hadoop.CodecFactory codecFactory,
org.apache.parquet.hadoop.metadata.ParquetMetadata footer,
List<SchemaPath> columns,
ParquetReaderUtility.DateCorruptionStatus dateCorruptionStatus) |
ParquetRecordReader(FragmentContext fragmentContext,
String path,
int rowGroupIndex,
org.apache.hadoop.fs.FileSystem fs,
org.apache.parquet.hadoop.CodecFactory codecFactory,
org.apache.parquet.hadoop.metadata.ParquetMetadata footer,
List<SchemaPath> columns,
ParquetReaderUtility.DateCorruptionStatus dateCorruptionStatus) |
ParquetRecordReader(FragmentContext fragmentContext,
String path,
int rowGroupIndex,
long numRecordsToRead,
org.apache.hadoop.fs.FileSystem fs,
org.apache.parquet.hadoop.CodecFactory codecFactory,
org.apache.parquet.hadoop.metadata.ParquetMetadata footer,
List<SchemaPath> columns,
ParquetReaderUtility.DateCorruptionStatus dateCorruptionStatus) |
| Modifier and Type | Method and Description |
|---|---|
static org.apache.parquet.column.statistics.Statistics |
ParquetFooterStatCollector.convertDateStatIfNecessary(org.apache.parquet.column.statistics.Statistics stat,
ParquetReaderUtility.DateCorruptionStatus containsCorruptDates) |
Copyright © 2017 The Apache Software Foundation. All rights reserved.