| Modifier and Type | Class and Description |
|---|---|
class |
HoodieCDCLogRecordIterator
Record iterator for Hudi logs in CDC format.
|
| Modifier and Type | Method and Description |
|---|---|
protected <T> ClosableIterator<HoodieRecord<T>> |
HoodieParquetDataBlock.deserializeRecords(byte[] content,
HoodieRecord.HoodieRecordType type) |
protected abstract <T> ClosableIterator<HoodieRecord<T>> |
HoodieDataBlock.deserializeRecords(byte[] content,
HoodieRecord.HoodieRecordType type) |
protected <T> ClosableIterator<HoodieRecord<T>> |
HoodieHFileDataBlock.deserializeRecords(byte[] content,
HoodieRecord.HoodieRecordType type) |
protected <T> ClosableIterator<HoodieRecord<T>> |
HoodieAvroDataBlock.deserializeRecords(byte[] content,
HoodieRecord.HoodieRecordType type) |
<T> ClosableIterator<HoodieRecord<T>> |
HoodieDataBlock.getRecordIterator(HoodieRecord.HoodieRecordType type)
Returns all the records iterator contained w/in this block.
|
<T> ClosableIterator<HoodieRecord<T>> |
HoodieDataBlock.getRecordIterator(List<String> keys,
boolean fullKey,
HoodieRecord.HoodieRecordType type)
Batch get of keys of interest.
|
protected <T> ClosableIterator<HoodieRecord<T>> |
HoodieDataBlock.lookupRecords(List<String> keys,
boolean fullKey) |
protected <T> ClosableIterator<HoodieRecord<T>> |
HoodieHFileDataBlock.lookupRecords(List<String> sortedKeys,
boolean fullKey) |
protected <T> ClosableIterator<HoodieRecord<T>> |
HoodieParquetDataBlock.readRecordsFromBlockPayload(HoodieRecord.HoodieRecordType type)
NOTE: We're overriding the whole reading sequence to make sure we properly respect
the requested Reader's schema and only fetch the columns that have been explicitly
requested by the caller (providing projected Reader's schema)
|
protected <T> ClosableIterator<HoodieRecord<T>> |
HoodieDataBlock.readRecordsFromBlockPayload(HoodieRecord.HoodieRecordType type) |
| Modifier and Type | Method and Description |
|---|---|
abstract ClosableIterator<HoodieKey> |
FileFormatUtils.getHoodieKeyIterator(HoodieStorage storage,
StoragePath filePath)
Provides a closable iterator for reading the given data file.
|
abstract ClosableIterator<HoodieKey> |
FileFormatUtils.getHoodieKeyIterator(HoodieStorage storage,
StoragePath filePath,
Option<BaseKeyGenerator> keyGeneratorOpt)
Provides a closable iterator for reading the given data file.
|
| Modifier and Type | Class and Description |
|---|---|
class |
CloseableMappingIterator<I,O>
MappingIterator requiring to be closed after iteration (to cleanup resources) |
class |
LazyFileIterable.LazyFileIterator<T,R>
Iterator implementation for the iterable defined above.
|
| Modifier and Type | Method and Description |
|---|---|
ClosableIterator<R> |
LazyFileIterable.iterator() |
static <E> ClosableIterator<E> |
ClosableIterator.wrap(Iterator<E> iterator) |
| Constructor and Description |
|---|
CloseableMappingIterator(ClosableIterator<I> source,
Function<I,O> mapper) |
| Modifier and Type | Class and Description |
|---|---|
class |
HoodieBootstrapRecordIterator<T> |
| Modifier and Type | Field and Description |
|---|---|
protected ClosableIterator<HoodieRecord<T>> |
HoodieBootstrapRecordIterator.dataFileIterator |
protected ClosableIterator<HoodieRecord<T>> |
HoodieBootstrapRecordIterator.skeletonIterator |
| Modifier and Type | Method and Description |
|---|---|
protected ClosableIterator<org.apache.avro.generic.IndexedRecord> |
HoodieAvroFileReader.getIndexedRecordIterator(org.apache.avro.Schema readerSchema) |
abstract ClosableIterator<org.apache.avro.generic.IndexedRecord> |
HoodieAvroFileReader.getIndexedRecordIterator(org.apache.avro.Schema readerSchema,
org.apache.avro.Schema requestedSchema) |
ClosableIterator<org.apache.avro.generic.IndexedRecord> |
HoodieNativeAvroHFileReader.getIndexedRecordIterator(org.apache.avro.Schema readerSchema,
org.apache.avro.Schema requestedSchema) |
abstract ClosableIterator<org.apache.avro.generic.IndexedRecord> |
HoodieAvroHFileReaderImplBase.getIndexedRecordsByKeyPrefixIterator(List<String> sortedKeyPrefixes,
org.apache.avro.Schema readerSchema) |
ClosableIterator<org.apache.avro.generic.IndexedRecord> |
HoodieNativeAvroHFileReader.getIndexedRecordsByKeyPrefixIterator(List<String> sortedKeyPrefixes,
org.apache.avro.Schema readerSchema) |
abstract ClosableIterator<org.apache.avro.generic.IndexedRecord> |
HoodieAvroHFileReaderImplBase.getIndexedRecordsByKeysIterator(List<String> keys,
org.apache.avro.Schema readerSchema) |
ClosableIterator<org.apache.avro.generic.IndexedRecord> |
HoodieNativeAvroHFileReader.getIndexedRecordsByKeysIterator(List<String> sortedKeys,
org.apache.avro.Schema readerSchema) |
default ClosableIterator<HoodieRecord<T>> |
HoodieFileReader.getRecordIterator() |
ClosableIterator<HoodieRecord<T>> |
HoodieBootstrapFileReader.getRecordIterator(org.apache.avro.Schema schema) |
default ClosableIterator<HoodieRecord<T>> |
HoodieFileReader.getRecordIterator(org.apache.avro.Schema readerSchema) |
ClosableIterator<HoodieRecord<T>> |
HoodieBootstrapFileReader.getRecordIterator(org.apache.avro.Schema readerSchema,
org.apache.avro.Schema requestedSchema) |
ClosableIterator<HoodieRecord<org.apache.avro.generic.IndexedRecord>> |
HoodieAvroFileReader.getRecordIterator(org.apache.avro.Schema readerSchema,
org.apache.avro.Schema requestedSchema) |
ClosableIterator<HoodieRecord<T>> |
HoodieFileReader.getRecordIterator(org.apache.avro.Schema readerSchema,
org.apache.avro.Schema requestedSchema) |
ClosableIterator<String> |
HoodieBootstrapFileReader.getRecordKeyIterator() |
ClosableIterator<String> |
HoodieFileReader.getRecordKeyIterator() |
ClosableIterator<String> |
HoodieNativeAvroHFileReader.getRecordKeyIterator() |
default ClosableIterator<HoodieRecord<T>> |
HoodieSeekingFileReader.getRecordsByKeyPrefixIterator(List<String> sortedKeyPrefixes) |
default ClosableIterator<HoodieRecord<T>> |
HoodieSeekingFileReader.getRecordsByKeyPrefixIterator(List<String> sortedKeyPrefixes,
org.apache.avro.Schema schema) |
ClosableIterator<HoodieRecord<org.apache.avro.generic.IndexedRecord>> |
HoodieNativeAvroHFileReader.getRecordsByKeyPrefixIterator(List<String> sortedKeyPrefixes,
org.apache.avro.Schema schema) |
default ClosableIterator<HoodieRecord<T>> |
HoodieSeekingFileReader.getRecordsByKeysIterator(List<String> sortedKeys) |
default ClosableIterator<HoodieRecord<T>> |
HoodieSeekingFileReader.getRecordsByKeysIterator(List<String> sortedKeys,
org.apache.avro.Schema schema) |
ClosableIterator<HoodieRecord<org.apache.avro.generic.IndexedRecord>> |
HoodieNativeAvroHFileReader.getRecordsByKeysIterator(List<String> sortedKeys,
org.apache.avro.Schema schema) |
| Constructor and Description |
|---|
HoodieBootstrapRecordIterator(ClosableIterator<HoodieRecord<T>> skeletonIterator,
ClosableIterator<HoodieRecord<T>> dataFileIterator,
org.apache.avro.Schema schema,
Option<String[]> partitionFields,
Object[] partitionValues) |
HoodieBootstrapRecordIterator(ClosableIterator<HoodieRecord<T>> skeletonIterator,
ClosableIterator<HoodieRecord<T>> dataFileIterator,
org.apache.avro.Schema schema,
Option<String[]> partitionFields,
Object[] partitionValues) |
Copyright © 2024 The Apache Software Foundation. All rights reserved.