org.apache.hudi.io.storage

Class HoodieNativeAvroHFileReader

java.lang.Object

org.apache.hudi.io.storage.HoodieAvroFileReader

org.apache.hudi.io.storage.HoodieAvroHFileReaderImplBase

org.apache.hudi.io.storage.HoodieNativeAvroHFileReader

All Implemented Interfaces:

AutoCloseable, HoodieFileReader<org.apache.avro.generic.IndexedRecord>, HoodieSeekingFileReader<org.apache.avro.generic.IndexedRecord>

public class HoodieNativeAvroHFileReader
extends HoodieAvroHFileReaderImplBase

An implementation of HoodieAvroHFileReaderImplBase using native HFileReader.

Field Summary

Fields inherited from class org.apache.hudi.io.storage.HoodieAvroHFileReaderImplBase

KEY_BLOOM_FILTER_META_BLOCK, KEY_BLOOM_FILTER_TYPE_CODE, KEY_FIELD_NAME, KEY_MAX_RECORD, KEY_MIN_RECORD, SCHEMA_KEY

Constructor Summary

Constructors

Constructor and Description
HoodieNativeAvroHFileReader(HoodieStorage storage, byte[] content, Option<org.apache.avro.Schema> schemaOption)
HoodieNativeAvroHFileReader(HoodieStorage storage, StoragePath path, Option<org.apache.avro.Schema> schemaOption)

Method Summary

Modifier and Type	Method and Description
void	close()
Set<String>	filterRowKeys(Set<String> candidateRowKeys)
ClosableIterator<org.apache.avro.generic.IndexedRecord>	getIndexedRecordIterator(org.apache.avro.Schema readerSchema, org.apache.avro.Schema requestedSchema)
ClosableIterator<org.apache.avro.generic.IndexedRecord>	getIndexedRecordsByKeyPrefixIterator(List<String> sortedKeyPrefixes, org.apache.avro.Schema readerSchema)
ClosableIterator<org.apache.avro.generic.IndexedRecord>	getIndexedRecordsByKeysIterator(List<String> sortedKeys, org.apache.avro.Schema readerSchema)
ClosableIterator<String>	getRecordKeyIterator()
ClosableIterator<HoodieRecord<org.apache.avro.generic.IndexedRecord>>	getRecordsByKeyPrefixIterator(List<String> sortedKeyPrefixes, org.apache.avro.Schema schema)
ClosableIterator<HoodieRecord<org.apache.avro.generic.IndexedRecord>>	getRecordsByKeysIterator(List<String> sortedKeys, org.apache.avro.Schema schema)
org.apache.avro.Schema	getSchema()
long	getTotalRecords()
BloomFilter	readBloomFilter()
String[]	readMinMaxRecordKeys()

Methods inherited from class org.apache.hudi.io.storage.HoodieAvroHFileReaderImplBase

deserialize, deserialize, readAllRecords, readRecords, readRecords

Methods inherited from class org.apache.hudi.io.storage.HoodieAvroFileReader

getIndexedRecordIterator, getRecordIterator

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.hudi.io.storage.HoodieSeekingFileReader

getRecordsByKeyPrefixIterator, getRecordsByKeysIterator

Methods inherited from interface org.apache.hudi.io.storage.HoodieFileReader

getRecordIterator, getRecordIterator, getRecordIterator

Constructor Detail

HoodieNativeAvroHFileReader

public HoodieNativeAvroHFileReader(HoodieStorage storage,
                                   StoragePath path,
                                   Option<org.apache.avro.Schema> schemaOption)

HoodieNativeAvroHFileReader

public HoodieNativeAvroHFileReader(HoodieStorage storage,
                                   byte[] content,
                                   Option<org.apache.avro.Schema> schemaOption)

Method Detail

getIndexedRecordIterator

public ClosableIterator<org.apache.avro.generic.IndexedRecord> getIndexedRecordIterator(org.apache.avro.Schema readerSchema,
                                                                                        org.apache.avro.Schema requestedSchema)
                                                                                 throws IOException

Specified by:

getIndexedRecordIterator in class HoodieAvroFileReader

Throws:

IOException

readMinMaxRecordKeys

public String[] readMinMaxRecordKeys()

readBloomFilter

public BloomFilter readBloomFilter()

filterRowKeys

public Set<String> filterRowKeys(Set<String> candidateRowKeys)

getRecordKeyIterator

public ClosableIterator<String> getRecordKeyIterator()
                                              throws IOException

Throws:

IOException

getSchema

public org.apache.avro.Schema getSchema()

close

public void close()

getTotalRecords

public long getTotalRecords()

getRecordsByKeysIterator

public ClosableIterator<HoodieRecord<org.apache.avro.generic.IndexedRecord>> getRecordsByKeysIterator(List<String> sortedKeys,
                                                                                                      org.apache.avro.Schema schema)
                                                                                               throws IOException

Throws:

IOException

getRecordsByKeyPrefixIterator

public ClosableIterator<HoodieRecord<org.apache.avro.generic.IndexedRecord>> getRecordsByKeyPrefixIterator(List<String> sortedKeyPrefixes,
                                                                                                           org.apache.avro.Schema schema)
                                                                                                    throws IOException

Throws:

IOException

getIndexedRecordsByKeysIterator

public ClosableIterator<org.apache.avro.generic.IndexedRecord> getIndexedRecordsByKeysIterator(List<String> sortedKeys,
                                                                                               org.apache.avro.Schema readerSchema)
                                                                                        throws IOException

Specified by:

getIndexedRecordsByKeysIterator in class HoodieAvroHFileReaderImplBase

Throws:

IOException

getIndexedRecordsByKeyPrefixIterator

public ClosableIterator<org.apache.avro.generic.IndexedRecord> getIndexedRecordsByKeyPrefixIterator(List<String> sortedKeyPrefixes,
                                                                                                    org.apache.avro.Schema readerSchema)
                                                                                             throws IOException

Specified by:

getIndexedRecordsByKeyPrefixIterator in class HoodieAvroHFileReaderImplBase

Throws:

IOException