C D G H O P R S W

C

cleanupInProgressFileRecoverable(InProgressFileWriter.InProgressFileRecoverable) - Method in class org.apache.flink.formats.hadoop.bulk.HadoopPathBasedPartFileWriter.HadoopPathBasedBucketWriter

closeForCommit() - Method in class org.apache.flink.formats.hadoop.bulk.HadoopPathBasedPartFileWriter

commit() - Method in class org.apache.flink.formats.hadoop.bulk.committer.HadoopRenameFileCommitter

commit() - Method in interface org.apache.flink.formats.hadoop.bulk.HadoopFileCommitter

Commits the in-progress file to the target path.

commitAfterRecovery() - Method in class org.apache.flink.formats.hadoop.bulk.committer.HadoopRenameFileCommitter

commitAfterRecovery() - Method in interface org.apache.flink.formats.hadoop.bulk.HadoopFileCommitter

Re-commits the in-progress file to the target path after fail-over.

create(Configuration, Path) - Method in class org.apache.flink.formats.hadoop.bulk.DefaultHadoopFileCommitterFactory

create(Configuration, Path) - Method in interface org.apache.flink.formats.hadoop.bulk.HadoopFileCommitterFactory

Creates a new Hadoop file committer for writing.

create(Path, Path) - Method in interface org.apache.flink.formats.hadoop.bulk.HadoopPathBasedBulkWriter.Factory

Creates a path-based writer that writes to the inProgressPath first and commits to targetPath finally.

createBuckets(int) - Method in class org.apache.flink.streaming.api.functions.sink.filesystem.HadoopPathBasedBulkFormatBuilder

createBucketWriter() - Method in class org.apache.flink.streaming.api.functions.sink.filesystem.HadoopPathBasedBulkFormatBuilder

D

DefaultHadoopFileCommitterFactory - Class in org.apache.flink.formats.hadoop.bulk

The default hadoop file committer factory which always use HadoopRenameFileCommitter.

DefaultHadoopFileCommitterFactory() - Constructor for class org.apache.flink.formats.hadoop.bulk.DefaultHadoopFileCommitterFactory

dispose() - Method in interface org.apache.flink.formats.hadoop.bulk.HadoopPathBasedBulkWriter

Disposes the writer on failures.

dispose() - Method in class org.apache.flink.formats.hadoop.bulk.HadoopPathBasedPartFileWriter

G

getConfiguration() - Method in class org.apache.flink.streaming.api.functions.sink.filesystem.SerializableConfiguration

getProperties() - Method in class org.apache.flink.formats.hadoop.bulk.HadoopPathBasedPartFileWriter.HadoopPathBasedBucketWriter

getSize() - Method in interface org.apache.flink.formats.hadoop.bulk.HadoopPathBasedBulkWriter

Gets the size written by the current writer.

getSize() - Method in class org.apache.flink.formats.hadoop.bulk.HadoopPathBasedPartFileWriter

getTargetFilePath() - Method in class org.apache.flink.formats.hadoop.bulk.committer.HadoopRenameFileCommitter

getTargetFilePath() - Method in interface org.apache.flink.formats.hadoop.bulk.HadoopFileCommitter

Gets the target path to commit to.

getTempFilePath() - Method in class org.apache.flink.formats.hadoop.bulk.committer.HadoopRenameFileCommitter

getTempFilePath() - Method in interface org.apache.flink.formats.hadoop.bulk.HadoopFileCommitter

Gets the path of the intermediate file to commit.

H

HadoopFileCommitter - Interface in org.apache.flink.formats.hadoop.bulk

The committer publishes an intermediate Hadoop file to the target path after it finishes writing.

HadoopFileCommitterFactory - Interface in org.apache.flink.formats.hadoop.bulk

The factory to create the HadoopFileCommitter.

HadoopPathBasedBucketWriter(Configuration, HadoopPathBasedBulkWriter.Factory<IN>, HadoopFileCommitterFactory) - Constructor for class org.apache.flink.formats.hadoop.bulk.HadoopPathBasedPartFileWriter.HadoopPathBasedBucketWriter

HadoopPathBasedBulkFormatBuilder<IN,BucketID,T extends HadoopPathBasedBulkFormatBuilder<IN,BucketID,T>> - Class in org.apache.flink.streaming.api.functions.sink.filesystem

Buckets builder to create buckets that use HadoopPathBasedPartFileWriter.

HadoopPathBasedBulkFormatBuilder(Path, HadoopPathBasedBulkWriter.Factory<IN>, Configuration, BucketAssigner<IN, BucketID>) - Constructor for class org.apache.flink.streaming.api.functions.sink.filesystem.HadoopPathBasedBulkFormatBuilder

HadoopPathBasedBulkFormatBuilder(Path, HadoopPathBasedBulkWriter.Factory<IN>, HadoopFileCommitterFactory, Configuration, BucketAssigner<IN, BucketID>, CheckpointRollingPolicy<IN, BucketID>, BucketFactory<IN, BucketID>, OutputFileConfig) - Constructor for class org.apache.flink.streaming.api.functions.sink.filesystem.HadoopPathBasedBulkFormatBuilder

HadoopPathBasedBulkWriter<T> - Interface in org.apache.flink.formats.hadoop.bulk

Specialized BulkWriter which is expected to write to specified Path.

HadoopPathBasedBulkWriter.Factory<T> - Interface in org.apache.flink.formats.hadoop.bulk

A factory that creates a HadoopPathBasedBulkWriter.

HadoopPathBasedPartFileWriter<IN,BucketID> - Class in org.apache.flink.formats.hadoop.bulk

The part-file writer that writes to the specified hadoop path.

HadoopPathBasedPartFileWriter(BucketID, HadoopPathBasedBulkWriter<IN>, HadoopFileCommitter, long) - Constructor for class org.apache.flink.formats.hadoop.bulk.HadoopPathBasedPartFileWriter

HadoopPathBasedPartFileWriter.HadoopPathBasedBucketWriter<IN,BucketID> - Class in org.apache.flink.formats.hadoop.bulk

Factory to create HadoopPathBasedPartFileWriter.

HadoopRenameFileCommitter - Class in org.apache.flink.formats.hadoop.bulk.committer

The Hadoop file committer that directly rename the in-progress file to the target file.

HadoopRenameFileCommitter(Configuration, Path) - Constructor for class org.apache.flink.formats.hadoop.bulk.committer.HadoopRenameFileCommitter

HadoopRenameFileCommitter(Configuration, Path, Path) - Constructor for class org.apache.flink.formats.hadoop.bulk.committer.HadoopRenameFileCommitter

O

openNewInProgressFile(BucketID, Path, long) - Method in class org.apache.flink.formats.hadoop.bulk.HadoopPathBasedPartFileWriter.HadoopPathBasedBucketWriter

org.apache.flink.formats.hadoop.bulk - package org.apache.flink.formats.hadoop.bulk

org.apache.flink.formats.hadoop.bulk.committer - package org.apache.flink.formats.hadoop.bulk.committer

org.apache.flink.streaming.api.functions.sink.filesystem - package org.apache.flink.streaming.api.functions.sink.filesystem

P

persist() - Method in class org.apache.flink.formats.hadoop.bulk.HadoopPathBasedPartFileWriter

preCommit() - Method in class org.apache.flink.formats.hadoop.bulk.committer.HadoopRenameFileCommitter

preCommit() - Method in interface org.apache.flink.formats.hadoop.bulk.HadoopFileCommitter

Prepares the intermediates file for committing.

R

recoverForCommit(Configuration, Path, Path) - Method in class org.apache.flink.formats.hadoop.bulk.DefaultHadoopFileCommitterFactory

recoverForCommit(Configuration, Path, Path) - Method in interface org.apache.flink.formats.hadoop.bulk.HadoopFileCommitterFactory

Creates a Hadoop file committer for commit the pending file.

recoverPendingFile(InProgressFileWriter.PendingFileRecoverable) - Method in class org.apache.flink.formats.hadoop.bulk.HadoopPathBasedPartFileWriter.HadoopPathBasedBucketWriter

resumeInProgressFileFrom(BucketID, InProgressFileWriter.InProgressFileRecoverable, long) - Method in class org.apache.flink.formats.hadoop.bulk.HadoopPathBasedPartFileWriter.HadoopPathBasedBucketWriter

S

SerializableConfiguration - Class in org.apache.flink.streaming.api.functions.sink.filesystem

Wrapper of hadoop Configuration to make it serializable.

SerializableConfiguration(Configuration) - Constructor for class org.apache.flink.streaming.api.functions.sink.filesystem.SerializableConfiguration

W

withBucketAssigner(BucketAssigner<IN, BucketID>) - Method in class org.apache.flink.streaming.api.functions.sink.filesystem.HadoopPathBasedBulkFormatBuilder

withBucketFactory(BucketFactory<IN, BucketID>) - Method in class org.apache.flink.streaming.api.functions.sink.filesystem.HadoopPathBasedBulkFormatBuilder

withConfiguration(Configuration) - Method in class org.apache.flink.streaming.api.functions.sink.filesystem.HadoopPathBasedBulkFormatBuilder

withOutputFileConfig(OutputFileConfig) - Method in class org.apache.flink.streaming.api.functions.sink.filesystem.HadoopPathBasedBulkFormatBuilder

withRollingPolicy(CheckpointRollingPolicy<IN, BucketID>) - Method in class org.apache.flink.streaming.api.functions.sink.filesystem.HadoopPathBasedBulkFormatBuilder

write(IN, long) - Method in class org.apache.flink.formats.hadoop.bulk.HadoopPathBasedPartFileWriter

C D G H O P R S W