org.apache.flink.streaming.api.functions.sink.filesystem

Class StreamingFileSink.RowFormatBuilder<IN,BucketID,T extends StreamingFileSink.RowFormatBuilder<IN,BucketID,T>>

java.lang.Object

org.apache.flink.streaming.api.functions.sink.filesystem.StreamingFileSink.BucketsBuilder<IN,BucketID,T>

org.apache.flink.streaming.api.functions.sink.filesystem.StreamingFileSink.RowFormatBuilder<IN,BucketID,T>

All Implemented Interfaces:

Serializable

Direct Known Subclasses:

StreamingFileSink.DefaultRowFormatBuilder

Enclosing class:

StreamingFileSink<IN>

@PublicEvolving
public static class StreamingFileSink.RowFormatBuilder<IN,BucketID,T extends StreamingFileSink.RowFormatBuilder<IN,BucketID,T>>
extends StreamingFileSink.BucketsBuilder<IN,BucketID,T>

A builder for configuring the sink for row-wise encoding formats.

See Also:

Serialized Form

Field Summary

Fields inherited from class org.apache.flink.streaming.api.functions.sink.filesystem.StreamingFileSink.BucketsBuilder

DEFAULT_BUCKET_CHECK_INTERVAL

Constructor Summary

Constructors

Modifier	Constructor and Description
protected	RowFormatBuilder(org.apache.flink.core.fs.Path basePath, org.apache.flink.api.common.serialization.Encoder<IN> encoder, org.apache.flink.streaming.api.functions.sink.filesystem.BucketAssigner<IN,BucketID> bucketAssigner)
protected	RowFormatBuilder(org.apache.flink.core.fs.Path basePath, org.apache.flink.api.common.serialization.Encoder<IN> encoder, org.apache.flink.streaming.api.functions.sink.filesystem.BucketAssigner<IN,BucketID> assigner, org.apache.flink.streaming.api.functions.sink.filesystem.RollingPolicy<IN,BucketID> policy, long bucketCheckInterval, BucketFactory<IN,BucketID> bucketFactory, org.apache.flink.streaming.api.functions.sink.filesystem.OutputFileConfig outputFileConfig)

Method Summary

Modifier and Type	Method and Description
StreamingFileSink<IN>	build() Creates the actual sink.
Buckets<IN,BucketID>	createBuckets(int subtaskIndex)
org.apache.flink.streaming.api.functions.sink.filesystem.BucketWriter<IN,BucketID>	createBucketWriter()
long	getBucketCheckInterval()
T	withBucketAssigner(org.apache.flink.streaming.api.functions.sink.filesystem.BucketAssigner<IN,BucketID> assigner)
T	withBucketCheckInterval(long interval)
<ID> StreamingFileSink.RowFormatBuilder<IN,ID,? extends StreamingFileSink.RowFormatBuilder<IN,ID,?>>	withNewBucketAssignerAndPolicy(org.apache.flink.streaming.api.functions.sink.filesystem.BucketAssigner<IN,ID> assigner, org.apache.flink.streaming.api.functions.sink.filesystem.RollingPolicy<IN,ID> policy)
T	withOutputFileConfig(org.apache.flink.streaming.api.functions.sink.filesystem.OutputFileConfig outputFileConfig)
T	withRollingPolicy(org.apache.flink.streaming.api.functions.sink.filesystem.RollingPolicy<IN,BucketID> policy)

Methods inherited from class org.apache.flink.streaming.api.functions.sink.filesystem.StreamingFileSink.BucketsBuilder

self

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

RowFormatBuilder

protected RowFormatBuilder(org.apache.flink.core.fs.Path basePath,
                           org.apache.flink.api.common.serialization.Encoder<IN> encoder,
                           org.apache.flink.streaming.api.functions.sink.filesystem.BucketAssigner<IN,BucketID> bucketAssigner)

RowFormatBuilder

protected RowFormatBuilder(org.apache.flink.core.fs.Path basePath,
                           org.apache.flink.api.common.serialization.Encoder<IN> encoder,
                           org.apache.flink.streaming.api.functions.sink.filesystem.BucketAssigner<IN,BucketID> assigner,
                           org.apache.flink.streaming.api.functions.sink.filesystem.RollingPolicy<IN,BucketID> policy,
                           long bucketCheckInterval,
                           BucketFactory<IN,BucketID> bucketFactory,
                           org.apache.flink.streaming.api.functions.sink.filesystem.OutputFileConfig outputFileConfig)

Method Detail

getBucketCheckInterval

public long getBucketCheckInterval()

withBucketCheckInterval

public T withBucketCheckInterval(long interval)

withBucketAssigner

public T withBucketAssigner(org.apache.flink.streaming.api.functions.sink.filesystem.BucketAssigner<IN,BucketID> assigner)

withRollingPolicy

public T withRollingPolicy(org.apache.flink.streaming.api.functions.sink.filesystem.RollingPolicy<IN,BucketID> policy)

withOutputFileConfig

public T withOutputFileConfig(org.apache.flink.streaming.api.functions.sink.filesystem.OutputFileConfig outputFileConfig)

withNewBucketAssignerAndPolicy

public <ID> StreamingFileSink.RowFormatBuilder<IN,ID,? extends StreamingFileSink.RowFormatBuilder<IN,ID,?>> withNewBucketAssignerAndPolicy(org.apache.flink.streaming.api.functions.sink.filesystem.BucketAssigner<IN,ID> assigner,
                                                                                                                                           org.apache.flink.streaming.api.functions.sink.filesystem.RollingPolicy<IN,ID> policy)

build

public StreamingFileSink<IN> build()

Creates the actual sink.

createBucketWriter

@Internal
public org.apache.flink.streaming.api.functions.sink.filesystem.BucketWriter<IN,BucketID> createBucketWriter()
                                                                                                                throws IOException

Specified by:

createBucketWriter in class StreamingFileSink.BucketsBuilder<IN,BucketID,T extends StreamingFileSink.RowFormatBuilder<IN,BucketID,T>>

Throws:

IOException

createBuckets

@Internal
public Buckets<IN,BucketID> createBuckets(int subtaskIndex)
                                             throws IOException

Specified by:

createBuckets in class StreamingFileSink.BucketsBuilder<IN,BucketID,T extends StreamingFileSink.RowFormatBuilder<IN,BucketID,T>>

Throws:

IOException