org.apache.flink.streaming.runtime.operators

类 TimestampsAndWatermarksOperator<T>

java.lang.Object

org.apache.flink.streaming.api.operators.AbstractStreamOperator<T>

org.apache.flink.streaming.runtime.operators.TimestampsAndWatermarksOperator<T>

类型参数:

T - The type of the input elements

所有已实现的接口:

Serializable, org.apache.flink.api.common.operators.ProcessingTimeService.ProcessingTimeCallback, org.apache.flink.api.common.state.CheckpointListener, Input<T>, KeyContext, OneInputStreamOperator<T,T>, SetupableStreamOperator<T>, StreamOperator<T>, StreamOperatorStateHandler.CheckpointedStreamOperator

public class TimestampsAndWatermarksOperator<T>
extends AbstractStreamOperator<T>
implements OneInputStreamOperator<T,T>, org.apache.flink.api.common.operators.ProcessingTimeService.ProcessingTimeCallback

A stream operator that may do one or both of the following: extract timestamps from events and generate watermarks.

These two responsibilities run in the same operator rather than in two different ones, because the implementation of the timestamp assigner and the watermark generator is frequently in the same class (and should be run in the same instance), even though the separate interfaces support the use of different classes.

另请参阅:

序列化表格

嵌套类概要

嵌套类

限定符和类型	类和说明
static class	TimestampsAndWatermarksOperator.WatermarkEmitter Implementation of the WatermarkEmitter, based on the components that are available inside a stream operator.

字段概要

从类继承的字段 org.apache.flink.streaming.api.operators.AbstractStreamOperator

chainingStrategy, config, latencyStats, LOG, metrics, output, processingTimeService

构造器概要

构造器

构造器和说明
TimestampsAndWatermarksOperator(org.apache.flink.api.common.eventtime.WatermarkStrategy<T> watermarkStrategy, boolean emitProgressiveWatermarks)

方法概要

限定符和类型	方法和说明
void	finish() This method is called at the end of data processing.
void	onProcessingTime(long timestamp)
void	open() This method is called immediately before any elements are processed, it should contain the operator's initialization logic, e.g. state initialization.
void	processElement(StreamRecord<T> element) Processes one element that arrived on this input of the MultipleInputStreamOperator.
void	processWatermark(Watermark mark) Override the base implementation to completely ignore watermarks propagated from upstream, except for the "end of time" watermark.
void	processWatermarkStatus(WatermarkStatus watermarkStatus) Override the base implementation to completely ignore statuses propagated from upstream.

从类继承的方法 org.apache.flink.streaming.api.operators.AbstractStreamOperator

close, getChainingStrategy, getContainingTask, getCurrentKey, getExecutionConfig, getInternalTimerService, getKeyedStateBackend, getKeyedStateStore, getMetricGroup, getOperatorConfig, getOperatorID, getOperatorName, getOperatorStateBackend, getOrCreateKeyedState, getPartitionedState, getPartitionedState, getProcessingTimeService, getRuntimeContext, getTimeServiceManager, getUserCodeClassloader, initializeState, initializeState, isUsingCustomRawKeyedState, notifyCheckpointAborted, notifyCheckpointComplete, prepareSnapshotPreBarrier, processLatencyMarker, processLatencyMarker1, processLatencyMarker2, processWatermark1, processWatermark2, processWatermarkStatus1, processWatermarkStatus2, registerCounterOnOutput, reportOrForwardLatencyMarker, setChainingStrategy, setCurrentKey, setKeyContextElement1, setKeyContextElement2, setProcessingTimeService, setup, snapshotState, snapshotState

从类继承的方法 java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

从接口继承的方法 org.apache.flink.streaming.api.operators.OneInputStreamOperator

setKeyContextElement

从接口继承的方法 org.apache.flink.streaming.api.operators.StreamOperator

close, getMetricGroup, getOperatorID, initializeState, prepareSnapshotPreBarrier, setKeyContextElement1, setKeyContextElement2, snapshotState

从接口继承的方法 org.apache.flink.api.common.state.CheckpointListener

notifyCheckpointAborted, notifyCheckpointComplete

从接口继承的方法 org.apache.flink.streaming.api.operators.KeyContext

getCurrentKey, setCurrentKey

从接口继承的方法 org.apache.flink.streaming.api.operators.Input

processLatencyMarker

构造器详细资料

TimestampsAndWatermarksOperator

public TimestampsAndWatermarksOperator(org.apache.flink.api.common.eventtime.WatermarkStrategy<T> watermarkStrategy,
                                       boolean emitProgressiveWatermarks)

方法详细资料

open

public void open()
          throws Exception

从类复制的说明: AbstractStreamOperator

This method is called immediately before any elements are processed, it should contain the operator's initialization logic, e.g. state initialization.

The default implementation does nothing.

指定者:

open 在接口中 StreamOperator<T>

覆盖:

open 在类中 AbstractStreamOperator<T>

抛出:

Exception - An exception in this method causes the operator to fail.

processElement

public void processElement(StreamRecord<T> element)
                    throws Exception

从接口复制的说明: Input

Processes one element that arrived on this input of the MultipleInputStreamOperator. This method is guaranteed to not be called concurrently with other methods of the operator.

指定者:

processElement 在接口中 Input<T>

抛出:

Exception

onProcessingTime

public void onProcessingTime(long timestamp)
                      throws Exception

指定者:

onProcessingTime 在接口中 org.apache.flink.api.common.operators.ProcessingTimeService.ProcessingTimeCallback

抛出:

Exception

processWatermark

public void processWatermark(Watermark mark)
                      throws Exception

Override the base implementation to completely ignore watermarks propagated from upstream, except for the "end of time" watermark.

指定者:

processWatermark 在接口中 Input<T>

覆盖:

processWatermark 在类中 AbstractStreamOperator<T>

抛出:

Exception

另请参阅:

Watermark

processWatermarkStatus

public void processWatermarkStatus(WatermarkStatus watermarkStatus)
                            throws Exception

Override the base implementation to completely ignore statuses propagated from upstream.

指定者:

processWatermarkStatus 在接口中 Input<T>

覆盖:

processWatermarkStatus 在类中 AbstractStreamOperator<T>

抛出:

Exception

另请参阅:

WatermarkStatus

finish

public void finish()
            throws Exception

从接口复制的说明: StreamOperator

This method is called at the end of data processing.

The method is expected to flush all remaining buffered data. Exceptions during this flushing of buffered data should be propagated, in order to cause the operation to be recognized as failed, because the last data items are not processed properly.

After this method is called, no more records can be produced for the downstream operators.

WARNING: It is not safe to use this method to commit any transactions or other side effects! You can use this method to flush any buffered data that can later on be committed e.g. in a CheckpointListener.notifyCheckpointComplete(long).

NOTE:This method does not need to close any resources. You should release external resources in the StreamOperator.close() method.

指定者:

finish 在接口中 StreamOperator<T>

覆盖:

finish 在类中 AbstractStreamOperator<T>

抛出:

Exception - An exception in this method causes the operator to fail.