org.tensorflow.op.core

Class NcclAllReduce<T extends Number>

java.lang.Object

org.tensorflow.op.PrimitiveOp

org.tensorflow.op.core.NcclAllReduce<T>

Type Parameters:

T - data type for data() output

All Implemented Interfaces:

Op, Operand<T>

public final class NcclAllReduce<T extends Number>
extends PrimitiveOp
implements Operand<T>

Outputs a tensor containing the reduction across all input tensors.

Outputs a tensor containing the reduction across all input tensors passed to ops within the same `shared_name.

The graph should be constructed so if one op runs with shared_name value `c`, then `num_devices` ops will run with shared_name value `c`. Failure to do so will cause the graph execution to fail to complete.

input: the input to the reduction data: the value of the reduction across all `num_devices` devices. reduction: the reduction operation to perform. num_devices: The number of devices participating in this reduction. shared_name: Identifier that shared between ops of the same reduction.

Field Summary

Fields inherited from class org.tensorflow.op.PrimitiveOp

operation

Method Summary

Modifier and Type	Method and Description
Output<T>	asOutput() Returns the symbolic handle of a tensor.
static <T extends Number> NcclAllReduce<T>	create(Scope scope, Operand<T> input, String reduction, Long numDevices, String sharedName) Factory method to create a class to wrap a new NcclAllReduce operation to the graph.
Output<T>	data()

Methods inherited from class org.tensorflow.op.PrimitiveOp

equals, hashCode, toString

Methods inherited from class java.lang.Object

clone, finalize, getClass, notify, notifyAll, wait, wait, wait

Method Detail

create

public static <T extends Number> NcclAllReduce<T> create(Scope scope,
                                                         Operand<T> input,
                                                         String reduction,
                                                         Long numDevices,
                                                         String sharedName)

Factory method to create a class to wrap a new NcclAllReduce operation to the graph.

Parameters:

scope - current graph scope

input -

reduction -

numDevices -

sharedName -

Returns:

a new instance of NcclAllReduce

data

public Output<T> data()

asOutput

public Output<T> asOutput()

Description copied from interface: Operand

Returns the symbolic handle of a tensor.

Inputs to TensorFlow operations are outputs of another TensorFlow operation. This method is used to obtain a symbolic handle that represents the computation of the input.

Specified by:

asOutput in interface Operand<T extends Number>

See Also:

OperationBuilder.addInput(Output)