org.bytedeco.tensorflow

Class SparseApplyCenteredRMSProp

java.lang.Object

org.bytedeco.javacpp.Pointer

org.bytedeco.tensorflow.SparseApplyCenteredRMSProp

All Implemented Interfaces:

AutoCloseable

@Namespace(value="tensorflow::ops")
 @NoOffset
 @Properties(inherit=tensorflow.class)
public class SparseApplyCenteredRMSProp
extends Pointer

Update '*var' according to the centered RMSProp algorithm. The centered RMSProp algorithm uses an estimate of the centered second moment (i.e., the variance) for normalization, as opposed to regular RMSProp, which uses the (uncentered) second moment. This often helps with training, but is slightly more expensive in terms of computation and memory. Note that in dense implementation of this algorithm, mg, ms, and mom will update even if the grad is zero, but in this sparse implementation, mg, ms, and mom will not update in iterations during which the grad is zero. mean_square = decay * mean_square + (1-decay) * gradient ** 2 mean_grad = decay * mean_grad + (1-decay) * gradient Delta = learning_rate * gradient / sqrt(mean_square + epsilon - mean_grad ** 2) $$ms <- rho * ms_{t-1} + (1-rho) * grad * grad$$ $$mom <- momentum * mom_{t-1} + lr * grad / sqrt(ms + epsilon)$$ $$var <- var - mom$$ Arguments: * scope: A Scope object * var: Should be from a Variable(). * mg: Should be from a Variable(). * ms: Should be from a Variable(). * mom: Should be from a Variable(). * lr: Scaling factor. Must be a scalar. * rho: Decay rate. Must be a scalar. * epsilon: Ridge term. Must be a scalar. * grad: The gradient. * indices: A vector of indices into the first dimension of var, ms and mom. Optional attributes (see Attrs): * use_locking: If True, updating of the var, mg, ms, and mom tensors is protected by a lock; otherwise the behavior is undefined, but may exhibit less contention. Returns: * Output: Same as "var".

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	SparseApplyCenteredRMSProp.Attrs Optional attribute setters for SparseApplyCenteredRMSProp

Nested classes/interfaces inherited from class org.bytedeco.javacpp.Pointer

Pointer.CustomDeallocator, Pointer.Deallocator, Pointer.NativeDeallocator, Pointer.ReferenceCounter

Field Summary

Fields inherited from class org.bytedeco.javacpp.Pointer

address, capacity, limit, position

Constructor Summary

Constructors

Constructor and Description
SparseApplyCenteredRMSProp(Pointer p) Pointer cast constructor.
SparseApplyCenteredRMSProp(Scope scope, Input var, Input mg, Input ms, Input mom, Input lr, Input rho, Input momentum, Input epsilon, Input grad, Input indices)
SparseApplyCenteredRMSProp(Scope scope, Input var, Input mg, Input ms, Input mom, Input lr, Input rho, Input momentum, Input epsilon, Input grad, Input indices, SparseApplyCenteredRMSProp.Attrs attrs)

Method Summary

Modifier and Type	Method and Description
Input	asInput()
Output	asOutput()
Node	node()
Operation	operation()
SparseApplyCenteredRMSProp	operation(Operation setter)
Output	out()
SparseApplyCenteredRMSProp	out(Output setter)
static SparseApplyCenteredRMSProp.Attrs	UseLocking(boolean x)

Methods inherited from class org.bytedeco.javacpp.Pointer

address, asBuffer, asByteBuffer, availablePhysicalBytes, calloc, capacity, capacity, close, deallocate, deallocate, deallocateReferences, deallocator, deallocator, equals, fill, formatBytes, free, getDirectBufferAddress, getPointer, getPointer, getPointer, getPointer, hashCode, interruptDeallocatorThread, isNull, isNull, limit, limit, malloc, maxBytes, maxPhysicalBytes, memchr, memcmp, memcpy, memmove, memset, offsetAddress, offsetof, offsetof, parseBytes, physicalBytes, physicalBytesInaccurate, position, position, put, realloc, referenceCount, releaseReference, retainReference, setNull, sizeof, sizeof, toString, totalBytes, totalCount, totalPhysicalBytes, withDeallocator, zero

Methods inherited from class java.lang.Object

clone, finalize, getClass, notify, notifyAll, wait, wait, wait

Constructor Detail

SparseApplyCenteredRMSProp

public SparseApplyCenteredRMSProp(Pointer p)

Pointer cast constructor. Invokes Pointer(Pointer).

SparseApplyCenteredRMSProp

public SparseApplyCenteredRMSProp(@Const @ByRef
                                  Scope scope,
                                  @ByVal
                                  Input var,
                                  @ByVal
                                  Input mg,
                                  @ByVal
                                  Input ms,
                                  @ByVal
                                  Input mom,
                                  @ByVal
                                  Input lr,
                                  @ByVal
                                  Input rho,
                                  @ByVal
                                  Input momentum,
                                  @ByVal
                                  Input epsilon,
                                  @ByVal
                                  Input grad,
                                  @ByVal
                                  Input indices)

SparseApplyCenteredRMSProp

public SparseApplyCenteredRMSProp(@Const @ByRef
                                  Scope scope,
                                  @ByVal
                                  Input var,
                                  @ByVal
                                  Input mg,
                                  @ByVal
                                  Input ms,
                                  @ByVal
                                  Input mom,
                                  @ByVal
                                  Input lr,
                                  @ByVal
                                  Input rho,
                                  @ByVal
                                  Input momentum,
                                  @ByVal
                                  Input epsilon,
                                  @ByVal
                                  Input grad,
                                  @ByVal
                                  Input indices,
                                  @Const @ByRef
                                  SparseApplyCenteredRMSProp.Attrs attrs)

Method Detail

asOutput

@ByVal
 @Name(value="operator tensorflow::Output")
public Output asOutput()

asInput

@ByVal
 @Name(value="operator tensorflow::Input")
public Input asInput()

node

public Node node()

UseLocking

@ByVal
public static SparseApplyCenteredRMSProp.Attrs UseLocking(@Cast(value="bool")
                                                                  boolean x)

operation

@ByRef
public Operation operation()

operation

public SparseApplyCenteredRMSProp operation(Operation setter)

out

@ByRef
public Output out()

out

public SparseApplyCenteredRMSProp out(Output setter)