public final class RetrieveTPUEmbeddingADAMParametersGradAccumDebug extends PrimitiveOp
An op that retrieves optimization parameters from embedding to host memory. Must be preceded by a ConfigureTPUEmbeddingHost op that sets up the correct embedding table configuration. For example, this op is used to retrieve updated parameters before saving a checkpoint.
Modifier and Type | Class and Description |
---|---|
static class |
RetrieveTPUEmbeddingADAMParametersGradAccumDebug.Options
Optional attributes for
RetrieveTPUEmbeddingADAMParametersGradAccumDebug |
operation
Modifier and Type | Method and Description |
---|---|
static RetrieveTPUEmbeddingADAMParametersGradAccumDebug |
create(Scope scope,
Long numShards,
Long shardId,
RetrieveTPUEmbeddingADAMParametersGradAccumDebug.Options... options)
Factory method to create a class wrapping a new RetrieveTPUEmbeddingADAMParametersGradAccumDebug operation.
|
Output<Float> |
gradientAccumulators()
Parameter gradient_accumulators updated by the ADAM optimization algorithm.
|
Output<Float> |
momenta()
Parameter momenta updated by the ADAM optimization algorithm.
|
Output<Float> |
parameters()
Parameter parameters updated by the ADAM optimization algorithm.
|
static RetrieveTPUEmbeddingADAMParametersGradAccumDebug.Options |
tableId(Long tableId) |
static RetrieveTPUEmbeddingADAMParametersGradAccumDebug.Options |
tableName(String tableName) |
Output<Float> |
velocities()
Parameter velocities updated by the ADAM optimization algorithm.
|
equals, hashCode, op, toString
public static RetrieveTPUEmbeddingADAMParametersGradAccumDebug create(Scope scope, Long numShards, Long shardId, RetrieveTPUEmbeddingADAMParametersGradAccumDebug.Options... options)
scope
- current scopenumShards
- shardId
- options
- carries optional attributes valuespublic static RetrieveTPUEmbeddingADAMParametersGradAccumDebug.Options tableId(Long tableId)
tableId
- public static RetrieveTPUEmbeddingADAMParametersGradAccumDebug.Options tableName(String tableName)
tableName
- public Output<Float> parameters()
public Output<Float> momenta()
public Output<Float> velocities()
Copyright © 2022. All rights reserved.