Poplar and PopLibs
|
A program to mark a tensor as equal across replicas. More...
#include <Program.hpp>
A program to mark a tensor as equal across replicas.
This can be used to tell Poplar that the value of a tensor is the same in all replicas (for example, if it is the result of a cross-replica all-gather operation). Poplar will use this information while checking for divergence in the control flow. This allows it to accept programs that it would otherwise reject because of lack of knowledge of tensor values.