Targeting the IPU from TensorFlow 2ΒΆ
- 1. Introduction
- 2. Targeting the Poplar XLA device
- 3. Support for TensorFlow 2
- 4. Keras with IPUs
- 5. Compiling and pre-compiling executables
- 6. Training a model
- 7. Efficient IPU I/O
- 8. Example using IPUEstimator
- 9. Example using IPUPipelineEstimator
- 10. Distributed training
- 11. Half-precision floating point and stochastic rounding
- 12. IPU-optimised operations
- 13. IPU Outlined Functions
- 14. Writing custom operations
- 15. IPU host embeddings
- 16. IPU embedded application runtime
- 17. Retrieving information about compilation and execution
- 18. IPU TensorFlow Addons
- 19. TensorFlow API changes
- 20. TensorFlow Python API
- 20.1. Operations and utilities related to the Graphcore IPU
- 20.2. Distribution strategy for a single system
- 20.3. Compiler interface
- 20.4. Scoping contexts
- 20.5. Infeed queue
- 20.6. Outfeed queue
- 20.7. General utilities
- 20.8. Configuration utilities
- 20.9. Looping utilities
- 20.10. Distributed training
- 20.11. Horovod
- 20.12. Serving utilities
- 20.13. Datasets
- 20.14. Estimators
- 20.15. Keras
- 20.16. Keras layers
- 20.17. Keras losses
- 20.18. Keras optimizers
- 20.19. Operators
- 20.19.1. Control flow operations.
- 20.19.2. Custom operations
- 20.19.3. Functional operators
- 20.19.4. Image operations
- 20.19.5. Graphcore utility operations
- 20.19.6. IPU specific maths operations
- 20.19.7. Pipelining operators
- 20.19.8. Popnn primitive neural network operators
- 20.19.9. Popnn normalization operators
- 20.19.10. Popnn recurrent neural network operators
- 20.19.11. Popops all to all and all gather operators
- 20.19.12. Popops cross replica operators
- 20.19.13. Popops embedding operators
- 20.19.14. Popops reduce scatter operator
- 20.19.15. Popops within replica operators
- 20.19.16. Poprand operators
- 20.19.17. Utility operations to be used in replicated mode
- 20.19.18. Slicing operators
- 20.19.19. Statistics operators
- 20.19.20. Embedded application runtime
- 20.20. Optimisers
- 20.21. Sharding
- 21. TensorFlow operators supported by the IPU
- 22. IPU TensorFlow Addons API changes
- 23. IPU TensorFlow Addons Python API
- 24. Resources
- 25. Trademarks & copyright