Model Parallelism on the IPU with TensorFlow: Sharding and Pipelining
This technical note describes how to parallelise TensorFlow models on IPU hardware.
Note: Searching from the top-level index page will search all documents. Searching from a specific document will search only that document.
"" (double quotes) to only get results where the phrase is exactly matched. For example "PyTorch for the IPU" or "replicated tensor sharding"* (asterisk) at the end of any word to indicate a prefix query. This will return results containing all words with the specific prefix. For example tensor*~N (tilde followed by a number) at the end of any word for a fuzzy search. This will return results that are similar to the search word. N specifies the “edit distance” (fuzziness) of the match. For example Polibs~1~N (tilde followed by a number) after a phrase (in quotes) returns results where the words are close to each other. N is the maximum number of positions allowed between matching words. For example "ipu version"~2+ signifies AND operation| signifies OR operation- negates a single word or phrase (returns results without that word or phrase)() controls operator precedenceThis technical note describes how to parallelise TensorFlow models on IPU hardware.