Highly Efficient Multi-Node Communication Patterns Using oneCCL

Neural networks are the keystone of deep learning algorithms. Training neural networks is compute intensive and therefore needs an…