PCCL

Notes on PCCL, a decentralized collective-communication stack that uses a master-coordinated dynamic ring and bit-identical state recovery to keep distributed training alive across churny, high-latency internet links.