Vh ddlmZddlmZGddej ZdZejjdeddg y) NFakeProcessGroupceZdZdZy) FakeStorez A fake store is a fake Key-Value store simply for initialization usage the of fake process group, one can either use FakeStore or HashStore. N)__name__ __module__ __qualname____doc__[/home/dcms/DCMS/lib/python3.12/site-packages/torch/testing/_internal/distributed/fake_pg.pyrr sr rct||S)a A fake process group (not related to FakeTensor) is a process group which doesn't actually do any communication, it just hallucinates some communication. You can run a single rank with a fake process group without needing multiple processes (simulates per-rank behavior) NOTE: This is not a real process group, and it would produce wrong results for every collective. It should be used as a convinient tool when playing with distributed but don't care about the actual data. r) prefix_storerank world_sizetimeouts r _create_fake_pgrs D* --r fakecpucuda)devices) torch.distributed distributeddisttorch._C._distributed_c10drStorerrBackendregister_backendr r r rsC!   . fovOr