Vh:ddlmZddlmZmZmZmZmZddlm Z ddl Z ddl m Z m Z gdZe ded ed efd Zd ed efd Zed eeeZe dde j.deeee j2fded ee j.dffdZe ddedeeee j2fded eefdZddZ ddeedfdeeeefdeeee j2fded eeedfeeeefdfff dZddedeee j2fded efdZy))Sequence)AnyOptionaloverloadTypeVarUnion) deprecatedN)GatherScatter)scatterscatter_kwargsgatherzC`is_namedtuple` is deprecated, please use the python checks instead)categoryobjreturnct|SN)_is_namedtuplers P/home/dcms/DCMS/lib/python3.12/site-packages/torch/nn/parallel/scatter_gather.py is_namedtupler s # cZt|txrt|dxr t|dS)N_asdict_fields) isinstancetuplehasattrrs rrrs+ 3V73 #:VwsI?VrT.inputs target_gpusdimcyrr r!r"s rr r ! rcyrr$r%s rr r *r&rc>fd |}d|S#dwxYw)zSlice tensors into approximately equal chunks and distributes them across given GPUs. Duplicates references to objects that are not tensors. ct|tjrtjd|St |r,t t|Dcgc]}t||c}St|tr)t|dkDrtt t|St|tr7t|dkDr)t t|Dcgc] }t|c}St|trKt|dkDr=t t|jDcgc]}t||c}SDcgc]}|c}Scc}wcc}wcc}wcc}w)Nr)rtorchTensorr applyrzipmaptyperlenlistdictitems)rargsi_r" scatter_mapr!s rr7zscatter..scatter_map9s c5<< (==dC= = # 14c+s6K1LMIDIt$M M c5 !c#hlSc234 4 c4 SX\%(#k3*?%@ADGA A c4 SX\*-s; /L*MNQIDIaLN N()))NBN)sEE+E  E%Nr$)r r!r"resr7s `` @rr r 3s* *$&! J kwargsc |r t|||ng}|r t|||ng}t|t|kr7|jdtt|t|z DnMt|t|kr6|jdtt|t|z Dt |t |fS)z+Scatter with support for kwargs dictionary.c3 K|]}dyw)r$Nr$.0r6s r z!scatter_kwargs..\ B  c3 K|]}iywrr$r=s rr?z!scatter_kwargs..`r@rA)r r0extendranger)r r:r!r"scattered_inputsscattered_kwargss rr r Rs=Cwv{C8fd |}d|S#dwxYw)aGather tensors from different GPUs on a specified device. This function is useful for gathering the results of a distributed computation. It takes a sequence of objects, one for each GPU, and returns a single object on the specified device. Args: outputs (Any): A sequence of objects (potentially tensors) to gather. target_device (Union[int, torch.device]): The device to gather the tensors to. Use 'cpu' for CPU to avoid a deprecation warning. dim (int, optional): The dimension along which to gather. Default: 0. Returns: Any: A gathered object (potentially tensor) on the specified device. cdttjrtjgSytt r:t fdDs tdtfdDStr*tjttStttS)Nrc3LK|]}tt|k(ywr)r0)r>douts rr?z-gather..gather_map..~s;as3x3q6);s!$z+All dicts must have the same number of keysc 3^K|]}|Dcgc]}|| c}f!ycc}wwrr$)r>krL gather_maprGs rr?z-gather..gather_map..s-S!a7,CaQqT,C!DES,Cs - ( -) rr*r+r r,r2all ValueErrorr/r_maker.r-)rGrMr"rPrHs`@rrPzgather..gather_mapwsaj c5<< (<< s=W= = ; c4 ;7;; !NOO49SsSS S # 9??3z3=#AB BtCyZg788rNr$)rGrHr"r8rPs `` @rrrfs*" 9 ! J r9).)r)collections.abcrtypingrrrrrtyping_extensionsr r*torch.nn.parallel._functionsr r __all__ FutureWarningboolrrr2r1rrr+intdevicer strr rr$rrr^s$::( 8 2 I st   CtU#  LL%U\\ 123  5<<     %U\\ 123  !W  F < #s(O< T#s(^ $<%U\\ 123< <  5c?E$sCx.#"56 67 <(%C%c5<<.?(@%s%SV%r