Vh tUddlmZddlZddlmZddlmZddlmZdee fdZ dee fdZ eeeeZ ee d <eeZee d <ejgZe dd e d edeeej(ej*fee efffd Zdej(defdZdeedej(defdZy))OptionalN)Tensor)no_grad) TypeAliasreturncDddtjjgS)z:Return the device type list that supports foreach kernels.cudaxputorch_C_get_privateuse1_backend_nameJ/home/dcms/DCMS/lib/python3.12/site-packages/torch/utils/_foreach_utils.py&_get_foreach_kernels_supported_devicesrs E588AAC DDrcJdddddtjjgS)zEReturn the device type list that supports fused kernels in optimizer.mpsr r hpucpur rrr$_get_fused_kernels_supported_devicesr s" 65%0V0V0X YYrTensorListListIndicestensorlistlist with_indicescBtjj||SN)r r "_group_tensors_by_device_and_dtype)rrs rrr s 88 6 6~| TTrdevicecx|jtdgzvxrtjj S)Nr)typerr jit is_scripting)rs r_device_has_foreach_supportr$'s4 ;;ACugM N oW\W`W`WmWmWoSoortensorsc@t|xrtd|DS)Nc3JK|]}|duxst|tvywr)r!_foreach_supported_types).0ts r z'_has_foreach_support..,s'6ylmqDy7gDGOgDg7g6ys!#)r$all)r%rs r_has_foreach_supportr-+s &v . y36yqx6y3yyr)F)typingrr rtorch.autograd.grad_modertyping_extensionsrliststrrrr__annotations__intrr(booldicttuplerdtyperr$r-rrrr9s  ,'ES EZd3iZ!hv&6!78 8#Y!LL> U"UU % ekk) *E.'2I,J JKU U p ppz$v,z zzr