AVh2 dZddlZddlmZmZmZddlmZddlm Z ddlm Z ddl mZdZd Zd Zd Zd Zed g d.dedeedee j,fdZedgdedefdZedgdedefdZedgdefdZedgdefdZedgdefdZedgd.deedefdZd edeeeffd!Zed"gdeefd#Zed$gde fd%Z!de fd&Z"de fd'Z#de fd(Z$ed)gdefd*Z%de fd+Z&de fd,Z'de fd-Z(y)/zDTensor Configuration API.N)ListOptionalUnion)context)config)device) tf_exportDTENSOR_CLIENT_IDDTENSOR_NUM_CLIENTSDTENSOR_JOB_NAME DTENSOR_JOBSDTENSOR_ENABLE_HEARTBEATz"experimental.dtensor.local_devices)v1 device_type for_client_idreturnc |jdvrtd|d| t}tt |Dcgc]$}t j td|||&c}Scc}w)z9Returns a list of device specs configured on this client.)CPUGPUTPUz Device type z is not CPU, GPU, or TPU.r)jobreplicataskr device_index)upper ValueError client_idrangenum_local_devices tf_device DeviceSpecjob_name)rris P/home/dcms/DCMS/lib/python3.12/site-packages/tensorflow/dtensor/python/config.py local_devicesr%.s  55 |K=0IJ KKKM$)):;)G#H    j!   s)A0z&experimental.dtensor.num_local_devicesc|jdvr1tj}|j|jSt t j |S)zGReturns the number of devices of device_type configured on this client.)rr)rr get_config device_countlen tf_configlist_physical_devices)rcontext_configs r$rrDsS N*'')N  & &{'8'8': ;; Y , ,[ 9 ::z'experimental.dtensor.num_global_devicesc.t|tzS)zEReturns the number of devices of device_type in this DTensor cluster.)r num_clients)rs r$num_global_devicesr0Ps ; '+- 77r-zexperimental.dtensor.client_idcttjjtd}|dkrt dtd|d|t k\r t dtdt d||S)zReturns this client's ID.0rzEnvironment variable z must be >= 0, got z. z must be < z, got )intosenvironget _DT_CLIENT_IDrr/)client_id_values r$rrVs }c:;/q ,]O<**9):"> ?? % ,]O<""--6GI JJ r-z experimental.dtensor.num_clientsc>tryttS)z6Returns the number of clients in this DTensor cluster.) is_local_moder)jobsr-r$r/r/ds_ TVr-zexperimental.dtensor.job_namecptjjtt dk(rdSdS)zAReturns the job name used by all clients in this DTensor cluster.r: localhostworker)r4r5r6 _DT_JOB_NAMEr/r=r-r$r"r"ls8  '2}'9  II?G IIr-z"experimental.dtensor.full_job_nametask_idcz| t}tdk(r|dk7rtd|dtd|S)zAReturns the fully qualified TF job name for this or another task.r:rzUnexpected task ID z in local runsz/replica:0/task:)rr/rr")rBs r$ full_job_namerDusK _kG]aGqL *7)>B CC J<'y 11r-rc|jddjdd} t|S#t$r|cYSwxYw)zTries to extract an integer task ID from a job name. For example, for `job` = '/.../tpu_worker/0:port_name', return 0. Args: job: A job name to extract task ID from. Returns: The task ID on success, or the original job name on failure. /:r)rsplitr3r)r maybe_task_ids r$ _bns_task_idrKsJ**S/"%,,S1!4- }   Js 3 AAzexperimental.dtensor.jobsctjjt}|gS|j d}t |Dcgc]}|j dc}r#|t|tk7rtd|d|Scc}w)zCReturns a list of job names of all clients in this DTensor cluster.,z/bns/)keyz Unexpected DTENSOR_JOBS content zP. Sort entries in DTENSOR_JOBS because cluster construction relies on the order.) r4r5r6_DT_JOBSsplitany startswithsortedrKr)d_jobs d_jobs_listnames r$r<r<s ::>>( #& ^ I S!+ { ;t$//' " ;<f[l;;  ,VH5    - OOr-ct S)z0Returns true if DTensor shall run in local mode.)r<r=r-r$r;r;s Vr-cBtjd}t|S)(Returns true if TPU devices are present. TPU_SYSTEM)r*r+bool)tpu_system_devicess r$is_tpu_presentrcs!!66|D  !!r-c>ttjdS)r_r)rar*r+r=r-r$is_gpu_presentres i--e4 55r-z*experimental.dtensor.preferred_device_typec0trytryy)zReturns the preferred device type for the accelerators. The returned device type is determined by checking the first present device type from all supported device types in the order of 'TPU', 'GPU', 'CPU'. rrr)rcrer=r-r$preferred_device_typergs   r-cHtjjdddk7S)zBReturn True if environment indicates multi-device mode is enabled.%DTENSOR_ENABLE_MULTI_DEVICE_EXPANSIONr2r4r5r6r=r-r$use_multi_device_moderks ? E LLr-cHtjjdddk7S)z@Return True if environment indicates NCCL shall be used for GPU."DTENSOR_GPU_USE_NCCL_COMMUNICATIONr2rjr=r-r$gpu_use_nccl_communicationrns rzsI! ((+;;6# '! 2  /B7$(C=,01E1E,F8* 3;;3;3;<; 4<8C8C8=8  +3 3 4  -"5S6 *r2I#I3I /B7 28C= 2C 28 2ceCHo$ &2.d3i/& 3;P4P<P t ""66  7B? s @ MtM JDJ AtAr-