BVhB" dZddlZddlmZddlmZddlmZddl m Z ddl m Z ddl m Zdd l mZdd l mZdd lmZdd lmZdd lmZdZdZdZdZdZdZedGddej<dgdZ ddZ dZ!dZ"dZ#y)z+TPU system metadata and associated tooling.N) config_pb2)session) device_util)contextconfig)device)errors)ops) tf_logging)tpu) tf_exportii  tpu_worker coordinator)localz"tpu.experimental.TPUSystemMetadatac"eZdZdZfdZxZS)TPUSystemMetadataaDescribes some metadata about the TPU system. Attributes: num_cores: interger. Total number of TPU cores in the TPU system. num_hosts: interger. Total number of hosts (TPU workers) in the TPU system. num_of_cores_per_host: interger. Number of TPU cores per host (TPU worker). topology: an instance of `tf.tpu.experimental.Topology`, which describes the physical topology of TPU system. devices: a tuple of strings, which describes all the TPU devices in the system. c4tt| ||||||SN)superr__new__)cls num_cores num_hostsnum_of_cores_per_hosttopologydevices __class__s Y/home/dcms/DCMS/lib/python3.12/site-packages/tensorflow/python/tpu/tpu_system_metadata.pyrzTPUSystemMetadata.__new__=s* " !9i9N&11)__name__ __module__ __qualname____doc__r __classcell__)rs@r rr(s 11r!rrrrrrc >d}g}tjt}tjrat j }|Dcgc]A}tjtj|j|jddC}}nd} tjd| tj j#5tj$|t't(|5} | j+} dddddd|D]h} t6j8j;| j} | jd k(s<|| j<j?| j@|dz }jd} |rhtC|jEDcgc] }tG|c}}tG|dk7rtId jK||jM} d}|r)|stId jK||tO||}d }tQtS|| }tU|tG|| ||}|rtjdtjd|jVtjd|jXtjd|jZ|j\D]} tjd| |Stjd||Scc}w#1swYnxYw dddn #1swYnxYwni#t,j.$rSd|z} |t0kr7tj2d| tj2d|t0|dz }n t5| YnwxYwcc}w)z._sort_keysJ    + +FKK 8D HHdllDIIt/?/?    r!)keyr'zFound TPU system:z*** Num TPU Cores: %dz*** Num TPU Workers: %dz *** Num TPU Cores Per Worker: %dz*** Available Device: %szFailed to find TPU: %s)/ collections defaultdictlistrexecuting_eagerlyrlist_logical_devices session_lib_DeviceAttributesr canonicalizer/r3logginginfor Graph as_defaultSessionget_session_config_with_timeout_PINGING_MASTER_TIMEOUT_IN_MS list_devicesr DeadlineExceededError _RETRY_TIMESwarning ValueErrorr,r-r.r2appendr4setvalueslen RuntimeErrorformatpop_obtain_topologytuplesortedrrrrr)master_address cluster_defquery_topologytpu_core_countr device_dictlogical_devicesd retry_countsessmsgr r5rcore_idsnum_cores_per_host_setrr6metadatas r _query_tpu_system_metadatarcDsg. '''-+  113O (),,[-E-Eaff-M-.]]AqB)G) K  llM!# YY[ # # % ""4/  $('')G    .f    + +FKK 8D 5 $))##D$5$56n   '2'9'9';<8X<> !"a'  w ))3668 (   @@FgA' ((   ,>? LL3//1""7 ll-v67 / LL)84 /k)       ) )  1  , & //$ $ //-{L I  +3     H =sV AL-"L/&L"5L L"L/N L L" L/"L+'L//A#NNc tjd|tjj 5t t |}tj||5}|jtj}|cdddcdddS#1swYnxYw dddy#1swYyxYw#tj$rtd|zwxYw)zObtains TPU fabric topology.zfInitializing TPU system (master: %s) to fetch topology for model parallelism. This might take a while.rNzaFail to initialize TPU system with master (%s). Please double check the TPU system is functional.)r@rAr rBrCrE!_INITIAL_TPU_SYSTEM_TIMEOUT_IN_MSr=rDrunr initialize_systemr rHrK)rVrWsession_configr^rs r rSrSs LLC!    !6 +[:n     14888C1134  % %  <   sF8B<(B0"%B B0 B<B# B0'B<0B95B<9B<<"Cc4tj||}|S)z>Returns a session given a timeout and a cluster configuration.)operation_timeout_in_msrW)r ConfigProto)timeout_in_secsrW config_protos r rErEs''-;H, r!ct|tvry|r |jstStd|jD}t|vr t dt |dk(r|jdj St |dk(r-t|vr%|jt|jSt d)aReturns the canonical job name to use to place TPU computations on. Args: master: A `string` representing the TensorFlow master to use. cluster_def: A ClusterDef object describing the TPU cluster. Returns: A string containing the job name, or None if no job should be specified. Raises: ValueError: If the user needs to specify a tpu_job_name, because we are unable to infer the job name automatically, or if the user-specified job names are inappropriate. Nc34K|]}|jywr)r/).0r0s r zmaster_job..s6s#((6sz1Currently, tpu_worker is not an allowed job name.r)rzCould not infer TPU job name.) _LOCAL_MASTERSr0_DEFAULT_JOB_NAMErMrKrOr/_DEFAULT_COORDINATOR_JOB_NAMEremoverR)masterrW job_namess r master_jobrys" ~  [__ 6koo66))# H II^q ??1  " ""^q$ 145 ]]_233r!)NF)$r%r8tensorflow.core.protobufrtensorflow.python.clientrr=tensorflow.python.distributertensorflow.python.eagerrtensorflow.python.frameworkrr r,r r tensorflow.python.platformr r@tensorflow.python.tpur tensorflow.python.util.tf_exportrrFrIrertrurs namedtuplerrcrSrEryr!r rs2/;4+.;.+<%6 - $.!  - /01K.11116<@.3`F(!4r!