BVhSgdZddlZddlZddlmZddlmZddlmZ ddlm Z ddlm Z ddlm Z dd lmZdd lmZdd lmZdd lmZdd lmZddlmZddlmZddlmZddlmZddlmZedZedZedZedZgdZdZ GddejBZ"dZ#Gdde$Z%ejLdZ'dZ(e(d Z)d!Z*d"Z+y)#z7AutomaticControlDependencies and related functionality.N)attr_value_pb2)context)auto_control_deps_utils)dtypes)indexed_slices)op_def_registry)ops)registry) sparse_tensor) array_ops)control_flow_ops)control_flow_util)tensor_array_ops)nest)object_identity) tf_decorator) CollectiveGatherCollectiveReduceCollectiveBcastSendCollectiveBcastSendV2CollectiveBcastRecvCollectiveBcastRecvV2 NcclAllReduceRecv CollectiveInitializeCommunicatorCollectiveAssignGroupV2) RandomUniformRandomUniformIntRandomStandardNormalParameterizedTruncatedNormalTruncatedNormal RandomShuffle Multinomial RandomGammaRandomGammaGrad RandomPoissonRandomPoissonV2) InfeedEnqueueInfeedEnqueueTupleEnqueueTPUEmbeddingSparseBatchEnqueueTPUEmbeddingIntegerBatch$EnqueueTPUEmbeddingSparseTensorBatch$EnqueueTPUEmbeddingRaggedTensorBatch'EnqueueTPUEmbeddingArbitraryTensorBatch.DynamicEnqueueTPUEmbeddingArbitraryTensorBatch)CudnnRNNCudnnRNNBackprop CudnnRNNV2 CudnnRNNV3CudnnRNNBackpropV2CudnnRNNBackpropV3 RestoreV2SaveV2)AllToAllCrossReplicaSumCollectivePermutec|jxr:|jtvxr&|jtvxr|jtvxs|jt v}|SN) _is_statefultypeASYNC_STATEFUL_OPSLEGACY_RANDOM_OPS&SKIPPED_ORDER_INSENSITIVE_STATEFUL_OPS_ALLOWLIST_STATELESS_OPS)oprets ]/home/dcms/DCMS/lib/python3.12/site-packages/tensorflow/python/framework/auto_control_deps.pyop_is_statefulrFsb // D GG- - C GG, , C GGA A / ''- -  *ceZdZdZdZy) ResourceTypez read-onlyz read-writeN)__name__ __module__ __qualname__ READ_ONLY READ_WRITErGrErIrIs )*rGrIc|jdk(r |jdgS|jdk(r |jtjSgS#t$rYgSwxYw#t$rYgSwxYw)aReturns CollectiveManager ID from the op if one exists, else None. CollectiveManager adds collective and no_op operations tagged with an ID, unique to the manager object. This function extracts that ID, or None, if the node was not generated by a CollectiveManager. Args: op: `Operation` to get the collective manager ID from. Returns: List of CollectiveManager IDs used by the op. r_collective_manager_idStatefulPartitionedCall)r>get_attr ValueErrorutilsCOLLECTIVE_MANAGER_IDS)rCs rEcollective_manager_ids_from_oprWsWW"" kk23 44 ww++ [[55 66 )   )   ) s"AA$ A! A!$ A10A1c4eZdZdZdZdZdZdZdZdZ y) AutomaticControlDependenciesaTContext manager to automatically add control dependencies. Code under this context manager will act as if a sensible set of control dependencies were present. More specifically: 1. All stateful ops in the scope will execute (with the exception of ops in ASYNC_STATEFUL_OPS and LEGACY_RANDOM_OPS) 2. Stateful ops which modify the same resource will execute in program order Note: creating variables in an automatic control dependencies context is not supported (the value of the variables will never change as they will keep getting reinitialized). NOT THREAD SAFE cbtj|_t|_g|_yr<)rObjectIdentitySet_returned_tensorssetops_which_must_run_independent_ops)selfs rE__init__z%AutomaticControlDependencies.__init__s%,>>@D!eDDrGct|tjrtj|j }tj|j }|jj||jj|tj|||jSt|tjrtj|j }tj|j }|jj||jj|tj|||jSt|tjrPtj|j}|jj|tj||Stj|}|jj||S)a}Acts like identity but marks the `Tensor` as a return value. This will possibly return a copy of the `Tensor`. Usage: ``` with AutomaticControlDependencies() as a: ... t = a.mark_as_return(t) _ = ...(t...) # i.e. it's safe to use t here ``` Args: tensor: the `Tensor` to be marked Returns: a copy of the `Tensor`. ) dense_shape) isinstancer IndexedSlicesr identityvaluesindicesr\addrcr SparseTensorr TensorArrayflowbuild_ta_with_new_flow)r`tensorrgrhrls rEmark_as_returnz+AutomaticControlDependencies.mark_as_returns{$&.667!!&--0f""6>>2g   )   (  ) ) 'v'9'9;; FM66 7!!&--0f""6>>2g   )   (  ' ' 6v'9'9;; F,88 9    ,d   &  4 4VT BB    'Fv& MrGc|jj||jdtjdy)a]Marks the given op as independent. Overrides any other rule for the op. Independent ops are guaranteed to execute before the return values, but are allowed to run in parallel with everything else. Use in programs which can guarantee that an op has side effects that don't affect any other op. Args: op: An operation _independent_side_effectsT)bN)r_append _set_attrr AttrValue)r`rCs rErun_independentlyz.AutomaticControlDependencies.run_independentlys2   $LL,n.F.F.NOrGctjr|Stj}||_d|_||_|j|_|S)NT) rexecuting_eagerlyr get_default_graph_graph_add_control_dependenciesexperimental_acd_managernum_operations _n_operations)r`gs rE __enter__z&AutomaticControlDependencies.__enter__ sP  " k ADK"&A!%A))+D KrGc|jd}tj|}|jtj k(r7|j jdk(r|j|j ||||jd}tj|}||vrytj|jd} |jj| dj _ |j| dj ||vr|j||| dj ||<||vr!||j| dj |jD]'} | dj |tj| <)y)aProcesses a switch node for a resource input. When tensorflow creates a cond, it creates a control flow context for each branch of the cond. Each external tensor accessed by that branch is routed through a switch op, which gets created in the graph _after_ the op which uses that tensor get created. If the resource comes from another switch op we process that one first. _process_switch creates a corresponding merge node for the switch node. This merge node is added to the outer control flow context of the switch node. We also ensure that: 1. The switch node executes after the previous op which used the resource tensor 2. Any op which uses a resource output of the switch node executes before the merge for the switch node. 3. The next op which uses the input resource to the switch node (which might be another switch node for the other branch of the conditional) will execute after the merge node is done. 4. The merge node is marked as must_run so it will run even if no subsequent operation uses the resource. Args: switch_op: the switch op to be processed ops_which_must_run: the set of ops which must run last_write_to_resource: map from resource tensor to last op updating it merge_for_resource: map from resource tensor to merge which must follow all usages of it. rSwitchNartificial_merge)name)inputsr tensor_iddtype dtypes_moduleresourcerCr>_process_switchoutputsr merge_control_flow_context outer_contextri_add_control_input) r` switch_opr^last_write_to_resourcemerge_for_resourceinpinput_idoutput output_id new_mergeos rErz,AutomaticControlDependencies._process_switchseJ   1 C}}S!H yyM***svv{{h/F 366#57M-/   q !F f%I&&  && 24I ''55aLOO)9Qd j@tBjDk(r9| j"d k(rV| D]C}| jG||j>D]!}tjH|}||vs| ||<#Et| g} t}tK| D]\}}|tLjNk(}tjH|}||vr4|j+||jPj"dk(r|jS|jP| || | jTjV}||vr1|s||jX| jXur| j+|||| vr| |jG| |r||j[| | j]||g||<| ||<t1| r+|s)| jXd|vr| jG|d| |d<t_| }|D]=}||vr| jG||| ||<!||vr| jG||| ||<?| r)s'| Dcgc]}|jX| jXur|} }| ja| |jbj]| d}tetgjht|jjd D]\}}|jbsg}|jTjVr8|d k(r/tmjn}|ja|jb|g}n;|jbDcgc]&}|jX|jPjXur|(}}|jPja|||_8y#t<$rYwxYwcc}wcc}w) NzdWithin the automatic control dependency context, the default graph cannot change. Upon entry it was z, but on exit it changed to outer_graphFc3<K|]}|jywr<) consumers).0rs rE z8AutomaticControlDependencies.__exit__..s'MUST_RUN_ORDER_INSENSITIVE_STATEFUL_OPSrvr_rirgetrFrURESOURCE_READ_OPSanyrrSrTrrrrrr_get_resource_inputsrIrMrCrgraphbuilding_functionrrsupdaterW_add_control_inputsr^ enumeraterflattenr\r no_opcollective_manager_ids_used)r` unused_type unused_valueunused_tracebackrr"reads_since_last_write_to_resource collective_manager_scopes_openedcollective_manager_scopes_usedr^rnew_operationsrCcontrol_inputsrrrresource_inputs resource_typeis_readis_building_function manager_ids manager_idccontrol_output_opidxrupdated_ops_which_must_runs rE__exit__z%AutomaticControlDependencies.__exit__Ws  "  {{#//11  //3{{m<..01 3 44 $++}d;K.9.S.Sdkk+.3dkk++/DKK( *5)@)@)F& (*$%'"[[//1$2D2D2EFN<l-  ( ( ,un ; ; r" t$$ $r"   rww ' / "  GG522 2 << <r" F  +- +2;;&,( ) H 1!3!3}7M7M!M G # 4A   "XX 4c}}S)H1113$X. 4 4 !"Yo!5R 80 #}<#9#99==%  & H% 66;;( "   svv'957I K!xx99 - - !$X.DD))*   5h? @ ) ) X & 9 9" =  ,X 6 = =b A    B8 L M9; ,X 6-/  *;0>  _&&. ) )   6t < =')t$326k# :* 9 9   @ L M9; *: 69 9  ! !"@"L M79 ( 4 :  4% &&"*B*BB    ^,Yl-^ ""#56 T$001TJL=Q %'" 77 $ $ AX 0 6 6 8   1 1$2I2I J(9': $00( ((ADD,F,FF( $(    !;<'=*(FD$S   R 4( s8V-#!V=+W- V:9V:N) rJrKrL__doc__rarorvrrrrOrGrErYrYs*  *X P ==~HFrGrYacd_resource_resolversc0tj||S)aRegister a function for resolving resources touched by an op. `f` is called for every Operation added in the ACD context with the op's original resource reads and writes. `f` is expected to update the sets of resource reads and writes in-place and return True if it updated either of the sets, False otherwise. Example: @register_acd_resource_resolver def identity_resolver(op, resource_reads, resource_writes): # op: The `Operation` being processed by ACD currently. # resource_reads: An `ObjectIdentitySet` of read-only resources. # resource_writes: An `ObjectIdentitySet` of read-write resources. def update(resource_inputs): to_remove = [] to_add = [] for resource in resource_inputs: if resource.op.type == "Identity": to_remove.append(resource) to_add.extend(resource.op.inputs) for t in to_remove: resource_inputs.discard(t) resource_inputs.update(to_add) return to_add or to_remove return update(resource_reads) or update(resource_writes) Args: f: Python function with signature (Operation, ObjectIdentitySet, ObjectIdentitySet) -> bool Returns: The function `f` after adding it to the registry. ) _acd_resource_resolvers_registryregister)fs rEregister_acd_resource_resolverr%sD#++A. (rGc.~d}||xs||S)z;Replaces Identity output with its input in resource_inputs.cg}g}|D]R}|jjdk(s|j||j|jjT|D]}|j ||j ||xs|S)NIdentity)rCr>rsextendrdiscardr)r to_removeto_addrts rErz"_identity_resolver..updateOsI F#*   Z '" hkk(()*!a !6"  YrGrO)rCresource_readsresource_writesrs rE_identity_resolverrKs#     :6/#::rGc#XKtj|\}}d}|sTd}tjD]8}tj ||||}|r|j |}|xr| }:|sT|D]}|t jf|D]}|t jfyw)z6Returns an iterable of resources touched by this `op`.FTN) rUget_read_write_resource_inputsrrlookup differencerIrMrN)rCreadswrites saturatedkeyupdatedrs rErr^s66r:-%) I/446 , 177.wrappersn % '81$!&!f26,,v2FGQQ%%a(GkG  " "6; 788G88s A*A%A*%A**A3)rmake_decorator)rrs` rEautomatic_control_dependenciesrws8  $ $Q 00rG),rrenumtensorflow.core.frameworkrtensorflow.python.eagerrtensorflow.python.frameworkrrUrrrrr r r tensorflow.python.opsr r rrtensorflow.python.utilrrr frozensetr?r@rrArBrFEnumrIrWobjectrYRegistryrrrrrrOrGrErs> 4+H?67+05+232'2/   ,,\+4 5 +' *3 4 *&  499  4fF6fFR $58#4#45M#N # L ; ;$'21rG