1VhGaNdZddlZddlmZdZdZdZdZdZd Z Gd d Z y) zCA wrapper around DebugDataReader used for retrieving tfdbg v2 data.N)errors__default_debugger_run__ictjfd}tj|d}|j|fS)aRun a target task repeatedly in the background. In the context of this module, `target` is the `update()` method of the underlying reader for tfdbg2-format data. This method is mocked by unit tests for deterministic behaviors during testing. Args: target: The target task to run in the background, a callable with no args. interval_sec: Time interval between repeats, in seconds. Returns: - A `threading.Event` object that can be used to interrupt an ongoing waiting interval between successive runs of `target`. To interrupt the interval, call the `set()` method of the object. - The `threading.Thread` object on which `target` is run repeatedly. cX jj)N)waitclear)event interval_sectargetsf/home/dcms/DCMS/lib/python3.12/site-packages/tensorboard/plugins/debugger_v2/debug_data_multiplexer.py_run_repeatedlyz5run_repeatedly_in_background.._run_repeatedly<s% H JJ| $ KKMT)r daemon) threadingEventThreadstart)r r rthreadr s`` @rrun_repeatedly_in_backgroundr(s=$ OO E  _T BF LLN &=rc  ddlm}t||jr\d|j|j |j |j|j|j|j|jd Stdt|z)Nrdebug_events_monitors InfNanAlert) alert_typeop_type output_slotsize num_neg_inf num_pos_infnum_nanexecution_indexgraph_execution_trace_indexzUnrecognized alert subtype: %s)tensorflow.python.debug.libr isinstancerrrrr r!r"r#r$ TypeErrortype)alertrs r_alert_to_jsonr*HsB%.::;'}} ,,JJ ,, ,,}}$44+0+L+L  84;FGGrc`d}d|vr#|jd\}}t|}||fS|}||fS)z@Helper function that extracts op name and slot from tensor name.r:)splitint) tensor_namerop_names rparse_tensor_namer1_sMK k*005+&  K  K rceZdZdZdZdZdZdZdZdZ dZ dd Z d Z d Z dd ZddZdZdZdZdZdZdZdZy )DebuggerV2EventMultiplexeraA class used for accessing tfdbg v2 DebugEvent data on local filesystem. This class is a short-term hack, mirroring the EventMultiplexer for the main TensorBoard plugins (e.g., scalar, histogram and graphs.) As such, it only implements the methods relevant to the Debugger V2 pluggin. TODO(cais): Integrate it with EventMultiplexer and use the integrated class from MultiplexerDataProvider for a single path of accessing debugger and non-debugger data. c||_d|_tj|_d|_|j y)zConstructor for the `DebugEventMultiplexer`. Args: logdir: Path to the directory to load the tfdbg v2 data from. N)_logdir_readerrLock _reader_lock_reload_needed_event_tryCreateReader)selflogdirs r__init__z#DebuggerV2EventMultiplexer.__init__vs7   %NN,$(! rc|jry|j5|js ddlm}ddlm} |j |j|_|j|jtg|_ t|jjt\|_}dddy#t $r YdddywxYw#t$r Ydddyt$r YdddywxYw#1swYyxYw)a*Try creating reader for tfdbg2 data in the logdir. If the reader has already been created, a new one will not be created and this function is a no-op. If a reader has not been created, create it and start periodic calls to `update()` on a separate thread. Nr)debug_events_readerr)limit)r6r8r%r?r ImportErrorDebugDataReaderr5AttributeError ValueError InfNanMonitorDEFAULT_PER_TYPE_ALERT_LIMIT _monitorsrupdateDEFAULT_RELOAD_INTERVAL_SECr9)r;r?r_s rr:z+DebuggerV2EventMultiplexer._tryCreateReaders  <<    % << P #6#F#F $DL*77 ,H8" 0LLL'')D0,)1G% % #% % & 1% % 2"9% % 23% % sX C1 B1 CAC11 C:C1CC1 C.C1C.#C1-C..C11C:cR|jr|jjyy)a(If a reader exists and has started period updating, unblock the update. The updates are performed periodically with a sleep interval between successive calls to the reader's update() method. Calling this method interrupts the sleep immediately if one is ongoing. N)r9setr;s r _reloadReaderz(DebuggerV2EventMultiplexer._reloadReaders$  $ $  % % ) ) + %rc|j td|tk7rtdtd||jjS)aWReturn the timestamp of the first DebugEvent of the given run. This may perform I/O if no events have been loaded yet for the run. Args: run: A string name of the run for which the timestamp is retrieved. This currently must be hardcoded as `DEFAULT_DEBUGGER_RUN_NAME`, as each logdir contains at most one DebugEvent file set (i.e., a run of a tfdbg2-instrumented TensorFlow program.) Returns: The wall_time of the first event of the run, which will be in seconds since the epoch as a `float`. zNo tfdbg2 runs exists.zExpected run name to be z , but got )r6rDDEFAULT_DEBUGGER_RUN_NAMEstarting_wall_time)r;runs rFirstEventTimestampz.DebuggerV2EventMultiplexer.FirstEventTimestampsO << 56 6 + +,c3 ||..00rctd)NzLDebugDataMultiplexer.PluginRunToTagToContent() has not been implemented yet.)NotImplementedError)r; plugin_names rPluginRunToTagToContentz2DebuggerV2EventMultiplexer.PluginRunToTagToContents!   rcr|j|jr|jtdgiiSiS)aReturn all the tfdbg2 run names in the logdir watched by this instance. The `Run()` method of this class is specialized for the tfdbg2-format DebugEvent files. As a side effect, this method unblocks the underlying reader's period reloading if a reader exists. This lets the reader update at a higher frequency than the default one with 30-second sleeping period between reloading when data is being queried actively from this instance. Note that this `Runs()` method is used by all other public data-access methods of this class (e.g., `ExecutionData()`, `GraphExecutionData()`). Hence calls to those methods will lead to accelerated data reloading of the reader. Returns: If tfdbg2-format data exists in the `logdir` of this object, returns: ``` {runName: { "debugger-v2": [tag1, tag2, tag3] } } ``` where `runName` is the hard-coded string `DEFAULT_DEBUGGER_RUN_NAME` string. This is related to the fact that tfdbg2 currently contains at most one DebugEvent file set per directory. If no tfdbg2-format data exists in the `logdir`, an empty `dict`. z debugger-v2)r:r6rNrPrMs rRunszDebuggerV2EventMultiplexer.RunssE8  <<    )"2, Irc|dkrtjd|z||kDrtjd||fz|dk\r||krtjd||fz|dkr|}|S)NrzInvalid begin index (%d)z!end index (%d) out of bounds (%d)z9end index (%d) is unexpectedly less than begin index (%d))rInvalidArgumentError)r;beginend total_counts r_checkBeginEndIndicesz0DebuggerV2EventMultiplexer._checkBeginEndIndices s 19--*U2   --3sK6HH  !8e --K,  7C rNc ddlm}|j}||vryg}t}t} |jD]T} | j } | s|j | t| |jrd} nd} t| || <| | | <Vt|} |!||vrtjd|z| |}|j||t|}|||| |t|||Dcgc] }t|c}dScc}w)aGet alerts from the debugged TensorFlow program. Args: run: The tfdbg2 run to get Alerts from. begin: Beginning alert index. end: Ending alert index. alert_type_filter: Optional filter string for alert type, used to restrict retrieved alerts data to a single type. If used, `begin` and `end` refer to the beginning and ending indices within the filtered alert type. rrNr__MiscellaneousAlert__z8Filtering of alerts failed: alert type %s does not exist)r\r]r num_alertsalerts_breakdownper_type_alert_limitalerts)r%rrYdictrGreextendr&rElenrr[r_rFr*)r;rRr\r]alert_type_filterrrunsrercalerts_by_typemonitormonitor_alertsrrbr)s rAlertsz!DebuggerV2EventMultiplexer.Alertss2 Fyy{ d?6~~ 8G$^^-N! MM. )'#8#F#FG* 5 +.~+> Z ()7N: & 8[  ( (8811N'($$56F((S[A+$ 0$@:@s:KL~e,L  Ms0Dc|j}||vry|jjd}|j||t |}||t ||||Dcgc]}|j c}dScc}w)a>Get ExecutionDigests. Args: run: The tfdbg2 run to get `ExecutionDigest`s from. begin: Beginning execution index. end: Ending execution index. Returns: A JSON-serializable object containing the `ExecutionDigest`s and related meta-information NTdigest)r\r] num_digestsexecution_digestsrYr6 executionsr_rhto_json)r;rRr\r]rjrsrqs rExecutionDigestsz+DebuggerV2EventMultiplexer.ExecutionDigestsQsyy{ d?!LL3343@((S9J5KL01/@s/K"%+ "   "s!A= c0|j}||vry|jjd}|j||t |}|||}|jjd||}|||Dcgc]}|j c}dScc}w)a`Get Execution data objects (Detailed, non-digest form). Args: run: The tfdbg2 run to get `ExecutionDigest`s from. begin: Beginning execution index. end: Ending execution index. Returns: A JSON-serializable object containing the `ExecutionDigest`s and related meta-information NTrpFrqr\r])r\r]rurt)r;rRr\r]rjrsru executions r ExecutionDataz(DebuggerV2EventMultiplexer.ExecutionDatamsyy{ d? LL3343@((S9J5KL-eC8\\,,EC,P @JK99,,.K  Ls7Bc|j}||vry| td|jjd}|j ||t |}||t ||||Dcgc]}|j c}dScc}w)a`Get `GraphExecutionTraceDigest`s. Args: run: The tfdbg2 run to get `GraphExecutionTraceDigest`s from. begin: Beginning graph-execution index. end: Ending graph-execution index. Returns: A JSON-serializable object containing the `ExecutionDigest`s and related meta-information NzFtrace_id support for GraphExecutionTraceDigest is not implemented yet.Trp)r\r]rrgraph_execution_digestsrYrUr6graph_execution_tracesr_rhrv)r;rRr\r]trace_idrjgraph_exec_digestsrqs rGraphExecutionDigestsz0DebuggerV2EventMultiplexer.GraphExecutionDigestssyy{ d?  %' "\\@@@M((S9K5LM12/A%/L(%+ (   (s.B c@|j}||vry| td|jjd}|j ||t |}|jjd||}|||Dcgc]}|j c}dScc}w)aTGet `GraphExecutionTrace`s. Args: run: The tfdbg2 run to get `GraphExecutionTrace`s from. begin: Beginning graph-execution index. end: Ending graph-execution index. Returns: A JSON-serializable object containing the `ExecutionDigest`s and related meta-information NzDtrace_id support for GraphExecutionTraceData is not implemented yet.TrpFry)r\r]graph_executionsr~) r;rRr\r]rrjdigestsr graph_execs rGraphExecutionDataz-DebuggerV2EventMultiplexer.GraphExecutionDatasyy{ d?  %' ,,55T5B((S\B<<>>3? 7G!)3 ""$!  !s?Bc|j}||vry |jj|}|j S#t$rt j d|zwxYw)aGet the information regarding a TensorFlow graph. Args: run: Name of the run. graph_id: Debugger-generated ID of the graph in question. This information is available in the return values of `GraphOpInfo`, `GraphExecution`, etc. Returns: A JSON-serializable object containing the information regarding the TensorFlow graph. Raises: NotFoundError if the graph_id is not known to the debugger. NThere is no graph with ID "%s")rYr6 graph_by_idKeyErrorr NotFoundErrorrv)r;rRgraph_idrjgraphs r GraphInfoz$DebuggerV2EventMultiplexer.GraphInfosl yy{ d? LL,,X6E }}  &&08;  s A"A$cz|j}||vry |jj|} |j |}|j||}|dD]/} |j |d} | s|j| ||d<1|d D]6} | D]/} |j | d} | s|j| || d<18|S#t$rt j d|zwxYw#t$rt j d|d|dwxYw#t$rd} YwxYw#t$rd} YwxYw) abGet the information regarding a graph op's creation. Args: run: Name of the run. graph_id: Debugger-generated ID of the graph that contains the op in question. This ID is available from other methods of this class, e.g., the return value of `GraphExecutionDigests()`. op_name: Name of the op. Returns: A JSON-serializable object containing the information regarding the op's creation and its immediate inputs and consumers. Raises: NotFoundError if the graph_id or op_name does not exist. NrzThere is no op named "z" in graph with ID ""inputsr0data consumers)rYr6rrrrget_op_creation_digest_opCreationDigestToDataObject) r;rRrr0rjrop_creation_digest data_object input_specinput_op_digestslot_consumer_specs consumer_specrqs r GraphOpInfoz&DebuggerV2EventMultiplexer.GraphOpInfos"yy{ d? LL,,X6E  !&!=!=g!F  88  &h/ J '"'">">y)# %)%G%G#U& 6" $/{#;  !4  ""99%i0F ,0,N,N-M&)  O &&08;    &&H&   '"& ' "!F"s:C C2DD, "C/2&D D)(D), D:9D:c|y|j}|d=|j|j|d<|j|d<|d=g|d<|jxsgD]'}t |\}}|dj ||d)g|d<t|dD]}|dj g|j|dD] \}} } |d|j | | d "|S) Nr graph_ids num_outputs input_namesr)r0rrr0)r0 input_slot) rv_getGraphStackIdsrrrr1appendrangeget_op_consumers) r;rr json_objectinput_tensor_name input_op_namerrJsrc_slotconsumer_op_namedst_slots rrz8DebuggerV2EventMultiplexer._opCreationDigestToDataObject$s5  %(002  ##'#9#9  ' '$ K &8%C%C M"  & " H!3!?!?!E2  ):;L)M &M;  ! ( ()+F   $& K {=12 0A  $ + +B / 0494J4J  "5   0H&  $X . 5 5,HE   rc|g}|jj|}|jrN|jd|j|jj|j}|jrN|S)aLRetrieve the IDs of all outer graphs of a graph. Args: graph_id: Id of the graph being queried with respect to its outer graphs context. Returns: A list of graph_ids, ordered from outermost to innermost, including the input `graph_id` argument as the last item. r)r6router_graph_idinsert)r;rrrs rrz,DebuggerV2EventMultiplexer._getGraphStackIdsAskJ  ((2""   Q 4 4 5LL,,U-A-ABE""rc`|j}||vry|jjSr)rYr6source_file_list)r;rRrjs rSourceFileListz)DebuggerV2EventMultiplexer.SourceFileListSs*yy{ d?||,,..rc|j}||vry |jj|\}}|||jj ||dS#t$rt j d|zwxYw)Nz(There is no source-code file at index %d) host_name file_pathlines)rYr6r IndexErrorrr source_lines)r;rRindexrjrrs r SourceLinesz&DebuggerV2EventMultiplexer.SourceLinesYsyy{ d? #'<<#@#@#B5#I Iy #"\\..y)D   &&:UB  s A"A9c|j}||vryg}|D]Z}||jjvrtjd|z|j |jj|\d|iS)Nz"Cannot find stack frame with ID %s stack_frames)rYr6_stack_frame_by_idrrr)r;rRstack_frame_idsrjrstack_frame_ids r StackFramesz&DebuggerV2EventMultiplexer.StackFramesisyy{ d? - QNT\\%D%DD**8>I    ? ? O P Q --rr)__name__ __module__ __qualname____doc__r=r:rNrSrWrYr_rnrwr{rrrrrrrrrrrr3r3jsl   0d,10 )V$3 j 8 2 B! F6=~:$/  .rr3) rr tensorboardrrPrFrIrr*r1r3rrrrsHJ7 $!@H. N.N.r