1VhaTdZddlZddlmZddlmZdZdZdZdZ d Z d Z d Z d Z d ZdZdZd&dZdZdZdZdZdZd&dZdZd&dZdZdZdZdZdZdZdZ d Z!d!Z"d"Z#d#Z$Gd$d%ejJZ&y)'aAn implementation of DataProvider that serves tfdbg v2 data. This implementation is: 1. Based on reading data from a DebugEvent file set on the local filesystem. 2. Implements only the relevant methods for the debugger v2 plugin, including - list_runs() - read_blob_sequences() - read_blob() This class is a short-term hack. To be used in production, it awaits integration with a more complete implementation of DataProvider such as MultiplexerDataProvider. N)provider)debug_data_multiplexerz debugger-v2alertsexecution_digestsexecution_datagraphexec_digestsgraphexec_data graph_info graph_op_infosource_file_list source_file stack_framesc`dt||fz}||d|zz }tj|g|gS)aQCreate a RunTagFilter for Alerts. Args: run: tfdbg2 run name. begin: Beginning index of alerts. end: Ending index of alerts. alert_type: Optional alert type, used to restrict retrieval of alerts data to a single type of alerts. Returns: `RunTagFilter` for the run and range of Alerts. %s_%d_%dz_%srunstags)ALERTS_BLOB_TAG_PREFIXr RunTagFilter)runbeginend alert_typetags c/home/dcms/DCMS/lib/python3.12/site-packages/tensorboard/plugins/debugger_v2/debug_data_provider.pyalerts_run_tag_filterr2sB .s; ;C uz!!  se3% 88c|jdd\}}|ttd}|jdd}t|d}t|d}d}t|dkDr|d}||||fS)aParse the BLOB key for Alerts. Args: blob_key: The BLOB key to parse. By contract, it should have the format: - `${ALERTS_BLOB_TAG_PREFIX}_${begin}_${end}.${run_id}` when there is no alert type filter. - `${ALERTS_BLOB_TAG_PREFIX}_${begin}_${end}_${alert_filter}.${run_id}` when there is an alert type filter. Returns: - run ID - begin index - end index - alert_type: alert type string used to filter retrieved alert data. `None` if no filtering is used. .N_)splitlenrint)blob_keykey_bodyr key_itemsrrrs r_parse_alerts_blob_keyr*Es"NN3*MHc2356HsA&I  ! E il CJ 9~q\ sJ &&rcHtj|gdt||fzgS)aCreate a RunTagFilter for ExecutionDigests. This differs from `execution_data_run_tag_filter()` in that it is for the small-size digest objects for execution debug events, instead of the full-size data objects. Args: run: tfdbg2 run name. begin: Beginning index of ExecutionDigests. end: Ending index of ExecutionDigests. Returns: `RunTagFilter` for the run and range of ExecutionDigests. rr)rr!EXECUTION_DIGESTS_BLOB_TAG_PREFIXrrrs rexecution_digest_run_tag_filterr.as/  U=ucJJ K rc|jdd\}}|ttd}t|jdd}t|jdd}|||fS)aParse the BLOB key for ExecutionDigests. This differs from `_parse_execution_data_blob_key()` in that it is for the small-size digest objects for execution debug events, instead of the full-size data objects. Args: blob_key: The BLOB key to parse. By contract, it should have the format: `${EXECUTION_DIGESTS_BLOB_TAG_PREFIX}_${begin}_${end}.${run_id}` Returns: - run ID - begin index - end index rr Nr!r#)r$r%r,r&r'r(rrrs r _parse_execution_digest_blob_keyr1vsg"NN3*MHc=>@AH s#A& 'E hnnS!!$ %C s?rcHtj|gdt||fzgS)aCreate a RunTagFilter for Execution data objects. This differs from `execution_digest_run_tag_filter()` in that it is for the detailed data objects for execution, instead of the digests. Args: run: tfdbg2 run name. begin: Beginning index of Execution. end: Ending index of Execution. Returns: `RunTagFilter` for the run and range of ExecutionDigests. rr)rrEXECUTION_DATA_BLOB_TAG_PREFIXr-s rexecution_data_run_tag_filterr4s/  U:E3GG H rc|jdd\}}|ttd}t|jdd}t|jdd}|||fS)aParse the BLOB key for Execution data objects. This differs from `_parse_execution_digest_blob_key()` in that it is for the deatiled data objects for execution, instead of the digests. Args: blob_key: The BLOB key to parse. By contract, it should have the format: `${EXECUTION_DATA_BLOB_TAG_PREFIX}_${begin}_${end}.${run_id}` Returns: - run ID - begin index - end index rr Nr!r#)r$r%r3r&r0s r_parse_execution_data_blob_keyr6sgNN3*MHc:;=>H s#A& 'E hnnS!!$ %C s?rcb| tdtj|gdt||fzgS)aCreate a RunTagFilter for GraphExecutionTraceDigests. This differs from `graph_execution_data_run_tag_filter()` in that it is for the small-size digest objects for intra-graph execution debug events, instead of the full-size data objects. Args: run: tfdbg2 run name. begin: Beginning index of GraphExecutionTraceDigests. end: Ending index of GraphExecutionTraceDigests. Returns: `RunTagFilter` for the run and range of GraphExecutionTraceDigests. zTtrace_id support for graph_execution_digest_run_tag_filter() is not implemented yet.rr)NotImplementedErrorrr'GRAPH_EXECUTION_DIGESTS_BLOB_TAG_PREFIXrrrtrace_ids r%graph_execution_digest_run_tag_filterr<sK"! #    U A5#N N  rc|jdd\}}|ttd}t|jdd}t|jdd}|||fS)aParse the BLOB key for GraphExecutionTraceDigests. This differs from `_parse_graph_execution_data_blob_key()` in that it is for the small-size digest objects for intra-graph execution debug events, instead of the full-size data objects. Args: blob_key: The BLOB key to parse. By contract, it should have the format: `${GRAPH_EXECUTION_DIGESTS_BLOB_TAG_PREFIX}_${begin}_${end}.${run_id}` Returns: - run ID - begin index - end index rr Nr!r#)r$r%r9r&r0s r&_parse_graph_execution_digest_blob_keyr>sg"NN3*MHcCDFGH s#A& 'E hnnS!!$ %C s?rcb| tdtj|gdt||fzgS)aCreate a RunTagFilter for GraphExecutionTrace. This method differs from `graph_execution_digest_run_tag_filter()` in that it is for full-sized data objects for intra-graph execution events. Args: run: tfdbg2 run name. begin: Beginning index of GraphExecutionTrace. end: Ending index of GraphExecutionTrace. Returns: `RunTagFilter` for the run and range of GraphExecutionTrace. zRtrace_id support for graph_execution_data_run_tag_filter() is not implemented yet.rr)r8rr$GRAPH_EXECUTION_DATA_BLOB_TAG_PREFIXr:s r#graph_execution_data_run_tag_filterrAsI ! #    U@%MM N rc|jdd\}}|ttd}t|jdd}t|jdd}|||fS)aParse the BLOB key for GraphExecutionTrace. This method differs from `_parse_graph_execution_digest_blob_key()` in that it is for full-sized data objects for intra-graph execution events. Args: blob_key: The BLOB key to parse. By contract, it should have the format: `${GRAPH_EXECUTION_DATA_BLOB_TAG_PREFIX}_${begin}_${end}.${run_id}` Returns: - run ID - begin index - end index rr Nr!r#)r$r%r@r&r0s r$_parse_graph_execution_data_blob_keyrC sg NN3*MHc@ACDH s#A& 'E hnnS!!$ %C s?rcf|s tdtj|gtd|d|gS)awCreate a RunTagFilter for graph op info. Args: run: tfdbg2 run name. graph_id: Debugger-generated ID of the graph. This is assumed to be the ID of the graph that immediately encloses the op in question. op_name: Name of the op in question. (e.g., "Dense_1/MatMul") Returns: `RunTagFilter` for the run and range of graph op info. #graph_id must not be None or empty.r!r) ValueErrorrrGRAPH_OP_INFO_BLOB_TAG_PREFIX)rgraph_idop_names rgraph_op_info_run_tag_filterrJ s8 >??  U98WM N rc|jd}||dzd}|d|}|ttd}|jdd\}}}|||fS)aParse the BLOB key for graph op info. Args: blob_key: The BLOB key to parse. By contract, it should have the format: `${GRAPH_OP_INFO_BLOB_TAG_PREFIX}_${graph_id}_${op_name}.${run_name}`, wherein - `graph_id` is a UUID - op_name conforms to the TensorFlow spec: `^[A-Za-z0-9.][A-Za-z0-9_.\/>-]*$` - `run_name` is assumed to contain no dots (`'.'`s). Returns: - run name - graph_id - op name rr Nr!r#)rindexr%rGr$)r'last_dot_indexrr(r!rHrIs r_parse_graph_op_info_blob_keyrN4sg&__S)N >A%' (C(H9:<=H#>>#q1Ax ' !!rc`|s tdtj|gtd|gS)zCreate a RunTagFilter for graph info. Args: run: tfdbg2 run name. graph_id: Debugger-generated ID of the graph in question. Returns: `RunTagFilter` for the run and range of graph info. rEr!r)rFrrGRAPH_INFO_BLOB_TAG_PREFIX)rrHs rgraph_info_run_tag_filterrQOs6 >??  U3X> ? rc\|jd\}}|ttdzd}||fS)zParse the BLOB key for graph info. Args: blob_key: The BLOB key to parse. By contract, it should have the format: `${GRAPH_INFO_BLOB_TAG_PREFIX}_${graph_id}.${run_name}`, Returns: - run name - graph_id rr N)r$r%rP)r'r(rrHs r_parse_graph_info_blob_keyrSas8NN3'MHc67!;=>H =rc<tj|gtgS)zCreate a RunTagFilter for listing source files. Args: run: tfdbg2 run name. Returns: `RunTagFilter` for listing the source files in the tfdbg2 run. r)rrSOURCE_FILE_LIST_BLOB_TAG)rs rsource_file_list_run_tag_filterrVqs  se3L2M NNrc0||jddzdS)zParse the BLOB key for source file list. Args: blob_key: The BLOB key to parse. By contract, it should have the format: `${SOURCE_FILE_LIST_BLOB_TAG}.${run_id}` Returns: - run ID rr N)indexr's r _parse_source_file_list_blob_keyrZ}s  HNN3'!+- ..rcFtj|gdt|fzgS)aCreate a RunTagFilter for listing source files. Args: run: tfdbg2 run name. index: The index for the source file of which the content is to be accessed. Returns: `RunTagFilter` for accessing the content of the source file. z%s_%dr)rrSOURCE_FILE_BLOB_TAG_PREFIX)rrXs rsource_file_run_tag_filterr]s-  U4e<< = rcp|jdd\}}t|ttdzd}||fS)aParse the BLOB key for accessing the content of a source file. Args: blob_key: The BLOB key to parse. By contract, it should have the format: `${SOURCE_FILE_BLOB_TAG_PREFIX}_${index}.${run_id}` Returns: - run ID, as a str. - File index, as an int. rr N)r$r&r%r\)r'r(rrXs r_parse_source_file_blob_keyr_s?NN3*MHc 89A=?@ AE :rcftj|gtdzdj|zgS)zCreate a RunTagFilter for querying stack frames. Args: run: tfdbg2 run name. stack_frame_ids: The stack_frame_ids being requested. Returns: `RunTagFilter` for accessing the content of the source file. r!r)rrSTACK_FRAMES_BLOB_TAG_PREFIXjoin)rstack_frame_idss rstack_frames_run_tag_filterrds7  U+S0388O3LL M  rc|jdd\}}|ttdzd}|jd}||fS)aBParse the BLOB key for source file list. Args: blob_key: The BLOB key to parse. By contract, it should have the format: `${STACK_FRAMES_BLOB_TAG_PREFIX}_` + `${stack_frame_id_0}_..._${stack_frame_id_N}.${run_id}` Returns: - run ID - The stack frame IDs as a tuple of strings. rr Nr!)r$r%ra)r'r(rrcs r_parse_stack_frames_blob_keyrfsINN3*MHc89A=?@HnnS)O  rceZdZdZfdZddZdZ ddddZ ddddd Z dddd Z dddd Z ddddd Z dd Z xZ S)LocalDebuggerV2DataProviderzA DataProvider implementation for tfdbg v2 data on local filesystem. In this implementation, `experiment_id` is assumed to be the path to the logdir that contains the DebugEvent file set. cVt|tj||_y)zConstructor of LocalDebuggerV2DataProvider. Args: logdir: Path to the directory from which the tfdbg v2 data will be loaded. N)super__init__rDebuggerV2EventMultiplexer _multiplexer)selflogdir __class__s rrkz$LocalDebuggerV2DataProvider.__init__s& 2MM  rNc |jjDcgc])}tj|||j |+c}Scc}w)zList runs available. Args: experiment_id: currently unused, because the backing DebuggerV2EventMultiplexer does not accommodate multiple experiments. Returns: Run names as a list of str. )run_idrun_name start_time)rmRunsrRun_get_first_event_timestamp)rnctx experiment_idrs r list_runsz%LocalDebuggerV2DataProvider.list_runssR ((--/   LL::3?    s.Acf |jj|S#t$r }Yd}~yd}~wwxYwN)rmFirstEventTimestamprF)rnrses rrwz6LocalDebuggerV2DataProvider._get_first_event_timestamps1 $$88B B  s  00)run_tag_filterc~~~tdNz1Debugger V2 DataProvider doesn't support scalars. TypeErrorrnrxry plugin_namers r list_scalarsz(LocalDebuggerV2DataProvider.list_scalarss ;KLLr) downsamplerc ~~~~tdrr)rnrxryrrrs r read_scalarsz(LocalDebuggerV2DataProvider.read_scalarss ; NKLLrc~~~tdrrrs rread_last_scalarsz-LocalDebuggerV2DataProvider.read_last_scalars s ;KLLrc~~~tr|)r8rs rlist_blob_sequencesz/LocalDebuggerV2DataProvider.list_blob_sequencess ;!##rc ~~|tk7rtd|z|j td|j tdt }|j j }|jD]}||vrt ||<|jD]l} | jttttttttt f s | t"fvsKt%j&| d|g||| <n|S)NzUnsupported plugin_name: %sz>.96?<2534  688 ..38LM(F3K$   * rc|jtrBt|\}}}}tj|j j ||||S|jtr?t|\}}}tj|j j|||S|jtr?t|\}}}tj|j j|||S|jtr?t|\}}}tj|j j|||S|jt r?t#|\}}}tj|j j%|||S|jt&r=t)|\}}tj|j j+||S|jt,r?t/|\}}}tj|j j1|||S|jt2r9t5|}tj|j j7|S|jt8r=t;|\}} tj|j j=|| S|jt>r=tA|\}} tj|j jC|| StEd|z)N)alert_type_filterzUnrecognized blob_key: %s)#rrr*jsondumpsrmAlertsr,r1ExecutionDigestsr3r6 ExecutionDatar9r>GraphExecutionDigestsr@rCGraphExecutionDatarPrS GraphInforGrN GraphOpInforUrZSourceFileListr\r_ SourceLinesrarf StackFramesrF) rnrxr'rrrrrHrIrXrcs r read_blobz%LocalDebuggerV2DataProvider.read_blobMs   5 6*@*J 'CZ::!!((z)   !B C>xHOC::!!223sC  !? @ ?%B8%L "C7::!!--c8WE  !: ;28>sCD D  !< =4X>JC::d//;;CGH H  != >#?#I C::!!--c?C 88CD Drr|)__name__ __module__ __qualname____doc__rkrzrwrrrrrr __classcell__)rps@rrhrhs   &MFJM  M  M  M  M$FJ$ , ,\.Errhr|)'rrtensorboard.datartensorboard.plugins.debugger_v2rrrr,r3r9r@rPrGrUr\rarr*r.r1r4r6r<r>rArCrJrNrQrSrVrZr]r_rdrf DataProviderrhrrrs  %B !$7!!1*=''7$) /.+-9&'8*0(,<06.("6$  O /"  $ $lE("7"7lEr