BVhusdZddlZddlZddlZddlZddlmZddlmZddlm Z ddlm Z ddl m Z ddl m Z e jZd Zd Zd Zd Zd ZdZdZdZdZGddeZ ddZdZGddeZ ddZy)z+Formats and displays profiling information.N) cli_shared)command_parser)debugger_cli_common) ui_factory) profiling) source_utilsnodeop_typeop_time exec_time start_timelinedevice_name_filternode_name_filterop_type_filtercTeZdZdZej fdZ d dZdZdZ dZ dZ y) ProfileDataTableViewzTable View of profiling data.c||_|Dcgc]}|jc}|_|Dcgc]#}tj|j |%c}|_|Dcgc]-}tj|jj|/c}|_ dddd|zd|zdg|_ tttttt g|_ycc}wcc}wcc}w) zConstructor. Args: profile_datum_list: List of `ProfileDatum` objects. time_unit: must be in cli_shared.TIME_UNITS. force_time_unitNodezOp TypezStart Time (us)z Op Time (%s)zExec Time (%s)zFilename:Lineno(function)N)_profile_datum_listr formatted_start_timertime_to_readable_strr formatted_op_timenode_exec_statsall_end_rel_microsformatted_exec_time _column_namesSORT_OPS_BY_OP_NAMESORT_OPS_BY_OP_TYPESORT_OPS_BY_START_TIMESORT_OPS_BY_OP_TIMESORT_OPS_BY_EXEC_TIMESORT_OPS_BY_LINE_column_sort_ids)selfprofile_datum_list time_unitdatums `/home/dcms/DCMS/lib/python3.12/site-packages/tensorflow/python/debug/cli/profile_analyzer_cli.py__init__zProfileDataTableView.__init__/s 2D&8!:"!:D ()  '' 8A C)D(  )  ''  ! ! 4 4% ' )D !#+(94*Y65 7D 12E35H24DFD%!:) )sC(C2CNcd}|dk(r%|j|jj}n*|dk(r|j|j}n |dk(rt |j |}n|dk(rt |j |}n|dk(rt |j|}n|dk(rd}|r|d td |z }|r|d td |z }|r|d td |z }|d |j|j|j|jfzz }tjd|}|j|j}nt!d |zt#|| S)aGet the content of a cell of the table. Args: row: (int) row index. col: (int) column index. device_name_filter: Regular expression to filter by device name. node_name_filter: Regular expression to filter by node name. op_type_filter: Regular expression to filter by op type. Returns: A debuggre_cli_common.RichLine object representing the content of the cell, potentially with a clickable MenuItem. Raises: IndexError: if row index is out of range. Nrps -- z %s --init_line %dzInvalid column index %d. font_attr)rr node_namer strrrr_DEVICE_NAME_FILTER_FLAG_NODE_NAME_FILTER_FLAG_OP_TYPE_FILTER_FLAG file_path line_numberrMenuItemfile_line_func IndexErrorRL) r'rowcolrrr menu_itemtextcommands r+valuezProfileDataTableView.valueMso,I ax  % %c * : : D Dd   % %c * 2 2d  **3/ 0d  '', -d  ))#. /d g !9!35 5 !79IJJ !5~FF %  " "3 ' 1 1  " "3 ' 3 3)555g&..tW=i  % %c * 9 9d 1C7 88 di ((c,t|jSN)lenrr's r+ row_countzProfileDataTableView.row_counts t'' ((rIc,t|jSrK)rLrrMs r+ column_countz!ProfileDataTableView.column_counts t!! ""rIc|jSrK)rrMs r+ column_namesz!ProfileDataTableView.column_namess   rIc |j|SrK)r&)r'rDs r+column_sort_idz#ProfileDataTableView.column_sort_ids   %%rI)NNN) __name__ __module__ __qualname____doc__r TIME_UNIT_USr,rHrNrPrRrTrIr+rr,s:%3=3J3JFB $! 2)h)#&rIrc |r&|j|jjsy|r(|jr|j|jsy|dkDr|jr|j|kry|dkDr|jr|j|k\ry|j |r|j|j sy||j |jsy|r&|j |jjsyy)aFilter function for list_profile command. Args: profile_datum: A `ProfileDatum` object. node_name_regex: Regular expression pattern object to filter by name. file_path_regex: Regular expression pattern object to filter by file path. op_type_regex: Regular expression pattern object to filter by op type. op_time_interval: `Interval` for filtering op time. exec_time_interval: `Interval` for filtering exec time. min_lineno: Lower bound for 1-based line number, inclusive. If <= 0, has no effect. max_lineno: Upper bound for 1-based line number, exclusive. If <= 0, has no effect. # TODO(cais): Maybe filter by function name. Returns: True iff profile_datum should be included. FrT) matchrr8r=r>r containsr r) profile_datumnode_name_regexfile_path_regex op_type_regexop_time_intervalexec_time_interval min_lineno max_linenos r+_list_profile_filterrfs6_22##--/   # #  ! !-"9"9 : 1n22*, 1n22:- 'M   m33 4 !*:*C*C+  2 ; ;##66!8  rIc(|tk(r|jjS|tk(r |jS|t k(r |j S|tk(r |jS|tk(r|jjS|jjS)aGet a profile_datum property to sort by in list_profile command. Args: profile_datum: A `ProfileDatum` object. sort_by: (string) indicates a value to sort by. Must be one of SORT_BY* constants. Returns: profile_datum property to sort by. ) r rr8r!r r%r@r#r r$rall_start_micros)r^sort_bys r+_list_profile_sort_keyrjs ##  ( ( 2 22%%   ""  ' ''%%   ''  ( ( ; ;;  ( ( 9 99rIceZdZdZdZddZdZ ddZdZe jZ e jZ dZd Zd Zd Zdd Zd ZdZdZy)ProfileAnalyzerzAnalyzer for profiling data.c|||_|s td||_i|_t j dtj }|jddtzttdd|jd dtzttdd |jd dtzttdd |jd ddtdd|jddtdd|jddtdd|jdddtdd|jdddtdd|jd d!d"ttd#d$jtt tt"t$t&gz|jd%d&d'd(d)*|jd+d,tt(j*d-d$jt(j,zd.z||jd/<t j d0tj }|jd1td23|jd4td5dgd5d67|jd+d,tt(j*d-d$jt(j,zd.z|jddtzttdd8|jd dtzttdd9|jd dtzttdd:|jd;d||jd?<y@)AzProfileAnalyzer constructor. Args: graph: (tf.Graph) Python graph object. run_metadata: A `RunMetadata` protobuf object. Raises: ValueError: If run_metadata is None. z+No RunMetadata passed for profile analysis.zList nodes profile information.) descriptionusagez-dz--%szfilter device name by regex.)desttypedefaulthelpz-nzfilter node name by regex.z-tzfilter op type by regex.z-fz--file_path_filterfile_path_filterzlfilter by file name at the top position of node's creation stack that does not belong to TensorFlow library.z --min_linenordzW(Inclusive) lower bound for 1-based line number in source file. If <= 0, has no effect.z --max_linenorezW(Exclusive) upper bound for 1-based line number in source file. If <= 0, has no effect.z-ez--execution_timeexecution_timezFilter by execution time interval (includes compute plus pre- and post -processing time). Supported units are s, ms and us (default). E.g. -e >100s, -e <100, -e [100us,1000ms]z-oz --op_timer zFilter by op time interval (only includes compute time). Supported units are s, ms and us (default). E.g. -e >100s, -e <100, -e [100us,1000ms]z-sz --sort_byriz#the field to sort the data by: (%s)z | z-rz --reversereverse store_truez+sort the data in reverse (descending) order)rqactionrtz --time_unitr)z Time unit () list_profilez>Print a Python source file with line-level profile informationsource_file_pathzPath to the source_file_path)rrrtz --cost_typer zType of cost to display)rrchoicesrsrtzFilter device name by regex.zFilter node name by regex.zFilter op type by regex.z --init_line init_linerz/The 1-based line number to scroll to initially. print_sourceN)_graph ValueError _run_metadata _arg_parsersargparseArgumentParserSUPPRESS add_argumentr:r9r;r<intr"joinr r!r#r$r%rrY TIME_UNITS)r'graph run_metadataaps r+r,zProfileAnalyzer.__init__sDK  D EE%DD  5 !BOO )) %  + -OO '' #  ) +OO %% !  ' )OO   A BOO  ' (OO  ' (OO   9  :OO   9 :OO   &3jj-/B02E/1ACDD  FOO   : < OO  '' UZZ (=(=> > D F)+Dn%  " !BOO  +-OO i( & ( OO  '' UZZ (=(=> > D F OO )) %  + -OO '' #  ) +OO %% !  ' )OO   > @)+Dn%rINcXd}|r d|vr|d}|jdj|jrtjjnd}j rtjj nd}j rtjj nd}jrtjjnd}jrtjjnd}tjdg} jrtjjnd} |j} t|j j"j$} t'| D] } |j j"j$| }| r| j)|j*sE| |Dcgc]+}t-||||||j.j0r|-}}t3|fdj4}| j7|j9|j*| | |j:j4j<jj j| | Scc}w) aVCommand handler for list_profile. List per-operation profile information. Args: args: Command-line arguments, excluding the command prefix, as a list of str. screen_info: Optional dict input containing screen information such as cols. Returns: Output text lines as a RichTextLines object. Pcolsr|Nrp)rdrec0t|jSrK)rjri)r*parseds r+z.ProfileAnalyzer.list_profile..s4UFNNKrI)keyrx)rrr screen_cols)r parse_argsr rparse_time_intervalrwrrecompilerurr RichTextLinesr_get_profile_data_generatorrLr step_stats dev_statsranger\devicerfrdresortedrxextend_get_list_profile_linesrir))r'args screen_inforrbrcr_r`raoutputdevice_name_regexdata_generator device_countindex device_statsr* profile_datars @r+r|zProfileAnalyzer.list_profilezs{Kv,'k   ~ . 9 9$ ?F!>>'::6>>J/3   **6+@+@A&*!11zz&"9"9:7;!11zz&"9"9:7;--ZZ 5 5637! . .t 4F"55F$=$=>;?557Nt))44>>?L|$*''22<N>N#)#<#.profile_data_generators)44 ;*   9 , 0D0D0O $$  $ $   ! !*"6"6 ;  # #J$8$8! <  ! !*"6"6 ;    4 4b 9 ; ; ;sCC)rget_operationsreversed tracebackrguess_is_tensorflow_py_librarynamerr) r'op trace_entryr=line_num func_namerrrrrs @@@@r+rz+ProfileAnalyzer._get_profile_data_generators Okk((* )!",,/+N q>N ::9E   $- %-"''"#, !#obgg ) ; "!rIc t||} td|D} td|D}ddtj| |tj||g}| j Dcgc] }t |}}t t |D] }t||t ||||<"t t |D]\}t | jD]1}t||t | j|||| | ||<3||xxdz cc<^td | zg}d |d z||fz}|jt||jtd }t}t | jD]}| j |}| j|}|d |}||k(r|s|dz }tjd|}|t||dgz }|td||t |z zz }|j|t | jD]v}t}t | jD]=}| j|||| | }||z }|td||t |z zz }?|j|xd}t!||D]\}}|d|zj#|z }|jt|jt|tj$|Scc}w)a6Get `RichTextLines` object for list_profile command for a given device. Args: device_name: (string) Device name. device_index: (int) Device index. device_count: (int) Number of devices. profile_datum_list: List of `ProfileDatum` objects. sort_by: (string) Identifier of column to sort. Sort identifier must match value of SORT_OPS_BY_OP_NAME, SORT_OPS_BY_OP_TYPE, SORT_OPS_BY_EXEC_TIME, SORT_OPS_BY_MEMORY or SORT_OPS_BY_LINE. sort_reverse: (bool) Whether to sort in descending instead of default (ascending) order. time_unit: time unit, must be in cli_shared.TIME_UNITS. device_name_filter: Regular expression to filter by device name. node_name_filter: Regular expression to filter by node name. op_type_filter: Regular expression to filter by op type. screen_cols: (int) Number of columns available on the screen (i.e., available screen width). Returns: `RichTextLines` object containing a table that displays profiling information for each op. )r)c34K|]}|jywrK)r .0r*s r+ z:ProfileAnalyzer._get_list_profile_lines..sF% Fsc3HK|]}|jjywrK)rrrs r+rz:ProfileAnalyzer._get_list_profile_lines..s$;# //BB;s "z Device Totalrpr)rrrr/-zDevice %d of %d: %sr.r|z -s z -rNboldr6r5z{:<%d})rsumrrrRrLrmaxrNrHrBappendrPrTrr?zipformat#rich_text_lines_from_rich_line_list)r' device_name device_indexrr(ri sort_reverser)rrrrr total_op_timetotal_exec_timedevice_total_row column_name column_widthsrDrCr device_row base_commandsort_idrGhead_menu_itemnew_rownew_cellrow_strwidths r+rz'ProfileAnalyzer._get_list_profile_liness8((:iPLF3EFFM;'9;;O '' 8A C''8A C D-9,E,E,GI(KIMIS)*+O}S137G7L3MNmCOS'( |--/01# # L$6$6#5!1- %7%/!01 c1CA {"# $F&q, *55J MM"Z.! MM"$"L $C\..01? --/4k++C0g*G4g G L5*33D'Bn R '? @@c R}S)C ,<<= >>c? MM#\++-. g|0023B#%%  1-) &+ 82c]3/#h-?@AAB mmG G-)9:0 s (U"**3//g0 MM"$ MM"W+  B B6 JJsIs4Mc \t|j}|jDcgc] }t|}}t|jD]K}t|D];}t ||tt |j ||dz||<=M|Scc}w)zDetermine the maximum column widths for each data list. Args: profile_data: list of ProfileDatum objects. Returns: List of column widths in the same order as columns in data. r/)rLrRrrNrr9 row_values)r'r num_columnsrwidthsrCrDs r+#_measure_list_profile_column_widthsz3ProfileAnalyzer._measure_list_profile_column_widths=sl//12K2>2K2K2M N;c+ NF N\++-.J{#J# 3KS!8!8!=c!BCDqHJs JJ M OsB)z#nodesz(#execs)linenosourcec ~ !~|jdj|}|jrtj|jnd}g}|j }t |jjj}t|D]Z}|jjj|} |r|j| jsD|j|| \tj|t j"j%|j&|j(|j*} | sbt-j.d|j&zdt0d|jdt2d|j(dt4d|j*gSd} | D]-} |j7| | |j8} t;| | } /tj<|j&\}}d}|j8}|d zt |d zt |j>d z|d !tAd !d z|zd !dt |z zz|jBzd !dt |jBz zz|jD}|tA|jF|jHz }tAd !d !dzz|j>zd !dt |j>z zzd !dzz|jD}|tA|jJdz }||g}i}tM|D]c\}}|d z}|| vr| |}|jO|j7||j8| |}|}|d !d t |z zz }tAtQjR|j7||j8|jT|jD} | d !dt | z zz } || z }tjV|j&dz}d|||d zfz}|jr|dt0d |jz }|j(r|dt2d |j(z }|j*r|dt4d |j*z }t-jXd|}tAd|jZ|j\fz|jD|g}|d !dt |z zz }||z }n tAd t_!fd!Dz}tAd|z|jH} | d !dt | z zz } || z }||z }|ja||jb|k(sEt |d z |t,jd<ft-jf||S)aGPrint a Python source file with line-level profile information. Args: args: Command-line arguments, excluding the command prefix, as a list of str. screen_info: Optional dict input containing screen information such as cols. Returns: Output text lines as a RichTextLines object. rN)rrzuThe source file %s does not contain any profile information for the previous Session run under the following filters:z --z: r r0r.)cost_bar total_costnum_nodes_execsr>r5rrrr6r>rr$z8lp --file_path_filter %s --min_lineno %d --max_lineno %dr4z%d(%d)c32K|]}|dk7r|yw)r>NrZ)rcol_namers r+rz/ProfileAnalyzer.print_source..s%4(!]2$H-4sz L%d) annotations)4rrrrrrrLrrrrr\rrrannotate_source_against_profileospath expanduserr}rrrrr:r;r<_get_total_cost cost_typer load_source_NUM_EXECS_SUB_HEADrB_NUM_NODES_HEAD_LINE_COST_ATTR _LINENO_HEAD_LINE_NUM_ATTR _SOURCE_HEAD enumerate_render_normalized_cost_barrrr)escaper? node_countnode_exec_countrrrINIT_SCROLL_POS_KEYr)"r'rrrrrrrrrsource_annotationmax_total_cost line_indexr source_linesline_num_widthcost_bar_max_lengthtotal_cost_headheadsub_headlinesoutput_annotationsirr annotationrannotated_linerurGrErline_num_columnrs" @r+rzProfileAnalyzer.print_sourceUs9    ~ . 9 9$ ?F#55F$=$=>;?L557Nt))44>>?L|$8''22<:6n7 $0#;#;$! L.&&O'!+/*Q.t7781<% M  mJ''  }\*S-AAB C   }./#d6J6J2KKL  M &&  (D Bt  D,?,? @@D }Z(\*+ ,    ! }./4++,- . . mM**  + &&(H 4$$77H 8 E\*2F41uf $ $&v. 33  V-=-= > !"#z!:S]!JKK 77  V-=-= >",,.#'"6"68  c]<83z?JKK *$99V%<%<=CL ffqjP22  $ $ #;#)#<#<> >'  " " #9#)#:#:< <'  #7#)#8#8: :''00w? X)>)>)3)C)C)EE(,(<("   V #7:5zA~   3 3 5c2Fh  B B - //rIcb|dk(r |jS|dk(r |jStd|z)Nr r zUnsupported cost type: %s)rrr)r'aggregated_profilers r+rzProfileAnalyzer._get_total_costs;K  / // i   - -- 2Y> ??rIcttjt||z |z}|xsd}t d|j }|t d|zd||z zzd|j gz }|t d|j z }|S)asRender a text bar representing a normalized cost. Args: cost: the absolute value of the cost. max_cost: the maximum cost value to normalize the absolute cost with. length: (int) length of the cost bar, in number of characters, excluding the brackets on the two ends. Returns: An instance of debugger_cli_common.RichTextLine. r.[r6|r5r])rnpceilfloatrBr)r'costmax_costlength num_ticksrs r+rz+ProfileAnalyzer._render_normalized_cost_barsBGGE$K(2V;<=IQI t33 4F by3&9*<#=="D$8$89;;F b 4 455F MrIc<|j|jSrK)r format_help)r' handler_names r+get_helpzProfileAnalyzer.get_helps   \ * 6 6 88rIrK)NNNr)rUrVrWrXr,r|rrrr COLOR_CYANr COLOR_YELLOWrrrrrrrrr#rZrIr+rlrlss$Z+x9v!"LFJ cKJ"))/**./",,E/N@(9rIrlc ~t||}tj||}|jd|j|j ddg|jd|j |j ddg|S)aCreate an instance of ReadlineUI based on a `tf.Graph` and `RunMetadata`. Args: graph: Python `Graph` object. run_metadata: A `RunMetadata` protobuf object. ui_type: (str) requested UI type, e.g., "readline". on_ui_exit: (`Callable`) the callback to be called when the UI exits. config: An instance of `cli_config.CLIConfig`. Returns: (base_ui.BaseUI) A BaseUI subtype object with a set of standard analyzer commands and tab-completions registered. ) on_ui_exitr|lp)prefix_aliasesrr3)rlrget_uiregister_command_handlerr|r#r)rrui_typer'configanalyzerclis r+create_profiler_uir0s$ UL 1('j9#'V  'V  *rI)rvrv)readlineNN)rXrrrnumpyrtensorflow.python.debug.clirrrrtensorflow.python.debug.librrRichLinerBr r!r#r$r"r%r:r;r<objectrrfrjrlr0rZrIr+r7s2 26;214!!#%/+'_&6_&R1h:2^9f^9F *"&" " rI