1VhdZddlZddlZddlZddlmZddlmZddlmZejZ ejdZ dZ dZd Zd Zd Zd Zd ZdZy)zIO helper functions.N)tf)io_util) tb_loggingz([*?[])cPtj|rdStjS)N/)r IsCloudPathosseppaths _/home/dcms/DCMS/lib/python3.12/site-packages/tensorboard/backend/event_processing/io_wrapper.py PathSeparatorr s%%d+377c|s tddtjjtj j |vS)aCheck the path name to see if it is probably a TF Events file. Args: path: A file path to check if it is an event file. Raises: ValueError: If the path is an empty string. Returns: If path is formatted like a TensorFlowEventsFile. Dummy files such as those created with the '.profile-empty' suffixes and meant to hold no `Summary` protos are treated as true TensorFlowEventsFiles. For background, see: https://github.com/tensorflow/tensorboard/issues/2084. zPath must be a nonempty stringtfevents) ValueErrorrcompat as_str_anyr r basenamer s r IsTensorFlowEventsFiler$s< 9:: --bgg.>.>t.DE EErc@t|xr|jd S)aCheck whether the path is probably a TF Events file containing Summary. Args: path: A file path to check if it is an event file containing `Summary` protos. Returns: If path is formatted like a TensorFlowEventsFile. Dummy files such as those created with the '.profile-empty' suffixes and meant to hold no `Summary` protos are treated as `False`. For background, see: https://github.com/tensorflow/tensorboard/issues/2084. z.profile-empty)rendswithr s r IsSummaryEventsFiler8s! "$ ' O >N0O,OOrchfdtjjjDS)zJYields all files in the given directory. The paths are absolute. c3^K|]$}tjj|&ywNr r join).0r directorys r z(ListDirectoryAbsolute..Ms% *. Y% *-)riogfilelistdir)r s`r ListDirectoryAbsoluter&Hs(  24%%++2E2Ei2P rcztjj|\}}|tj d|S)zEscapes the glob characters in a path. Python 3 has a glob.escape method, but python 2 lacks it, so we manually implement this method. Args: path: The absolute path to escape. Returns: The escaped path string. z[\1])r r splitdrive_ESCAPE_GLOB_CHARACTERS_REGEXsub)r drives r _EscapeGlobCharactersr,Rs5''$$T*KE49==gtL MMrc#Ktjjt|d}d} tj d|t jjj|}tj dt|||sytjt}|D]3}|tjj|j|5|j!D]\}}|t#|ft|dk(r:tjjt|j%dd}tjj|d}|dz }Iw)a Recursively lists all files within the directory. This method does not list subdirectories (in addition to regular files), and the file paths are all absolute. If the directory does not exist, this yields nothing. This method does so by glob-ing deeper and deeper directories, ie foo/*, foo/*/*, foo/*/*/* and so on until all files are listed. All file paths are absolute, and this method lists subdirectories too. For certain file systems, globbing via this method may prove significantly faster than recursively walking a directory. Specifically, TF file systems that implement TensorFlow's FileSystem.GetMatchingPaths method could save costly disk reads by using this method. However, for other file systems, this method might prove slower because the file system performs a walk per call to glob (in which case it might as well just perform 1 walk). Args: top: A path to a directory. Yields: A (dir_path, file_paths) tuple for each directory/subdirectory. *rz+GlobAndListFiles: Starting to glob level %dz.GlobAndListFiles: %d files glob-ed at level %dN)r r rr,loggerinforr#r$globlen collections defaultdictlistdirnameappenditemstuplekeys)topcurrent_glob_stringlevelr2pairs file_pathdir_name file_pathss r ListRecursivelyViaGlobbingrCbs90'',,'D  7 sE6E8c#Ktjjj|dD]\}}fd|Dfyw)afWalks a directory tree, yielding (dir_path, file_paths) tuples. For each of `top` and its subdirectories, yields a tuple containing the path to the directory and the path to each of the contained files. Note that unlike os.Walk()/tf.io.gfile.walk()/ListRecursivelyViaGlobbing, this does not list subdirectories. The file paths are all absolute. If the directory does not exist, this yields nothing. Walking may be incredibly slow on certain file systems. Args: top: A path to a directory. Yields: A (dir_path, file_paths) tuple for each directory/subdirectory. T)topdownc3^K|]$}tjj|&ywrr)rfilenamedir_paths r r!z,ListRecursivelyViaWalking..s H(RWW\\(H - Hr"N)rr#r$walk)r<_ filenamesrHs @r ListRecursivelyViaWalkingrLsL"#%%%++"2"23"2"E !Y  Hi H   sAAcztjjj|sytjjj |st d|zt j|rtjdt}ntjdt}d||DS)aObtains all subdirectories with events files. The order of the subdirectories returned is unspecified. The internal logic that determines order varies by scenario. Args: path: The path to a directory under which to find subdirectories. Returns: A tuple of absolute paths of all subdirectories each with at least 1 events file directly within the subdirectory. Raises: ValueError: If the path passed to the method exists and is not a directory. z?GetLogdirSubdirectories: path exists and is not a directory, %szCGetLogdirSubdirectories: Starting to list directories via glob-ing.zBGetLogdirSubdirectories: Starting to list directories via walking.c3JK|]\}}td|Dr|yw)c32K|]}t|ywr)r)rfs r r!z4GetLogdirSubdirectories...s8Q%a(8sN)any)rsubdirfiless r r!z*GetLogdirSubdirectories..s*  VU 8%8 8  s!#) rr#r$existsisdirrrrr0r1rCrL)r traversal_methods r GetLogdirSubdirectoriesrXs 55;;  d # 55;;  T " " #  4   Q 6  P 5 /5 r)__doc__r4r retensorboard.compatrtensorboard.utilrr get_loggerr0compiler)rrrr&r,rCrLrXrNrr r_sm "$'     * 9 58F( P  N 6r 0-r