1Vh)dZddlZddlZddlZddlZddlZddlmZddlm Z ddl m Z GddZ e dZ Gdd ZGd d ZGd d ej Zy)z"Writes events to disk in a logdir.N)tf) event_pb2) RecordWriterceZdZdZdZy) AtomicCountercD||_tj|_yN)_value threadingLock_lock)self initial_values \/home/dcms/DCMS/lib/python3.12/site-packages/tensorboard/summary/writer/event_file_writer.py__init__zAtomicCounter.__init__s# ^^% c|j5 |j|xjdz c_cdddS#|xjdz c_wxYw#1swYyxYw)N)r r rs rgetzAtomicCounter.get"sO ZZ ! !{{ q  ! ! q  ! !sA 9AAAAN)__name__ __module__ __qualname__rrrrrrs &!rrc2eZdZdZ ddZdZdZdZdZy) EventFileWritera&Writes `Event` protocol buffers to an event file. The `EventFileWriter` class creates an event file in the specified directory, and asynchronously writes Event protocol buffers to the file. The Event file is encoded using the tfrecord format, which is similar to RecordIO. c ||_tjjj |t j j|dtjtjt jtjfz|z|_tjjj|jd|_t#t%|j |||_t)j*tjdt)j,d}|j/||j1y)aCreates a `EventFileWriter` and an event file to write to. On construction the summary writer creates a new event file in `logdir`. This event file will contain `Event` protocol buffers, which are written to disk via the add_event method. The other arguments to the constructor control the asynchronous writes to the event file: Args: logdir: A string. Directory where event file will be written. max_queue_size: Integer. Size of the queue for pending events and summaries. flush_secs: Number. How often, in seconds, to flush the pending events and summaries to disk. z"events.out.tfevents.%010d.%s.%s.%swbz brain.Event:2z,tensorboard.summary.writer.event_file_writer)writer) wall_time file_versionsource_metadataN)_logdirriogfilemakedirsospathjointimesocket gethostnamegetpid _global_uidr _file_nameGFile_general_file_writer _AsyncWriterr _async_writerrEventSourceMetadata add_eventflush)rlogdirmax_queue_size flush_secsfilename_suffix_events rrzEventFileWriter.__init__6s"   V$ GGLL4IIK&&(IIKOO%    %'EEKK$5$5doot$L!) 22 3^Z  iik(%44E  v rc|jS)z7Returns the directory where event file will be written.)r#rs r get_logdirzEventFileWriter.get_logdirfs ||rct|tjstdt |z|j j |jy)zeAdds an event to the event file. Args: event: An `Event` protocol buffer. z.Expected an event_pb2.Event proto, but got %sN) isinstancerr4 TypeErrortyper3writeSerializeToString)revents rr6zEventFileWriter.add_eventjsO %1 $U ,    !8!8!:;rc8|jjy)zFlushes the event file to disk. Call this method to make sure that all pending events have been written to disk. N)r3r7rs rr7zEventFileWriter.flushws   "rc8|jjy)zPerforms a final flush of the event file to disk, stops the write/flush worker and closes the file. Call this method when you do not need the summary writer anymore. N)r3closers rrHzEventFileWriter.closes   "rN) x) rrr__doc__rr>r6r7rHrrrrr-s(JL.` <##rrc0eZdZdZddZdZdZdZdZy) r2zWrites bytes to a file.c||_d|_tj||_t |j|j||_tj|_ |j jy)a@Writes bytes to a file asynchronously. An instance of this class holds a queue to keep the incoming data temporarily. Data passed to the `write` function will be put to the queue and the function returns immediately. This class also maintains a thread to write data in the queue to disk. The first initialization parameter is an instance of `tensorboard.summary.record_writer` which computes the CRC checksum and then write the combined result to the disk. So we use an async approach to improve performance. Args: record_writer: A RecordWriter instance max_queue_size: Integer. Size of the queue for pending bytestrings. flush_secs: Number. How often, in seconds, to flush the pending bytestrings to disk. FN) _writer_closedqueueQueue _byte_queue_AsyncWriterThread_workerr r r start)r record_writerr9r:s rrz_AsyncWriter.__init__s` %   ;;~6)   dllJ  ^^%  rc|j5|j|jr td|jj ||jdddy#1swYyxYw)z4Enqueue the given bytes to be written asychronously.Writer is closedN)r _check_worker_statusrPIOErrorrSput)r bytestrings rrCz_AsyncWriter.writesa ZZ (  % % '||011     ,  % % ' ( ( (s AA))A2c|j5|j|jr td|jj |j j|jdddy#1swYyxYw)zWrite all the enqueued bytestring before this flush call to disk. Block until all the above bytestring are written. rYN)r rZrPr[rSr)rOr7rs rr7z_AsyncWriter.flushso ZZ (  % % '||011    ! ! # LL     % % ' ( ( (s A,BB c"|jsw|j5|jsUd|_|jj|jj |jj dddyy#1swYyxYw)z@Closes the underlying writer, flushing any pending writes first.TN)rPr rUstoprOr7rHrs rrHz_AsyncWriter.closesm|| )||#'DLLL%%'LL&&(LL&&(  ) ) ) )s A"BBc8|jj}||y)zzMakes sure the worker thread is still running and raises exception thrown in the worker thread otherwise. N)rU exception)rrbs rrZz!_AsyncWriter._check_worker_statuss#LL**  O !rN)rJ) rrrrLrrCr7rHrZrrrr2r2s!2 (( )rr2c(eZdZdZdZdZdZdZy)rTz;Thread that processes asynchronous writes for _AsyncWriter.ctjj|d|_d|_||_||_||_d|_d|_ t|_ y)aCreates an _AsyncWriterThread. Args: queue: A Queue from which to dequeue data. record_writer: An instance of record_writer writer. flush_secs: How often, in seconds, to flush the pending file to disk. TNrF) r Threadrdaemonrb_queue_record_writer _flush_secs_next_flush_time_has_pending_dataobject_shutdown_signal)rrQrWr:s rrz_AsyncWriterThread.__init__sW !!$'  +% !!& &rcn|jj|j|jyr )rhr\rnr)rs rr`z_AsyncWriterThread.stops! --. rc |jy#t$r]}||_ |jj d|jj 6#t j$rYwxYwd}~wwxYw)NF)_run Exceptionrbrhr task_donerQEmpty)rexs rrunz_AsyncWriterThread.runsp  IIK DN KKOOE*KK))+;;    s1 A9A47AA1.A40A11A44A9c tj}|j|z }d} |dkDr|jjd|}n|jjd}||jur |r|jj yy|j j|d|_|r|jj  tj}||jkDrA|jr!|j jd|_||jz|_5#tj$rYwxYw#|r|jj wwxYw)NTrF) r*rkrhrrnrsrirCrlrQrtr7rj)rnowqueue_wait_durationdatas rrqz_AsyncWriterThread._runsC ))+C"&"7"7#"= D ,&*;;??41DED;;??51D4000 KK))+ ##))$/)-&KK))+))+CT***))''--/-2D*(+d.>.>(>%;;;  KK))+s*A D7"D77E  E E  EE/N)rrrrLrr`rvrqrrrrTrTsE)( "?rrT)rLr'rQr+r r*tensorboard.compatrtensorboard.compat.protor(tensorboard.summary.writer.record_writerrrr.rr2rfrTrrrr~sh)  !.A ! !A Y#Y#xKK\M?))M?r