BVh/dZddlZddlmZddlmZddlmZddlm Z ddlm Z ddlm Z dd lm Z dd lmZdd lmZdd lmZdd lmZddlmZddlmZddlmZddlmZddlmZddlmZddlmZddlmZddlm Z ddl!m"Z"ddl#m$Z$ddl%m&Z&ddl%m'Z'ddl%m(Z(ddl)m*Z*e+gdZ,e-gdZ.dZ/Gd d!e"j`Z1Gd"d#e"j`Z2d$Z3d%Z4d=d&Z5d'Z6d(Z7d)Z8Gd*d+e"j`Z9d,Z:d-Z;d.Z<e*d/g0d>d1Z=Gd2d3e"j`Z>Gd4d5e"j`Z?d6Z@d7ZAGd8d9ejZCd:ZDd;ZEd<ZFy)?z8Utilities for working with and creating SaveableObjects.N)saveable_compat)session)context) constant_op)device)dtypes)ops)tensor) tensor_util) array_ops)gen_control_flow_ops) ref_variable)resource_variable_ops) state_ops) variables) tf_logging)base) base_delegate) python_state)trackable_utils)saveable_object)core)compat)nest)object_identity) tf_export)Variable VariableV2AutoReloadVariable VarHandleOpReadVariableOp)rrrctj|r|Stjj |}|j dd}|j S)zCreates a new device string based on `device_string` but using /CPU:0. If the device is already on /CPU:0 or it is a custom device, this is a no-op. Args: device_string: A device string. Returns: A device string. CPUr) device_type device_index)ris_custom_devicepydev DeviceSpec from_stringreplace to_string) device_string parsed_devices f/home/dcms/DCMS/lib/python3.12/site-packages/tensorflow/python/training/saving/saveable_object_util.pyset_cpu0r/9sR m, ""..}=-''E'J-  ""c(eZdZdZfdZdZxZS)ReferenceVariableSaveablez?SaveableObject implementation that handles reference variables.cxtj||||j}tt|||g|yNdtype)rSaveSpecr6superr2__init__)selfvar slice_specnamespec __class__s r.r9z"ReferenceVariableSaveable.__init__Ns3  # #CT KD #T3C$Fr0c|d}|tj||d}tj|j||duxr(|jj j S)Nr)validate_shape)r reshaperassignop get_shapeis_fully_defined)r:restored_tensorsrestored_shapesrestored_tensors r.restorez!ReferenceVariableSaveable.restoreRsl&q)O"!))/?1;MNo    &$./ ,,.  00r0__name__ __module__ __qualname____doc__r9rJ __classcell__r?s@r.r2r2KsGG0r0r2c(eZdZdZfdZdZxZS)ResourceVariableSaveablez=SaveableObject implementation that handles ResourceVariables.c|j|_|j|_t |t j r!|jjd|_ |}nItj|rd}|j|_ ||}ntdt|tj ||||j"|j}t$t&|S||g|y)Nrcfd}|S)Nc~tjj5tjrj s dddyj }tjd5t j|cdddcdddS#1swYnxYw dddy#1swYyxYw)Nz /device:CPU:0)r rrexecuting_eagerlyis_initializedread_value_no_copyr identity)xvs r.fzLResourceVariableSaveable.__init__.._read_variable_closure..fiszz!((# +((*13C3C3E + + $$&AO, +''* + + + + + + + + + +s)&B3%B35B B3B& "B33B<)r\r]s` r._read_variable_closurezAResourceVariableSaveable.__init__.._read_variable_closurehs +r0zCSaveable is neither a resource variable nor a read operation. Got: )r6r)r _var_deviceshape _var_shape isinstance tensor_libTensorrDinputs handle_opris_resource_variablehandle ValueErrorreprrr7r6r8rSr9)r:r;r<r=r r_r>r?s r.r9z!ResourceVariableSaveable.__init__`szzDiiDO#z(()vv}}Q'dnf  3 3C 8 zzdn%c*f  9+     # #FJ*-))CJJ HD "D23Er0c |d}|tj||d}tj|j5tj |} t j|j|j|}|cdddS#t$r9}td|jd|jd|jd|d}~wwxYw#1swYyxYw)z@Restores tensors. Raises ValueError if incompatible shape found.rNz(Received incompatible tensor with shape z0 when attempting to restore variable with shape z and name .) r rBr rr`rZr!shape_safe_assign_variable_handlergrbrjrar=)r:rGrHrIassigned_variablees r.rJz ResourceVariableSaveable.restores&q)O"!))/?1;MNo D$$ % !**?;o-1SS NNDOO_>   -67L7L6MN>>Boo=NO {! %&,- --  s0C+B C C4C  CCCrKrQs@r.rSrS]sE FDr0rScrt|tjxr|jjt vSN)rcrdrerDtype _VARIABLE_OPS)r\s r._tensor_comes_from_variablerus' Az(( ) Haddii=.HHr0c#Kt|tstd|t|tjr|yt|t t tjfrLt|tjr t |}d}|D]}t|tjr|#t|tjstd||jstd|||jj}n>||jjk7r%td|d|jj|jjtvr$t!||jj"|t%||jj"|!yt|t&j(rt|tjst+|dj-D]m\}}|t&j.k(r|}n|t0j2k(r|}n|d z|z}t5|r||n|}t7||j8D]}|oyt|t:j<r+|j>r |j@}n|}t%|d |ytCjDrtd t|d tGjH|d }tK|std||jjtvrt!|d |yt%|d |yw)aCreate `SaveableObject`s from an operation. Args: op: A variable, operation, or SaveableObject to coerce into a SaveableObject. name: A string name for the SaveableObject. Yields: `SaveableObject`s which together save/restore `op`. Raises: TypeError: If `name` is not a string. ValueError: For operations with no known conversion to SaveableObject. zfnames_to_saveables must be a dict mapping string names to trackable operations. Name is not a string: NzSlices must all be Variables: zSlices must all be slices: z)Slices must all be from the same tensor: z != T tf1_saver_zJCan only save/restore ResourceVariables when executing eagerly, got type: rmas_refz]names_to_saveables must be a dict mapping string names to Tensors/Variables. Not a variable: )&rcstr TypeErrorrSaveableObjectlisttuplerPartitionedVariablerrj_save_slice_info full_namerDrs_REF_VARIABLE_OPSr2r>rS trackable Trackablesaveable_objects_from_trackableitemsVARIABLE_VALUE_KEYrSERIALIZE_TO_TENSORS_NAMEcallablesaveable_objects_for_opr=rBaseResourceVariable_in_graph_mode_graph_elementrrWr convert_to_tensorru)rDr= slice_namevariableattrfactoryrs r.rrs D#   77;f > ??O223 H"tUI$A$ABC"i334 8bJ- Ho<< = )"4"4 59(DEE  & &6xjABB  ..88 22<< <7 |4((223 56 6   . .' h//44d< <'x1J1J1O1O'+- -%-*"i))*:)  49 d!EG  g -- - ?<< < 3J% "*7"3GI b'BGG4"  "+@@A  $$ $Xr4 88  " " $99=b !EF F&&r$7h ( 2 ;;C* FG G   . .'"d;;&xT::sM Mct|tttfst d|t j t|}t|d}i}|D]}t|tjxst|tj}t|tjr|||j<dt|tj r6|j|vrt#d|j|||j<t|tj$re|j&rY|j&j(}||vr7t||tst#d|||j+|+|g||<3t|t,j.rX|sVt1|dj3Dcgc]}t5|r|n|}}|j7t9|t;|ddsmt|tjst#d t=|d |j?|j@|}||ust#d |j@d |rWt|tjr |jB}ntEjF|d }tI|st d||jJj<dk(r.|jJjLdjJj}n|jJj}||vrt#d||||<|Scc}w)a;Create a dictionary of names to operation lists. This method is only used when the variable name matters (e.g. when saving or restoring from a TF1 name-based checkpoint). In TF2, this can be called from `tf.train.Checkpoint.restore` when loading from a name-based checkpoint. Args: op_list: A (nested) list, tuple, or set of Variables or SaveableObjects. convert_variable_to_tensor: Whether or not to convert single Variables with no slice info into Tensors. Returns: A dictionary of names to the operations that must be saved under that name. Variables with save_slice_info are grouped together under the same key in no particular order. Raises: TypeError: If the type of op_list or its elements is not supported. ValueError: If at least two saveables share the same name. zz!op_list_to_dict..s !&&r0keyz+At least two variables have the same name: z1Mixing slices and non-slices with the same name: TrwrzSCan only save/restore ResourceVariables when eager execution is enabled. Got type: rmzBTwo different ResourceVariable objects with the same shared_name 'z' were passed to the Saver. This likely means that they were created in different Graphs or isolated contexts, and may not be checkpointed together.r{z$Variable to save is not a Variable: r!r)'rcrrsetr~rflattensortedrrr RefVariablerrr=rrrjrrrappendrrrvaluesrupdateop_list_to_dictgetattrrs setdefault _shared_namerr rrurDrf) op_listconvert_variable_to_tensornames_to_saveablesr;resource_or_ref_variabler=rtrackable_saveablesset_vars r.rrs9* GdE3/ 0 !!( + ,, LLg '' 7 0 1' :'c3-BBC 23 001#556%(" C66 7 ' '9#(( DF F%(" C++ ,1E1E  ! ! + +d # #,T2D9N"V%& &4 '',$'54 C,, -6N.cTBIIKN!)79w 6NN - .0 S*D 1#4IIJ''+Cyk45 5%//0@0@#F # !../0IIJ J & 2GG H$$C''D9C,S1B3%HI I 66;;* *q!$$))$$ % %HOP P#&4 u:'z ONsM c|j&|j|vrtd|j|j||j |jy)aIAdds the saveable to the saveables list. Args: saveables: List to append the SaveableObject to. seen_ops: Set of the ops of the saveables already processed. Used to check that each saveable is only saved once. saveable: The saveable. Raises: ValueError: If the saveable has already been processed. Nz3The same saveable will be restored with two names: )rDrjr=radd) saveablesseen_opssaveables r. _add_saveablerRsU[[!8 J ( )) 8 ,,x{{r0cg}tj}t|jdD]#\}}t ||D]}t |||%|S)aReturns the variables and names that will be used for a Saver. Args: names_to_saveables: A dict (k, v) where k is the name of an operation and v is an operation to save or a BaseSaverBuilder.Saver. Returns: A list of SaveableObjects. Raises: TypeError: If any of the keys are not strings or any of the values are not one of Tensor or Variable or a trackable operation. ValueError: If the same operation is given in more than one value (this also applies to slices of SlicedVariables). c |dS)Nrr^rs r.rz+validate_and_slice_inputs..ys qtr0r)rObjectIdentitySetrrrr)rrrr=rDconverted_saveable_objects r.validate_and_slice_inputsresp )  . . 0(+113+-DhdB&=R%FD!Ix)BCDD r0ct|tjrtjd|dgSt d|DrgS|S)z:Makes sure SaveableObjects are compatible with SavedModel.zNote that object zu stores python values into the checkpoint. These values will not be restored when loading the SavedModel into python.c3PK|]}t|tj ywrr)rcrNoRestoreSaveable).0rs r. z5validate_saveables_for_saved_model..s% $  Hi99 : $s$&)rcr PythonStateloggingwarnany)robjs r."validate_saveables_for_saved_modelrsV\--. LL C5!  I $" $$ I r0c(eZdZdZfdZdZxZS)RestoredSaveableObjectzFSaveableObject restored from SavedModel using the traced save/restore.c ||_||_tj|r|}n2t j 5t j|}ddd|}g}t||D]4\\}} } |jtj| d| ||z6tt|;d||y#1swYlxYw)Nr ) save_functionrestore_functionr is_tf_typer init_scoperconstantziprrr7r8rr9) r:names_and_slicesrrr= name_tensortensorsspecsstr_name str_slice tensor_infor?s r.r9zRestoredSaveableObject.__init__s&D,Dd#k >> 1!**40 1K(G E.12BG.L>*9{ ll?++K,A9,08O=>> $0udC11s B==Cc~|jtt|jDcgc]}|| c}Scc}wrr)rrangelenr)r:rGrHis r.rJzRestoredSaveableObject.restores@ 4 ',S_'= >! 1  > @@ >s >rKrQs@r.rrsND @r0rc Hg}tj5|jD]\}}|dD]}|d}|d}tjsPtj }|$|d|d}nt jx}|d<|j||g\}}|jt|t|f dddi} |jD](\}\}} tjt||| | |<*| S#1swYHxYw)zEReturns a dict of SaveableObject factories generated from loaded fns.rzr=r<Nr)rrr)r rrrrWget_default_sessionrSessionrunr_convert_to_stringr functoolspartialr) saveable_fn_by_name temp_sessionrsave_fnryrr=r<sesssaveable_factories restore_fns r.recreate_saveable_objectsrsB ~~-)002-   -+6" . ((*((*$ \A*!!_d'.'88d\!_!XXtZ&89 $  t $ z *!, - ---$%8%>%>%@%!d !Wj(00)#  %t% 3--s B9DD!c ||S|tjk(r ||St|r5|jdfd}|jdfd}||||S||S)aRCreates a SaveableObject while potentially in a different graph. When creating the frozen saver for SavedModel, the save and restore ops are placed in a separate graph. Since RestoredSaveableObject uses tf.functions to save and restore, the function captures must be mapped to the new graph. Args: name: Name of SaveableObject factory. key: Checkpoint key of this SaveableObject. factory: Factory method for creating the SaveableObject. call_with_mapped_captures: Helper that calls a tf.function while remapping the captures. Returns: a SaveableObject. r)r=call_with_mapped_capturesrc|gSrrr^)r=rconcrete_save_fns r.rz'create_saveable_object..save_fns &'7$ @@r0rc|Srrr^)rGrconcrete_restore_fns r.rz*create_saveable_object..restore_fns &':N :   r0c^t|tjxr|jtuSrr)rcrrfuncr)rs r.rrs) Wi// 0 1 ,,0 02r0z5__internal__.tracking.saveable_objects_from_trackable)v1cJttjr@tjt j t jjiS|rj}|r|Strdfd }tj|iSjS)a Returns SaveableObject factory dict from a Trackable. Args: obj: A `Trackable` tf1_saver: Boolean, whether this is being called from a TF1 Saver ( `tf.compat.v1.train.Saver`). When this is True, the SaveableObject will be generated from `obj`'s legacy `_gather_saveables_for_checkpoint` fn. When saving with TF2, `Trackable._serialize_from_tensors` is preferred. Returns: A dict mapping attribute names to SaveableObject factories (callables that produce a SaveableObject). )state_callbackrestore_callbackc N j}|r$t|tjr ||g}n|}g}g}|j D]\}}|j |t|t sd|i}|tj|z}|j D]X\} } t| tjr| } || _ | | _ ntj| | |} |j | Zt |||tj xsd|S)Nrz)rrr= local_namesprefixr)_serialize_to_tensorsrcrConcreteFunctionrrdictrescape_local_namerr7r=r<TrackableSaveablerget_saveable_name) r=rr tensor_dictrr tensor_name maybe_tensor spec_namer<r r>rs r.create_saveablez8saveable_objects_from_trackable..create_saveables#))g # Wd33 4/< i ek'2'8'8': #+|;',-l+,?<<[II "."4"4"6  J  8 8 9D!DI(DO"++FJ JD ,,t  "! 2237=2$= ??r0)rzN) rcrr PYTHON_STATErr_PythonStringStateSaveable serialize deserialize _gather_saveables_for_checkpoint!trackable_has_serialize_to_tensorrr)rrxrrs` r.rrs\--.!!   *"}}!$ 2 ==? &s+!?F  5 5 GG  / / 11r0c2eZdZdZ dfd ZdZdZxZS)rz>A SaveableObject that defines `Trackable` checkpointing steps.ch||_||_||_||_tt ||||yrr)_prefix _local_names _trackable_call_with_mapped_capturesr8rr9)r:rrr=rrrr?s r.r9zTrackableSaveable.__init__=s5DL#DDO&?D# T+C=r0c J~i}t|jD] \}}||||<|jj}t j sst |jDcgc]L}t|jtjr&|jjjtvNc}r||S|jr.t|t j"r|j||g}n||}||St%j&Scc}wrr) enumerater r _restore_from_tensorsr #executing_eagerly_outside_functionsrrrc_tensorrdrerDrsrrrrr no_op) r:rGrHrestored_tensor_dictn local_namerr>rets r.rJzTrackableSaveable.restoreEs "4#4#45= :)9!)<:&=66J  2 2 4JJ>8  dllJ$5$5 6  11>8:9, -- '':t445  + +J9M8N Oc + ,c  j  % % ''>8s&AD ct|j|jDcgc] \}}|j|z|jf"c}}Scc}}wrr)rr rr r=)r:rr>s r.#get_proto_names_and_checkpoint_keysz5TrackableSaveable.get_proto_names_and_checkpoint_keys_sM$'(9(94::$F H D\\J & 2 HH Hs%A rr)rLrMrNrOr9rJrrPrQs@r.rr:sF*.>(4Hr0rc.eZdZdZfdZdZdZxZS)rz#Saves Python state in a checkpoint.cxfd}||_||_tjd5t j dt j|_dddtj|jd|t j}tt|7|j|g|y#1swY[xYw)a5Configure saving. Args: name: The checkpoint key to write to. state_callback: A function taking no arguments which returns a string. This function is run every time a checkpoint is written. restore_callback: A function taking a Python string, used to restore state. cftj5cdddS#1swYyxYwrr)r r)rsr._state_callback_wrapperzD_PythonStringStateSaveable.__init__.._state_callback_wrapperrs( >>     s'0z/cpu:0rzr5N)_state_callback_restore_callbackr rrrrstring _save_stringrr7r8rr9)r:r=rrrr>r?s ` r.r9z#_PythonStringStateSaveable.__init__gs 3D-D H H%..rGdH  # # 2t6== :D $d4T5F5F59; HHs +B00B9c:|j|jiS)z4When running a graph, indicates fresh state to feed.)r"rr:s r.feed_dict_additionsz._PythonStringStateSaveable.feed_dict_additionss   t335 66r0cpfd}tj|tjjdS)z?Create a frozen `SaveableObject` which saves the current state.cjtjjtjSr4)rrrrr!r$sr._constant_statez:_PythonStringStateSaveable.freeze.._constant_states#  ! !$"6"6"8 NNr0zcpu:0)r r6r=r)rrrr!r=)r:r(s` r.freezez!_PythonStringStateSaveable.freezes2O  & &mm YY  r0)rLrMrNrOr9r%r)rPrQs@r.rrds+;07 r0rc|tjurt|jS d|jvry t|jD]_}|tjurt|jcS|tjuryd|jvryd|jvs_yy#t t f$rYwxYw)z@Returns whether obj's class has `_serialize_to_tensors` defined.rTFr) rDelegatingTrackableMixinrr __dict__AttributeErrorr~rsmrorr)rts r.rrsM 2 22 -S^^ << #,,./ 9==? aM 2 22/s~~ >>I   AJJ .  +qzz 9   + ) $  sB55CCcRtjtj|Srr)ras_strr constant_valuers r.rrs {11!4 55r0cFeZdZdZdZdZedZedZdZ dZ y) SaveableCompatibilityConverteraWConverts object's `SaveableObjects` to functions used in TF2 checkpointing. A class that converts a Trackable object's `SaveableObjects` to save and restore functions with the same signatures as `Trackable._serialize_to_tensors` and `Trackable._restore_from_tensors`. This class also produces a method for filling the object proto. _obj _saveablesc ||_||_y)zkConstructor. Args: obj: A Trackable object. saveables: A list of saveables for `obj`. Nr5)r:rrs r.r9z'SaveableCompatibilityConverter.__init__sDIDOr0c|jSrr)r6r$s r.rz"SaveableCompatibilityConverter.objs 99r0c|jS)zFReturns a list of SaveableObjects generated from the Trackable object.)r7r$s r.rz(SaveableCompatibilityConverter.saveabless ??r0c,t|jS)z'Returns a dict of tensors to serialize.)saveable_object_to_tensor_dictrr$s r.rz4SaveableCompatibilityConverter._serialize_to_tensorss )$.. 99r0c Dg}|jD]$}|jd|jD&t||j k7r5t d|j d|dt|j t|j|S)z1Returns the restore ops defined in the Saveables.c3lK|],}tjt|j.ywrr)rextract_local_namerr=)rr>s r.rzGSaveableCompatibilityConverter._restore_from_tensors..s-&  , ,-? -J K&s24zCould not restore object zE because not all expected tensors were in the checkpoint. Expected: z Got: ) rextendrrkeysrjr6rsaveable_object_to_restore_fn)r:rG expected_keysrs r.rz4SaveableCompatibilityConverter._restore_from_tensorss MNN&&nn&&& =-2244 2499+>((5"4(8(=(=(?#@"AC DD 9 ( 89I JJr0N) rLrMrNrO __slots__r9propertyrrrrr^r0r.r4r4sF%)     :Kr0r4ci}|D]}}|jD]l}t|j}t|j}t |j r|n |j }|r||j |i|<h|||<n|S)z:Converts a list of SaveableObjects to a tensor dictionary.)rrr=r<rrr)rrrr>r=r<r s r.r<r<s+ #h #  *d%doo6j  -t4<r=r<rrs r.rz._restore_from_tensorssK ;"$..C$112DTYY2OP'8 '- ,-l+,!((j)ABC$,#3#3 #T$4$;k(--  ; r0r^)rrs` r.rBrBs$ r0c tj}|jD]\}}|s t|trK|j }i||<|j D]*}tj|j}|g|||<,eg}g}tj|xsd} |jD]\} } t| tsd| i} | jD]W\} } t| tjr|j| 2|jtj| | | Y|jtj| | tj t#t%|j'}tj(t+||||| gi||<|S)a'Converts a tensor dict to a SaveableObject cache. Args: serialized_tensors: Map from Trackable to a tensor dict. The tensor dict maps checkpoint key (-> slice_spec) -> Tensor Returns: A dict mapping Trackable objects to a map from local savable name to SaveableObject. rz)rr)rObjectIdentityWeakKeyDictionaryrrcr4rrrr?r=rrrrr7rextract_object_namenextiterrArr)serialized_tensorssaveables_cacherr trackable_objrrrrrcheckpoint_keyrr<r object_names r.$serialized_tensors_to_saveable_cacherUs$CCE/,224"Oc; #56ggm')om$mm@($77 F 6>Z &z2@ EK  . .s 3 9rF(3(9(9(; E$  d +L) , 2 2 4A *f fo66 7 ,,v  ,,//0:0>@ A A;;Nrbsc?8,+37.+<3+6.7++<9547=()'26'( NO#$0 > >0$5==5pIV;r]@&4 @_;;@2B$N2  BrJC2KC2L'H66'HT)!?!?)X"J62KY%8%82Kj"00r0