BVhldZddlZddlmZmZmZddlmZddlmZddlm Z ddlm Z ddlm Z dd l m Z dd lmZdd lmZdd lmZdd lmZddlmZddlmZddlmZddlmZddlmZddlmZddlmZddlm Z ddl!m"Z"Gdde#Z$dZ%dZ&dZ'ejPdgdZ)dZ*dZ+d Z,y)!z7Logic for restoring checkpointed values for Trackables.N)OptionalMappingAny)checkpoint_adapter)checkpoint_view)functional_saver) save_util_v1)saveable_compat)context)ops)tensor) array_ops) gen_io_ops)io_ops) tf_logging) registration)base) constants) python_state)trackable_utils)saveable_object_util)object_identityc eZdZdZgdZdZd$dZdZdejfdZ d e fd Z d e fd Z d$d eed eeej$ffd ZdZdZdZd$dZedZedZedZedZedZdZdZdZ dZ! d$de"de#jHdededeejf d Z%d!Z&d$d"Z'd#Z(y)%CheckpointPositionz>Indicates a position within a `_CheckpointRestoreCoordinator`.) _checkpoint _proto_id skip_restorecallbackc`||_||_d|_tj|_y)zSpecify an object within a checkpoint. Args: checkpoint: A _CheckpointRestoreCoordinator object. proto_id: The index of this object in TrackableObjectGraph.nodes. FN)rrrrReshardCallbackr)self checkpointproto_ids T/home/dcms/DCMS/lib/python3.12/site-packages/tensorflow/python/checkpoint/restore.py__init__zCheckpointPosition.__init__.s-"DDND&668DMNctj5|j|r.|j|}|r|jj |dddy#1swYyxYw)z$Restore this value into `trackable`.N)r init_scope bind_object_restore_descendantsrnew_restore_ops)r! trackablereader restore_opss r$restorezCheckpointPosition.restore<sX  8  ) $//7     * *; 7 888s AAA'c`|j}|jj||jj |j d}|j j|j |||j|j <y||urtjd|d|dy)a\Set a checkpoint<->object correspondence. Args: trackable: The object to record a correspondence for. Returns: True if this is a new assignment, False if this object has already been mapped to a checkpointed `Object` proto. Raises: AssertionError: If another object is already bound to the `Object` proto. NTa&Inconsistent references when loading the checkpoint into this object graph. For example, in the saved checkpoint object, `model.layer.weight` and `model.layer_copy.weight` reference the same variable, while in the current object these are two different variables. The referenced variables are:(z and z).F) r"all_python_objectsaddobject_by_proto_idgetrmatched_proto_idsloggingwarning)r!r,r"current_assignments r$r)zCheckpointPosition.bind_objectFsJ!!%%i0#66::4>>4P  $$T^^4!6?j##DNN3  9 ,  ##5 2  7 8r&rcttjt|js t d||_y)zAdd a resharding callback to the checkpoint. This will be applied to the checkpoint value before being supplied to the restore ops. Args: callback: Reshard callback for resharding this checkpoint position. Maybe None. z@Cannot override resharding callback, already set to non trivial.N) issubclassrr typer TypeError)r!rs r$update_resharding_callbackz-CheckpointPosition.update_resharding_callbackhs7 (88$t}}:M N  L DMr&returnc^ttjt|j S)zCDetermine whether this value has a non-trivial resharding callback.)r:rr r;rr!s r$ has_non_trivial_reshard_callbackz3CheckpointPosition.has_non_trivial_reshard_callbackzs(**D,? r&c|jj}t|dk(xr9|djtj k(xr|jj S)zEDetermine whether this value is restorable with a Tensor initializer.r) object_proto attributeslennamerVARIABLE_VALUE_KEYchildren)r!rEs r$is_simple_variablez%CheckpointPosition.is_simple_variablesX""--J J1 + qM  )">"> > +!!** *r&shape_and_slicesc :i}|jjD]e}|j}|jjj xsd}t j5t j|5||j|vr||j}nd}|jj||\}}g} |D]6} |jj| } | j| j8tj |jj"||| |jd} |jj%| |} dddt'j( ||j<dddh|S#1swY8xYw#1swYxYw)aCreate value `Tensor`s for this object's attributes. Does not require that the Python object has been created. Used for restore-on-create when executing eagerly. Args: shape_and_slices: A dict mapping from object attribute names to a shape and slice string that will be passed to a RestoreV2 op. If the dict is None or if an object attribute is not in the dict, the full tensor will be restored. Returns: A dictionary mapping from object attribute names to `Tensor`s. zcpu:0N_checkpoint_read)prefix tensor_namesrKdtypesrG)rDrEcheckpoint_keyroptionsexperimental_io_devicer r(devicerGrupdate_restore_inputs dtype_mapappend base_dtyper restore_v2save_path_tensorreshardridentity)r!rK value_tensorsserialized_tensorrR io_deviceshape_and_slicecheckpoint_keysfull_shape_and_slicesrQkeydtyperestored_valuesvalues r$r^z CheckpointPosition.value_tensorss"M!..99!J(77n""**AALWi >> J ZZ " *#((,<<./@/E/EFO Omm11 / 1/0 &$ ,c$$..s3E MM%** + ,#--%%66*4+<+A+AC  /--'' %3 :1:0B0B50I ',,-=JJ!JD =  JJs%!F7CF *FF FF c|j}|jjs|sgigifSg}i}g}tjt }t j|j}tj|j}|rA|jsQ|jjj}|j|||<n|r3|jjdj|ji||<nt|jtj r|j#|n|j%t&j(hk(r|j+|\}}n{|r|j-|\}}nd|jjD]K} |j.j0j3|j4gj#| j6M||||fS)zLooks up or creates SaveableObjects which don't have cached ops. Returns: A tuple of ( existing_restore_ops: list, named_saveables: dict, python_positions: list, registered_savers: dict) r)get_registered_saver_namerDrE collections defaultdictdictrsaveable_objects_from_trackabler,rrregistered_saver object_namerR isinstancer PythonStaterXkeysrSERIALIZE_TO_TENSORS_NAME$_create_serialize_to_tensor_saveable#_create_saveables_by_attribute_namerunused_attributes setdefaultrrG) r!recorded_registered_saverexisting_restore_opsnamed_saveablespython_positionsregistered_saverssaveable_factories saver_namerGr_s r$gather_ops_or_named_saveablesz0CheckpointPosition.gather_ops_or_named_saveabless!% > > @    ( (,E R^O#//5-MM 77GJ     11===A^^34T:     & &q ) 8 8$..' # DNNL$<$< =d#  "11'   3 34F G,O   2 23E F,O $00;;?  **55 NNB &'8'='= >? !/3C  r&ctj|jxsd}t|jj dj |z}tjsj|jjj|d}||gifS|jjj|ji}||vr g|||ifS|tj|}tjs||<g||ifS)z9Creates a saveable using the _serialize_to_tensor method.rMrNrG)r get_saveable_namer,_extract_saveable_namerDrErRr executing_eagerlyrrestore_ops_by_namer4saveables_cacherwrrs)r!r}suffix saveable_name existing_oprsaveables r$rtz7CheckpointPosition._create_serialize_to_tensor_saveables . .t~~ > D"F* $$Q'668:@AM  $ $ &$$88<< k  }b  ((88CC .."o / )M?=#ABBBL!/"K"KL H  $ $ &'/om$ x( ((r&c i}g}t}|jjD] tjrd}n0|j j j jd}||j|_t fd|Drt|j j}|d}nK|j|jij jd}t|dk(r|\}nd}|' j|jvrd}||j=|t| |}|K|j j j#|j$gj j_|*|g|j#|ji j<|| j<||fS)a+Creates or caches SaveableObjects by matching the attribute names. The attribute name keys in the `saveable_factories` is used to find the corresponding attribute in the object proto. Attributes contain checkpoint keys which are passed to the factory function to generate the SaveableObject. Args: saveable_factories: a dict mapping attribute name to a callable factory function that produces a SaveableObject. Returns: A tuple of ( existing_restore_ops: list, named_saveables: dict) Nc3TK|]}jj|!ywN)rG startswith).0rGr_s r$ zICheckpointPosition._create_saveables_by_attribute_name..:s* / # # . .t 4 /s%(rrC)setrDrEr rrrr4rRrXanyrr,rGrF_get_saveable_from_factoryrvrwr) r!r}rzrycreated_compat_namesrrr saveable_listr_s @r$ruz6CheckpointPosition._create_saveables_by_attribute_names$O5!..99<C  " " $ &&::>>  , ,d4  ##K0  /- / / ((88o   (++DNN,.0034E4J4J4;1=  }  "#)( (    + +8== @(dnn-  ..@.?.BD      , , 7 7nnb ""(&):)?)?"@   &DL:  $ $T^^%' )):)?)? A:Bo'667y<C|  00r&c|jr td|j\}}}}|j|jj ||||S)ajCreate or fetch restore ops for this object's attributes. Requires that the `Trackable` Python object has been bound to an object ID in the checkpoint. Args: reader: A `CheckpointReader`. If None, a new instance will be created. Returns: A list of operations when graph building, or an empty list when executing eagerly. zOUnable to run individual checkpoint restore for objects with registered savers.r-)_has_registered_saver ValueErrorrextendrrestore_saveables)r!r-r.tensor_saveablesr{_s r$r.zCheckpointPosition.restore_opspsx !!# 2 33  , , .["$4 ** .v + ?@ r&c|jSr)rr@s r$r"zCheckpointPosition.checkpoints   r&cH|jj|jSr)rr3rr@s r$r,zCheckpointPosition.trackables    . .t~~ >>r&c\|jjj|jSr)robject_graph_protonodesrr@s r$rDzCheckpointPosition.object_protos#    . . 4 4T^^ DDr&c|jSr)rr@s r$r#zCheckpointPosition.proto_ids >>r&c.|jjSr)r restore_uidr@s r$rzCheckpointPosition.restore_uids    ' ''r&c,t|jSr)reprrDr@s r$__repr__zCheckpointPosition.__repr__s !! ""r&c|jjD]D}|jtjk(s!|j j |jcSy)zoThe shape of the VARIABLE_VALUE tensor. Returns: If found a TensorShape object, otherwise None. N)rDrErGrrHr shape_maprR)r!r_s r$ value_shapezCheckpointPosition.value_shapesY "..99L   9#?#? ?))*;*J*JKKL r&cTt|jjjSr)boolrDrnrGr@s r$rz(CheckpointPosition._has_registered_savers !!2277 88r&c|jrC|jjj} t j |j ||Sy#t$r)}t j|r|d|_ Yd}~|Sd}~wwxYw)z)E6 6 77 9dnn E  4WI>!{! %  '??A$4$:$:$<F g '0'D'D'J'J(%  ( ( . .w 7D>>  & - __  ? ?  ,-.M   $==?l(7(K(K //!  + +)-l$%  8 8t L a&?? ""#% T__ %5!6 6D 0123?0145 5/MM -//DDF%)*<=N*O%P"%.N  ()*I IQ   *.N  ()*@ - .nWIQ H II  4??s#56G#HII D01BCDEFLdoo./q2 33 -''(:;CCIN$3#K#K#M 68 !23J)~~"1101BCDI ##45  J ''(BCKK KFr&cx|j|jj}|r|j|r|Syr)_checkpoint_adapterr"save_path_string is_applicable)checkpoint_positionr,adapters r$_maybe_get_adapterrs;  ) )$$55 ' &&y1 N r&c|j}|j}t||}|jjD]}}|j j j|jd}|7|j|j}|j|j|}|j} || jdr| jj} nDt| jxs-| j xs| j"xs| jd} | s|j} |r1|j%|j\} } | r|j'| |j(j+| gj-|W|j/|sk|j-||fy)z>Queues the restoration of trackable's children or defers them.Nhas_checkpoint_valuesrn)r,)r,_trackable_childrenrrDrIr"r3r4rr_lookup_dependency local_nameHasFieldrrgrrEslot_variables maybe_reshardr=_deferred_dependenciesrwrXr)) rrr,trackable_childrenrchildcorrespondencechild_position local_object child_proto has_valuelocal_trackable_namers r$rrs"++) 446 2I >'"//88+;e)33FFJJ tN!(>>u}}MN//0@0@0BDL --K   5 655;;    8%% 8)) 8##$67  $// 3:3H3H4 0  0  5 56F G((33 " &  # #l # ; NL9:W+;r& _DeferredSlotVariableRestorationoriginal_variablerrc |j}|j}|jj|jdD]j}|j ||j |j|j|jr |jnd\}}|X|j||fl|jj|jdD]}|jj|jd}|V|jj!|jgjt#||j|jt%|ds|j |||j|j|jr |jnd\}}||j||fy)z&Queues slot variables for restoration.rNrr)r,r"deferred_slot_restorationspopr#rrrrrArrXslot_restorationsr3r4 optimizer_idrwrhasattr) rrr,r"deferred_slot_restorationrrslot_restorationrs r$rrs!++)"--*$.$I$I$M$M""B%(B 99  % 7 7 % 6 6 % / / #CCE ( ( *M)0-@A#B$%66::""B("D!4488%%t-++66  ' '--3V.$-#3#D#D,668.9 !#E F  ; ;//(( %EEG"** ,m +2MBCE"Dr&chtjdz}|d|j|t|zS)N/)rOBJECT_ATTRIBUTES_NAMEindexrF)rR search_keys r$rrs455;* K--j9C OK LLr&c<d}|j}|j}||vr||}|b|jD]O\}}|j|s| t d|}t |j|z}|j |Qt|r ||S|S)z7Returns the saveable generated from the factory method.NzForward compatibility load error: Unable to load checkpoint saved in future version of TensorFlow. Please update your version of TensorFlow to the version in which the checkpoint was saved.r)rGrRrrrrr2callable)r}r_rmatched_factoryexpected_factory_namefactory_input_name factory_namefactorys r$rr s/ ,00(7700()>?O!3!9!9!;/ g  ) ), 7  & HI I "3  , ,.0<=  ./"o  2 33 r&)-rrjtypingrrrtensorflow.python.checkpointrrrr r tensorflow.python.eagerr tensorflow.python.frameworkr r tensorflow.python.opsrrrtensorflow.python.platformrr6tensorflow.python.saved_modelrtensorflow.python.trackablerrrr!tensorflow.python.training.savingrtensorflow.python.utilrobjectrrrr namedtuplerrrrrr&r$r4s>));8958++.+6(<6,147B2CNCNLhV1;h$:;#9#9&)$ 8DvM &r&