BVhvdZddlZddlmZmZddlmZddlmZGddZ Gdd ejZ y) z(Experimental API for checkpoint adapter.N)ListOptional)tensor)baseceZdZdZdefdZdeejdeedejfdZ de eeeeffdZ y) ReshardCallbackzAPI to reshard a checkpoint value during restore. When a ReshardCallback is attached to a CheckpointPosition, the restored value of the checkpoint position is resharded based on this callback. returncy)zReturns the local name of the object being restored. Override this method when the local name of object is different than in the checkpoint. N)selfs _/home/dcms/DCMS/lib/python3.12/site-packages/tensorflow/python/checkpoint/checkpoint_adapter.py object_namezReshardCallback.object_names checkpoint_valuesshape_and_slice_specc@~t|dk7r td|dS)azReshards the checkpoint values as read from the checkpoint file. Override this to reshard/modify the restored values Args: checkpoint_values: The values returned by the restore op, as read from file. shape_and_slice_spec: The shape and slice spec required by the caller. Returns: List of restored Tensor values after being resharded. z2Default reshard expects a single checkpoint value.r)len ValueError)r rrs r reshardzReshardCallback.reshard&s,  " K LL Q rc|g|gfS)a<Updates the specs to restore op. Override this method if the arguments to restore op need to be updated as per the resharding required. Args: checkpoint_key: The cehckpopoint key as requested by the caller shape_and_slice_spec: The shape and slice spec as requested by caller Returns: Tuple of list of checkpoint_keys and specs that the restore op should fetch as per the resharding requirement. The length of checkpoint keys returned by this method will match the length of checkpoint_values that are input to `reshard`. r )r checkpoint_keyrs r update_restore_inputsz%ReshardCallback.update_restore_inputs<s" 34 55rN) __name__ __module__ __qualname____doc__strrrrTensorrtuplerr rr rrsd 3 fmm, !I }}  ,6 T#YS !"6rrceZdZdZeej defdZej de jde fdZ ej dede efdZdedeee effd Zy ) AbstractCheckpointAdapterzAbstract API for checkpoint adapter. This is an experimental API that specifies how checkpoint restore should be adapted for specific trackable objects. pathcy)zdCreate factory to create an Adapter from checkpoint. Args: path: Path to checkpoint. Nr )clsr#s r create_from_checkpointz0AbstractCheckpointAdapter.create_from_checkpointWr trackabler cy)aReturns whether the adapter is applicable to trackable for resharding. Args: trackable: A Trackable object that is being restored. Returns: A Boolean indicating if the checkpoint value for this Trackable should be resharded. Nr )r r(s r is_applicablez'AbstractCheckpointAdapter.is_applicable`r'rnamecy)z;Returns the reshard callback for the trackable with `name`.Nr )r r+s r get_reshard_callbackz.AbstractCheckpointAdapter.get_reshard_callbacklr'rc||j|}||dfS|jr|j|fS||fS)z>Returns the updated name and ReshardCallback applicable to it.N)r-r)r r+callbacks r maybe_reshardz'AbstractCheckpointAdapter.maybe_reshardpsL((.H 4Z  ! ! #X -- >rN)rrrr classmethodabcabstractmethodrr&r Trackableboolr*rrr-r r0r rr r"r"Ps  T^^   FsFx/HFFc8O3L.L(Mrr") rr2typingrrtensorflow.python.frameworkrtensorflow.python.trackablerrABCr"r rr r:s1/ !.,6666r''r