BVh+2dZddlmZdZdZGddeZy)z3Helper library for sharding during TPU compilation.) tensor_shapeceZdZdZdZdZdZdZedZ dZ edZ d Z ed Z d Zd Zd ZddZdZdZy)ShardingPolicyz7An object use to hold the sharding policy for a Tensor.c<d|_d|_d|_d|_y)NrF)_number_of_shards_number_of_partitions_shard_dimension_frozenselfs R/home/dcms/DCMS/lib/python3.12/site-packages/tensorflow/python/tpu/tpu_sharding.py__init__zShardingPolicy.__init__s!!D!"D DDLcj|j |jyd|j|jfzS)NzShardingPolicy(unset)z&ShardingPolicy(%d shards dimension %d))number_of_shardsshard_dimensionr s r__str__zShardingPolicy.__str__"s= $(<(<(D $6$$d&:&:;<=rc|j t|_|jtjt |_yyN)r_DEFAULT_NUMBER_OF_SHARDSr r as_dimension_DEFAULT_SHARD_DIMENSIONr s r_fill_default_valuesz#ShardingPolicy._fill_default_values)s= %8d $*77 "$d%rcL|js|jd|_yy)zPrevents further modification to the sharding policy. Any values that have not been set when freeze is called are set to defaults. If the ShardingPolicy is already frozen, this is a NoOp. TN)r rr s rfreezezShardingPolicy.freeze0s# << !dl rc|jS)zBReturns the number of shards in the policy or None if unspecified.)rr s rrzShardingPolicy.number_of_shards:s  ! !!rc|jr+|j|k7rtd|d|jy|dkDr||_ytd|d)auSets the number of shards for the current policy. If the policy has been frozen then number_of_shards must match the existing setting. Args: number_of_shards: The number of shards to use in the policy. Raises: ValueError: If the policy has been frozen and number_of_shards differs from the frozen value; or number_of_shards <= 0. z!Can't set sharding policy to use z( shards since it has been frozen to use rz shards; value must be > 0N)r r ValueError)r rs rset_number_of_shardsz#ShardingPolicy.set_number_of_shards?s ||  #3 3/0@/AB))-)?)?(@ BC C 4 A !1/0@/AB  ! !rc|jS)zFReturns the number of partitions of the policy or None if unspecified.)r r s rnumber_of_partitionsz#ShardingPolicy.number_of_partitionsYs  % %%rc|jr,|j|k7rtd|d|jdy||_y)aeSets the number of partitions for the current policy. If the policy has been frozen then shard_dimension must match the existing setting. Args: number_of_partitions: The number of partitions to use in the policy. Raises: ValueError: If the policy has been frozen and shard_dimension differs from the frozen value. z"Can't set number_of_partitions to z! since it has been frozen to use .N)r r r)r r"s rset_number_of_partitionsz'ShardingPolicy.set_number_of_partitions^s[ || # #'; ;01E0FG))-)C)C(DA GH H < $8d rc|jS)zAReturns the shard dimension of the policy or None if unspecified.)r r s rrzShardingPolicy.shard_dimensionss   rc|jr*|j|k7rtd||jfzytj||_y)aSets the shard dimension for the current policy. If the policy has been frozen then shard_dimension must match the existing setting. Args: shard_dimension: The shard dimension to use in the policy. Raises: ValueError: If the policy has been frozen and shard_dimension differs from the frozen value, or shard_dimension can't be interpreted as a Dimension. zCCan't set shard dimension to %d since it has been frozen to use %d.N)r r rrr)r rs rset_shard_dimensionz"ShardingPolicy.set_shard_dimensionxs[ ||  / 1 ($*?*?@ AB B 2 +77Hdrc|j|j|j|j|j|jyy)zMerges the policy of another policy into the current policy. Args: other: The policy to merge into this one. Raises: ValueError: If this policy has been frozen and the merge conflicts with the frozen policy. N)rr rr()r others rmergezShardingPolicy.mergesI )  6 67 ( u445)rc~tj|}|j}|j|j|sy||j*t d|jd|jd|jdkDr!||jxx|jzcc<tj|S)avReturns the shape of an unpartitioned Tensor. When given the shape of a 'sharded-size' Tensor, returns the shape of the full shape of its unpartitioned Tensor. Args: shape: The shape of the sharded Tensor. Returns: The shape of the unpartitioned version of the Tensor. Raises: ValueError: if shape has unknown sharded dimension NShape & must have a fixed size for dimension z that is known. r)ras_shapeas_listr r r)r shapedimss rget_unpartitioned_shapez&ShardingPolicy.get_unpartitioned_shapes  ! !% (E ==?D %)C)C)K   D ! !"*  01$$($9$9#::JL MM !!A% 4 !T%?%??!   &&rNc6|j |jy|0|dks||jk\rtd|d|jdt j |}|jdk(r|S|j }|td|d||jkr)td|jd |j|j}||j*td|jd |jd ||j|jzdk7r6td|jd |jd |j||jxx|jzcc<t j|S)ayReturns the shape of a shard of a full Tensor. When given the shape of a 'full-size' Tensor, returns the shape of the sub-Tensor after it has been sharded. Freezes the policy if it has not yet been frozen. Args: shape: The shape of the full-size Tensor to be sharded. shard_index: The index of the shard whose shape should be returned. shard_index can be None for sharding policies that use the same shape for every shard. Returns: The shape of the sharded version of the Tensor. Raises: ValueError: If shard_index is None when shards are of different shapes; or shard_index is not None and !(0<=shard_index(>(F  qK4+@+@@$[M2(() -. .  ! !% (E " l KKE } w&=> ?? %%%  5==?##E  " " # % && ==?D D ! !"*  5==?##I  " " ##G I JJ T " "#d&<&<<B  5==?##6t7M7M6NO""&"7"7!8 : ;;   D$:$::  # #D ))rctj|}|jdk(r|S|j}|t d|d||j kr*t d|j d|j d|j }||j xx|jzcc<tj|S)aJReturn the unsharded shape that would generate a given sharded shape. Args: shape: the sharded shape to unshard Returns: The unsharded shape. Raises: ValueError: if shape is unknown or does not contain self.shard_dimension TypeError: if shape is not convertible to a TensorShape rr-z must be statically known.r5z. Rank is too small.)rr/rr7rr r0r8)r r1r7r2s r_unshard_shapezShardingPolicy._unshard_shapes  ! !% (E " l KKE } w&@A BB %%%  01**.*?*?)@A,- .. ==?D  4#9#99  # #D ))rc |jt||jk7r'td|dt|d|j|Dcgc]}|j |}}t |jdz D]O}||j ||jdz r(td|d|jd|jd|d Scc}w) aReturns the shape of an unsharded Tensor given a list of shards. When given a list of shapes of shards, returns the shape of the unsharded Tensor that would generate the shards. Sets defaults for the policy if number_of_shards or shard_dimension is None. Args: shapes: The shapes of the Tensor shards to be combined. Returns: The shape of the unsharded version of the Tensor. Raises: ValueError: if shapes is not a list of length self.number_of_shards; or any element of shapes is not a valid shape consistent with the sharding policy; or the list of shapes is not a valid sharding of a full shape. TypeError: if an element of shapes is not convertible to a TensorShape zShapes z is length z/ but must be a list of length number_of_shards=rzSharded shapes z3 are not consistent shards of a full shape sharded r6r$r)rlenrrr<rangeis_compatible_withr)r shapessunsharded_shapesis rget_unsharded_shapez"ShardingPolicy.get_unsharded_shape s *  6{d+++  F8;s6{m4%%)%:%:$; = >>9??1++A.?? 4((1, -2 a 3 3 40014 57fX&,,-.--.a 12 22 A @sCr)__name__ __module__ __qualname____doc__rrrrpropertyrr r"r%rr(r+r3r:r<rErrrrs? =$ " "!4 & &8* ! !I, 6'65*n*:"rrN)rItensorflow.python.frameworkrrrobjectrrKrrrNs):5UVUr