AVhkWdZddlmZddlmZddlmZddlmZddlmZddlmZddlm Z dd l m Z dd l m Z dd l m Z dd lmZej ej" dde j$de j$fdZdZdZdZdZdZdZej ej& dde j$de j$fdZej ej6 dde j$de j$fdZej ej8 dde j$de j$fdZej<ddZy ) z$Gather operations for RaggedTensors.)dtypes)indexed_slices)ops) tensor_shape) array_ops)gen_ragged_array_ops)math_ops)ragged_array_ops)ragged_math_ops) ragged_tensor)dispatchNparamsindicescD~tj|d||g5tj|d}tj|d}tj||\}}||j j k7r-tj||j j dd}|j j $||j j k\r td ||}tj||j j d }||kr td |j j Fd |cxkr|j j ks'ntd|d|j j t||||cdddS#1swYyxYw)aGathers ragged slices from `params` axis `0` according to `indices`. See `tf.gather` for full documentation. (This version has the same API as `tf.gather`, but supports ragged `params` and `indices`.) Examples: >>> params = tf.constant(['a', 'b', 'c', 'd', 'e']) >>> indices = tf.constant([3, 1, 2, 1, 0]) >>> ragged_params = tf.ragged.constant([['a', 'b', 'c'], ['d'], [], ['e']]) >>> ragged_indices = tf.ragged.constant([[3, 1, 2], [1], [], [0]]) >>> tf.gather(params, ragged_indices) >>> tf.gather(ragged_params, indices) >>> tf.gather(ragged_params, ragged_indices) Args: params: The potentially ragged tensor from which to gather values. Must be at least rank 1. indices: The potentially ragged tensor indicating which values to gather. Must have dtype `int32` or `int64`. Values must be in the range `[0, params.shape[0]]`. validate_indices: Ignored. axis: The axis in `params` to gather `indices` from. batch_dims: The number of batch dimensions. name: A name for the operation (optional). Returns: A `RaggedTensor`, where `output.dtype=params.dtype` and `output.shape=indices.shape + params.shape[1:]` and `output.ragged_rank=indices.shape.ndims + params.ragged_rank`. Raises: ValueError: If indices.shape.ndims is not known statically. RaggedGatherrnamer batch_dimsz rank(indices)) axis_name ndims_nameNz)batch_dims must be less than rank(params)z rank(params))rz0axis must be greater than or equal to batch_dimsrz batch_dims=z% must be between 0 and rank(indices)=) r name_scoper "convert_to_tensor_or_ragged_tensormatch_row_splits_dtypesshaperankrget_positive_axis ValueError_gather)rrvalidate_indicesaxisrrs ^/home/dcms/DCMS/lib/python3.12/site-packages/tensorflow/python/ops/ragged/ragged_gather_ops.pygatherr"!sp^ ~~dNVW,=>6  = =XF>>i!G#;;FGLOFGW]]'''..  --   $ &j ||$v||7H7H)H B CC | d  & & fllN >MM''#f.F.F*GG!K/  - - ,,!33(  *&  % % < <   &"="= = O& ]]1 FOOGf6G6G6M6MNM$$]3MW]]((1,-*3/f#0q#9f }}f  -c |jd|j|jd|s(td|jd|d|j|dkDrt|tj sM|j tdtj j|d|jj}t|tj sM|j tdtj j|d|jj}|jt|j|j|dz |dz S|dkDrt|tj s5|jtj||jd}nt|tj s6tj j|d|jj}t||jtjt!j"|j%|jdd}t'||||dzS|jj( td |dk(sJt+|}t-||j}t/||jj0}||z}t|||dz dS) aJHelper that implements the body for ragged gather() when batch_dims>0. Args: params: The tensor from which to gather values. indices: The indices of values to gather. axis: The axis in `params` to gather `indices` from. batch_dims: The number of batch dimensions. Returns: A potentially ragged tensor. Nzbatch shape from indices z does not match params shape r%zvbatch shape from indices does not match params shape: ragged indices dimension corresponds to uniform params dimension ragged_rankrow_splits_dtypezvbatch shape from indices does not match params shape: ragged params dimension corresponds to uniform indices dimensionrr$)ris_compatible_withr isinstancer r6uniform_row_length from_tensorr:r;r/rr0rrepeat row_lengthsr r=nrowsr-r_flatten_dims_0_and_1 _row_starts_increase_rank_tor1)rrr radjusted_indices flat_params adjustmentss r!r-r-s" kz " 5 5 mmKZ  " #*==*#=v||M NN!^ fm88 9  # # + HI I))55 a'2D2D2J2J6Lf g}99 :  " " * HI I**66 q63D3D3J3J7Lg    w~~taxaH JJ AX g}99 :++   7F$6$6$8! <> : : ;++77 G4F4F4L4L8N    ..0&2D2D2FH IJKQ P !14a HH ]] = >> q&f-+FGMM2+!+w}}/B/BC+{* .q! <0 and batch_dims==0. Args: params: The tensor from which to gather values. indices: The indices of values to gather. axis: The axis in `params` to gather `indices` from. Returns: A potentially ragged tensor. r%rJrr$)rNr r6rPr:r;r/rr0rrrrTrUrVr1)rrr rXrYrWs r!r.r.s AX fm88 9))55 a'2D2D2J2J6Lf   gfmmWdQhJ KK ]] = >> &f-+FGMM2+!+w}}/B/BQ/FG+{* .q! <>'!* % 22rHcht|tjr|jt ||dz St j |}t j|t j|z g|j}t j||gd}t j||S)zEAdds *trailing* size-1 dimensions to `t` until it has the given rank.r%rr^) rNr r6r/rVrronesrr;r`r_)rarold_dimsnew_dims new_shapes r!rVrV:s=--. ==*1dQh7 88q!H~~tinnQ&778(..IH  (H!5A>I   Q **rHc"t||||||S)N)r")rrrrr rs r!_ragged_gather_v1rlEs !14T JJrHc & t|tr|dk7r tdtj|s.tj|st j ||||S|dvr tdtj|d||g5tj|d}tj|d }tj||\}}|j}|j}| td |dk(r td tj|r||jd zk(r tdtj|d}| td|dkDrtj| }|r9tj j#||dz |j$j&}|j)t ||j*} |rFtj| r1| j|dz k(rtj j-| } | cd d d Stj|rJtj|sJ|dk(r|jt j.|j*z} t1|d z D]} t3j4|d}t j6t j|d dt j8| gt:j<gd} t3j>|| cd d d S|d k(r,t j@|dg} tC|| cd d d StEjF||j$j&}t jB|j$|d} | |dz } |jH}t1d|D]} tj|sXt j4| d } t j6| |d| d fgd } t j || ccd d d St jB|jK| } | |d| fz } |jH}tC|| cd d d S#1swYy xYw)aGather slices from `params` using `n`-dimensional indices. This operation is similar to `gather`, but it uses the innermost dimension of `indices` to define a slice into `params`. In particular, if: * `indices` has shape `[A1...AN, I]` * `params` has shape `[B1...BM]` Then: * `result` has shape `[A1...AN, B_{I+1}...BM]`. * `result[a1...aN] = params[indices[a1...aN, :]]` Args: params: A potentially ragged tensor with shape `[A1...AN, I]`. indices: A potentially ragged tensor with shape `[B1...BM]`. batch_dims: Must be zero. name: A name for the operation (optional). bad_indices_policy: A string. If `""` or `"DEFAULT"`, the default behavior is used (error on CPU and ignore on GPU). If `"IGNORE"`, the bad indices are ignored and 0 is stored in the Returns: A potentially ragged tensor with shape `[A1...AN, B_{I+1}...BM]`. #### Examples: >>> params = tf.ragged.constant( ... [ [ ['000', '001'], ['010' ] ], ... [ ['100' ], ['110', '111', '112'], ['120'] ], ... [ [ ], ['210' ] ] ]) >>> # Gather 2D slices from a 3D tensor >>> tf.gather_nd(params, [[2], [0]]) >>> # Gather 1D slices from a 3D tensor >>> tf.gather_nd(params, [[2, 1], [0, 0]]) >>> # Gather scalars from a 3D tensor >>> tf.gather_nd(params, [[0, 0, 1], [1, 1, 2]]).numpy() array([b'001', b'112'], dtype=object) rz7batch_dims != 0 is not supported for ragged gather yet.)rbad_indices_policy)DEFAULTz>non-default bad_indices_policy not supported for ragged gatherRaggedGatherNdrrrNz!indices.rank be statically known.z indices.rank must be at least 1.r%z4The innermost dimension of indices may not be raggedr\z+indices.shape[-1] must be statically known.r]rJr^).r).r%.)&rNintrr r,r gather_ndrrrrrr1rKrdimension_valuer6rPr:r;with_flat_valuesr5 to_tensorrr=r expand_dimsr`rgrint32tiler_r"r rdr0re)rrrrrnrE indices_ndims index_sizeindices_is_denserC params_ndimsrG multiplesflattened_index_tuplesflattened_paramss r!rsrsRszh J $ a N OO  ! !& )]-D-DW-M   d7I . H  ~~d,vw.?@Y>  = =XF>>i!G#;;FGLOFGMMM!''M : ;; 9 ::(,,q00 M NN--mB.?@J D EE q*44W== ,,88 !2#..4496'' &':M:M(NOf }66v>     1 1++55f= IY>Y>P&&w// /  " "6 ** *Q'')..9K9K*LLl}q()>#!--f1=>"" //' "3B ' .., 6$)* +i  " "69 5mY>Y>r q(002$? F2 3wY>Y>D gv'8'8'>'>?g )//0A0A07 A/q*% 3#&&'78#,#8#8$1$. #,#3#3%wsCDy'9:$D $$%57MN NcY>Y>f"+!1!1  ' ' )+A"C'#s("33+22 3$&< =sY>Y>Y>s( FR.C0R('RCR6ARRc"t|||||S)N)rn)rs)rrrrrns r!_ragged_gather_nd_v1rs  gz4rs+.6+4+6*986+ 9../! K6=..K6!//K60K6\;|O=d%=PO3+9++,(,!" Km99K,::K-K9112  X>  ' 'X>  ( (X>3X>v9../    ' '   ( ( 0 n%O&OrH