Vht_ UddlddlZddlmZmZddlmZddlmZddl m Z da e Z ddd Z d Zd ejfd Zd ejfdZdZGddejZGddej(j*ZGddej(j*ZdZ d#deejdeejd eeejffdZdejdejdejd eeejeejffdZdaeejed<d ejfdZ d$d Z! d$d!Z" d%d"Z#y)&)*N) DispatchKeyDispatchKeySet)is_expandable_to) NestedIntNode)WeakTensorKeyDictionarycoeffcddlm}ddlm}||}t ||r|j |St j|}|5tjtt|}tdz a |t |<|S)Nr FakeTensor)mb_unwrap_functional_tensorr r ) torch._subclasses.fake_tensorr#torch._subclasses.functional_tensorr isinstanceget_nested_int_tensor_symint_registrygettorchSymIntr_tensor_id_counter)tensorr rr tensor_symints T/home/dcms/DCMS/lib/python3.12/site-packages/torch/nested/_internal/nested_tensor.pyget_tensor_symintrs|8O) 0F&*%$$5$11,//7M ]3Eu%MN a*7' c@t||jSN)intitem)funcrs r_get_sdpa_extreme_seqlenr##s tF|  " ##rreturnc.tj|dSNr)rzeros)vals r_store_val_in_tensorr)'s ;;sA rtc |jdSr&shape)r*s r_load_val_from_tensorr.,s 771:rctdi|S)N) NestedTensor)constructor_kwargss r _rebuild_njtr31s  -, --rceZdZUejed<ejed<eejed<eedfed<eedfed<eed<e e e fed<e d d d Z d d fd Zd ZdZdZdZdZedeejfdZedeejfdZedZedZedeefdZedeefdZdZdZdZe de fdZed dZ ed dZ!xZ"S)!r1_values_offsets_lengths._size_strides _ragged_idx_metadata_cacheN)lengthsc bttj}|jtj}|J|j dk(sJt |trJ|j|jk(sJ||n|}t|d}|jdd}|jddz } || |jdk(sJ|dz } | g|jd| ||j| dzd} |j} || | zg| } tjj|| | dtj|j tj"|jd|jddddd||j%j' } || _| | _| | _| S) Nr r r:rF requires_gradsizesT) storage_size)rrr1addAutogradNestedTensorndimrdevicerrr-striderTensor_make_wrapper_subclasscontiguous_formatdtypejaggeduntyped_storagesizer:r8r9)clsvaluesoffsetsr<kwargsks ragged_source ragged_sizer:Brr8rEr9s r__new__zNestedTensor.__new__MsK44 5 VVK44 5"""||q   fl333}}...$+? ' Q? jj2 MM! q    a(( (( !OKV\\"1%K{KV\\!a%'5JK&)+5f5 LL / /     # # LL LL MM  JJ .    //1668! 0 $$  rc <t|||_||_||_|j dxsi|_tjj||jtjj|j|jdz |j j dd}| tjj|d|j j dd}|!tjj|dyy)Nr;r max_seqlenr min_seqlen) super__init__r5r6r7rr;r_dynamomaybe_mark_dynamicr: mark_dynamic)selfrNrOr<rPmax_seqlen_tensormin_seqlen_tensor __class__s rr[zNestedTensor.__init__s     &zz*;<B  ((t/?/?@ ((t7G7G!7KL!0044\4H  ( MM & &'8! < 0044\4H  ( MM & &'8! < )rc,tj|Sr)r_nested_get_valuesr_s rrNzNestedTensor.valuess''--rc|jSr)r6res rrOzNestedTensor.offsets }}rc|jSr)r7res rr<zNestedTensor.lengthsrgrc|j}|dttj|j|j j n |j}t|}||jd<t|SNrX) _max_seqlen_tensorr#rmaxr7r6diffr)r;r.)r_r`max_vals r_get_max_seqlenzNestedTensor._get_max_seqlenm 33  $. (, (= ""$4==G!5W = 1BD  .$%677rc|j}|dttj|j|j j n |j}t|}||jd<t|SNrY) _min_seqlen_tensorr#rminr7r6rmr)r;r.)r_ramin_vals r_get_min_seqlenzNestedTensor._get_min_seqlenrprr$c:|jjddSrjr;rres rrkzNestedTensor._max_seqlen_tensor##'' d;;rc:|jjddSrrrxres rrszNestedTensor._min_seqlen_tensorryrc"|jSr)rores r _max_seqlenzNestedTensor._max_seqlen##%%rc"|jSr)rvres r _min_seqlenzNestedTensor._min_seqlenr}rc8|j}|dSt|Sr)rkr.r_mts r_maybe_max_seqlenzNestedTensor._maybe_max_seqlen"  $ $zt@'grad_fnr8r6r7)r_ grad_fn_strs r__repr__zNestedTensor.__repr__su8<7I7It112 3r  <<&t||n5K#DJJ)r_utils_get_obj_state#_clear_non_serializable_cached_datadictr3r5r6r7r:r;r>_tensor_rebuild_from_type_v2type)r_protostater"r2argss r __reduce_ex__zNestedTensor.__reduce_ex__s ++D1 002%J%$777U  'N * ll}}}}++#33!//  #$ 33dDJe5TUUrc|j|jd}ddg}|j|jd|j|jd|j |jd||fS)N)r> ragged_idxr5r6r7rsrk)r>r:r7appendrsrk)r_ctx inner_tensorss r__tensor_flatten__zNestedTensor.__tensor_flatten__s!//** #J/ == $   ,  " " .  !5 6  " " .  !5 6c!!rrcXddlm}t|dk\rt|dksJ|d}|d}|jdd}|jdd}|jd d} i} ||| d <| | | d <|d } ||n|} t | |r || } | | _t ||||d | | S)Nrr r5r6r7rsrkrYrXrr>)rOr<r>r:r;)rrlenrrnested_int_memor1)rmeta outer_size outer_striderrNrOr<rar`metadata_cacherrRrSs r__tensor_unflatten__z!NestedTensor.__tensor_unflatten__s<=!Q&3}+=+BBBy) +##J5)--.BDI)--.BDI  (+t&v& & HH F F HH : :   >@<&4;;r;D;F;<< < "$''<FL.# $ - ,TCDCFC - -'  668 -T,V, - -  - -  - - -  - - -s9B  / ;B ;!B A7$ B 7B <B  B)r0N)#__name__ __module__ __qualname__rrF__annotations__Optionaltupler DictstrAny staticmethodrVr[rNrOr<rorvpropertyrkrsr|rrrrrrr classmethodrr __classcell__)rbs@rr1r15s \\llu||$$ c?CHo#s(^#  66p48=,. 8 8z#jagged_from_list..s,q177,r zOWhen constructing a nested tensor, all tensors in list must have the same dtypec34K|]}|jywrrDrs rrz#jagged_from_list..s-188-rzQWhen constructing a nested tensor, all tensors in list must be on the same devicec3<K|]}|jywrdimrs rrz#jagged_from_list..s,q1557,szMWhen constructing a nested tensor, all tensors in list must have the same dimz@Cannot construct a nested tensor from a list of zero-dim tensorsNc3:K|]}|dk7yw)rNr0)rrLdr?s rrz#jagged_from_list..s"EtDGuQx{2EszCannot represent given tensor list as a nested tensor with the jagged layout. Note that the jagged layout only allows for a single ragged dimension. For example: (B, *, D_0, D_1, ..., D_N), with ragged * dim.rrDrIrIrDrc3BK|]}|jdz ywr Nr,rr*rs rrz#jagged_from_list..>QWWZ!^,>c3BK|]}|jdz ywrr,rs rrz#jagged_from_list..rr)rYrXrr0)r RuntimeErrorsetrr-rangeanyrcattor'int64rDrcumsumrtrlnested_view_from_values_offsets)rrOrIrD component_dimr* dim_is_raggedrN to_kwargssrYrXret_ntrrr?s @@@rjagged_from_listrs> 7|qWXX s,G,, - 2 ]   s-W-- .! 3 _   s,G,, - 2 [  AJNN$M N  & &QWW &EJ = ! EuEE !U "R  YYwZ!^ 5FI $ ( " ' VYY # #F)) AU[[G 0561QzA~&6v}}&Q&-   >g>>J>g>>J , F G i 'J7s ?H$Hrstartsr<c|jd}t|j|fr:t|j|fr#|j|}|j|}n tdt |jdk\sJd|jd}|t j d|t j|jz}t j||z|d|dz|dzjdg}t |jdkDr!|jdg|jdd} n|jd} d } |jd} t j|ddj| rd } t j|dd jj| rd } |d|dz| k7rd } tt j |j#} tt j$|j#} | rt'| |d|d||dz | | }nt)| ||| | }||| rdfS|fS) zjConstructs a NestedTensor backed by jagged layout from a tensor, starts of sequences, and sequence lengthsrzWhen constructing a jagged nested tensor using narrow(), your start and length must be Tensors that broadcast to input.shape[0]rz;tensor must at least be 2D for the nested narrow op to workr rNTF)rYrX)r-rexpandrrrarangerrDr unsqueezeviewrnermr rlr!rtr'nested_view_from_values_offsets_lengths)rrr< batch_size start_list length_list max_seq_lenoffset_lengthsrOrN is_contiguousorig_dimactual_max_seqlenrYrs rjagged_from_tensor_and_lengthsrsYaJ zm49I }:]]:. nnZ0  U   FLLQEDE,,q/K 5<< :U[[$Nii  ' ^nR0 0;r? B M Ma P G 6<<1R3&,,qr"23RM||AH yyQr"%%h/0  yy2##%((23 qzKN"h. EIIg.3356UYYw',,./J0 71: , gaj !(  9   !(   G]T DD DDr_dummy_instancectUttjdddtjddtjj atS)Nrr)rDrI)rNrO)rr1rr'rrr0rr_nt_view_dummyrHsJ&;;q!F3KK& D  &(  rc d}| t|}d}| t|}tj||td|||Srr)r_nested_view_from_jaggedr)rNrOrrYrXrar`s rrrRs]0<0<  ) )  rc d}| t|}d}| t|}tj||t||||Srr)rNrOr<rrYrXrar`s rr r hs]0<0<  ) ) rc d}| t|}d}| t|}tj||t||||Sr)r)r_nested_from_padded_tensorr)paddedrOrrYrXsum_Srar`s rnested_from_paddedr"~s]0<0<  + +  r)NN)r NN)r NNN)$typingrtorch._Crrtorch._prims_commonr!torch.nested._internal.nested_intrtorch.utils.weakrrrrr#rFr)r.r3r1autogradFunctionrrrListrrrrrrrrr r"r0rrr+s 00;413()($ U\\ .r-5<<r-v  5>>22 (&5>>22&8.   S %,, S ell #S  < %& SlCE LLCE"',,CE9>CE <x '= =>CET+/%,,'. @D.IM.LPr