Vh ddlmZ ddlZddlZddlZddlZddlZddlZddlZddl Z ddlm Z m Z ddl m Z mZmZddlZddlmcmZddlmZmZmZmZmZmZmZmZddlmZerddlmZej@e!Z"ej$jGe!dZ$gd Z%dd l&m'Z(d Z)Gd d Z*idejVdejXdejZdej\dej\dej^dej`dejbdejddejfdejhdejjdddejldejndejpdejrid ejtd!ejvd"ejxd#ejzd$ejzd%ej|d&ej|d'ej~d(ejd)ejd*ed+ed,ed-ed.ed/ejd0ejZChd1ZDd2ZEd3ZFeFD]JZGd4eGZHd5eHZIeJe*eHeEeGeKeeIeCeH<eDj[eHe%jeHLdhZMeDeMzZNhd6ZOhd7ZPdhZQeOeQzZRhd8ZSdd#hZTdd#d9ZUhd:ZVeFD]ZGd4eGZHeVj[eHhd;ZWhd<ZXd=ZYd>ZZd?Z[d@Z\dAZ]dBZ^dCZ_dDZ`dEZadFZbdGZc dpdHZddIZedJZfedejejte\e]e^e_eee`efeYeZe[eaebdKZgdLZhdMZidNZjdOZkdPZldQZmdRZndSZodTZpdUZqdVZrdWZsdXZte je!ZvdYZweFD]'ZGdZeGZxeweGZyexxey_zey_!eJevexey)[y[G[xd[Z{dqd\Z|d]Z}d^Z~iegid.ejdejVdeld!emdendeodepdeqdeidejd*e}dekd"ejxd-erd,esd+etde{e|e~d_ZeFD]ZGd4eGZHeKevdZeGeeH<[G[H[F[vd`ZdaZdbZdcZddZdeZdfZdgZeeeeeedhZejejdiZdjZdkZdlZdmZdnZej%D]\ZZeeeej%D]\ZZeeedoZej%D]I\ZZeeOvr eeeeeSvr eee"eeQvseePvr eeeeeeeeUvsAeeeK[[y)r) annotationsN) lru_cacheupdate_wrapper)Optional TYPE_CHECKINGUnion) sym_floatsym_itesym_maxsym_minsym_notSymBoolSymFloatSymInt)dtrace_structured)ShapeEnvsym_node)SymNodemethod_to_operator magic_methods) py_sym_typescZ|turtS|turtS|turt S|SN)boolrintrfloatr)ts N/home/dcms/DCMS/lib/python3.12/site-packages/torch/fx/experimental/sym_node.py _to_symtyper:s+DyCx Ez HceZdZUdZdZded< dY dZdZd[dZd\dZd]d Z e d Z e d Z d Z d^d ZdZdZdZdZdZdZdZdZdZdZdZdZdZdZd_dZd`dZd`dZd^d`dZ d`d Z!d`d!Z"d`d"Z#d`d#Z$d`d$Z%d`d%Z&d`d&Z'd`d'Z(d`d(Z)d`d)Z*d`d*Z+d`d+Z,d`d,Z-d`d-Z.d`d.Z/d`d/Z0d`d0Z1d`d1Z2d`d2Z3d`d3Z4d`d4Z5d`d5Z6d`d6Z7d`d7Z8d`d8Z9d`d9Z:d`d:Z;d`d;Zd`d>Z?d`d?Z@d`d@ZAd`dAZBd`dBZCd`dCZDdDZEdEZFdFZGdGZHdHZId`dIZJdJZKdKZLdLZMd`dMZNdadNZOdOZPdPZQdQZRdRZSdSZTdTZUdUZVdVZWdWZXdXZYy)brz This is a type erased SymInt/SymFloat which we use to do actual operations. End users don't touch this. Magic methods are NOT defined on this object. Fr_optimized_summationNc|_|_|_|_fd}|t ||us,t |t |usJd|dt |jrCjj r-|} || k(s!J|d| djd|}|_|_ jxrjj } | xr|_ y)Ncddlm}|jryjj jd}|#t |t sj|n|}|S)Nr)has_free_unbacked_symbolsT) compute_hint)%torch.fx.experimental.symbolic_shapesr%expr shape_env_maybe_evaluate_static isinstanceSymTypespytype)r%hintselfs rr&z&SymNode.__init__..compute_hintsZ W)3>>88QU8VD0:40Jt{{4(PTKr zCannot create SymNode of type z with incompatible hint of type z != z (for )) _exprr)r-r"typer_translation_validation_enabledr(_hintconstantfx_node) r/r(r)r-r.r5r6optimized_summationr& computed_hinttx_validation_ens ` r__init__zSymNode.__init__Vs " $7!:   :'4:V9L+L 0(:4:,H L~~$.."P"P!- M)BV4 fTYYKqAB) >D ;C NN Mt~~MM (3G r ct|j||j|j|j|j Sr)rr1r-r4r5r6)r/r)s rwith_shape_envzSymNode.with_shape_envs0 JJ 4;; DMM4<<  r c |j|jk(xrj|j|jk(xrO|j|jk(xr4|j|jk(xr|j|jk(Sr)r1r-r4r5r6r/others r _value_eqzSymNode._value_eqsq JJ%++ % . u||+ . ekk) . / .  -  r ct|j|j|j|j|j fSr)hashr1r-r4r5r6r/s r _value_hashzSymNode._value_hashs,TZZdjj$--VWWr cL|jj|jSr)r)replacer1rCs rr(z SymNode.exprs~~%%djj11r c|jSrr4rCs rr.z SymNode.hints zzr c|jduSrrHrCs rhas_hintzSymNode.has_hintszz%%r crddlm}|j|n||j}|jjDcic]"}|||vrdn|j j |$}}|jj|S|j j|jS|jScc}w)Nrfree_unbacked_symbolsi) r'rMr4r( free_symbolsr) var_to_valxreplace size_hint)r/fallbackrMunbacked_symbolss replacementss r require_hintzSymNode.require_hintsO :: #$9#C "YY33 q$44t$..:S:STU:VV   yy)),77>>++DII6 6zz s'B4cZ|jjrt|jSyr)r( is_numberrrCs r maybe_as_intzSymNode.maybe_as_ints 99  tyy> !r cvddl}t|j|jrt |jSyNr)sympyr+r(Floatrr/r\s rmaybe_as_floatzSymNode.maybe_as_floats) dii -# #r cpddl}|j|jury|j|juryy)NrTF)r\r(truefalser^s r maybe_as_boolzSymNode.maybe_as_bools. 99 " YY%++ %r c&|jtuSr)r-rrCs ris_intzSymNode.is_ints{{c!!r c&|jtuSr)r-rrCs ris_floatzSymNode.is_floats{{e##r c&|jtuSr)r-rrCs ris_boolzSymNode.is_bools{{d""r c|jduxr@t|jtxr$|jjj Sr)r4r+rnode is_nested_intrCs rrlzSymNode.is_nested_intsA JJd " 04::v. 0 --/ r ct|tusJddl}t|j ||j t|||SNr)r5r6)r2rr\rIntegerr)r/numr\s rwrap_intzSymNode.wrap_ints?CyC MM# S3PS  r ct|tusJddl}t|j ||j t|||Srn)r2rr\rr]r)rps r wrap_floatzSymNode.wrap_floats?CyE!!! KK dnneS3PS  r ct|tusJddl}t|r |jn |j |j t|||Srn)r2rr\rrarbr)rps r wrap_boolzSymNode.wrap_boolsFCyD   EJJ5;; NN     r c|SrrCs rclonez SymNode.clone%s r c|jSr)r(rCs rstrz SymNode.str(s))r c"|jSrr{rCs r__str__zSymNode.__str__+sxxzr czd|jd|jd|jg}|j|j d|j|j |j d|j |j |j d|j dj|dzS) NzSymNode(z , shape_env=z , pytype=zhint=z constant=zfx_node=z, r0)r1r)r-r4appendr5r6join)r/reps r__repr__zSymNode.__repr__.stzzl,t~~.>i } U  :: ! JJtzzl+ , == $ JJ4==/2 3 << # JJ$,,0 1yy~##r c"|jSrr}rCs r _graph_reprzSymNode._graph_repr:sxxzr c"|jSr)_absrCs rabsz SymNode.abs@yy{r c"|jSr)_posrCs rposz SymNode.posCrr c$|j|Sr)_round)r/ndigitss rroundz SymNode.roundFs{{7##r c"|jSr)_truncrCs rtruncz SymNode.truncI{{}r c$|j|Sr)_addr>s raddz SymNode.addLyyr c$|j|Sr)_subr>s rsubz SymNode.subOrr c$|j|Sr)_mulr>s rmulz SymNode.mulRrr c$|j|Sr)_modr>s rmodz SymNode.modUrr c$|j|Sr) _float_powr>s r float_powzSymNode.float_powXsu%%r c$|j|Sr)_pow_by_naturalr>s rpow_by_naturalzSymNode.pow_by_natural[s##E**r c$|j|Sr)_and_r>s rand_z SymNode.and_^szz%  r c$|j|Sr)_or_r>s ror_z SymNode.or_arr c$|j|Sr)_float_truedivr>s r float_truedivzSymNode.float_truedivds""5))r c$|j|Sr) _int_truedivr>s r int_truedivzSymNode.int_truedivg  ''r c$|j|Sr) _int_floordivr>s r int_floordivzSymNode.int_floordivj!!%((r c$|j|Sr)_lshiftr>s rlshiftzSymNode.lshiftm||E""r c$|j|Sr)_rshiftr>s rrshiftzSymNode.rshiftprr c"|jSr)_sym_notrCs rr zSymNode.sym_nots}}r c$|j|Sr)_eqr>s reqz SymNode.eqvxxr c$|j|Sr)_ner>s rnez SymNode.neyrr c$|j|Sr)_gtr>s rgtz SymNode.gt|rr c$|j|Sr)_ltr>s rltz SymNode.ltrr c$|j|Sr)_ler>s rlez SymNode.lerr c$|j|Sr)_ger>s rgez SymNode.gerr c"|jSr)_floorrCs rfloorz SymNode.floorrr c"|jSr) _is_integerrCs r is_integerzSymNode.is_integers!!r c"|jSr) _sym_floatrCs rr zSymNode.sym_floats  r c"|jSr)_sym_intrCs rsym_intzSymNode.sym_intrr c"|jSr)_ceilrCs rceilz SymNode.ceilszz|r c"|jSr)_negrCs rnegz SymNode.negrr c$|j|Sr)_sym_minr>s rr zSymNode.sym_min}}U##r c$|j|Sr)_sym_maxr>s rr zSymNode.sym_maxrr c&|j||Sr)_sym_ite)r/then_valelse_vals rr zSymNode.sym_ites}}Xx00r c&|j||Sr)_is_contiguousr/sizesstridess r is_contiguouszSymNode.is_contiguouss""5'22r c&|j||Sr)_is_channels_last_contiguous_2drs ris_channels_last_contiguous_2dz&SymNode.is_channels_last_contiguous_2d33E7CCr c&|j||Sr)_is_channels_last_contiguous_3drs ris_channels_last_contiguous_3dz&SymNode.is_channels_last_contiguous_3drr c&|j||Sr)_is_channels_last_strides_2drs ris_channels_last_strides_2dz#SymNode.is_channels_last_strides_2d00@@r c&|j||Sr)_is_channels_last_strides_3drs ris_channels_last_strides_3dz#SymNode.is_channels_last_strides_3drr c&|j||Sr)'_is_non_overlapping_and_dense_indicatorrs r&is_non_overlapping_and_dense_indicatorz.SymNode.is_non_overlapping_and_dense_indicators;;E7KKr c$|j|Sr)rr>s rsym_orzSymNode.sym_orrr c$|j|Sr)rr>s rsym_andzSymNode.sym_andrr c$|j|Sr) _bitwise_andr>s r bitwise_andzSymNode.bitwise_andrr c$|j|Sr) _bitwise_orr>s r bitwise_orzSymNode.bitwise_ors&&r c$|j|Sr)rr>s rtruedivzSymNode.truedivrr c$|j|Sr)rr>s rfloordivzSymNode.floordivrr c$|j|Sr)rr>s rpowz SymNode.pows~~e$$r cX|j||jt|dS)N)rrto_noders ris_non_overlapping_and_densez$SymNode.is_non_overlapping_and_denses)::5'JMMgVZ\]N^__r c&|jddSNr) guard_intrCs rint_z SymNode.int_s~~b!$$r c ddl}ddlm}m}|r3t ||t j td|DfiS|Dcgc]}|j}}|j|}g}d} |D]+}|jn(|j|j-t|} |jjt j td|Df\} } t||jt | | Scc}w)Nrget_proxy_modehandle_sym_dispatchc32K|]}t|ywr) wrap_node.0as r z"SymNode.sym_sum..s6A9Q<6sc34K|]}|jywrr6r&s rr)z"SymNode.sym_sum..s!:!))!:sr+)r\"torch.fx.experimental.proxy_tensorr"r#rtorchsym_sumtupler(Addr.rsumr)_create_fx_call_functionrr) r/argsr\r"r#r(exprsout size_hintsout_hintr6_s rr.zSymNode.sym_sums  #MM6668 "&&A&&eii  'Avv~   aff % ' :H^^<< MME!:T!::<  sDNNC7KK#'s D c:|jj||Sr)r)evaluate_sym_node)r/size_obliviouss revaluatezSymNode.evaluates~~//nEEr c|j} t|S#t$rtj d|wxYw)NzFailed to convert to int: %s)r<r Exceptionlogwarningr/fileliners rrzSymNode.guard_ints> MMO q6M  KK6 :   !>c|j} t|S#t$rtj d|wxYw)NzFailed to convert to float: %s)r<rr>r?r@rAs r guard_floatzSymNode.guard_float s> MMO 8O  KK8! <  rEc|j} t|S#t$rtj d|wxYw)NFailed to convert to bool: %sr<rr>r?r@rAs r guard_boolzSymNode.guard_bools> MMO 7N  KK7 ;  rEcddlm}|jr:||js(|jj s|j ||S|jj|j|d||jS)NrrL:r+) r'rMrJr(r)+prefer_deferred_runtime_asserts_over_guardsrKdefer_runtime_assertr6)r/rBrCrMs r expect_truezSymNode.expect_truestO MMO)$))4NNNN??4. . ~~22 II$q'3  r cddlm}|j|jd}|j ||}|r!|j s|t ||S)Nr)_advise_is_size)r'rRrrrrPrJr)r/rBrCrRbrDs r expect_sizezSymNode.expect_size1sJI GGDMM!$ % MM$ % T]]_ F4L )r c|jd} t|S#t$rtj d|wxYw)aN Like guard_bool, but if we encounter unbacked symbols, if those symbols are size-like, we will treat them as >= 2 for the purposes of the analysis. This CHANGES the runtime semantics, but all size-oblivious sites have been audited to ensure that the runtime semantics don't change in a material way. Acceptable runtime semantic changes are, e.g., squeeze() no longer dropping an unbacked one size, or a tensor reporting as non-contiguous even if it's contiguous if it would have been reported contiguous due to being empty. T)r;rIrJrAs rguard_size_obliviouszSymNode.guard_size_oblivious?sC MMM . 7N  KK7 ;  s !Ac&|jddSr)rKrCs rbool_z SymNode.bool_Ssr1%%r cy)NTrxrCs r is_symboliczSymNode.is_symbolicVr cyrrxrCs r nested_intzSymNode.nested_intYr[r cy)NFrxrCs r is_constantzSymNode.is_constant\sr )NNF)r.z!Optional[Union[int, float, bool]])r)rreturnr)r?rr`r)r`rr)r`z builtins.str)r`r)F)Z__name__ __module__ __qualname____doc__r"__annotations__r:r<r@rDpropertyr(r.rJrVrYr_rcrergrirlrrrtrvryr{r~rrrrrrrrrrrrrrrrrrrr rrrrrrrrr rrrr r r rrrrrrrr r rrrrrrr.r<rrGrKrPrTrVrXrZr]r_rxr rrrGs"'$&!P4 0 P4d  X22&0"$#      $ $    &+! *()##"!$$13DDAAL (')(%`%#LJF $ (&r rrrrandr rrrrrrrrc"|jSr)rxs rrkns ALLNr rrrrrrrorrrrrrrr r r r r rr> rrrrrrrr r cfd}|S)Nc,t|dS)N_sym_)getattr)r/names rfnz_get_sym_node_fn..fns,wtuTF^,..r rxrqrrs` r_get_sym_node_fnrts/ Ir ) sqrtcoscoshsinsinhtantanhasinacosatanlog2sym_r8>rlrgr r >rrr>rrsym_log2r)r r>rr rr>rrrr> rrrrrrrlrgr rrc ddlm}|||S)Nr) FloatTrueDiv)torch.utils._sympy.functionsr)r(rSrs r_sympy_float_truedivr9 1 r c ddlm}|||S)Nr) IntTrueDiv)rr)r(rSrs r_sympy_int_truedivrs7 a r c ddlm}|||S)Nr)FloorDiv)rr)r(rSrs r_sympy_floordivr5 Aq>r cfddlm}m}|jr|jr |||S|||S)NrMod PythonMod)rrris_nonnegative)r(rSrrs r _sympy_modrs.;A,,1ayAr c ddlm}|||S)Nr) PowByNatural)rr)r(rSrs r_sympy_pow_by_naturalrrr c ddlm}|||S)Nr)FloatPow)rr)r(rSrs r_sympy_float_powrrr c.ddl}|j||Sr[)r\Andr(rSr\s r _sympy_andr s 99Q?r c.ddl}|j||Sr[)r\Orrs r _sympy_orr 88Aq>r c ddlm}|||S)Nr)LShift)rr)r(rSrs r _sympy_lshiftr3 !Q<r c ddlm}|||S)Nr)RShift)rr)r(rSrs r _sympy_rshiftrrr c`t|dk(r|gSddlm}m}||d||kr||gzS||d||kDr|g|zSdt|dz }}||kr9||zdz}|j |||}|dk(ry|dkr|dz}n|dz }||kr9|j |||S)zs If new_arg is found in ordered_args None is returned, else the new ordered_args with new_arg inserted r) _args_sortkeyBasicrN)lensympy.core.basicrrcompareinsert) ordered_argsnew_argsort_keyrlowhighmidcompare_results r_binary_search_insert_argr%s  <AyA R !HW$55wi'' Q 8G#44y<''3|$q(C +Tza|C'8'B Q  a 'C7D +W% r c ddl ddlm} fd}ddlm}|||z}|||z}|r|r||j d||j dkr||j |j zS||j d||j dkDr||j |j zS|r5|j r)tt|j |}|||S|r5|j r)tt|j |}|||S j||}|||fS)a Custom optimization for Add used to optimize incremental binary summations of certain properties. The idea is when we know the expression is a summation of unique symbols all we need to know is the correct order of symbols, and no other optimizations are needed. We pass evaluate=false, with the correct order of args and save the following. 1. Avoid running other optimizations when the Add is constructed. 2. Manually figure out the order of the args for the new expression in log(n) comparisons instead of nLog(n) (comparing terms is expensive and shows in the profiles). The function returns a tuple of (1) a boolean that indicates whether the output is a summation of unique symbols, (2) the result sympy expression. rN)rc0j|ddi}d|fS)Nr<FT)r0)rresultr\s rmake_optimizedz&_optimized_add..make_optimizedWs"L959f~r )_is_symbols_binary_summationr) r\rrrr_args is_symbolrlistr0) lhsrhslhs_is_optimized_summationrhs_is_optimized_summationsortkeyrrnew_argsrr\s @r_optimized_addrGs29J">s"CC">s"CC!&@ 399R= !GCIIaL$9 9!#))cii"78 8 399Q< 7399R=#9 9!#))cii"78 8"cmm,T#))_cB  !(+ +"cmm,T#))_cB  !(+ + YYsC F ( 0& 99r c ddlm}|||S)Nr)BitwiseFn_bitwise_and)rr)r(rSrs rr r xsB A &&r c ddlm}|||S)Nr)BitwiseFn_bitwise_or)rr)r(rSrs rrr~sA 1 %%r )rrrrrrrgr rlrrrrrrcddl}t||jrf|j}t |dk(rLt|d|j r3|dj r$|j|d}|d|k(r||dzSt||j r||j|k(st||jr|j|S||S)Nrrr)r\r+Mulr3rr]rro)r(rrr\aacoefs r_floor_ceil_helperrs!UYY VV r7a.fns1+Mwu{{))33~dV5LMaPPr rxrss` r_get_sym_math_fnrsQ Ir _sympy_c,ddl}|j|Sr[)r\Abs)r(r\s r _sympy_absrs 99Q<r c8ddlm}m}|||S|||S)Nr) RoundDecimal RoundToInt)rrr)numberrrrs r _sympy_roundr s"E&!!FG,,r cddlm}||SNr)ToFloat)rr )r(r s r_sympy_sym_floatr s4 1:r cdddl}ddlm}|j||j ||Sr )r\rr rr)r(r\r s r_sympy_is_integerrs&4 88GEKKN+Q //r )rrc `t|}t||tt|dz ddS)Nrr)rsympy_is_contiguous_genericrrange)rrdims rsympy_is_contiguousrFs, e*C &ugtE#'2re >g >>r )rrrrrr)r r ct|tr |jSt|tur|j |St|t ur|j|St|tur|j|StSr) r+r,rkr2rrvrrrrrtNotImplemented)r/rqs rrrsn#x xx cd ~~c"" cc }}S!! ce s##r ct|tr|j |jS|jr t |S|j r t |S|jr t|Std|)Nzunrecognized return type ) r+rr5rerrgrrirAssertionErrorris rr%r%sk!W!**"8zzxxzay { qz8<==r ct|Sr)METHOD_TO_OPERATOR)methods rrrs f %%r cltdtvrd}n}d d}fd}|fd}|fd}tvrttd||ydk(rfd}ttd||yd k(rd fd }ttd||yttd||y) Nr8cLddl}|jj|jj|jj j |g}ddl}|Dchc]}tj|c}|jjjzdhzScc}w)Nrz) r-_dynamo eval_framerfx experimentalrtorch._dynamo.guardsinspectgetfileguardsuninteresting_files)r-modsr's rrCz-_make_node_magic..uninteresting_filess MM $ $ MM   HH ! ! * *    $*. .AW__Q  .mm""668 9l  .sB!cHtjdfd }|S)Nc| |n ||tjjjr#|||gn|gdfd t dfdS)Ncddl}|jyt|tk(ryt|j|j |j fry|j|j|jfvryt|Sr[) r\r5idr+r(ror]rarb)rr\rs rget_idzM_make_node_magic..capture_provenance..wrapper..get_idsl ((4#HF3##HMMEMM5;;3OP#!5::u{{*CC#h<'r expression_createdc ttDcgc] }t|c}Dcgc]}| |c}tjdtjddScc}wcc}w)Nr)r7r result_id arguments argument_ids user_stackstack)r{rH structuredget_user_stackget_framework_stack)r(irMrIr7rs rrkzO_make_node_magic..capture_provenance..wrapper.. sv"("%f+%'Z6?%@c!f%@/8)*+F1I.capture_provenance..wrappersc}DD%~~''==$!%u I!%I ("( ! Mr r) functoolswraps)rrrYr7s` rcapture_provenancez,_make_node_magic..capture_provenances&  (  ( Tr c Dddlm}m}t}d}|j)|j||j|j}t j }|r'|%t||t|t|S|r(t|||t|t|fiSt|tsJd} dk(rddl m }m } |j} |jj s(| j#|jj$dk\r\|jj s(| j#|jj$dk\r||j|j} nw| |j|j} nYdk(r7|j|j|j&|j&\}} n|j|j} t.j1d|j|j| t2vrt4} nFt6vrt8} n7|j:t4us|j:t4urt4} n |j:} | |t|t<s| |}|jj?||j@|j@f\} }t| |j| || | }|S#t($r.t*j-d|j|jwxYw) Nrr!Frrrfailed to eval %s(%s, %s)z%s %s %s -> %s)r6r7)!r,r"r#rr. alternate_impl_if_hinted_methodsgetrr%r+rrrrr)r(r bound_sympylowerr"r>r?r@ sym_node_logdebugalways_float_magic_methodsralways_bool_magic_methodsrr-r,r2r6)r/r?r"r#opr7alternate_implr7rrr)r5r-r6r8rfuncr7s rbinary_magic_implz+_make_node_magic..binary_magic_impls   ' 99 UZZ%;$))UZZ0H9==fE h24 $5AQ!RS S  )"y %@P.QSUV %)))# G!NN II,, ,,TYY7==BJJ-- ,,UZZ8>>!Cdii4C#DIIuzz:C5-1IIJJ--.. .*$c499ejj1 +VTYY CP / /F 0 0F [[E !U\\U%:F[[F  $x2h'H^^<< u}}-   NN   3   U  KK3VTYY S  s D*K((7Lc ddlm}m}t }|rt |||t |fiS|j } dk(s dk(r|jj|}  |}tjd ||d}|j||j} tvrt }n* t"vrt$}n t&vrt(}n |j*}|jj-||j.f\}} t1||j|||S#t$rtjd |wxYw)Nrr!rceilingzfailed to eval %s(%s)z %s %s -> %sr+)r,r"r#rrr%r(r)_simplify_floor_divr>r?r@rcrdr.always_int_magic_methodsrrfrrerr-r2r6r) r/r"r#rgr(r5r7r-r6r8rir7s runary_magic_implz*_make_node_magic..unary_magic_implys3   '  4!4R)D/9KR!PQ Qyy W ) 3>>55d;D t*C =$c: 99 $))}H - -F 0 0F 1 1F[[F^^<  s ,D))"E r c ddlm}m}|jr |jn |j}|r6t ||t t |t |t |fiS  |j|j|j}|jjt |j|j|jf\}}t||j|j||S#t$r9tjd |j|j|jwxYw)Nrr!zfailed to eval %s(%s, %s, %s)r+)r,r"r#r.rr r%r(r>r?r@r)r2r6rr-) pred_node then_node else_noder"r#r7r5r6r8rir7s r sym_ite_implz&_make_node_magic..sym_ite_impls  *3y~~Y^^H'%i0%i0%i0    9>>9>>9>>J#,,EE)++Y->-> @Q@QRJGQY(()*:*:Hg   3NNNNNN  s ,(C<rc (ddlm}m}tj}|rt |||t ||fiS|j}  ||}|t}n |j}d}|j||j|}|jg} || j||j j#|t%| \} } t'||j ||| S#t$rtjd ||wxYw)Nrr!z!failed to eval %s(%s, ndigits=%s)r+)r,r"r#builtinsrrr%r(r>r?r@rr-r.r6rr)r2r/r)r/rr"r#rgr(r5r-r7r3r6r8rir7s r round_implz$_make_node_magic..round_impls   B-b9T?G2LbQ99D 4) Hyy$dii1LL>D" G$@@U4[QJGQ3'R R1  ?wW s C..#D)r`zset[str]r)r2magic_methods_on_operator_with_trailing_underscore unary_methodssetattrr) r7ri method_attrrCr\rjrortrws `` r_make_node_magicr|s 9S>$ D CCl   ",\\\|"O"OH1[M*,<= 9 & P 1[M*L9 7 ' SR 1[M*J71[M*,=>r cfd}ttd|fd}ttjt s#ttjt |yy)Nc "ddlm}m}ttj t }|rDt||||Dcgc] }t|c}|Dcgc] }t|c}fiS|Dcgc]}|j}}|Dcgc]}|j}} ||} g} d} |D]+}|jnX| j|j-g} |D]+}|jn&| j|j-|| | } jdrt } nt"} t%| |j&| | Scc}wcc}wcc}wcc}w#t$rtjd||wxYw)Nrr!r^ _indicator)r,r"r#rpsysmodulesrarr%r(r>r?r@r.rendswithrrrr))r/rrr"r#rgrT size_exprs stride_exprsr5r6r7 stride_hintsr-rir7s rsizes_strides_implz4_make_node_sizes_strides..sizes_strides_impls S[[*F 3  #,12qil274SaYq\4ST ',,aff, ,(/010 0 z<0C   8Avv~   aff % 8 L 866>##AFF+ 8 j,7 ??< (FFsDNNFH==E34S-0  KK3VZ V  s#EE:E!E&) E++#Fr8c "ddl}ddlm}tj||D]~}t |t stt|j|Dcgc]}t|j|c}|Dcgc]}t|j|c}cSdk(r |||St|Dcgc]}|j|c}|Dcgc]}|j|c}Scc}wcc}wcc}wcc}w)Nr)!eval_is_non_overlapping_and_denser) r\r'r itertoolschainr+rr%rprkrrsympify)rrr\rr(rSrir7s rsizes_strides_userz4_make_node_sizes_strides..sizes_strides_user3s 0 A!V$ +GAFFF+5:;+;5<=+=  = =4UGD D/45!U]]1%5/67!U]]1%7 <=67sC=8D<D D )rzrhasattrrrra)r7rirrs`` r_make_node_sizes_stridesrsS.>` Gq\#56 6 3;;x(& 1 H%v/AB 2r c  tvrd n dd d tvrd nd fd fd} fd} fd }tvrt|d d |ytvr$t |}t|t ||yd k(r fd }t|d d |yd k(rd fd }t|d d |y}tvr t}t|d |d |tvrt|d|d |yy)Nrct|tttfr|St|tr|j j ddStd)Nrrz*expect to be called with constant SymBools)r+rrrrrkrKr4ris r get_constantz&_make_user_magic..get_constantbsE a#ud+ ,H a !66$$R+ +IJJr ct|tttfryt|tt t fr|jjSy)NTF) r+rrrrrrrkr_ris rr_z%_make_user_magic..is_constantis= a#ud+ , a&(G4 566%%' 'r ct|tr-t|jj t |S|S)z;Implements True+True=2, which works in python but not sympy)r+rrrkrrrris rpromotez!_make_user_magic..promotes-!W%affooc!f566Hr c|Srrxris rrz!_make_user_magic..promotesHr cdvr||fSt|ttjf}t|ttjf}|s|r.|stj|}|stj|}||fS)N)rrrrrrrr r rrrrrr)r+rr-rr )r/r?f_selff_otherr7s rpromote2z"_make_user_magic..promote2sy   $; D5%.."9:UUENN$;< Wt,.U{r c|}|rt|Stt|jSr)rr%rprk)r/rr_r7r{rs rroz*_make_user_magic..unary_magic_implsHt} t .&v. T0BC C8K8:;;r c t|ttttt t fstStjd|||}|} ||\}}|rt||S|r|}t|j|}|turtStt|j|}|r|S|S)NzMAGIC %s %s %s)r+rrrrrrr2rcrdrrrkr%rp r/r? other_noderetrr_r7r{rrs rrjz+_make_user_magic..binary_magic_impls%#udFHg!NO! !+VT5At}tU+ e t .&v. T0BEJ J u  'ETYY.  '! !7 ;7 CD$/$4|C =#=r c t|ttttt t fstS|}|} ||\}}|rt||S|r|}t|j|}|turtStt||j}|r|S|Sr) r+rrrrrrr2rrrkr%rprs rrbinary_magic_implz,_make_user_magic..rbinary_magic_impls%#udFHg!NO! !t}tU+ e t .&v. T0BEJ J u  'ETYY.  '! !8 K8CD$/$4|C =#=r __r c|j}t||}t||}|tus|turtSt|tr)t|tr|j |j k(sJt t|j||}|jjr|S|Sr) rkrr2r+rr-r%rpr_) predrrrqrrrsrrr{s rsym_ite_magic_implz,_make_user_magic..sym_ite_magic_impls I 84I 84IN*i>.I%%9g.y'2$$ (8(88 9;GDII{;IyQRC(+(<(<(><$ GC Gr rc|rtj||Stt|j|Sr)rvrr%rprk)r/rrr_r7s rround_magic_implz*_make_user_magic..round_magic_impls?4 ~~l4&8'BB7WTYY7@A Ar __r)rjz2Union[SymInt, int, SymFloat, float, SymBool, bool]r) rxbool_becomes_int_magic_methodsunary_magic_methodsrzunary_nonmagic_methodsrpr bitwise_opsreflectable_magic_methods)r7 user_typerorjrorigrr method_namerr_r{rrs` @@@@@r_make_user_magicrYsGCCVHo  KB//  !T<< >>">> $$ Rxr?,<= ) )y&) 6>2BD#IJ 9  H  Rxr?,>? 7  B  Rxr?,<= [ %f-K R }B/1BC . . I[M46H I /r )FFr) __future__rrvrZr@rloggingmathoperatorrrrtypingrrrr-torch._logging.structuredrVrQr r r r r rrrtorch._loggingrr'r getLoggerrar?getArtifactLoggerrc__all__ torch.typesrr,rrrrrrrrrrrrrrrrrrrrrrrrrrr6rrt math_op_namesrqsym_name priv_sym_namerzrprrryonly_bool_magic_methodsralso_bool_magic_methodsbool_magic_methodsonly_float_magic_methodsrxrrernrfrrrrrrrrrrrrr rrrrrrrrrrrrrrrrcurrent_modulerpriv_sympy_namerrrcrr r rinvertrrrr!r%r(r+r-r0sizes_strides_methodsminmaxr_rr%rr|ritemsr7rirrxr rrs#  /11 ..   ->g!~~//*E  =1 VVt# 8<<# 8<<# 8<<# 8== # 8== #  DII # (++# TZZ# TZZ#H%%# (++# (++#*# (++# hoo#  (++!#" 8<<##$ 8<<%#& (++'#( 8<<)#* (,,+#,(,,-#./#0hll1#2 X^^3#4 hoo5#6 8<<7#89#:w;#<w=#>w?#@wA#BX%%C#D8##E#J    DdV}HzNM GX/56#*5-#@x H% NN8 $&<< >!6&,/FFJ7U 0EH% PPS?)&J&J#D#D.[ ||||$  >&e?P TCn"'')#LFDVT"#*//1+LFDVT*+tJn"'') +LFD (() ))* ((F6T,T)VV$ [ * + r