Vh, ddlZddlmZmZmZddlZddlmZmZddl m Z m Z m Z m Z mZmZddlmZddlmZej(Gdd Zej(Gd d Z dd eeeefeeeedfd eeeeeeeedfffdeedeeeeefffdZ dd eeeefeeeedfdeedeeeefdeedeeeeefff dZ ddeeeeeffdeedeeeefeeeedffdZy)N)AnyOptionalUnion) UserError UserErrorType)_check_dynamic_shapes _DerivedDim_Dim_DimHint_tree_map_with_pathDim)tree_map)_dataclass_to_dictc@eZdZUdZeed<eedfed<eeed<y)RootDimz( This represents a _Dim object. minNmaxderived) __name__ __module__ __qualname____doc__int__annotations__rliststrR/home/dcms/DCMS/lib/python3.12/site-packages/torch/_export/serde/dynamic_shapes.pyrrs' H sDy  #YrrcTeZdZUdZeeeefeee edfe d<eee fe d<y)DynamicShapesSpeczA This stores a dynamic_shapes spec for de/serialization. Ndynamic_shapesdims) rrrrrdictrrtuplerrrrrr r"r"s<$sCx.%*d3iEFF sG| rr"r#r$to_dictreturnc ddlm}t|jDcic]/\}}|t |d|d|urdn|dt|d1}}}t ||}|r t |S|Scc}}w) z4 Sorts dims and dumps to dictionary format. r)int_oorrNrrrrr#r$)torch.utils._sympy.numbersr*sorteditemsrr"r)r#r$r'r*kvspecs r _postprocess_serialized_shapesr3(s24::<(   Aq 7%%F*%1Y<(   D  N FD!$''  s4A6argskwargsc i d}dtdtttfdtdttff fd }|didS|xsi}t |t r|j}t|}t|t|jz}tt t||t|||d}t||}t| | S) ay Utility function for dynamic shapes serialization, serializing a dynamic_shapes spec. Returns a DynamicShapesSpec dataclass containing 2 fields, "dynamic_shapes" and "dims". Uses args & kwargs to distinguish between tensor-level and dim-level specs (only for Nones). dynamic_shapes: A pytree structure mirroring the dynamic_shapes input to export(): - Each tensor input is represented with a list of values, non-tensor inputs with None. - dynamic dimensions (i.e. symbols) in tensors and Dim enums are represented with strings. - static dimensions are represented with ints. dims: A dictionary mapping each symbol name to the min/max range and derived dim names. For example: ``` dx = Dim("dx", min=4, max=16) dy = dx + 1 inputs = ( [ torch.randn(4, 4), torch.randn(5, 4), ], torch.randn(4), torch.randn(4, 4), "hello", ) dynamic_shapes = { "a": [ (dx, 4), (dy, 4), ], "b": (Dim.STATIC,), "c": None, "d": None, } out = _dump_dynamic_shapes(dynamic_shapes, inputs, to_dict=True) ``` would generate the following output: ``` { 'dynamic_shapes': ( [ ['dx', 4], ['dx + 1', 4], ], ['_DimHint.STATIC'], ['_DimHint.STATIC', '_DimHint.STATIC'], None, ), 'dims': { 'dx': { 'min': 4, 'max': 16, 'derived': ['dx + 1'], }, }, } ``` ct|tjsy|'tjgt |j zSg}t|trRt|j D]8\}}|j|j||n|j|:|St|ttfsJt|j D] \}}|j|||n||"|S)z Helps standardize the dynamic_shapes tree structure we serialize, returning lists for each tensor shape, handling tensor-level Nones. N) isinstancetorchTensorr STATIClenshaper% enumerateappendgetr&r)pathtensorr=outiss r _standardize_shapesz1_dump_dynamic_shapes.._standardize_shapess &%,,/ =JJ<#fll"33 3 eT "!&,,/ H1  ! 41%))A,G H  eeT]3 33!&,,/ @1 a 01eAh? @ rvalNr(c|t|tr|St|tr&|jjdz|j zSt|t sJt|tr |jn|}|jvr/|j|jtd|j<t|tr+|jdj|j|jS)z^ Tracks dims, ranges, derived dims from the standardized dynamic_shapes spec. .r+r) r8rr __class__rnamer r rootrrsetadd)rGrLr$s r _track_dim_from_dimsz2_dump_dynamic_shapes.._track_dim_from_dimss ;*S#.J c8 $==))C/#((: :#t$$$&c;7sxxS == $xxxx5#D  c; '   * . .s|| <||rr,inputs) tree_name)r')rrr r rr8r%valuesr&rr>r rr3) r#r4r5r'rFrO combined_args tree_shapesserialized_shapesr$s @r _dump_dynamic_shapesrVAsB')D( 4h, - tS#~ 8"&33\rF.$''..0>*N$K% "88M$y78.I%]NhK!!5{C )*;T7 SSrr2 from_dictc ddl}ddlm}|rt|ts&t t jdt|t|jddgk7r+t t jd|ji|djD]O\}}t|ts&t t jdt|t|jgd k7r+t t jd |jt|d ts#t t jd |d |d t|dtr|d#t t jd|d |dt|dtrtd|dDr#t t jd|d |dt!di||<R|d}nNt|t"s&t t jdt||j$|j&}|yijD]U\}}|j)|} t| |j*st t jd|t-||j.|j0|<|j2D]} |j)| } t5| j6dk7s| | j6vr t t jd|d| || st t jd| |j8j:j=| | \} } |}| dk7rt| |z}| dk7r|t| z}|| <Xdt>dttfdt>dtt@tBfffd }tE||S)z Utility function for dynamic shapes serialization. Deserializes a DynamicShapesSpec or corresponding dictionary into a dynamic_shapes input to export(). rN)_is_supported_equivalencez7With from_dict=True, expected `spec` to be a dict, got r$r#z]With from_dict=True, expected `spec` to have keys `dims` and `dynamic_shapes`, instead found z@Expected `spec['dims']` keys to be strings for symbols, got key )rrrzWExpected `spec['dims']` values to have keys `derived`, `max`, and `min`, instead found rzK|]}t|t yw)N)r8r).0ds r z'_load_dynamic_shapes..s9+,Jq#&&9szWExpected dims in `spec['dims']` to map `derived` to a list of derived expressions, got z/Expected `spec` to be a DynamicShapesSpec, got z0Expected `spec['dims']` keys to be symbols, got )rrrz(Expected derived expressions in to have z as the only free symbol, got z;Expected derived expressions to be linear expressions, got rGr(cH|t|tr|S|dk(rtjS|dk(rtjSt|t st tjd||vr.t tjd|dj|S)Nz _DimHint.AUTOz_DimHint.STATICzuExpected leaves in `spec['dynamic_shapes']` to be ints, None, Dim.AUTO/STATIC, symbols, or derived expressions, got zOExpected dims in `spec['dynamic_shapes']` to be tracked in `spec['dims']`, got z which is not in ) r8rr AUTOr;rrr INVALID_INPUTkeys)rG dim_cacher$s r deserialize_shapez/_load_dynamic_shapes..deserialize_shape*s ;*S#.J O #== % %?? "#s#++003u6  i ++e,TYY[M;  ~rr)#sympy%torch.fx.experimental.symbolic_shapesrYr8r%rrr`typer.rar/rrranyrr"r$r#sympifySymbolr rrrr< free_symbolspolys polytoolsdivrr r r)r2rWrdrYr0r1r#rKinfosymbol_exprexprmodulus remainderddimrcrbr$s @@r _load_dynamic_shapesrusO$%++I$t*V  $))+ 6+;"< <++!!% /  L&&( #DAqa%!//VW[\]W^V_`affh#<<!//%%&VVXJ0 ah,!//RSTRUUWXYZ_X`Wabah,%0@!//Z[\Z]]_`abg`h_ija lD1S901) 96 !//#R) ~/ llDG= #>./$ 12++A$t*N yy,,Ijjl$ dt$&%,,/++B4&I ddhh? $\\ $E=='D4$$%*fDtfDbcgbhi-T2!//QRVQWX"'!6!6!:!:4!H GYT?D!|7|d*A~c)n,#Ie % $$8 4c> " tS$( ). %~ 66r)F)NF) dataclassestypingrrrr9torch._dynamo.excrrtorch.export.dynamic_shapesrr r r r r torch.utils._pytreer serializer dataclassrr"r%rr&rrboolr3rVrurrr r~s'' 6))  $$sCx.%*d3iEF sDeCcD$899:: ;d^ d38n ,- 8(,# DT$sCx.%*d3iEFDT *DT T#s(^ $DTd^ DT  d38n ,- DTR!&y7 !4S>1 2y7~y7 4S>5:tCy$ 67y7r