VhddlZddlZddlZddlZddlZddlZddlZddlZddlZddl Z ddl Z ddl Z ddl Z ddl mZddlmZddlmZddlmZmZmZmZddlmZddlZddlZddlmcmZddlm Z ddl!m"Z"dd l#m$Z$dd l%m&Z&dd l'm(Z(m)Z)m*Z*m+Z+m,Z,m-Z-m.Z.m/Z/m0Z0m1Z1m2Z2dd lm3Z4dd l5m6Z6ddl7m8Z8ddl9m:Z:m;Z;ddlZ>ej~e@ZAejGddZCedZD d&dddddddedeEedeeFeGefdeeFeGefdeeFeGefdeHdeHd eHd!eeIeGeGffd"ZJd#eGd$eGd!efd%ZKy)'N) OrderedDict)contextmanager) lru_cache)AnyCallableOptionalUnion)patch)enable_python_dispatcher)compile_context)log_export_usage)reorder_kwargs) ArgumentSpecConstantArgumentExportGraphSignature InputKind InputSpec OutputKind OutputSpecSymIntArgumentSymBoolArgumentSymFloatArgumentTensorArgument) traceback) compatibility)make_fx)_PyTreeCodeGen _PyTreeInfo)_wrap_submodules)_materialize_cpp_cia_opsc eZdZUdZdZeed<y)ExportDynamoConfigz: Manage Export-specific configurations of Dynamo. T allow_rnnN)__name__ __module__ __qualname____doc__r$bool__annotations__F/home/dcms/DCMS/lib/python3.12/site-packages/torch/_export/__init__.pyr#r#5sItr,r#cddlm}tjdtjdtjdtjdy)Nrconfigz+============================+z| !!! WARNING !!! |ztorch._export.aot_compile()/torch._export.aot_load() is being deprecated, please switch to directly calling torch._inductor.aoti_compile_and_package(torch.export.export())/torch._inductor.aoti_load_package() instead.)torch._inductorr0logwarningr/s r-aot_compile_warningr4?s=&KK01KK01KK01KK 78r,FT)dynamic_shapesoptionsremove_runtime_assertionsdisable_constraint_solversame_signaturefargskwargsr5r6r7r8r9returnc ddlm}ddlm} ddlm} t | jr=tjjj||||dj} n|||||||d} tj5tjj| ||| } d d d | S#1swY SxYw) av Note: this function is not stable yet Traces either an nn.Module's forward function or just a callable with PyTorch operations inside, generates executable cpp code from the program, and returns the path to the generated shared library Args: f: the `nn.Module` or callable to trace. args: example positional inputs. kwargs: optional example keyword inputs. dynamic_shapes: Should either be: 1) a dict from argument names of ``f`` to their dynamic shape specifications, 2) a tuple that specifies dynamic shape specifications for each input in original order. If you are specifying dynamism on keyword args, you will need to pass them in the order that is defined in the original function signature. The dynamic shape of a tensor argument can be specified as either (1) a dict from dynamic dimension indices to :func:`Dim` types, where it is not required to include static dimension indices in this dict, but when they are, they should be mapped to None; or (2) a tuple / list of :func:`Dim` types or None, where the :func:`Dim` types correspond to dynamic dimensions, and static dimensions are denoted by None. Arguments that are dicts or tuples / lists of tensors are recursively specified by using mappings or sequences of contained specifications. options: A dictionary of options to control inductor disable_constraint_solver: Whether the dim constraint solver must be disabled. Returns: Path to the generated shared library r)_export_to_torch_ir)select_decomp_tabler/T) pre_dispatchF)r8r9 restore_fqn)r6N)torch.export._tracer?torch._inductor.decompositionr@r1r0r4is_predispatchtorchexport_trace_exportmoduleno_grad _inductor aot_compile) r:r;r<r5r6r7r8r9r?r@r0gmso_paths r-rMrMLs\8A&  \\ ( (D&.W[ ( \ c c e!   &?)   Q//--b$-PQ NQ Ns $B77CrOdevicect|dk(r+tjjj |dn|dk(s|j dr,tjjj |d|nP|dk(s|j dr,tjjj|d|ntd|zfd}|S) z Loads a shared library generated by aot_compile and returns a callable Args: so_path: Path to the shared library Returns: A callable cpurcudazcuda:xpuzxpu:zUnsupported device cxj}tj|d}tj|d}tj|t ||fd}|Dcgc]}t |t js|!}}j|}tj||Scc}w)Nrr) get_call_specpytreetreespec_loads tree_flattenr isinstancerFTensorruntree_unflatten) r;r< call_specin_specout_spec flat_inputsx flat_outputsrunners r- optimizedzaot_load..optimizeds((* '' ! 5((16))41P*QRSTU "-MQAu||1LqM Mzz+. $$\8<<Ns *B7 B7) r4rF_C_aotiAOTIModelContainerRunnerCpu startswithAOTIModelContainerRunnerCudaAOTIModelContainerRunnerXpu RuntimeError)rOrPrerds @r-aot_loadrms ;;GQG 6 V..w7<rs   #%11 $$;)23    /166&+g!   8  8(,H 04(,&+&+HH *H T#s(^ $H T#s(^, H d38n % H $H $HH 49c>HTc38r,