Vh| rddlmZmZmZddlZddlmZddlmZddl m Z ddl m Z m Z mZddlmZgdZed d e d ed ededef dZed GddeZed  dd e deeej,ddfdZed de defdZed d e de defdZy))Any NamedTupleOptionalN) compatibility)Graph) GraphModule)map_argNodeTarget) ShapeProp)replace_target_nodes_with size_bytesget_size_of_all_nodesget_tensor_metaget_size_of_nodeF)is_backward_compatible fx_moduleold_op old_targetnew_op new_targetc t}i |jjD]}|j|k(r|j|k(ryt |j fd}t |j fd}t|tsJt|tsJ|j|||||j |<|j| fd |<||_y)zModifies all nodes in fx_module.graph.nodes which match the specified op code and target, and updates them to match the new op code and targetc|SNnval_maps R/home/dcms/DCMS/lib/python3.12/site-packages/torch/fx/passes/graph_manipulation.pyz+replace_target_nodes_with..#s  c|Srrrs rr z+replace_target_nodes_with..$s GAJr!c|Srrrs rr z+replace_target_nodes_with..+s  r!N)rgraphnodesoptargetr argskwargs isinstancetupledict create_nodename node_copy) rrrrr new_graphnoder(r)rs @rr r sI "G%% L 77f  !:499&:;DT[[*>?FdE* **fd+ ++%11 D&$))GDM&//6JKGDM L IOr!c"eZdZUeed<eed<y)r output_size total_sizeN)__name__ __module__ __qualname__int__annotations__rr!rrr/s Or!rr(returnc|t|j||jjD]$}|jdk(ryt |||_&y)zGiven a fx graph module, update each node with its total size (weights + bias + output) and its output_size(output). For a non-module node, the total size is the output size. return total sizeNoutput)r propagater$r%r&rr)rr(r1s rrr5s_ & )&&-%%< 77h   +9d;< r!r1c^|jjd}|std|d|S)N tensor_metazNode zQ has no tensor metadata associated with it! Check that shape propagation has run.)metaget RuntimeError)r1r?s rrrGs=))-- .K D64 5  r!c$d}|jdk(rUt|j}||j}|j }|D]\}}||j z }t |}|jj } || z }|jr0tjg|jj} n/tjg|jj} | |z} | | z} t| | S)zGiven a node with node.dtype and node.shape, return its total size and its output size. total_size = weights + bias + output_size r call_module)dtype)r&r, named_modulesr'named_parametersnumelrshape is_quantizedtorch_empty_affine_quantizedrE element_sizetensorr) rr1total_num_of_elemssubmodule_dict submodule parameters_namepr? output_elemsize_per_elem_bytesr4r3s rrrTs  ww-i5578"4;;/ //1 " ,HE1 !'') +  ,"$'K##))+K+%#;; k'' ,. $ll2[5F5FGTTV$'99J% 3K k: ..r!r)typingrrrrKtorch.fx._compatibilityrtorch.fx.graphrtorch.fx.graph_moduler torch.fx.noder r r torch.fx.passes.shape_propr __all__strr rlistTensorrrrrr!rras%,, 1 -//0 e,         - 2e,- e,AE  "*4 +=">   - "e, $ 3 - e,/ /4/J/-/r!