VhB%JddlZgdZGddejjZGddejjZGddejj ZGd d ejj ZGd d ejjZy) N) LayerNorm GroupNormInstanceNorm1dInstanceNorm2dInstanceNorm3dc^eZdZdZ d dfd ZdZdZed dZedZ xZ S) rzThis is the quantized version of :class:`~torch.nn.LayerNorm`. Additional args: * **scale** - quantization scale of the output, type: double. * **zero_point** - quantization zero point of the output, type: long. c || d} t ||f||d| ||_||_|j dt j |fi| |j dt j |fi| y)Ndevicedtype)epselementwise_affinescale zero_pointsuper__init__weightbiasregister_buffertorchtensor) selfnormalized_shaperrrrr rr r factory_kwargs __class__s [/home/dcms/DCMS/lib/python3.12/site-packages/torch/ao/nn/quantized/modules/normalization.pyrzLayerNorm.__init__s%+U;   1      Well5&KN&KL \5<< +Un+UVc tjjj||j|j |j |j|j|jS)N)rrr output_scaleoutput_zero_point) rops quantized layer_normrrrr rrrinputs rforwardzLayerNorm.forward/sSyy""--   ! !;;"oo.  rcy)NQuantizedLayerNormrs r _get_namezLayerNorm._get_name:#rc |jj\}}||j|j|jt |t ||j|j}|SN) activation_post_processcalculate_qparamsrrrfloatintr rclsmoduse_precomputed_fake_quantrrnew_mods r from_floatzLayerNorm.from_float=sa77IIKz  JJ HH %L  O GG  " " rc ||j|j|jt|t ||j |j Sr/)rrrr2r3r rr5r6rrs rfrom_referencezLayerNorm.from_referenceKsD  JJ HH %L  O GG  " "  rh㈵>TNNreturnNF __name__ __module__ __qualname____doc__rr'r, classmethodr9r< __classcell__rs@rrrsY W W0  $      rrcVeZdZdZgdZ d dfd ZdZdZed dZ xZ S) rzThis is the quantized version of :class:`~torch.nn.GroupNorm`. Additional args: * **scale** - quantization scale of the output, type: double. * **zero_point** - quantization zero point of the output, type: long. ) num_groups num_channelsr affinec | | d} t |||||fi| ||_||_|j dt j |fi| |j dt j |fi| yNr rrr) rrKrLrrrrr rMr r rrs rrzGroupNorm.__init__bsq%+U; \3Q.Q   Well5&KN&KL \5<< +Un+UVrc tjjj||j|j |j |j|j|jSr/) rr"r# group_normrKrrr rrr%s rr'zGroupNorm.forwardvsLyy""--  OO KK II HH JJ OO  rcy)NQuantizedGroupNormr*r+s rr,zGroupNorm._get_namer-rc |jj\}}||j|j|j|j t |t||j|j}|Sr/) r0r1rKrLrrr2r3r rMr4s rr9zGroupNorm.from_floatsf77IIKz NN    JJ HH %L  O GG JJ  rr=r?rA) rCrDrErF __constants__rr'r,rGr9rHrIs@rrrXsMDM W W(  $  rrcbeZdZdZ d dfd ZdZdZed dZedZ xZ S) rzThis is the quantized version of :class:`~torch.nn.InstanceNorm1d`. Additional args: * **scale** - quantization scale of the output, type: double. * **zero_point** - quantization zero point of the output, type: long. c | | d} t |||||| fi| ||_||_|j dt j |fi| |j dt j |fi| yrOrr num_featuresrrrrr momentumrMtrack_running_statsr r rrs rrzInstanceNorm1d.__init__|%+U;  #x1D HV    Well5&KN&KL \5<< +Un+UVrctjjj||j|j |j |j|jSr/ rr"r# instance_normrrr rrr%s rr'zInstanceNorm1d.forward@yy""00 4;; 488TZZ  rcy)NQuantizedInstanceNorm1dr*r+s rr,zInstanceNorm1d._get_name(rc |jj\}}||j|j|jt |t ||j|j}|Sr/ r0r1rYrrr2r3r rMr4s rr9zInstanceNorm1d.from_float_77IIKz    JJ HH %L  O GG JJ rc ||j|j|jt|t ||j |j Sr/rYrrr2r3r rMr;s rr<zInstanceNorm1d.from_referenceB    JJ HH %L  O GG JJ  rr>g?FFNNr?rArBrIs@rrr_ !W W. )      rrcbeZdZdZ d dfd ZdZdZed dZedZ xZ S) rzThis is the quantized version of :class:`~torch.nn.InstanceNorm2d`. Additional args: * **scale** - quantization scale of the output, type: double. * **zero_point** - quantization zero point of the output, type: long. c | | d} t |||||| fi| ||_||_|j dt j |fi| |j dt j |fi| yrOrrXs rrzInstanceNorm2d.__init__r\rctjjj||j|j |j |j|jSr/r^r%s rr'zInstanceNorm2d.forwardr`rcy)NQuantizedInstanceNorm2dr*r+s rr,zInstanceNorm2d._get_namercrc |jj\}}||j|j|jt |t ||j|j}|Sr/rer4s rr9zInstanceNorm2d.from_floatrfrc ||j|j|jt|t ||j |j Sr/rhr;s rr<zInstanceNorm2d.from_reference rirrjr?rArBrIs@rrrrkrrcbeZdZdZ d dfd ZdZdZed dZedZ xZ S) rzThis is the quantized version of :class:`~torch.nn.InstanceNorm3d`. Additional args: * **scale** - quantization scale of the output, type: double. * **zero_point** - quantization zero point of the output, type: long. c | | d} t |||||| fi| ||_||_|j dt j |fi| |j dt j |fi| yrOrrXs rrzInstanceNorm3d.__init__#r\rctjjj||j|j |j |j|jSr/r^r%s rr'zInstanceNorm3d.forward:r`rcy)NQuantizedInstanceNorm3dr*r+s rr,zInstanceNorm3d._get_name?rcrc |jj\}}||j|j|jt |t ||j|j}|Sr/rer4s rr9zInstanceNorm3d.from_floatBrfrc ||j|j|jt|t ||j |j Sr/rhr;s rr<zInstanceNorm3d.from_referencePrirrjr?rArBrIs@rrrrkrr)r__all__nnrrrrrr*rrr|s  G ""G T9""9x@ UXX,,@ F@ UXX,,@ F@ UXX,,@ r