VhAddlmZmZddlmZddlmcmZddlm Z ddl m Z ddgZ Gddeje Z Gd deje Zy) )AnyOptionalN)Tensor)ReferenceQuantizedModule Embedding EmbeddingBagceZdZdZ ddededeedeededed ed eed ee e e fd dffd Z dZ ded efdZedZxZS)raQA reference quantized Embedding module that fits into the FX Graph Mode Quantization workflow, activation will be floating point Tensor, we will store floating point weight as well in the module, but in forward we'll quantize and dequantize the weight before running the floating point functional embedding operator. Nnum_embeddings embedding_dim padding_idxmax_norm norm_typescale_grad_by_freqsparse_weightweight_qparamsreturnc Zt |||||||||| | |j| | yNsuper__init___init_weight_qparams) selfr r r rrrrrdevicedtyper __class__s ^/home/dcms/DCMS/lib/python3.12/site-packages/torch/ao/nn/quantized/reference/modules/sparse.pyrzEmbedding.__init__sB             !!.&9cyNzQuantizedEmbedding(Reference)rs r _get_namezEmbedding._get_name2.r inputc |j}tj|||j|j|j |j |jSr) get_weightF embeddingr rrrr)rr'weight_quant_dequants rforwardzEmbedding.forward5sM#0{{     MM NN  # # KK  r c ||j|j|j|j|j|j |j |j|jj|jj| Sr) r r r rrrrweightrr)clsmodrs r from_floatzEmbedding.from_floatAsj       OO LL MM  " " JJ JJ JJ   JJ     r ) NN@FFNNNN)__name__ __module__ __qualname____doc__intrfloatboolrdictstrrrr%r- classmethodr2 __classcell__rs@rrrs&*$(#($(37:::c] : 5/ :  :!::&!:!c3h0: :8/  V        r ceZdZdZ ddededeedededed ed ee d ed eed ee ee fddffd Z dZ dde dee dee de fdZeddZxZS)r aTA reference quantized EmbeddingBag module that fits into the FX Graph Mode Quantization workflow, activation will be floating point Tensor, we will store floating point weight as well in the module, but in forward we'll quantize and dequantize the weight before running the floating point functional embedding operator. Nr r rrrmoderrinclude_last_offsetr rrc^t|||||||||| | | | |j| | yrr)rr r rrrrArrrBr rrrrs rrzEmbeddingBag.__init__ZsH               !!.&9r cyr"r#r$s rr%zEmbeddingBag._get_namezr&r r'offsetsper_sample_weightsc |j}tj||||j|j|j |j |j||j|j Sr) r)r* embedding_bagrrrrArrBr )rr'rErFr,s rr-zEmbeddingBag.forward}se $0   MM NN  # # II KK   $ $     r cB||j|j|j|j|j|j |j |j|j|j|jj|jj| Sr) r r rrrrArr/rBr rr)r0r1ruse_precomputed_fake_quants rr2zEmbeddingBag.from_floatsz       LL MM  " " HH JJ JJ  # # OO JJ   JJ     r ) Nr3FmeanFNFNNNN)NN)F)r4r5r6r7r8rr9r:r<rr;rrr%r-r=r2r>r?s@rr r Rs%)#($($)%)37:::5/ :  : ! :::&!:":c]:!c3h0: :@/ %)/3   &! %V,    *  r )typingrrtorch.nnnntorch.nn.functional functionalr*torchrutilsr__all__rr r#r rrTsN +  'A  6A HP 2??$<P r