BVh!;dZddlZddlZddlZddlZddlZddlZddlmZ ddlm Z ddl m Z dZ dZdZd Zd Zdd Zd Zd ZdZddZdZdZdZdZdZdZdZdZdZy)zUtility functions for FlatBuffers. All functions that are commonly used to work with FlatBuffers. Refer to the tensorflow lite flatbuffer schema here: tensorflow/lite/schema/schema.fbs N)schema_py_generated) schema_util)gfilesTFL3ctjj|d}tjj |S)zBConverts a tflite model from a bytearray to an object for parsing.r) schema_fbModelGetRootAsModelModelT InitFromObj)model_bytearray model_objects V/home/dcms/DCMS/lib/python3.12/site-packages/tensorflow/lite/tools/flatbuffer_utils.pyconvert_bytearray_to_objectr&s///C,    % %l 33ctj|std|ztj|d5}t |j }dddt |S#1swYt SxYw)a2Reads a tflite model as a python object. Args: input_tflite_file: Full path name to the input tflite file Raises: RuntimeError: If input_tflite_file path is invalid. IOError: If input_tflite_file cannot be opened. Returns: A python object corresponding to the input tflite file. zInput file not found at %r rbN)rExists RuntimeErrorGFile bytearrayreadread_model_from_bytearray)input_tflite_fileinput_file_handler s r read_modelr,so ' ( 58II JJ {{$d+:/@ 1 6 6 89O: "? 33: "? 33s A''A:ct|}tjdk(r t|dd|jD]H}|j s||j |j |j z|_d|_d|_J|jD]Y}|jD]H}|js||j|j|jz|_ d|_ d|_ J[|S)zReads a tflite model as a python object. Args: model_bytearray: TFLite model in bytearray format. Returns: A python object corresponding to the input tflite file. biglittler) rsys byteorderbyte_swap_tflite_model_objbuffersoffsetsizedata subgraphs operatorslargeCustomOptionsOffsetlargeCustomOptionsSize customOptions)r modelbuffersubgraphops rrr@s &o 6%]]euh6 f }}#FMMFMMFKK4OPfkfmfk  //&h  & $ $*  ' '"*E*E''+( '(#$%!&& ,rc>tjt|S)aCReads a tflite model as a python object with mutable tensors. Similar to read_model() with the addition that the returned object has mutable tensors (read_model() returns an object with immutable tensors). NOTE: This API only works for TFLite generated with _experimental_use_buffer_offset=false Args: input_tflite_file: Full path name to the input tflite file Raises: RuntimeError: If input_tflite_file path is invalid. IOError: If input_tflite_file cannot be opened. Returns: A mutable python object corresponding to the input tflite file. )copydeepcopyr)rs rread_model_with_mutable_tensorsr2`s& z"34 55rctjd}|j|}|j|tt |j }||z}|S)z@Converts a tflite model from an object to a immutable bytearray.i)file_identifier) flatbuffersBuilderPackFinish_TFLITE_FILE_IDENTIFIERbytesOutput)r extra_bufferbuilder model_offsetr s rconvert_object_to_bytearrayr?vsV    %'""7+, ../F.G'..*+/#l2/ rctjdk(r"tj|}t |ddt |}t j|d5}|j|dddy#1swYyxYw)asWrites the tflite model, a python object, into the output file. NOTE: This API only works for TFLite generated with _experimental_use_buffer_offset=false Args: model_object: A tflite model as a python object output_tflite_file: Full path name to the output tflite file. Raises: IOError: If output_tflite_file path is invalid or cannot be opened. rrwbN) rr r0r1r!r?rrwrite)r output_tflite_filer output_file_handles r write_modelrEsi ]]e==.L|UH=/ =/ {{%t,.0B_-...s A22A;cd|_|jD]!}d|_|jD] }d|_ #d|_y)ayStrips all nonessential strings from the model to reduce model size. We remove the following strings: (find strings by searching ":string" in the tensorflow lite flatbuffer schema) 1. Model description 2. SubGraph name 3. Tensor names We retain OperatorCode custom_code and Metadata name. Args: model: The model from which to remove nonessential strings. N) descriptionr&nametensors signatureDefs)r+r-tensors r strip_stringsrLsL%//hHM""fk %rcvtjjjD]\}}||k(s |cSy)z4Converts a numerical enum to a readable tensor type.N)r TensorType__dict__items) tensor_typerHvalues r type_to_namerSs<))2288:kdE  k rc8tj||j}tdt |}||Dcgc] }||vs| }}i}|j D]c}|j D]R}|j |jD]3} |j| } t| j|| j<5Te|D]} || j} | dn | j} | dk(r(|j| d}|jdr]|dk(rdnd}td| t!j"|D]0}tj$d d }t!j&|| ||2t| D]}tj(dd | |<ycc}w) aRandomize weights in a model. Args: model: The model in which to randomize weights. random_seed: The input to the random number generator (default value is 0). buffers_to_skip: The list of buffer indices to skip. The weights in these buffers are left unmodified. NrINT8FLOATFLOAT16efgg?)randomseedr"rangelenr&r'inputsrIrStyper,r%r$get startswithstructcalcsizeuniform pack_intorandint)r+ random_seedbuffers_to_skipr" buffer_idsidx buffer_typesgraphr. input_idxrKi buffer_i_data buffer_i_size buffer_type format_coder#rRjs rrandomize_weightsrvs ++k MM'QG %* !+J#s//I#JJJ,@eoo@   yy@)y)&26;;&? V]]#@@@ 2aAJOOM&.AM4F4FM""1f-Kg&&)3Ck!]FOOK,HID&tS)mVUCD]#2!!>>!S1 a2'2Ks FFc|jD]H}|js|jjd}||vs0||jd|_Jy)zRename custom ops so they use the same naming style as builtin ops. Args: model: The input tflite model. map_custom_op_renames: A mapping from old to new custom op names. asciiN) operatorCodes customCodedecodeencode)r+map_custom_op_renamesop_code op_code_strs rrename_custom_opsrs[$$Pg&&--g6k - -2;?FFwO Prc|j|}t|j|j}t t j jD]\}}||k(s |cSy)zConverts a TFLite op_code to the human readable name. Args: model: The input tflite model. op_code: The op_code to resolve to a readable name. Returns: A string containing the human readable op name, or None if not resolvable. N)rymax builtinCodedeprecatedBuiltinCodevarsrBuiltinOperatorrP)r+r~r.coderHrRs ropcode_to_namersb 7#" R^^R55 6$)334::<kdE } k rc tjd}t}t|5}|D]m}|j |}||j d}t d|jd}|Dcgc]}t|d} }|j| o dddt|Scc}w#1swYt|SxYw)a@Converts xxd output C++ source file to bytes (immutable). Args: input_cc_file: Full path name to th C++ source file dumped by xxd Raises: RuntimeError: If input_cc_file path is invalid. IOError: If input_cc_file cannot be opened. Returns: A bytearray corresponding to the input cc file array. z\W*(0x[0-9a-fA-F,x ]+).*NrU,)base) recompileropenmatchgroupfiltersplitintextendr:) input_cc_filepatternr file_handleline values_match list_text values_textxvaluess rxxd_output_to_bytesrs JJ2 3'K/ M%k%]]4(l  $$Q'i4!56k*55AAB5f5V$%%$  6%$  sA B75B2 B72B77C c.t|}t|S)a7Converts xxd output C++ source file to object. Args: input_cc_file: Full path name to th C++ source file dumped by xxd Raises: RuntimeError: If input_cc_file path is invalid. IOError: If input_cc_file cannot be opened. Returns: A python object corresponding to the input tflite file. )rr)r model_bytess rxxd_output_to_objectr/s$M2+ $[ 11rc "tdt|j|Dcgc]}|j|||z}}dj|Dcgc](}tj ||j ||*c}|_ycc}wcc}w)z4Helper function for byte-swapping the buffers field.rrN)r^r_r%joinr from_bytesto_bytes)r, chunksize from_endiness to_endinessrpto_swapbyteswaps rbyte_swap_buffer_contentr@sQFKK()4   kk!a)m$ '   nnX}-66y+N&+  s B -B c rtj|jdd|}t|jd|dzzd}dj t d|dzdzdzdDcgc]8}tj|j||dz|j d|:c}}||z|_ycc}w)aHelper function for byte-swapping the string buffer. Args: buffer: TFLite string buffer of from_endiness format. from_endiness: The original endianness format of the string buffer. to_endiness: The destined endianness format of the string buffer. rNrrU)rrr%rrr^r)r,rrnum_of_stringsstring_contentrp prefix_datas rbyte_swap_string_contentrLs>>&++a"2MB.V[[nq.@)A)CDE.Q!+q014a8   nnV[[QU+];DD [+ n,&+ s%=B4cb|yg}tjjtjjtjjg}tjj tjj tjjtjjg}tjjtjjtjjtjjg}|jD]}|jD]n}|jdkDs|jt!|j"ks7|j|vsF|j"|jj$j|j&tjj(k(r%t+|j"|j||n|j&|vr&t-|j"|jd||nj|j&|vr&t-|j"|jd||n6|j&|vr&t-|j"|jd||nT|j/|jqy)aByte swaps the buffers field in a TFLite model. Args: model: TFLite model object of from_endiness format. from_endiness: The original endianness format of the buffers in model. to_endiness: The destined endianness format of the buffers in model. Nrrr)rrNrXINT16UINT16FLOAT32INT32 COMPLEX64UINT32INT64FLOAT64 COMPLEX128UINT64r&rIr,r_r"r%raSTRINGrrappend) r+rrbuffer_swappedtypes_of_16_bitstypes_of_32_bitstypes_of_64_bitsr-rKs rr!r!_s ] .""  !! ""  $$!!   ""%%!!  //-h""- --! mmc%--00mm>1mmFMM*//; ;;)..55 5 "mmFMM*M; [[, , "mmFMM*A}k [[, , "mmFMM*A}k [[, , "mmFMM*A}k  fmm,3--rcN|yt|}t|||t|S)aGenerates a new model byte array after byte swapping its buffers field. Args: tflite_model: TFLite flatbuffer in a byte array. from_endiness: The original endianness format of the buffers in tflite_model. to_endiness: The destined endianness format of the buffers in tflite_model. Returns: TFLite flatbuffer in a byte array, after being byte swapped to to_endiness format. N)rr!r?) tflite_modelrrr+s rbyte_swap_tflite_bufferrs2  %l 3%UM;? %U ++rct|tjs t|}t }|j D]}|j |j D]q}tj|j|j}|tjjk(sM|j|jjst!|S)zCalculates the number of unique resource variables in a model. Args: model: the input tflite model, either as bytearray or object. Returns: An integer number representing the number of unique resource variables. ) isinstancerr rsetr&r'r#get_builtin_code_from_operator_codery opcodeIndexr VAR_HANDLEaddbuiltinOptions sharedNamer_)r+unique_shared_namesr-r. builtin_codes rcount_resource_variablesrs E9++ , ' .E//>h!  > DD   bnn -l 22== = 1 1 < <= >> !!r)r)rN) __doc__r0r\rrdrr5tensorflow.lite.pythonrrrtensorflow.python.platformrr9rrrr2r?rErLrSrvrrrrrrr!rrrrrs C.,!4 4(@6,.*.02f P$$ N2" -&7-t,2"r