Vh *ddlZddlZddlZddlZddlZddlmZddlmZddl m Z m Z m Z ddl mZddlmZddlmZdd lmZmZej,eZej2d Gd d Zej2d GddZej2d GddZej2d GddZGddZy)N)Path)Optional)counters dynamo_timedset_feature_use)justknobs_check)FileLock)triton_cache_dir) _IS_WINDOWSGPU_KERNEL_BIN_EXTST)frozenc0eZdZUdZeed<eed<eed<y)TritonBundleEntryz When we have compiled a triton kernel, we take note of that kernel by its triton generated hash, its device, and where this kernel is located. This is the minimum information we can use to later retrieve this kernel from file system. kernel_hashdevice directoryN)__name__ __module__ __qualname____doc__str__annotations__intN/home/dcms/DCMS/lib/python3.12/site-packages/torch/_inductor/triton_bundler.pyrrs KNrrcLeZdZUdZeed<ejdZe ed<y)TritonKernelArtifactzq Artifact for an individual kernel converted to bytes. Bytes could be a cubin, json, ttir, or ttgir. filenameF)reprpayloadN) rrrrrr dataclassesfieldr"bytesrrrrr"s% M&[&&E2GU2rrc6eZdZUdZeed<eed<eeed<y)TritonKernelArtifactsz: Collection of artifacts for a particular kernel. rr artifactsN) rrrrrrrlistrrrrr'r'-s  K())rr'c"eZdZUdZeeed<y)TritonBundlerMetadataz+ Metadata used for instrumentation cached_kernel_namesN)rrrrr)rrrrrr+r+8sc"rr+ceZdZUdZdZeeeed<dZ e ed<e de fdZ eddZedd Zed ed eddfd Zedeeeeeffd Ze deedeefdZy) TritonBundlera Lightweight Triton Kernel bundler that notes each time we compile a triton kernel. When collect is called, converts all the previously noted kernels and their artifacts into a structured bytes blob, and later when write is called it writes this structured blob back to file system. Intended Life cycle: - TritonBundler.begin_compile is called when we start compiling in Inductor - TritonBundler.put is called each time a Triton Kernel is compiled - TritonBundler.collect is called when a cache entry is being generated - TritonBundler.end_compile is called to indicate bundling is completed, collect will execute this function as well. - TritonBundler.read_and_emit is called when a cache entry is read N_entriess [REPLACE]_REPLACE_BYTESreturncddlm}|jry|jx}|S|j syt dS)Nr)configFz9pytorch/remote_cache:bundle_triton_into_fx_graph_cache_v2)torch._inductorr3force_disable_caches!bundle_triton_into_fx_graph_cache is_fbcoder)r3bs r is_enabledzTritonBundler.is_enabledWsF*  & &99 9A FH! G  rctjsytjd|jJg|_y)z Initializes the TritonBundler. The current TritonBundler bundle is finalized by TritonBundler.collect. Nz%TritonBundler.begin_compile is called)r.r9logdebugr/clss r begin_compilezTritonBundler.begin_compilehs7 '')  9:||### rc<tjdd|_y)zt Finalizes the TritonBundler. If collect is not yet called, it discards the current bundle. z#TritonBundler.end_compile is calledN)r;r<r/r=s r end_compilezTritonBundler.end_compilets 78 rrrc l|jx}&|jt||t|yy)z Lazily observes that we have seen a Triton kernel compilation. Remembers it for when collect is later called. N)r/appendrr )r>rrentriess rputzTritonBundler.put}s6 || #G 0 NN!+v7G7OP  1rc tjs |jtddgdfStddt dd5|j }|Sg}g}|D]#}g}t jj|j|j}t jj|sZt j|D]}}t jj||} t jj|sJt|d5} | j} |j!drutj"| vr0t$j'd tj"| t)d | j+t,j/|tj"} |j1t3|| dddt4d d xxd z cc<t jj;|d } | t=j>vsZ|j1tA|jB|s|j1tE|j|jF|&|j|tI|fcdddSgdfcdddS#1swYxYw#t6$rt$j9ddYwxYw#1swYyxYw)a This is the main function called when a cache write happens. This function converts all the previously remembered kernels into bundled format so that it can be written into a cache entry. This function also finalizes the current bundle. triton_bundlingFNTzTritonBundler.collectkeylog_pt2_compile_eventrb.jsonz'Bundle contains illegal %s, payload: %szBundle contains illegal bytesinductortriton_bundler_save_kernelr zfailed to collect triton kernel)exc_info)%r.r9rArrr/ospathjoinrrexistslistdirisfileopenreadendswithr0r;warningAssertionErrorreplacerencoderCrr Exceptionr<splitextr valuesrstemr'rr+) r>rDresult kernel_namesentryr(rQr filepathfiler" extensions rcollectzTritonBundler.collects'') OO  -u 5t8O)40 5T R4 llG"68*, $,E<>I77<<9J9JKD77>>$/ $&JJt$4E#%77<<h#?X#%77>>(#;;#;!%h!5"*.))+#+#4#4W#='4'C'Cw'N(+ ,U,9,H,H,3)* /=,K/*)*/6oo(+ 4(8-:V:V/&G!* 0 0$87$K!"#"(%Z01MNRSSN%'GG$4$4X$>q$A $(;(B(B(DD)//X0C0CD?E@! 1 % 1 1 % )M,Z!4\BBg4 4 ht8i4 4 ""* )XII&GRVIWXG4 4 s]B)K08-K %B2J> K 38K0-)K0AK01K0>K K  K- *K0,K- -K00K9bundlec dtjsytdd5g}|D]}t|j}t j j||j}t j j|r8tt j|dk7rtjd|t|jddt!t#j$}t j j|d|}t j&||j(D]3}t j j||j*}t-|d 5} |j.} |j*j1d r3| j3tj4t j7|} | j9| dddt:d d xxd z cc<t j j=|j*d } | t?j@vs|jCt|j*jD6tFrctI|dz5t j j|rtKjL|t j2||dddt j2||tO|cdddS#1swY)xYw#1swYxYw#1swYyxYw)a This is the main function called when a cache read happens. This function converts the bundled format back into individual files and writes them to the filesystem. NOTE: When we are writing to the filesystem, we assume exclusive access to the target directory. This means that if the target folder already exists and is non-empty, we bail out. Exclusive access means that no other process should be writing to or reading from the target directory. NzTritonBundler.read_and_emitTrHrz8Bailing out TritonBundler.read_and_emit, %s is non empty)parentsexist_okztmp.wbrLrM#triton_bundler_read_and_emit_kernelr z.lock)(r.r9rr rrPrQrRrrSlenrTr;r<rmkdirruuiduuid4makedirsr(r rVr"rXr[r0r\writerr^r r_rCr`r r shutilrmtreer+) rhrbr(basedirrrnd_idtmp_dirartifactrdrer"rfs r read_and_emitzTritonBundler.read_and_emits '') -T 2 7')L#+ 3 *9+;+;<GGLL)2G2GH 77>>),RZZ 5J1Kq1PIIR!W ##D4#@TZZ\*'',,w$vh@ G$ ) 3 3JH!ww||GX5F5FGHh-,"*"2"2#,,55g>&-oo - < S'G 7+ ,Z()NOSTTO " 0 01B1B CA FI $7$>$>$@@%++D1B1B,C,H,HIJ !)g"56777>>)4"MM)4 7I677 JJw 2W+ 3Z)6e2 72 76,,77U2 72 7sFEL&9A,L %AL&AL& A L-L& L L&L# L&&L/)r1N)rrrrr/rr)rrr0r% staticmethodboolr9 classmethodr?rArrrEtupler'r+rgrzrrrr.r.As 37Hht-./6)NE(     c34C t)*H5J,KK LCCJD7*+D7 ' (D7D7rr.)r#loggingrPrtrppathlibrtypingrtorch._dynamo.utilsrrrtorch._utils_internalrtorch.utils._filelockr runtime.runtime_utilsr utilsr r getLoggerrr; dataclassrrr'r+r.rrrrs GG1*33g!d#  $ d#33$3d#**$*d###$#R7R7r