VhndZddlmZddlmZmZmZddlZddlm Z ddlm Z gd Z ee e edfZd efd Zd efd Zd efd Zd efdZd efdZd efdZd efdZd efdZd!ded dfdZGddZGddZeZead!ded efdZGddeZded efdZ d efdZ!ded dfdZ"d e fd Z#y)"zj This package implements abstractions found in ``torch.cuda`` to facilitate writing device-agnostic code. )AbstractContextManager)AnyOptionalUnionNdevice)amp) is_available synchronizecurrent_devicecurrent_streamstream set_device device_countStream StreamContextEventreturncRtjjjS)z/Returns a bool indicating if CPU supports AVX2.)torch_C_cpu_is_avx2_supportedB/home/dcms/DCMS/lib/python3.12/site-packages/torch/cpu/__init__.pyrr s 88== + + --rcRtjjjS)z1Returns a bool indicating if CPU supports AVX512.)rrr_is_avx512_supportedrrrr r %s 88== - - //rcRtjjjS)z6Returns a bool indicating if CPU supports AVX512_BF16.)rrr_is_avx512_bf16_supportedrrrr"r"*s 88== 2 2 44rcRtjjjS)z/Returns a bool indicating if CPU supports VNNI.)rrr_is_avx512_vnni_supportedrrr_is_vnni_supportedr%/s 88== 2 2 44rcRtjjjS)z3Returns a bool indicating if CPU supports AMX_TILE.)rrr_is_amx_tile_supportedrrrr'r'5 88== / / 11rcRtjjjS)z3Returns a bool indicating if CPU supports AMX FP16.)rrr_is_amx_fp16_supportedrrrr*r*:r(rcRtjjjS)zInitializes AMX instructions.)rrr _init_amxrrrr,r,?s 88== " " $$rcy)zReturns a bool indicating if CPU is currently available. N.B. This function only exists to facilitate device-agnostic code Trrrrr r Ds rr cy)zWaits for all kernels in all streams on the CPU device to complete. Args: device (torch.device or int, optional): ignored, there's only one CPU device. N.B. This function only exists to facilitate device-agnostic code. Nrrs rr r Mrc:eZdZdZd deddfdZd dZd dZd dZy) rzH N.B. This class only exists to facilitate device-agnostic code priorityrNcyNr)selfr1s r__init__zStream.__init__\ rcyr3rr4rs r wait_streamzStream.wait_stream_r6rcyr3rr4s r record_eventzStream.record_eventbr6rcyr3r)r4events r wait_eventzStream.wait_eventer6r)rN) __name__ __module__ __qualname____doc__intr5r9r<r?rrrrrWs)  d    rrc4eZdZdefdZdddZddZdddZy) rrcy)NTrr;s rqueryz Event.queryjsrNcyr3rr8s rrecordz Event.recordmr6rcyr3rr;s rr zEvent.synchronizepr6rcyr3rr8s rwaitz Event.waitsr6rr3rA)rBrCrDboolrIrKr rNrrrrrist   rrctS)zReturns the currently selected :class:`Stream` for a given device. Args: device (torch.device or int, optional): Ignored. N.B. This function only exists to facilitate device-agnostic code )_current_streamrs rrr{s  rcFeZdZUdZeeed<dZdZde de de dd fd Z y ) rzvContext-manager that selects a given stream. N.B. This class only exists to facilitate device-agnostic code cur_streamc(||_t|_yr3)r_default_cpu_stream prev_streamr8s rr5zStreamContext.__init__s .rc<|j}|yt|_|ayr3)rrQrV)r4rSs r __enter__zStreamContext.__enter__s#[[   +$rtypevalue tracebackrNc:|j}|y|jayr3)rrVrQ)r4rYrZr[rSs r__exit__zStreamContext.__exit__s![[   **r) rBrCrDrErr__annotations__r5rXrr]rrrrrs?   /%+S++++rrrct|S)zWrapper around the Context-manager StreamContext that selects a given stream. N.B. This function only exists to facilitate device-agnostic code )r)rs rrrs   rcy)zReturns number of CPU devices (not cores). Always 1. N.B. This function only exists to facilitate device-agnostic code r rrrrrrs rcy)zzSets the current device, in CPU we do nothing. N.B. This function only exists to facilitate device-agnostic code Nrrs rrrr/rcy)zyReturns current device for cpu. Always 'cpu'. N.B. This function only exists to facilitate device-agnostic code cpurrrrrrs rr3)$rE contextlibrtypingrrrrr _devicer __all__strrF _device_trOrr r"r%r'r*r,r r rrrUrQrrrrrrrrrrks/ .''   '3T) * .D. 0d0 545 5D5 22 22 %4% d T  $   h% 9  +*+>!6!4! c yTr