You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
When using the kernel decorator numba-dpex generates SYCL interoperability kernels for OpenCL and Level Zero. These interoperability kernels are not cached by the dpcpp runtime and need to be cached at the end of numba-dpex or dpctl to avoid recompilation performance overheads.
The feature was implemented in Python in the numba_dpex.core.kernel_interface.dispatcher.JitKernel class. As the new KernelDispacther class and call_kernel API generate sycl::kernel_bundle compilation using LLVM IR/C the cahing of kernel bundles has to be moved into the C layer, most likely inside dpctl's libsyclinterface.
The text was updated successfully, but these errors were encountered:
diptorupd
changed the title
Enable caching of kernel bundles
Enable caching of compiled sycl::kernel_bundle wrapper objects in the experimental KernelDispatcher module
Nov 6, 2023
When using the
kernel
decorator numba-dpex generates SYCL interoperability kernels for OpenCL and Level Zero. These interoperability kernels are not cached by the dpcpp runtime and need to be cached at the end of numba-dpex or dpctl to avoid recompilation performance overheads.The feature was implemented in Python in the
numba_dpex.core.kernel_interface.dispatcher.JitKernel
class. As the newKernelDispacther
class andcall_kernel
API generate sycl::kernel_bundle compilation using LLVM IR/C the cahing of kernel bundles has to be moved into the C layer, most likely inside dpctl'slibsyclinterface
.The text was updated successfully, but these errors were encountered: