You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Triton Kernel Fix:
If you see No such file or directory: '/root/.triton/cache/e3457c918521f16104a655b081235e5a.....
(issue caused by pytorch dependency of triton==2.3.0)
You can fix it by hacking the file compiler.py
vim /usr/local/lib/python3.10/dist-packages/triton/compiler/compiler.py
L230
self.asm = {
file.suffix[1:]: file.read_bytes() if file.suffix[1:] == driver.binary_ext else None
Or you can uninstall triton and reinstall the triton nightly
Activity
hnyls2002 commentedon Jul 25, 2024
It is related to triton-lang/triton#2688. And there are some attempts to fix it. triton-lang/triton#3544 has been merged into triton==2.3.1 but bugs still remain. The latest triton-lang/triton#4295 seems to have solved it.
While waiting for triton==3.0.0 to apply this fix, I will try to fix it like vllm-project/vllm#6140 temporarily.
Fixing breaking flow for running on TPU7x (sgl-project#548)
[sgl-project#550][sgl-project#706] Close the register-then-allocate w…