[torch.compile] Hide KV cache behind torch.compile boundary#11677

Merged

youkaichao merged 22 commits intovllm-project:mainfrom

heheda12345:hide_kv_cache

Jan 10, 2025

Commits on Jan 1, 2025

hide kv cache behind torch.compile
heheda12345
committed

Commits on Jan 2, 2025

Commits on Jan 6, 2025

Merge branch 'main' of github.com:vllm-project/vllm into hide_kv_cache
heheda12345
committed

Commits on Jan 8, 2025

Commits on Jan 9, 2025

Merge branch 'main' of github.com:vllm-project/vllm into hide_kv_cache
heheda12345
committed
fork new process for v1 teste
heheda12345
committed
Merge branch 'main' of github.com:vllm-project/vllm into hide_kv_cache
heheda12345
committed

Commits on Jan 10, 2025