Skip to content

Commit 7d7e6e0

Browse files
committed
🫙 Updated readme on archiving.
1 parent d708d57 commit 7d7e6e0

File tree

2 files changed

+14
-0
lines changed

2 files changed

+14
-0
lines changed

README.md

Lines changed: 13 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1,3 +1,16 @@
1+
> <h2 id="archive"> 🫙 Archive </h1>
2+
3+
> Project `koila` has 2 main components:
4+
5+
> 1. Metadata tracking for `torch.Tensor`s.
6+
> 2. Decouple some symbolic info (batch size) to run a reduced graph, with gradient accumulation to prevent OOM.
7+
8+
> For 1.: Now `PyTorch` officially has <a href="https://docs.pytorch.org/docs/stable/torch.compiler_fake_tensor.html"> FakeTensor</a> (koila predates it). It has great compatibility and support of torch operators, something `koila` never was able to do.
9+
10+
> For 2.: `Koila` only tracks symbolic info partially, on the batch dimension. I have now something a lot better, a compiler for deep learning `aioway` <a href="https://github.com/rentruewang/aioway">link</a> that handles all these info, which by the time of writing (2025/09/14) is not yet open source, but will be soon.
11+
12+
> As `FakeTensor` is now available, and `aioway` in development, I think to keep `koila` as it is, a POC that I did for fun.
13+
114
# 🐨 Koila
215

316
> Koila solves `CUDA error: out of memory error` painlessly.

docs/_coverpage.md

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -4,3 +4,4 @@ No more `CUDA error: out of memory error`.
44

55
[Github](https://github.com/rentruewang/koila)
66
[Website](https://koila.rentruewang.com)
7+
[Archive](#archive)

0 commit comments

Comments
 (0)