Commit bd7eb95
committed
exp82: 80 shards (10B tokens) + order-13 packed n-gram
exp81c proved paradigm: 0.1518 BPB with 40 shards order-9.
Extend to full 80 shards (10B tokens) + order 2-13 for richer cache.
Expected: sub-0.12 (closing gap to openai#900 at 0.1197).1 parent 838ad4f commit bd7eb95
2 files changed
Lines changed: 3 additions & 2 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
51 | 51 | | |
52 | 52 | | |
53 | 53 | | |
| 54 | + | |
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
2032 | 2032 | | |
2033 | 2033 | | |
2034 | 2034 | | |
2035 | | - | |
| 2035 | + | |
2036 | 2036 | | |
2037 | | - | |
| 2037 | + | |
2038 | 2038 | | |
2039 | 2039 | | |
2040 | 2040 | | |
| |||
0 commit comments