Commit 497091d
committed
V21: COMPLETE PR openai#1855 stack + AWQ-lite + AsymLogit (CRITICAL FIX)
V19c/V20 ran with FUNDAMENTALLY WRONG base config:
- smear_gate_enabled: False (PR openai#1855 needs True)
- sparse_attn_gate_enabled: False (PR openai#1855 needs True)
- num_phases: 1 (PR openai#1855 needs 3)
- compressor: brotli (PR openai#1855 needs pergroup with lrzip)
- embed_bits: 8 (PR openai#1855 needs 7)
- 11+ other hparams default-not-PR1855
Hence V19c/V20 artifacts hit 16.93 MB (over 16 MB cap, INVALID submission)
and TTT recovery was 1-phase only, severely handicapped.
V21 = exact PR openai#1855 README reproduction command env vars + AWQ-lite (PR openai#1908)
+ ASYM_LOGIT_RESCALE=1 (V19 innovation, V19c proved -0.001/-0.002 BPB benefit).
Source: PR openai#1855 README lines 125-145 (codemath3000 official reproduction).
Predicted (seed 42):
pre-quant: ~1.064 (matches PR openai#1908 1.06384)
quantized: ~1.072 (matches PR openai#1908 1.07226)
artifact: ~15.99 MB (lrzip pergroup compression + EMBED_BITS=7)
post-TTT: ~1.057 (PR openai#1908 1.05957 - 0.002 from AsymLogit)
Win threshold: < 1.06021
Probability: 50-60% real frontier break
Pre-req: apt-get install lrzip on RunPod pod (handled in setup script)1 parent cab7fe0 commit 497091d
1 file changed
Lines changed: 98 additions & 0 deletions
Lines changed: 98 additions & 0 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
| 1 | + | |
| 2 | + | |
| 3 | + | |
| 4 | + | |
| 5 | + | |
| 6 | + | |
| 7 | + | |
| 8 | + | |
| 9 | + | |
| 10 | + | |
| 11 | + | |
| 12 | + | |
| 13 | + | |
| 14 | + | |
| 15 | + | |
| 16 | + | |
| 17 | + | |
| 18 | + | |
| 19 | + | |
| 20 | + | |
| 21 | + | |
| 22 | + | |
| 23 | + | |
| 24 | + | |
| 25 | + | |
| 26 | + | |
| 27 | + | |
| 28 | + | |
| 29 | + | |
| 30 | + | |
| 31 | + | |
| 32 | + | |
| 33 | + | |
| 34 | + | |
| 35 | + | |
| 36 | + | |
| 37 | + | |
| 38 | + | |
| 39 | + | |
| 40 | + | |
| 41 | + | |
| 42 | + | |
| 43 | + | |
| 44 | + | |
| 45 | + | |
| 46 | + | |
| 47 | + | |
| 48 | + | |
| 49 | + | |
| 50 | + | |
| 51 | + | |
| 52 | + | |
| 53 | + | |
| 54 | + | |
| 55 | + | |
| 56 | + | |
| 57 | + | |
| 58 | + | |
| 59 | + | |
| 60 | + | |
| 61 | + | |
| 62 | + | |
| 63 | + | |
| 64 | + | |
| 65 | + | |
| 66 | + | |
| 67 | + | |
| 68 | + | |
| 69 | + | |
| 70 | + | |
| 71 | + | |
| 72 | + | |
| 73 | + | |
| 74 | + | |
| 75 | + | |
| 76 | + | |
| 77 | + | |
| 78 | + | |
| 79 | + | |
| 80 | + | |
| 81 | + | |
| 82 | + | |
| 83 | + | |
| 84 | + | |
| 85 | + | |
| 86 | + | |
| 87 | + | |
| 88 | + | |
| 89 | + | |
| 90 | + | |
| 91 | + | |
| 92 | + | |
| 93 | + | |
| 94 | + | |
| 95 | + | |
| 96 | + | |
| 97 | + | |
| 98 | + | |
0 commit comments