Skip to content
Closed
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -30,6 +30,7 @@ Happy training!

| Run | Score | Author | Summary | Date | Info |
|-----|------:|--------|---------|------|------|
| Mikey | 0.87980 | newjordan | On PR #1848: 12L SP4096 + brotli + mixed-int + score-first TTT | 2026-04-27 | [info](records/track_10min_16mb/2026-04-27_Mikey/README.md) |
| SP8192 + 3-Layer Recurrence + Parallel Residuals + Legal TTT | 1.0810 | bigbag | On PR #1493: 3-layer recurrence, parallel residuals, QK-Gain 5.25, and legal score-first TTT on the PR #1394 stack | 2026-04-09 | [info](records/track_10min_16mb/2026-04-09_SP8192_3LayerRecur_ParResid_QK525_LegalTTT/README.md) |
| SP8192 + Parallel Residuals + Score-First TTT | 1.0822 | aryanbhosale | On PR #1477: parallel residuals on the PR #1413 SP8192 + legal score-first TTT stack | 2026-04-08 | [info](records/track_10min_16mb/2026-04-08_SP8192_ParallelResid_ScoreFirstTTT/README.md) |
| SP8192 + QK-Gain 5 + Legal Score-First TTT | 1.0828 | dexhunter | On PR #1413: QK-Gain 5.0 + legal score-first TTT on the PR #1394 SP8192 stack | 2026-04-06 | [info](records/track_10min_16mb/2026-04-06_SP8192_QK5_LegalTTT_1.0828/README.md) |
Expand Down
12 changes: 12 additions & 0 deletions records/track_10min_16mb/2026-04-27_Mikey/README.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,12 @@
# Mikey

| seed | val_bpb | bytes |
|------|---------|-------|
| 42 | 0.87994906 | 15,626,464 |
| 300 | 0.88084235 | 15,601,472 |
| 444 | 0.87861866 | 15,671,210 |
| **mean** | **0.87980336** | — |

```
torchrun --standalone --nproc_per_node=8 train_gpt.py
```
30 changes: 30 additions & 0 deletions records/track_10min_16mb/2026-04-27_Mikey/submission.json
Original file line number Diff line number Diff line change
@@ -0,0 +1,30 @@
{
"author": "newjordan",
"github_id": "newjordan",
"name": "Mikey",
"date": "2026-04-27",
"track": "10min_16mb",
"val_bpb": 0.87980336,
"val_bpb_std": 0.00112,
"seeds": [42, 300, 444],
"seed_results": {
"42": {"val_bpb": 0.87994906, "artifact_bytes": 15626464},
"300": {"val_bpb": 0.88084235, "artifact_bytes": 15601472},
"444": {"val_bpb": 0.87861866, "artifact_bytes": 15671210}
},
"hardware": "8xH100 80GB SXM",
"pytorch_version": "2.11.0+cu130",
"technique_summary": "",
"compliance": {
"train_under_600s": true,
"artifact_under_16mb": true,
"eval_under_600s": true,
"no_slot": true,
"no_pre_quant_ttt": true,
"no_etlb": true,
"no_ngram_cache": true,
"score_first_ttt": true,
"three_seeds": true
},
"attribution": {}
}
Loading