Skip to content

Commit 372c5f1

Browse files
committed
Record: openai#1787 + Sparse Gate + Updated Frozen Carry — val_bpb 1.06287
1 parent 75700cb commit 372c5f1

5 files changed

Lines changed: 6812 additions & 0 deletions

File tree

Original file line numberDiff line numberDiff line change
@@ -0,0 +1,14 @@
1+
{
2+
"val_bpb": 1.06287,
3+
"val_loss": 2.326951,
4+
"seeds": [42, 0, 1234],
5+
"per_seed": {
6+
"42": {"steps": 4989, "pre_quant_bpb": 1.06749, "quantized_bpb": 1.07678, "post_ttt_bpb": 1.06366, "artifact_bytes": 15909254},
7+
"0": {"steps": 4974, "pre_quant_bpb": 1.06685, "quantized_bpb": 1.07608, "post_ttt_bpb": 1.06311, "artifact_bytes": 15904209},
8+
"1234": {"steps": 4973, "pre_quant_bpb": 1.06578, "quantized_bpb": 1.07509, "post_ttt_bpb": 1.06183, "artifact_bytes": 15909401}
9+
},
10+
"hardware": "8xH100 SXM 80GB",
11+
"region": "NA-1",
12+
"base_pr": 1787,
13+
"git_commit": "1d12cb6"
14+
}

0 commit comments

Comments
 (0)