Skip to content

Commit c171fc0

Browse files
resouerclaude
andcommitted
SLOT: restore LR=0.008 steps=16 (now runs before compile)
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
1 parent a487edc commit c171fc0

1 file changed

Lines changed: 2 additions & 2 deletions

File tree

train_gpt.py

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -105,8 +105,8 @@ class Hyperparameters():
105105

106106
# Causal SLOT
107107
slot_enabled = bool(int(os.environ.get("SLOT_ENABLED", "1")))
108-
slot_lr = float(os.environ.get("SLOT_LR", 0.001))
109-
slot_steps = int(os.environ.get("SLOT_STEPS", 4))
108+
slot_lr = float(os.environ.get("SLOT_LR", 0.008))
109+
slot_steps = int(os.environ.get("SLOT_STEPS", 16))
110110

111111
# Compression
112112
compressor = os.environ.get('COMPRESSOR', 'brotli') #(lzma or brotli)

0 commit comments

Comments
 (0)