Non-record: sin² activation + causal screening pipeline#877

Open

clthuang wants to merge 61 commits intoopenai:mainfrom

clthuang:clthuang-dev

Commits on Mar 24, 2026

pd: specify review iteration 1

Terry
authored and
Terry
committed
pd: specify review iteration 2

Terry
authored and
Terry
committed
pd: specify phase-review iteration 1

Terry
authored and
Terry
committed
pd: design review iteration 1

Terry
authored and
Terry
committed
pd: design review iteration 2

Terry
authored and
Terry
committed
pd: design handoff review iteration 1

Terry
authored and
Terry
committed
pd: design revision - discovery-adjust cycle, observability, schema fixes

Terry
authored and
Terry
committed
pd: design review iteration 1 (post-revision) - fix cycle versioning, feedback mechanism, disambiguation

Terry
authored and
Terry
committed
pd: design review iteration 2 (post-revision) - fix I4 path, I2 append mode, C10 sentinel, diagnostic paths

Terry
authored and
Terry
committed
pd: design - fix I5 versioned path, C5 parsing/overrides, cycle_status field

Terry
authored and
Terry
committed
pd: design - fix sentinel docs, I6 versioned path, cycle_status formatting

Terry
authored and
Terry
committed
pd: design - address final phase-review warnings: spec overrides, stop_max_cycles, shard_variance note

Terry
authored and
Terry
committed
pd: design - use pyenv+uv for dependency management, remove scripts/causal/requirements.txt

Terry
authored and
Terry
committed
pd: plan review iteration 1 - add TDD ordering, import safety check, error handling, complexity labels

Terry
authored and
Terry
committed
pd: plan review iteration 2 - S12 tests, import safety criteria, checkpoint prereqs, FCI degenerate test

Terry
authored and
Terry
committed
pd: plan phase-review iteration 1 - fix S5 deps, S12 ordering, S4a README output

Terry
authored and
Terry
committed
pd: plan simplification - merge S4a/S4b, remove verbose rationale, tighten descriptions

Terry
authored and
Terry
committed
pd: plan review fixes - checkpoint prereq, import criteria, syntax test, parsing, dep check

Terry
authored and
Terry
committed
pd: tasks review iteration 1 - split T4/T11, add platform flag, function refs

Terry
authored and
Terry
committed
pd: tasks - fix T4→T4b deps, add R4.2 consolidation note to T17

Terry
authored and
Terry
committed
pd: implement T1-T4b — project setup, common.py with tests

authored and
Terry
committed
Implement T14, T15, T16: statistical analysis, token loss decomposition, quant gap

authored and
Terry
committed
pd: implement T5-T18 — all causal analysis scripts with tests

authored and
Terry
committed
pd: implement T10+T11 — README and identifiability_check with tests

authored and
Terry
committed
pd: fix review issues — import path, spec consolidation, phase correlations

authored and
Terry
committed

Commits on Mar 25, 2026

pd: fix checkpoint test — use .npz format matching train_gpt_mlx.py output

authored and
Terry
committed
pd: finish feature — mark T1-T18 complete, T19 deferred

authored and
Terry
committed
pd: implement T19 — submission assembly with dry-run support

authored and
Terry
committed
pd: mark T19 complete (except H100 validation)

Terry
authored and
Terry
committed
Merge feature/1-causal-inference-training into clthuang-dev

Terry
authored and
Terry
committed
pd: add auto research pipeline + fix subprocess import paths

authored and
Terry
committed
Add in-process MLX training runner to avoid subprocess warmup overhead

authored and
Terry
committed
pd: add in-process trainer with warmup caching

authored and
Terry
committed
pd: integrate in-process trainer into pipeline + upgrade to Python 3.12

authored and
Terry
committed
fix: add sys.path for in-process trainer import in run_pipeline.py

Terry
authored and
Terry
committed
fix: load_model test prefers default_ckpt to avoid shape mismatches

authored and
Terry
committed
pd: refactor + quality improvements across pipeline

authored and
Terry
committed
perf: reduce screening warmup from 20 steps to 1, add GRAD_ACCUM_STEPS=1

authored and
Terry
committed
perf: add progress logging + validate only at end for screening

authored and
Terry
committed
pd: track per-step losses + screening_mode + loss curve plotting

authored and
Terry
committed
feat: add activation function variants to screening pipeline

authored and
Terry
committed
fix: remove broken FAN activation + add Priority 3 search space sweep

authored and
Terry
committed

Commits on Mar 26, 2026

feat: add Rho-1 selective loss and Adaptive-K multi-token prediction variants

authored and
Terry
committed
feat: add --fast flag and balanced reduction for relative screening

authored and
Terry
committed
perf: bump --fast iteration preset from 50 to 300 for longer-term signal

Terry
authored and
Terry
committed
fix: move _logger creation before activation patch to avoid NameError

authored and
Terry
committed
feat: add --cooldown flag to prevent GPU thermal throttling

chefterryhuang
and
claude
committed
Non-record submission: sin^2 activation + causal screening pipeline
chefterryhuang
committed

Commits on Apr 4, 2026

Merge remote-tracking branch 'origin/main' into clthuang-dev
chefterryhuang
committed

Commits on Apr 6, 2026

Commits on Apr 8, 2026

feat: Phase C fork - paper GPTQ-lite script + corrupted context

chefterryhuang
and
claude
committed