Skip to content

docs(news): six new results from the leaderboards since August - #10

Merged
futrime merged 10 commits into
mainfrom
claude/news-leaderboards
Oct 5, 2026
Merged

futrime merged 10 commits into
mainfrom
claude/news-leaderboards

Conversation

@futrime

@futrime futrime commented Oct 5, 2026 •

Copy link
Copy Markdown
Member

Six new News posts, written from the current leaderboards. Each one reports only progress we could check against its source, as of 2026-10-05. Every post is under news/ and dated 2026-10-05, with frontmatter title, description, date, authors, tag. The author names match W2's people.ts.

Posts and sources

  1. news/2026-10-05-putnambench-672.md: "672 of 672: we closed PutnamBench's last two, and three others got there too" (HOA; Ligeng Zhu, Zhengyang Zhang)
  2. news/2026-10-05-lean-eval-v1.md: "30 first solves on Lean-Eval v1, the most of anyone — and second by one on total" (HOA; Zhengyang Zhang, Hongzhou Lin, Jui-Hui Chung)
    • Board data, generated 2026-10-05 08:56Z
    • v1: unique 1 (4th on the default sort), first solves 30 (1st), total 79 (2nd, behind NEAR's 80)
    • Archive: 170/171, a three-way tie
    • Across both scopes: 249, our own count
  3. news/2026-10-05-olympiads.md: "Full marks on five science exams, and the fine print on every one" (HOA; Jing Xiong, Zhengyang Zhang, Ligeng Zhu)
    • ipho2026: 30/30, self-graded; Lean 47.45 and 29.90 out of 50
    • icho2026: 68/68 formalization, against a native /goal baseline of 32 and 31 out of 68; generous answer scores 424.5 and 417.5 out of 437
    • ioi2026: 6/6 on Codeforces
    • ibo2024: 100/100 tasks, 400/400 against the key
    • lean-qit-qlg and HF QIT: 40/40, plus QAlg 36/36
  4. news/2026-10-05-kda-upstream.md: "Six KDA pull requests land in SGLang, the best adding 8.7% end to end" (KDA; Xiaoyu Zhang, Dongyun Zou, Song Bian)
  5. news/2026-10-05-hma-mle-bench.md: "78.2% medal rate on MLE-bench in six hours, by making two agents take turns" (HKA; Changye Li)
    • humanfia/hma README
    • The post states it is self-reported, not on the official leaderboard (which has been closed to submissions since April), and that the paper is pending
  6. news/2026-10-05-kaggle-biohub-final.md: "Biohub closed at #188 of 3,947: top 5%, not the feat(flows): a Flows section beside Projects, generated from flowverse #8 the public board showed" (HKA; Changye Li)
    • Team Radar snapshot 2026-10-05 09:18Z, re-derived from the page's embedded JSON
    • Counts all 39 completed competitions, without the audit's 12 exclusions: 16 in the top 5% = 3 authenticated final + 1 public-at-snapshot + 12 late estimates
    • Ongoing: 3 of 13 in the top 5%
    • The earlier "27 vs 39" conflict comes from that exclusion list. The tracked account set also changed since August, so the post compares competition by competition, never totals across the two snapshots

Boards checked, no change to report

  • ProgramBench: no Humanfia entry.
  • FlowBench: unreleased.
  • IMO 2026: unchanged since the July post.
  • SOL-ExecBench: no Humanfia username on any collection, so nothing claimed.
  • Dropped: a vllm-omni and a cudnn-frontend item from the earlier research. The PRs are by other authors, and the cudnn one was closed unmerged.

Notes for the coordinator

  • On main, nothing lists news/ until W2 (feat(news): split news from blog, credit authors with GitHub avatars, import KDA² #6) lands: no index, sidebar or feed. check:feed counts only blog/ here (22 items).
  • I also built this branch merged onto claude/blog-news-split. There, the news feed has 22 items (16 moved + 6 new), bylines show avatars, and all checks pass.
  • To build on main without W2, the posts don't link the old /blog/... result posts. After W2 lands, cross-links to /news/... can be added.
  • projects/* is untouched (W5 owns it).

Testing

  • pnpm build, pnpm check:anchors, pnpm check:feed and pnpm check:docs all pass, on this branch and merged with W2.
  • Playwright screenshots of all six posts in light and dark at 1280px, plus 375px mobile. Tables scroll horizontally on mobile, which is VitePress's default.

🤖 Generated with Claude Code

@futrime futrime changed the title docs(news): new results from the leaderboards since August docs(news): six new results from the leaderboards since August Oct 5, 2026
@futrime
futrime marked this pull request as ready for review October 5, 2026 10:19
@futrime
futrime requested a review from Lyken17 as a code owner October 5, 2026 10:19
Copilot AI balanced review requested due to automatic review settings October 5, 2026 10:19

Copilot AI left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copilot was unable to review this pull request because the user who requested the review has reached their quota limit.

futrime and others added 10 commits October 5, 2026 19:22
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@futrime
futrime force-pushed the claude/news-leaderboards branch from 42fae70 to cd16eea Compare October 5, 2026 11:23
@futrime
futrime merged commit 5030d8b into main Oct 5, 2026
7 checks passed
@futrime
futrime deleted the claude/news-leaderboards branch October 5, 2026 11:25
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants