Skip to content

[Bug]: Provider streaming work (#2868, #2873, #2875) stranded on deleted dev branch — never reached master #4093

@joehoyle

Description

@joehoyle

Summary

Provider streaming for channel draft updates was implemented in March 2026 via PRs #2868, #2873, and #2875 (by @theonlyhennygod). All three were merged to an internal dev branch. The dev branch was subsequently deleted without ever being merged to master. The streaming code has never reached master or any release.

Issues #2721 and #2869 are closed as "completed" despite the code never landing.

Affected component

agent, provider, channel

Current behavior (master / v0.5.4)

run_tool_call_loop in src/agent/loop_.rs calls provider.chat() exclusively (non-streaming). Channels that support draft updates only receive:

  • Progress messages ("🤔 Thinking...", "💬 Got N tool call(s)")
  • Post-hoc chunked final text (split on whitespace after the full response arrives)

No real token-by-token streaming reaches channels.

What was implemented (and lost)

PR Title Merge commit Base branch
#2868 fix(channel): consume provider streaming in tool loop drafts 52b9e6a dev
#2873 feat(router): add streaming passthrough for routed providers 27c9f8a dev
#2875 feat(streaming): add native tool-event streaming parity 88aef93 dev

The orphaned commits are still fetchable:

git fetch origin 52b9e6a2210df08dbccf08ff81907d6d93cf9254
git fetch origin 27c9f8a9fd9e3de147eeb58b2d3c309cc5cfc5de
git fetch origin 88aef9349c5285665d2cfb5872907299bb3b0c4e

Cherry-picking onto v0.5.4 produces 3 conflicts in src/agent/loop_.rs — the chat result handling and display text resolution have diverged.

Request

Please re-land the provider streaming work on master, either by resolving the cherry-pick conflicts or re-implementing based on the original PR designs.

Related

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions