Skip to content

[inworld] Allow Async delivery of timestamps info#3625

Merged
markbackman merged 1 commit intopipecat-ai:mainfrom
ianbbqzy:ian/inworld-async-timestamp
Feb 13, 2026
Merged

[inworld] Allow Async delivery of timestamps info#3625
markbackman merged 1 commit intopipecat-ai:mainfrom
ianbbqzy:ian/inworld-async-timestamp

Conversation

@ianbbqzy
Copy link
Copy Markdown
Contributor

@ianbbqzy ianbbqzy commented Feb 3, 2026

  • speed up first audio chunk latency

Please describe the changes in your PR. If it is addressing an issue, please reference that as well.

There might be requirements to keep the timestamp info synced with the audio chunks. E.g. if a response chunk {audio_bytes: asdflksdafja} has the audio for "Hello", then the same response must also have {audio_bytes: asdflksdafja, timestamp_info: {... "Hello" ...}}, such as in some latency sensitive lipsync use cases.

But IIUC, Pipecat doesn't really care about this because the timestamps and audios are emitted to two independent channels anyway. If my understanding is incorrect, I will refactor the PR to allow SDK users to configure SYNC vs ASYNC in case some have this requirement for backward compatibility

Official docs for this mode will be up shortly.

@ianbbqzy
Copy link
Copy Markdown
Contributor Author

ianbbqzy commented Feb 3, 2026

cc @cshape

@ianbbqzy ianbbqzy force-pushed the ian/inworld-async-timestamp branch 2 times, most recently from 8df1e36 to 062ed11 Compare February 6, 2026 18:23
@codecov
Copy link
Copy Markdown

codecov Bot commented Feb 6, 2026

Codecov Report

❌ Patch coverage is 0% with 17 lines in your changes missing coverage. Please review.

Files with missing lines Patch % Lines
src/pipecat/services/inworld/tts.py 0.00% 17 Missing ⚠️
Files with missing lines Coverage Δ
src/pipecat/services/inworld/tts.py 0.00% <0.00%> (ø)
🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@ianbbqzy ianbbqzy force-pushed the ian/inworld-async-timestamp branch from 062ed11 to 3e6acd3 Compare February 7, 2026 23:22
@ianbbqzy ianbbqzy marked this pull request as ready for review February 7, 2026 23:28
@ianbbqzy ianbbqzy force-pushed the ian/inworld-async-timestamp branch 5 times, most recently from 301e6e4 to d3e569e Compare February 11, 2026 23:52
@ianbbqzy ianbbqzy changed the title [DRAFT][inworld] Allow Async delivery of timestamps info [inworld] Allow Async delivery of timestamps info Feb 12, 2026
Copy link
Copy Markdown
Contributor

@markbackman markbackman left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Generally looks good! Just a few findings.

Also, you'll need to rebase to get the latest changes (should only affect imports).

Comment thread src/pipecat/services/inworld/tts.py
Comment thread src/pipecat/services/inworld/tts.py Outdated
Comment thread src/pipecat/services/inworld/tts.py
* speed up first audio chunk latency
@ianbbqzy ianbbqzy force-pushed the ian/inworld-async-timestamp branch from d3e569e to 94f01af Compare February 13, 2026 01:49
@ianbbqzy ianbbqzy requested a review from markbackman February 13, 2026 01:49
Copy link
Copy Markdown
Contributor

@markbackman markbackman left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM!

@markbackman markbackman merged commit 9e6f27c into pipecat-ai:main Feb 13, 2026
6 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants