M5CoreS3 HA voice Assistant wake work not working

[lboue]

Hello,

I followed the M5CoreS3 HA voice Assistant to setup my M5CoreS3 HA voice Assistant. I set up the assist pipeline with add-ons:

1. Whisper
2. Piper
3. openWakeWord

It's still waiting for a wake-up call and nothing happens on the screen (the status icon doesn't change) when I say “hey Nabu”.

ESPHome debug log

I see these events over and over again in ESPHome debug log:

[08:50:31][D][voice_assistant:627]: Event Type: 0
[08:50:31][D][voice_assistant:627]: Event Type: 2
[08:50:31][D][voice_assistant:719]: Assist Pipeline ended
[08:50:31][D][voice_assistant:504]: State changed from STREAMING_MICROPHONE to IDLE
[08:50:31][D][voice_assistant:510]: Desired state set to IDLE
[08:50:31][D][voice_assistant:504]: State changed from IDLE to START_MICROPHONE
[08:50:31][D][voice_assistant:510]: Desired state set to START_PIPELINE
[08:50:31][D][voice_assistant:221]: Starting Microphone
[08:50:31][D][voice_assistant:504]: State changed from START_MICROPHONE to STARTING_MICROPHONE
[08:50:31][D][voice_assistant:504]: State changed from STARTING_MICROPHONE to START_PIPELINE
[08:50:31][D][voice_assistant:275]: Requesting start...
[08:50:31][D][voice_assistant:504]: State changed from START_PIPELINE to STARTING_PIPELINE
[08:50:31][D][voice_assistant:525]: Client started, streaming microphone
[08:50:31][D][voice_assistant:504]: State changed from STARTING_PIPELINE to STREAMING_MICROPHONE
[08:50:31][D][voice_assistant:510]: Desired state set to STREAMING_MICROPHONE
[08:50:31][D][voice_assistant:627]: Event Type: 1
[08:50:31][D][voice_assistant:630]: Assist Pipeline running
[08:50:31][D][voice_assistant:627]: Event Type: 9
[08:50:36][D][voice_assistant:627]: Event Type: 0
[08:50:36][D][voice_assistant:627]: Event Type: 2
[08:50:36][D][voice_assistant:719]: Assist Pipeline ended
[08:50:36][D][voice_assistant:504]: State changed from STREAMING_MICROPHONE to IDLE
[08:50:36][D][voice_assistant:510]: Desired state set to IDLE
[08:50:36][D][voice_assistant:504]: State changed from IDLE to START_MICROPHONE
[08:50:36][D][voice_assistant:510]: Desired state set to START_PIPELINE
[08:50:36][D][voice_assistant:221]: Starting Microphone
[08:50:36][D][voice_assistant:504]: State changed from START_MICROPHONE to STARTING_MICROPHONE
[08:50:36][D][voice_assistant:504]: State changed from STARTING_MICROPHONE to START_PIPELINE
[08:50:36][D][voice_assistant:275]: Requesting start...
[08:50:36][D][voice_assistant:504]: State changed from START_PIPELINE to STARTING_PIPELINE
[08:50:36][D][voice_assistant:525]: Client started, streaming microphone
[08:50:36][D][voice_assistant:504]: State changed from STARTING_PIPELINE to STREAMING_MICROPHONE
[08:50:36][D][voice_assistant:510]: Desired state set to STREAMING_MICROPHONE
[08:50:36][D][voice_assistant:627]: Event Type: 1
[08:50:36][D][voice_assistant:630]: Assist Pipeline running
[08:50:36][D][voice_assistant:627]: Event Type: 9

openwakeword debug log

[08:58:36] INFO: Successfully sent discovery information to Home Assistant.
s6-rc: info: service discovery successfully started
s6-rc: info: service legacy-services: starting
s6-rc: info: service legacy-services successfully started
DEBUG:wyoming_openwakeword.handler:Client disconnected: 7552575926732
DEBUG:wyoming_openwakeword.handler:Client connected: 7557108632769
DEBUG:wyoming_openwakeword.handler:Receiving audio from client: 7557108632769
DEBUG:wyoming_openwakeword.handler:Client disconnected: 7557108632769
DEBUG:wyoming_openwakeword.handler:Client connected: 7562164447063
DEBUG:wyoming_openwakeword.handler:Receiving audio from client: 7562164447063
DEBUG:wyoming_openwakeword.handler:Client disconnected: 7562164447063
DEBUG:wyoming_openwakeword.handler:Client connected: 7567223924514
DEBUG:wyoming_openwakeword.handler:Receiving audio from client: 7567223924514
DEBUG:wyoming_openwakeword.handler:Client disconnected: 7567223924514
DEBUG:wyoming_openwakeword.handler:Client connected: 7572276020050
DEBUG:wyoming_openwakeword.handler:Receiving audio from client: 7572276020050
DEBUG:wyoming_openwakeword.handler:Client disconnected: 7572276020050
DEBUG:wyoming_openwakeword.handler:Client connected: 7577334003736
DEBUG:wyoming_openwakeword.handler:Receiving audio from client: 7577334003736
DEBUG:wyoming_openwakeword.handler:Client connected: 7582108624491
DEBUG:wyoming_openwakeword.handler:Sent info to client: 7582108624491
DEBUG:wyoming_openwakeword.handler:Client disconnected: 7577334003736
DEBUG:wyoming_openwakeword.handler:Client connected: 7582520841845
DEBUG:wyoming_openwakeword.handler:Receiving audio from client: 7582520841845
DEBUG:wyoming_openwakeword.handler:Client disconnected: 7582108624491

HA pipeline status

Piper 1.5.1

Whisper 2.1.2

openWakeWord 1.10

ESPHome device

How can I identify and correct this?

ESPHome debug log file
logs_m5cores3-ha-voice-assistant_run.txt

[Jayson-Stangel]

I am struggling with the same issues. here is a snippet from my log output and yaml. Any help would be appreciated

09:53:55 | [D] | [voice_assistant:504] | State changed from IDLE to START_MICROPHONE
09:53:55 | [D] | [voice_assistant:510] | Desired state set to START_PIPELINE
09:53:55 | [D] | [voice_assistant:221] | Starting Microphone
09:53:55 | [D] | [voice_assistant:504] | State changed from START_MICROPHONE to STARTING_MICROPHONE
09:53:55 | [D] | [voice_assistant:504] | State changed from STARTING_MICROPHONE to START_PIPELINE
09:53:55 | [D] | [voice_assistant:275] | Requesting start...
09:53:55 | [D] | [voice_assistant:504] | State changed from START_PIPELINE to STARTING_PIPELINE
09:53:56 | [D] | [voice_assistant:525] | Client started, streaming microphone
09:53:56 | [D] | [voice_assistant:504] | State changed from STARTING_PIPELINE to STREAMING_MICROPHONE
09:53:56 | [D] | [voice_assistant:510] | Desired state set to STREAMING_MICROPHONE
09:53:56 | [D] | [voice_assistant:627] | Event Type: 1
09:53:56 | [D] | [voice_assistant:630] | Assist Pipeline running
09:53:56 | [D] | [voice_assistant:627] | Event Type: 9
09:54:01 | [D] | [voice_assistant:627] | Event Type: 0
09:54:01 | [D] | [voice_assistant:627] | Event Type: 2
09:54:01 | [D] | [voice_assistant:717] | Assist Pipeline ended
09:54:01 | [D] | [voice_assistant:504] | State changed from STREAMING_MICROPHONE to IDLE
09:54:01 | [D] | [voice_assistant:510] | Desired state set to IDLE
09:54:01 | [D] | [voice_assistant:504] | State changed from IDLE to START_MICROPHONE
09:54:01 | [D] | [voice_assistant:510] | Desired state set to START_PIPELINE
09:54:01 | [D] | [voice_assistant:221] | Starting Microphone
09:54:01 | [D] | [voice_assistant:504] | State changed from START_MICROPHONE to STARTING_MICROPHONE
09:54:01 | [D] | [voice_assistant:504] | State changed from STARTING_MICROPHONE to START_PIPELINE
09:54:01 | [D] | [voice_assistant:275] | Requesting start...
09:54:01 | [D] | [voice_assistant:504] | State changed from START_PIPELINE to STARTING_PIPELINE
09:54:01 | [D] | [voice_assistant:525] | Client started, streaming microphone
09:54:01 | [D] | [voice_assistant:504] | State changed from STARTING_PIPELINE to STREAMING_MICROPHONE
09:54:01 | [D] | [voice_assistant:510] | Desired state set to STREAMING_MICROPHONE
09:54:01 | [D] | [voice_assistant:627] | Event Type: 1
09:54:01 | [D] | [voice_assistant:630] | Assist Pipeline running
09:54:01 | [D] | [voice_assistant:627] | Event Type: 9
09:54:10 | [D] | [voice_assistant:627] | Event Type: 0
09:54:10 | [D] | [voice_assistant:627] | Event Type: 2
09:54:10 | [D] | [voice_assistant:717] | Assist Pipeline ended

substitutions:
  name: esphome-web-790460
  friendly_name: m5stack

esphome:
  name: ${name}
  friendly_name: ${friendly_name}
  min_version: 2024.6.0
  name_add_mac_suffix: false
  platformio_options:
    board_build.flash_mode: dio
  project:
    name: esphome.web
    version: dev

esp32:
  board: esp32-s3-devkitc-1
  framework:
    type: arduino

# Enable logging
logger:

# Enable Home Assistant API
api:
  encryption:
    key: XYZ
# Allow Over-The-Air updates
ota:
- platform: esphome

# Allow provisioning Wi-Fi via serial
improv_serial:

wifi:
  # Set up a wifi access point
  ap: {}

# In combination with the `ap` this allows the user
# to provision wifi credentials to the device via WiFi AP.
captive_portal:

dashboard_import:
  package_import_url: github://esphome/firmware/esphome-web/esp32s3.yaml@main
  import_full_config: true

# Sets up Bluetooth LE (Only on ESP32) to allow the user
# to provision wifi credentials to the device.
esp32_improv:
  authorizer: none

# To have a "next url" for improv serial
web_server:

packages:
  m5stack.cores3-voice-assistant: github://m5stack/M5CoreS3-Esphome/voice-assistant/m5stack-cores3.yaml@main