gnumpi / esphome_audio

Custom audio components for ESPHome
Other
20 stars 8 forks source link

ES8388: Slow Audio Output and Microphone not running #2

Open nighi opened 3 months ago

nighi commented 3 months ago

Thank you for this component and your efforts, really appreciate.

Hardware:

DAC: es8388 Board: AI-Tinker ESP32-A1S

Problem 1: Audio output is much too slow

Audio output of the media player is working but is much too slow, maybe half of the original velocity.

Problem 2: Microphone not running

The log message

[21:39:55][D][voice_assistant:118]: microphone not running

is present as soon as I start the voice-assistant. But no other error message on the log.

config.yaml ```yaml esphome: name: voice-sat name_add_mac_suffix: false on_boot: - priority: -100 then: - wait_until: api.connected - delay: 1s - if: condition: switch.is_on: use_wake_word then: - voice_assistant.start_continuous: api: logger: ota: wifi: ssid: !secret wifi_ssid password: !secret wifi_password captive_portal: esp32: board: esp-wrover-kit framework: type: esp-idf external_components: #- source: github://pr#3552 # DAC support https://github.com/esphome/esphome/pull/3552 - source: github://mulcmu/esphome-es8388-a1s@nightdav-patch components: [es8388] refresh: 0s - source: github://pr#5230 components: - esp_adf refresh: 0s - source: type: git url: https://github.com/nighi/esphome_audio ref: main components: [ adf_pipeline, i2s_audio ] refresh: 0s i2c: sda: GPIO33 scl: GPIO32 es8388: i2s_audio: id: i2s_in_out i2s_lrclk_pin: GPIO25 i2s_bclk_pin: GPIO27 adf_pipeline: # create an I2SWriter pipeline element # using the i2s_out configuration - platform: i2s_audio type: sink id: adf_i2s_out i2s_audio_id: i2s_in_out i2s_dout_pin: GPIO26 # create an I2SReader pipeline element # using the i2s_in configuration - platform: i2s_audio type: source id: adf_i2s_in i2s_audio_id: i2s_in_out i2s_din_pin: GPIO35 channel: left sample_rate: 16000 ##??? bits_per_sample: 16bit ##?? microphone: - platform: adf_pipeline id: adf_microphone pipeline: - adf_i2s_in - self speaker: - platform: adf_pipeline id: adf_speaker pipeline: - self - adf_i2s_out media_player: - platform: adf_pipeline id: adf_media_player name: s3-dev_media_player internal: false pipeline: - self - adf_i2s_out voice_assistant: microphone: adf_microphone media_player: adf_media_player id: va volume_multiplier: 6 noise_suppression_level: 4 auto_gain: 20dBFS on_end: - delay: 100ms - wait_until: not: speaker.is_playing: - script.execute: reset_led on_listening: - light.turn_on: led switch: - platform: gpio pin: GPIO21 name: "AMP Switch" restore_mode: ALWAYS_OFF - platform: template name: Use wake word id: use_wake_word optimistic: true restore_mode: RESTORE_DEFAULT_ON entity_category: config on_turn_on: - lambda: id(va).set_use_wake_word(true); - if: condition: not: - voice_assistant.is_running then: - voice_assistant.start_continuous - script.execute: reset_led on_turn_off: - voice_assistant.stop - lambda: id(va).set_use_wake_word(false); - script.execute: reset_led script: - id: reset_led then: - if: condition: switch.is_on: use_wake_word then: - light.turn_on: led else: - light.turn_off: led light: - platform: binary id: led name: "Test LED 1" output: light_output_1 - platform: binary name: "Test LED 2" output: light_output_2 output: - id: light_output_1 platform: gpio pin: GPIO22 inverted: true - id: light_output_2 platform: gpio pin: GPIO19 inverted: true ```
As reference: working config.yml without adf-pipeline ```yaml esphome: name: m5stack-atom-echo-59aac0 friendly_name: check name_add_mac_suffix: false on_boot: - priority: -100 then: - wait_until: api.connected - delay: 1s - if: condition: switch.is_on: use_wake_word then: - voice_assistant.start_continuous: api: # Enable logging logger: ota: wifi: ssid: !secret wifi_ssid password: !secret wifi_password captive_portal: esp32: board: esp-wrover-kit framework: type: esp-idf external_components: #- source: github://pr#3552 # DAC support https://github.com/esphome/esphome/pull/3552 - source: github://mulcmu/esphome-es8388-a1s@nightdav-patch components: [es8388] refresh: 0s - source: github://pr#5230 components: - esp_adf refresh: 0s i2c: sda: GPIO33 scl: GPIO32 es8388: speaker: - platform: i2s_audio id: AudioKit i2s_dout_pin: GPIO26 dac_type: external mode: mono i2s_audio: i2s_lrclk_pin: GPIO25 i2s_bclk_pin: GPIO27 microphone: - platform: i2s_audio i2s_din_pin: GPIO35 id: mic1 adc_type: external pdm: false esp_adf: voice_assistant: microphone: mic1 speaker: AudioKit id: va volume_multiplier: 6 noise_suppression_level: 4 auto_gain: 20dBFS on_end: - delay: 100ms - wait_until: not: speaker.is_playing: - script.execute: reset_led on_listening: - light.turn_on: led switch: - platform: gpio pin: GPIO21 name: "AMP Switch" restore_mode: ALWAYS_OFF - platform: template name: Use wake word id: use_wake_word optimistic: true restore_mode: RESTORE_DEFAULT_ON entity_category: config on_turn_on: - lambda: id(va).set_use_wake_word(true); - if: condition: not: - voice_assistant.is_running then: - voice_assistant.start_continuous - script.execute: reset_led on_turn_off: - voice_assistant.stop - lambda: id(va).set_use_wake_word(false); - script.execute: reset_led script: - id: reset_led then: - if: condition: switch.is_on: use_wake_word then: - light.turn_on: led else: - light.turn_off: led light: - platform: binary id: led name: "Test LED 1" output: light_output_1 - platform: binary name: "Test LED 2" output: light_output_2 output: - id: light_output_1 platform: gpio pin: GPIO22 inverted: true - id: light_output_2 platform: gpio pin: GPIO19 inverted: true ```
log output slow audio output ```log [21:59:38][D][media_player:059]: 's3-dev_media_player' - Setting [21:59:38][D][media_player:066]: Media URL: http://192.168.0.90:8123/api/tts_proxy/d555e0334f6ad942f00e7d91a189993c0c3a1143_de-de_f56410318a_cloud.mp3 [21:59:38][D][esp-idf:000]: I (31318) AUDIO_ELEMENT: [http-0x3ffd57dc] Element task created [21:59:38][D][esp-idf:000]: I (31321) AUDIO_ELEMENT: [decoder-0x3ffd5b68] Element task created [21:59:38][D][esp-idf:000]: I (31330) AUDIO_ELEMENT: [i2s_out-0x3ffda26c] Element task created [21:59:38][D][esp-idf:000]: I (31340) AUDIO_PIPELINE: Func:audio_pipeline_run, Line:359, MEM Total:112280 Bytes [21:59:38][D][esp-idf:000]: I (31350) AUDIO_ELEMENT: [http] AEL_MSG_CMD_RESUME,state:1 [21:59:38][D][esp-idf:000]: I (31362) AUDIO_ELEMENT: [decoder] AEL_MSG_CMD_RESUME,state:1 [21:59:38][D][esp-idf:000]: I (31365) AUDIO_ELEMENT: [i2s_out] AEL_MSG_CMD_RESUME,state:1 [21:59:38][D][esp-idf:000]: I (31371) AUDIO_PIPELINE: Pipeline started [21:59:38][I][adf_audio:135]: got new pipeline state: 2 [21:59:38][W][component:214]: Component api took a long time for an operation (0.07 s). [21:59:38][W][component:215]: Components should block for at most 20-30ms. [21:59:38][I][esp_adf_pipeline:198]: [ * ] CMD: 8 status: 12 [21:59:38][I][adf_audio:135]: got new pipeline state: 2 [21:59:38][D][esp-idf:000]: I (31431) HTTP_CLIENT: Body received in fetch header state, 0x3ffe36bf, 1841 [21:59:38][D][esp-idf:000]: I (31437) HTTP_STREAM: total_bytes=10031 [21:59:38][I][esp_adf_pipeline:217]: [ * ] CMD: 10 Pipeline: 2 [21:59:38][I][esp_adf_pipeline:217]: [ * ] CMD: 8 Pipeline: 2 [21:59:38][I][esp_adf_pipeline:222]: [ http ] status: 12 [21:59:38][I][esp_adf_pipeline:217]: [ * ] CMD: 8 Pipeline: 2 [21:59:38][I][esp_adf_pipeline:222]: [ decoder ] status: 12 [21:59:38][I][HTTPStreamReader:046]: [ * ] Receive music info from mp3 decoder, sample_rates=24000, bits=16, ch=1 [21:59:38][I][esp_adf_pipeline:217]: [ * ] CMD: 9 Pipeline: 2 [21:59:39][D][esp-idf:000]: W (32236) HTTP_STREAM: No more data,errno:0, total_bytes:10031, rlen = 0 [21:59:39][D][esp-idf:000]: I (32242) AUDIO_ELEMENT: IN-[http] AEL_IO_DONE,0 [21:59:39][I][esp_adf_pipeline:217]: [ * ] CMD: 11 Pipeline: 2 [21:59:39][I][esp_adf_pipeline:217]: [ * ] CMD: 8 Pipeline: 2 [21:59:39][I][esp_adf_pipeline:222]: [ http ] status: 15 [21:59:39][D][esp-idf:000]: I (32747) AUDIO_ELEMENT: IN-[decoder] AEL_IO_DONE,-2 [21:59:40][D][esp-idf:000]: I (33257) MP3_DECODER: Closed [21:59:40][I][esp_adf_pipeline:217]: [ * ] CMD: 11 Pipeline: 2 [21:59:40][I][esp_adf_pipeline:217]: [ * ] CMD: 8 Pipeline: 2 [21:59:40][I][esp_adf_pipeline:222]: [ decoder ] status: 15 [21:59:40][D][esp-idf:000]: I (33448) AUDIO_ELEMENT: IN-[i2s_out] AEL_IO_DONE,-2 [21:59:42][I][esp_adf_pipeline:217]: [ * ] CMD: 11 Pipeline: 2 [21:59:42][I][esp_adf_pipeline:198]: [ * ] CMD: 8 status: 15 [21:59:42][I][adf_audio:135]: got new pipeline state: 4 [21:59:42][I][adf_audio:135]: got new pipeline state: 4 [21:59:42][I][esp_adf_pipeline:217]: [ * ] CMD: 8 Pipeline: 4 [21:59:42][I][esp_adf_pipeline:222]: [ i2s_out ] status: 15 [21:59:51][D][switch:012]: 'AMP Switch' Turning ON. [21:59:51][D][switch:055]: 'AMP Switch': Sending state ON [21:59:53][D][media_player:059]: 's3-dev_media_player' - Setting [21:59:53][D][media_player:069]: Volume: 0.47 [21:59:55][D][media_player:059]: 's3-dev_media_player' - Setting [21:59:55][D][media_player:063]: Command: PLAY [21:59:55][D][esp-idf:000]: I (48835) AUDIO_PIPELINE: Func:audio_pipeline_run, Line:359, MEM Total:109920 Bytes [21:59:55][D][esp-idf:000]: I (48839) AUDIO_ELEMENT: [http] AEL_MSG_CMD_RESUME,state:1 [21:59:55][D][esp-idf:000]: I (48843) AUDIO_ELEMENT: [decoder] AEL_MSG_CMD_RESUME,state:1 [21:59:55][D][esp-idf:000]: I (48846) AUDIO_ELEMENT: [i2s_out] AEL_MSG_CMD_RESUME,state:1 [21:59:56][D][esp-idf:000]: I (48853) AUDIO_PIPELINE: Pipeline started [21:59:56][I][adf_audio:135]: got new pipeline state: 2 [21:59:56][I][esp_adf_pipeline:198]: [ * ] CMD: 8 status: 12 [21:59:56][I][adf_audio:135]: got new pipeline state: 2 [21:59:56][I][esp_adf_pipeline:217]: [ * ] CMD: 8 Pipeline: 2 [21:59:56][I][esp_adf_pipeline:222]: [ i2s_out ] status: 12 [21:59:56][I][esp_adf_pipeline:217]: [ * ] CMD: 10 Pipeline: 2 [21:59:56][I][esp_adf_pipeline:217]: [ * ] CMD: 8 Pipeline: 2 [21:59:56][I][esp_adf_pipeline:222]: [ http ] status: 12 [21:59:56][I][esp_adf_pipeline:217]: [ * ] CMD: 8 Pipeline: 2 [21:59:56][I][esp_adf_pipeline:222]: [ decoder ] status: 12 [21:59:56][I][HTTPStreamReader:046]: [ * ] Receive music info from mp3 decoder, sample_rates=24000, bits=16, ch=1 [21:59:56][I][esp_adf_pipeline:217]: [ * ] CMD: 9 Pipeline: 2 [21:59:56][D][esp-idf:000]: W (49644) HTTP_STREAM: No more data,errno:0, total_bytes:10031, rlen = 0 [21:59:56][D][esp-idf:000]: I (49650) AUDIO_ELEMENT: IN-[http] AEL_IO_DONE,0 [21:59:56][I][esp_adf_pipeline:217]: [ * ] CMD: 11 Pipeline: 2 [21:59:56][I][esp_adf_pipeline:217]: [ * ] CMD: 8 Pipeline: 2 [21:59:56][I][esp_adf_pipeline:222]: [ http ] status: 15 [21:59:57][D][esp-idf:000]: I (50155) AUDIO_ELEMENT: IN-[decoder] AEL_IO_DONE,-2 [21:59:57][D][esp-idf:000]: I (50665) MP3_DECODER: Closed [21:59:57][I][esp_adf_pipeline:217]: [ * ] CMD: 11 Pipeline: 2 [21:59:57][I][esp_adf_pipeline:217]: [ * ] CMD: 8 Pipeline: 2 [21:59:57][I][esp_adf_pipeline:222]: [ decoder ] status: 15 [21:59:58][D][esp-idf:000]: I (50857) AUDIO_ELEMENT: IN-[i2s_out] AEL_IO_DONE,-2 [21:59:58][D][media_player:059]: 's3-dev_media_player' - Setting [21:59:58][D][media_player:066]: Media URL: http://192.168.0.90:8123/api/tts_proxy/d555e0334f6ad942f00e7d91a189993c0c3a1143_de-de_f56410318a_cloud.mp3 [21:59:58][D][esp-idf:000]: E (50980) AUDIO_ELEMENT: [http] Element already stopped [21:59:58][D][esp-idf:000]: E (50983) AUDIO_ELEMENT: [decoder] Element already stopped [22:00:00][I][adf_audio:135]: got new pipeline state: 4 [22:00:00][I][adf_audio:135]: got new pipeline state: 4 [22:00:00][D][esp-idf:000]: I (52915) AUDIO_ELEMENT: [http-0x3ffd57dc] Element task created [22:00:00][D][esp-idf:000]: I (52918) AUDIO_ELEMENT: [decoder-0x3ffd5b68] Element task created [22:00:00][D][esp-idf:000]: I (52920) AUDIO_ELEMENT: [i2s_out-0x3ffda26c] Element task created [22:00:00][D][esp-idf:000]: I (52923) AUDIO_PIPELINE: Func:audio_pipeline_run, Line:359, MEM Total:111964 Bytes [22:00:00][D][esp-idf:000]: I (52926) AUDIO_ELEMENT: [http] AEL_MSG_CMD_RESUME,state:1 [22:00:00][D][esp-idf:000]: I (52937) AUDIO_ELEMENT: [decoder] AEL_MSG_CMD_RESUME,state:1 [22:00:00][D][esp-idf:000]: I (52941) AUDIO_ELEMENT: [i2s_out] AEL_MSG_CMD_RESUME,state:1 [22:00:00][D][esp-idf:000]: I (52947) AUDIO_PIPELINE: Pipeline started [22:00:00][I][adf_audio:135]: got new pipeline state: 2 [22:00:00][W][component:214]: Component api took a long time for an operation (2.00 s). [22:00:00][W][component:215]: Components should block for at most 20-30ms. [22:00:00][D][esp-idf:000]: I (52999) HTTP_CLIENT: Body received in fetch header state, 0x3ffdefd3, 1841 [22:00:00][D][esp-idf:000]: I (53006) HTTP_STREAM: total_bytes=10031 [22:00:00][I][esp_adf_pipeline:198]: [ * ] CMD: 8 status: 12 [22:00:00][I][adf_audio:135]: got new pipeline state: 2 [22:00:00][I][esp_adf_pipeline:217]: [ * ] CMD: 8 Pipeline: 2 [22:00:00][I][esp_adf_pipeline:222]: [ i2s_out ] status: 12 [22:00:00][I][esp_adf_pipeline:217]: [ * ] CMD: 10 Pipeline: 2 [22:00:00][I][esp_adf_pipeline:217]: [ * ] CMD: 8 Pipeline: 2 [22:00:00][I][esp_adf_pipeline:222]: [ http ] status: 12 [22:00:00][I][esp_adf_pipeline:217]: [ * ] CMD: 8 Pipeline: 2 [22:00:00][I][esp_adf_pipeline:222]: [ decoder ] status: 12 [22:00:00][I][HTTPStreamReader:046]: [ * ] Receive music info from mp3 decoder, sample_rates=24000, bits=16, ch=1 [22:00:00][I][esp_adf_pipeline:217]: [ * ] CMD: 9 Pipeline: 2 [22:00:01][D][esp-idf:000]: W (53994) HTTP_STREAM: No more data,errno:0, total_bytes:10031, rlen = 0 [22:00:01][D][esp-idf:000]: I (54001) AUDIO_ELEMENT: IN-[http] AEL_IO_DONE,0 [22:00:01][I][esp_adf_pipeline:217]: [ * ] CMD: 11 Pipeline: 2 [22:00:01][I][esp_adf_pipeline:217]: [ * ] CMD: 8 Pipeline: 2 [22:00:01][I][esp_adf_pipeline:222]: [ http ] status: 15 [22:00:01][D][esp-idf:000]: I (54506) AUDIO_ELEMENT: IN-[decoder] AEL_IO_DONE,-2 [22:00:02][D][esp-idf:000]: I (55018) MP3_DECODER: Closed ```
log output microphone not running ```log INFO ESPHome 2023.12.9 INFO Reading configuration /config/esphome/m5stack-atom-echo-59aac0.yaml... INFO Updating https://github.com/mulcmu/esphome-es8388-a1s.git@nightdav-patch INFO Updating https://github.com/esphome/esphome.git@pull/5230/head INFO Updating https://github.com/nighi/esphome_audio@main INFO Starting log output from 192.168.0.85 using esphome API INFO Successfully connected to voice-sat @ 192.168.0.85 in 0.033s INFO Successful handshake with voice-sat @ 192.168.0.85 in 0.074s [21:39:55][D][voice_assistant:118]: microphone not running [21:39:55][I][app:102]: ESPHome version 2023.12.9 compiled on Feb 16 2024, 16:21:00 [21:39:55][C][wifi:573]: WiFi: [21:39:55][C][wifi:405]: Local MAC: B8:D6:1A:59:AA:C0 [21:39:55][C][wifi:410]: SSID: XXXXXX [21:39:55][C][wifi:411]: IP Address: 192.168.0.85 [21:39:55][C][wifi:413]: BSSID: XXXXXXXXXX [21:39:55][C][wifi:414]: Hostname: 'voice-sat' [21:39:55][C][wifi:416]: Signal strength: -64 dB ▂▄▆█ [21:39:55][C][wifi:420]: Channel: 6 [21:39:55][C][wifi:421]: Subnet: 255.255.255.0 [21:39:55][C][wifi:422]: Gateway: 192.168.0.1 [21:39:55][C][wifi:423]: DNS1: 192.168.0.1 [21:39:55][C][wifi:424]: DNS2: 0.0.0.0 [21:39:55][D][voice_assistant:118]: microphone not running [21:39:55][C][logger:439]: Logger: [21:39:55][C][logger:440]: Level: DEBUG [21:39:55][C][logger:441]: Log Baud Rate: 115200 [21:39:55][C][logger:443]: Hardware UART: UART0 [21:39:55][D][voice_assistant:118]: microphone not running [21:39:55][C][i2c.idf:061]: I2C Bus: [21:39:55][C][i2c.idf:062]: SDA Pin: GPIO33 [21:39:55][C][i2c.idf:063]: SCL Pin: GPIO32 [21:39:55][C][i2c.idf:064]: Frequency: 50000 Hz [21:39:55][C][i2c.idf:067]: Recovery: bus successfully recovered [21:39:55][I][i2c.idf:077]: Results from i2c bus scan: [21:39:55][I][i2c.idf:083]: Found i2c device at address 0x10 [21:39:55][D][voice_assistant:118]: microphone not running [21:39:55][D][voice_assistant:118]: microphone not running [21:39:55][D][voice_assistant:118]: microphone not running [21:39:55][C][switch.gpio:068]: GPIO Switch 'AMP Switch' [21:39:55][C][switch.gpio:091]: Restore Mode: always OFF [21:39:55][C][switch.gpio:031]: Pin: GPIO21 [21:39:55][D][voice_assistant:118]: microphone not running [21:39:55][C][gpio.output:010]: GPIO Binary Output: [21:39:55][C][gpio.output:011]: Pin: GPIO22 [21:39:55][C][gpio.output:012]: Inverted: YES [21:39:55][D][voice_assistant:118]: microphone not running [21:39:55][C][gpio.output:010]: GPIO Binary Output: [21:39:55][C][gpio.output:011]: Pin: GPIO19 [21:39:55][C][gpio.output:012]: Inverted: YES [21:39:55][D][voice_assistant:118]: microphone not running [21:39:55][D][voice_assistant:118]: microphone not running [21:39:55][C][light:103]: Light 'Test LED 1' [21:39:55][D][voice_assistant:118]: microphone not running [21:39:55][C][light:103]: Light 'Test LED 2' [21:39:55][D][voice_assistant:118]: microphone not running [21:39:55][C][template.switch:068]: Template Switch 'Use wake word' [21:39:55][C][template.switch:091]: Restore Mode: restore defaults to ON [21:39:55][C][template.switch:057]: Optimistic: YES [21:39:55][D][voice_assistant:118]: microphone not running [21:39:55][D][voice_assistant:118]: microphone not running [21:39:55][D][voice_assistant:118]: microphone not running [21:39:55][D][voice_assistant:118]: microphone not running [21:39:55][D][voice_assistant:118]: microphone not running [21:39:55][D][voice_assistant:118]: microphone not running [21:39:55][D][voice_assistant:118]: microphone not running [21:39:55][C][captive_portal:088]: Captive Portal: [21:39:55][D][voice_assistant:118]: microphone not running [21:39:55][C][mdns:115]: mDNS: [21:39:55][C][mdns:116]: Hostname: voice-sat [21:39:55][D][voice_assistant:118]: microphone not running [21:39:55][C][ota:097]: Over-The-Air Updates: [21:39:55][C][ota:098]: Address: voice-sat.local:3232 [21:39:55][D][voice_assistant:118]: microphone not running [21:39:55][C][api:139]: API Server: [21:39:55][C][api:140]: Address: voice-sat.local:6053 [21:39:55][C][api:142]: Using noise encryption: YES [21:39:55][D][voice_assistant:118]: microphone not running [21:39:55][D][voice_assistant:118]: microphone not running [21:39:55][D][voice_assistant:118]: microphone not running [21:39:55][D][voice_assistant:118]: microphone not running [21:39:55][C][esp_adf.speaker:019]: ESP ADF Speaker Configs: [21:39:55][D][voice_assistant:118]: microphone not running [21:39:55][C][adf_audio:019]: ESP-ADF-MediaPlayer: [21:39:55][C][adf_audio:021]: Number of ASPComponents: 2 [21:39:55][D][voice_assistant:118]: microphone not running [21:39:55][D][voice_assistant:118]: microphone not running [21:39:55][D][voice_assistant:118]: microphone not running [21:39:55][D][voice_assistant:118]: microphone not running [21:39:55][D][voice_assistant:118]: microphone not running [21:39:55][D][voice_assistant:118]: microphone not running [21:39:55][D][voice_assistant:118]: microphone not running [21:39:55][D][voice_assistant:118]: microphone not running [21:39:55][D][voice_assistant:118]: microphone not running [21:39:55][D][voice_assistant:118]: microphone not running [21:39:55][D][voice_assistant:118]: microphone not running [21:39:55][D][voice_assistant:118]: microphone not running [21:39:55][D][voice_assistant:118]: microphone not running [21:39:55][D][voice_assistant:118]: microphone not running [21:39:55][D][voice_assistant:118]: microphone not running [21:39:55][D][voice_assistant:118]: microphone not running [21:39:55][D][voice_assistant:118]: microphone not running [21:39:55][D][voice_assistant:118]: microphone not running [21:39:55][D][voice_assistant:118]: microphone not running [21:39:55][D][voice_assistant:118]: microphone not running [21:39:55][D][voice_assistant:118]: microphone not running [21:39:55][D][voice_assistant:118]: microphone not running [21:39:55][D][voice_assistant:118]: microphone not running [21:39:55][D][voice_assistant:118]: microphone not running [21:39:55][D][voice_assistant:118]: microphone not running [21:39:55][D][voice_assistant:118]: microphone not running [21:39:55][D][voice_assistant:118]: microphone not running [21:39:55][D][voice_assistant:118]: microphone not running [21:39:55][D][voice_assistant:118]: microphone not running [21:39:55][D][voice_assistant:118]: microphone not running [21:39:55][D][voice_assistant:118]: microphone not running [21:39:55][D][voice_assistant:118]: microphone not running [21:39:55][D][voice_assistant:118]: microphone not running [21:39:55][D][voice_assistant:118]: microphone not running [21:39:55][D][voice_assistant:118]: microphone not running [21:39:55][D][voice_assistant:118]: microphone not running [21:39:55][D][voice_assistant:118]: microphone not running [21:39:55][D][voice_assistant:118]: microphone not running [21:39:55][D][voice_assistant:118]: microphone not running [21:39:55][D][voice_assistant:118]: microphone not running [21:39:55][D][voice_assistant:118]: microphone not running [21:39:55][D][voice_assistant:118]: microphone not running [21:39:55][D][voice_assistant:118]: microphone not running [21:39:55][D][voice_assistant:118]: microphone not running [21:39:55][D][voice_assistant:118]: microphone not running [21:39:55][D][voice_assistant:118]: microphone not running [21:39:55][D][voice_assistant:118]: microphone not running [21:39:55][D][voice_assistant:118]: microphone not running [21:39:55][D][voice_assistant:118]: microphone not running [21:39:55][D][voice_assistant:118]: microphone not running [21:39:55][D][voice_assistant:118]: microphone not running [21:39:55][D][voice_assistant:118]: microphone not running [21:39:55][D][voice_assistant:118]: microphone not running [21:39:55][D][voice_assistant:118]: microphone not running [21:39:55][D][voice_assistant:118]: microphone not running [21:39:55][D][voice_assistant:118]: microphone not running [21:39:55][D][voice_assistant:118]: microphone not running [21:39:55][D][voice_assistant:118]: microphone not running [21:39:55][D][voice_assistant:118]: microphone not running [21:39:55][D][voice_assistant:118]: microphone not running [21:39:55][D][voice_assistant:118]: microphone not running [21:39:55][D][voice_assistant:118]: microphone not running [21:39:55][D][voice_assistant:118]: microphone not running [21:39:55][D][voice_assistant:118]: microphone not running [21:39:55][D][voice_assistant:118]: microphone not running [21:39:55][D][voice_assistant:118]: microphone not running [21:39:55][D][voice_assistant:118]: microphone not running [21:39:55][D][voice_assistant:118]: microphone not running [21:39:55][D][voice_assistant:118]: microphone not running [21:39:55][D][voice_assistant:118]: microphone not running ```

Are external DACs already supported? Do I have to specify this in the config? If you need further details, feel free to ask.

gnumpi commented 3 months ago

Thank you for bringing this to my attention. Currently, I don't have access to external DACs to perform tests. It's unclear whether the adf_pipeline component is compatible with 'source: github://pr#5230'; it's likely incompatible. You may consider removing it since adf_pipeline already incorporates the idf-adf SDK. Additionally, could you experiment with a different TTS voice? The one you're currently using generates samples at a 24000 rate, which appears to be unsupported or at least not set correctly. You could also try testing if it is possible to stream radio stations using the radio browser component.

And I just noticed, you should remove the speaker component from you configuration when you use voice assistant with media_player ...

gnumpi commented 3 months ago

Can you try using the branch: 3-make-supported-i2s-sampling-rates-configurable

- source:
     type: git
     url: https://github.com/nighi/esphome_audio
     ref: 3-make-supported-i2s-sampling-rates-configurable
   components: [ adf_pipeline, i2s_audio ]
   refresh: 0s

I removed any restriction on setting the i2s sampling rate and number of channels in this branch

Regarding the microphone:

Unfortunately I can't see any helpful information in you log. Could you set your use_wake_word switch to RESTORE_DEFAULT_OFF, wait until all components are set up and then switch the voice assistant component on manually? Hopefully the log will show more relevant information then...

nighi commented 3 months ago

Oh, good hint with the idf-adf, thought I'd removed it. I removed the external component and the speaker, but it seems to make no difference. Regarding the external DAC/ADC I'm wondering why the speaker works(ish) while the microphone not.

I've tried different audio sources, but nothing really works. Some tracks are even to fast or to slow. I even downloaded a sample file for 16K Sample rate and streamed it with HA local media. here Because I didn't know how to adjust the tts settings. This sample file works fine until I play something different with another sample rate. Then the file is again to slow until I reset the esp.

With your new branch Deutschlandfunk and BBC World from the radiobrowser works correctly.

[14:10:54][D][media_player:066]:   Media URL: http://st01.dlf.de/dlf/01/128/mp3/stream.mp3
[14:10:55][I][HTTPStreamReader:046]: [ * ] Receive music info from mp3 decoder, sample_rates=48000, bits=16, ch=2

The tts engines and the 16K-sample doesn't work and sound is additionally distorted. If I reboot and play at first a tts or the 16k-sample (all ch=1) it works also fine. After a stereo channel media is played the mono channel media doesn't work anymore. So maybe it can't switch between channels?

Regarding the microphone I also realized that I only pasted the tail of my log. Here is the full:

log ``` [14:58:42][D][switch:012]: 'Use wake word' Turning ON. [14:58:42][D][switch:055]: 'Use wake word': Sending state ON [14:58:42][D][voice_assistant:412]: State changed from IDLE to START_PIPELINE [14:58:42][D][voice_assistant:418]: Desired state set to START_MICROPHONE [14:58:42][D][light:036]: 'Test LED 1' Setting: [14:58:42][D][light:047]: State: ON [14:58:42][D][voice_assistant:118]: microphone not running [14:58:42][D][voice_assistant:200]: Requesting start... [14:58:42][D][voice_assistant:412]: State changed from START_PIPELINE to STARTING_PIPELINE [14:58:42][D][voice_assistant:433]: Client started, streaming microphone [14:58:42][D][voice_assistant:412]: State changed from STARTING_PIPELINE to START_MICROPHONE [14:58:42][D][voice_assistant:418]: Desired state set to STREAMING_MICROPHONE [14:58:42][D][voice_assistant:153]: Starting Microphone [14:58:42][D][esp-idf:000]: E (720488) I2S: register I2S object to platform failed [14:58:42][D][esp-idf:000]: I (720496) LYRAT_V4_3: I2S0, MCLK output by GPIO0 [14:58:42][D][esp_adf_pipeline:142]: pipeline tag 0, i2s_in [14:58:42][D][esp_adf_pipeline:142]: pipeline tag 1, pcm_reader [14:58:42][D][esp-idf:000]: I (720517) AUDIO_PIPELINE: link el->rb, el:0x3ffdfe44, tag:i2s_in, rb:0x3ffda1a0 [14:58:42][D][esp_adf_pipeline:154]: Setting up event listener. [14:58:42][D][esp-idf:000]: I (720529) AUDIO_ELEMENT: [i2s_in-0x3ffdfe44] Element task created [14:58:42][D][esp-idf:000]: I (720547) AUDIO_ELEMENT: [pcm_reader-0x3ffdfbcc] Element task created [14:58:42][D][esp-idf:000]: I (720548) AUDIO_PIPELINE: Func:audio_pipeline_run, Line:359, MEM Total:75904 Bytes [14:58:42][D][esp-idf:000]: I (720557) AUDIO_ELEMENT: [i2s_in] AEL_MSG_CMD_RESUME,state:1 [14:58:42][D][esp-idf:000]: I (720568) AUDIO_PIPELINE: Pipeline started [14:58:42][D][voice_assistant:412]: State changed from START_MICROPHONE to STARTING_MICROPHONE [14:58:42][W][component:214]: Component voice_assistant took a long time for an operation (0.09 s). [14:58:42][W][component:215]: Components should block for at most 20-30ms. [14:58:42][I][esp_adf_pipeline:198]: [ * ] CMD: 8 status: 12 [14:58:42][I][esp_adf_pipeline:217]: [ * ] CMD: 8 Pipeline: 2 [14:58:42][I][esp_adf_pipeline:222]: [ pcm_reader ] status: 12 [14:58:42][D][voice_assistant:519]: Event Type: 1 [14:58:42][D][voice_assistant:522]: Assist Pipeline running [14:58:42][D][voice_assistant:412]: State changed from STARTING_MICROPHONE to STREAMING_MICROPHONE [14:58:42][I][esp_adf_pipeline:198]: [ * ] CMD: 8 status: 12 [14:58:42][I][esp_adf_pipeline:217]: [ * ] CMD: 8 Pipeline: 2 [14:58:42][I][esp_adf_pipeline:222]: [ pcm_reader ] status: 12 [14:58:42][D][voice_assistant:519]: Event Type: 9 [14:58:42][I][esp_adf_pipeline:217]: [ * ] CMD: 8 Pipeline: 2 [14:58:42][I][esp_adf_pipeline:222]: [ i2s_in ] status: 12 [14:58:42][I][esp_adf_pipeline:217]: [ * ] CMD: 11 Pipeline: 2 [14:58:42][I][esp_adf_pipeline:217]: [ * ] CMD: 8 Pipeline: 2 [14:58:42][I][esp_adf_pipeline:222]: [ i2s_in ] status: 15 [14:58:42][D][esp-idf:000]: I (720691) AUDIO_ELEMENT: IN-[pcm_reader] AEL_IO_DONE,-2 [14:58:42][I][esp_adf_pipeline:198]: [ * ] CMD: 8 status: 14 [14:58:42][I][esp_adf_pipeline:217]: [ * ] CMD: 8 Pipeline: 4 [14:58:42][I][esp_adf_pipeline:222]: [ pcm_reader ] status: 14 [14:58:42][D][voice_assistant:118]: microphone not running [14:58:42][D][voice_assistant:118]: microphone not running [14:58:42][D][voice_assistant:118]: microphone not running [14:58:42][D][voice_assistant:118]: microphone not running [14:58:42][D][voice_assistant:118]: microphone not running [14:58:42][D][voice_assistant:118]: microphone not running [14:58:42][D][voice_assistant:118]: microphone not running [14:58:42][D][voice_assistant:118]: microphone not running [14:58:42][D][voice_assistant:118]: microphone not running [14:58:42][D][voice_assistant:118]: microphone not running [14:58:42][D][voice_assistant:118]: microphone not running [14:58:42][D][voice_assistant:118]: microphone not running [14:58:42][D][voice_assistant:118]: microphone not running [14:58:42][D][voice_assistant:118]: microphone not running [14:58:42][D][voice_assistant:118]: microphone not running [14:58:42][D][voice_assistant:118]: microphone not running [14:58:42][D][voice_assistant:118]: microphone not running [14:58:42][D][voice_assistant:118]: microphone not running [14:58:42][D][voice_assistant:118]: microphone not running [14:58:42][D][voice_assistant:118]: microphone not running [14:58:42][D][voice_assistant:118]: microphone not running [14:58:42][D][voice_assistant:118]: microphone not running [14:58:42][D][voice_assistant:118]: microphone not running [14:58:42][D][voice_assistant:118]: microphone not running [14:58:42][D][voice_assistant:118]: microphone not running [14:58:42][D][voice_assistant:118]: microphone not running [14:58:42][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:43][D][voice_assistant:118]: microphone not running [14:58:44][D][voice_assistant:118]: microphone not running [14:58:44][D][voice_assistant:118]: microphone not running [14:58:44][D][voice_assistant:118]: microphone not running [14:58:44][D][voice_assistant:118]: microphone not running [14:58:44][D][voice_assistant:118]: microphone not running [14:58:44][D][voice_assistant:118]: microphone not running [14:58:44][D][switch:016]: 'Use wake word' Turning OFF. [14:58:44][D][switch:055]: 'Use wake word': Sending state OFF [14:58:44][D][voice_assistant:512]: Signaling stop... [14:58:44][D][voice_assistant:412]: State changed from STREAMING_MICROPHONE to STOP_MICROPHONE [14:58:44][D][voice_assistant:418]: Desired state set to IDLE [14:58:44][D][light:036]: 'Test LED 1' Setting: [14:58:44][D][light:047]: State: OFF [14:58:44][D][voice_assistant:412]: State changed from STOP_MICROPHONE to IDLE [14:58:44][D][voice_assistant:519]: Event Type: 0 [14:58:44][E][voice_assistant:646]: Error: no_wake_word - No wake word detected [14:58:44][D][voice_assistant:519]: Event Type: 2 [14:58:44][D][voice_assistant:609]: Assist Pipeline ended [14:58:44][D][light:036]: 'Test LED 1' Setting: ```
gnumpi commented 3 months ago

Thanks, that's very helpful information to localise the bug! I will look into it...

gnumpi commented 3 months ago

Ok, I committed a fix for switching the number of channels into the 3-make-supported-i2s-sampling-rates-configurable branch. Can you check if it helps with your problem?

I will look into the microphone problem later...

nighi commented 3 months ago

Okay, it seems to be better. Switching from 2 to 1 channel still causes some problems, though. It sounds like the speed is right now. But there are still dropouts and distortion after the switch.

output ``` [18:35:53][C][wifi:420]: Channel: 6 [18:35:53][C][wifi:421]: Subnet: 255.255.255.0 [18:35:53][C][wifi:422]: Gateway: 192.168.0.1 [18:35:53][C][wifi:423]: DNS1: 192.168.0.1 [18:35:53][C][wifi:424]: DNS2: 0.0.0.0 [18:35:53][C][logger:439]: Logger: [18:35:53][C][logger:440]: Level: DEBUG [18:35:53][C][logger:441]: Log Baud Rate: 115200 [18:35:53][C][logger:443]: Hardware UART: UART0 [18:35:53][C][i2c.idf:061]: I2C Bus: [18:35:53][C][i2c.idf:062]: SDA Pin: GPIO33 [18:35:53][C][i2c.idf:063]: SCL Pin: GPIO32 [18:35:53][C][i2c.idf:064]: Frequency: 50000 Hz [18:35:53][C][i2c.idf:067]: Recovery: bus successfully recovered [18:35:53][I][i2c.idf:077]: Results from i2c bus scan: [18:35:53][I][i2c.idf:083]: Found i2c device at address 0x10 [18:35:53][C][switch.gpio:068]: GPIO Switch 'AMP Switch' [18:35:53][C][switch.gpio:091]: Restore Mode: always OFF [18:35:53][C][switch.gpio:031]: Pin: GPIO21 [18:35:53][C][gpio.output:010]: GPIO Binary Output: [18:35:53][C][gpio.output:011]: Pin: GPIO22 [18:35:53][C][gpio.output:012]: Inverted: YES [18:35:53][C][gpio.output:010]: GPIO Binary Output: [18:35:53][C][gpio.output:011]: Pin: GPIO19 [18:35:53][C][gpio.output:012]: Inverted: YES [18:35:53][C][light:103]: Light 'Test LED 1' [18:35:53][C][light:103]: Light 'Test LED 2' [18:35:53][C][template.switch:068]: Template Switch 'Use wake word' [18:35:53][C][template.switch:091]: Restore Mode: restore defaults to ON [18:35:53][C][template.switch:057]: Optimistic: YES [18:35:54][C][captive_portal:088]: Captive Portal: [18:35:54][C][mdns:115]: mDNS: [18:35:54][C][mdns:116]: Hostname: voice-sat [18:35:54][C][ota:097]: Over-The-Air Updates: [18:35:54][C][ota:098]: Address: voice-sat.local:3232 [18:35:54][C][api:139]: API Server: [18:35:54][C][api:140]: Address: voice-sat.local:6053 [18:35:54][C][api:142]: Using noise encryption: YES [18:35:54][C][adf_audio:019]: ESP-ADF-MediaPlayer: [18:35:54][C][adf_audio:021]: Number of ASPComponents: 2 [18:35:56][D][media_player:059]: 's3-dev_media_player' - Setting [18:35:56][D][media_player:069]: Volume: 0.04 [18:35:58][D][switch:012]: 'AMP Switch' Turning ON. [18:35:58][D][switch:055]: 'AMP Switch': Sending state ON [18:36:00][D][media_player:059]: 's3-dev_media_player' - Setting [18:36:00][D][media_player:069]: Volume: 0.01 [18:36:05][D][media_player:059]: 's3-dev_media_player' - Setting [18:36:05][D][media_player:066]: Media URL: http://192.168.0.90:8123/media/local/ff-16b-1c-16000hz.mp3?authSig=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiI1MjgyY2RjYjk1NmQ0ZGY3YmQ4NWRhZDRkMzk2MmU3NyIsInBhdGgiOiIvbWVkaWEvbG9jYWwvZmYtMTZiLTFjLTE2MDAwaHoubXAzIiwicGFyYW1zIjpbXSwiaWF0IjoxNzA4MTkxMzY1LCJleHAiOjE3MDgyNzc3NjV9.-aA381WoFIWcV4rvuSn8MqknpulI8sXrRnyEL3lgXC4 [18:36:05][D][esp-idf:000]: I (20251) AUDIO_ELEMENT: [http-0x3ffd5518] Element task created [18:36:05][D][esp-idf:000]: I (20273) AUDIO_ELEMENT: [decoder-0x3ffd590c] Element task created [18:36:05][D][esp-idf:000]: I (20284) AUDIO_ELEMENT: [i2s_out-0x3ffd9f94] Element task created [18:36:05][D][esp-idf:000]: I (20293) AUDIO_PIPELINE: Func:audio_pipeline_run, Line:359, MEM Total:111716 Bytes [18:36:05][D][esp-idf:000]: I (20296) AUDIO_ELEMENT: [http] AEL_MSG_CMD_RESUME,state:1 [18:36:05][D][esp-idf:000]: I (20305) AUDIO_ELEMENT: [decoder] AEL_MSG_CMD_RESUME,state:1 [18:36:05][D][esp-idf:000]: I (20309) AUDIO_ELEMENT: [i2s_out] AEL_MSG_CMD_RESUME,state:1 [18:36:05][D][esp-idf:000]: I (20315) I2S_STREAM: AUDIO_STREAM_WRITER [18:36:05][I][esp_adf_pipeline:198]: [ * ] CMD: 8 status: 12 [18:36:05][I][adf_audio:135]: got new pipeline state: 2 [18:36:05][D][esp-idf:000]: I (20379) HTTP_STREAM: total_bytes=562097 [18:36:05][I][esp_adf_pipeline:217]: [ * ] CMD: 10 Pipeline: 2 [18:36:05][I][esp_adf_pipeline:217]: [ * ] CMD: 8 Pipeline: 2 [18:36:05][I][esp_adf_pipeline:222]: [ http ] status: 12 [18:36:05][I][esp_adf_pipeline:217]: [ * ] CMD: 8 Pipeline: 2 [18:36:05][I][esp_adf_pipeline:222]: [ decoder ] status: 12 [18:36:05][I][HTTPStreamReader:046]: [ * ] Receive music info from mp3 decoder, sample_rates=16000, bits=16, ch=1 [18:36:06][D][esp-idf:000]: I (21543) AUDIO_ELEMENT: [i2s_out] AEL_MSG_CMD_PAUSE [18:36:06][D][esp-idf:000]: W (21547) AUDIO_ELEMENT: [i2s_out-0x3ffd9f94] RESUME timeout [18:36:06][I][esp_adf_pipeline:217]: [ * ] CMD: 9 Pipeline: 2 [18:36:06][W][component:214]: Component adf_pipeline.media_player took a long time for an operation (1.09 s). [18:36:06][W][component:215]: Components should block for at most 20-30ms. [18:36:06][I][esp_adf_pipeline:198]: [ * ] CMD: 8 status: 13 [18:36:06][I][adf_audio:135]: got new pipeline state: 5 [18:36:06][I][esp_adf_pipeline:217]: [ * ] CMD: 8 Pipeline: 5 [18:36:06][I][esp_adf_pipeline:222]: [ i2s_out ] status: 13 [18:36:06][I][esp_adf_pipeline:198]: [ * ] CMD: 8 status: 12 [18:36:06][I][adf_audio:135]: got new pipeline state: 2 [18:36:06][I][esp_adf_pipeline:217]: [ * ] CMD: 8 Pipeline: 2 [18:36:06][I][esp_adf_pipeline:222]: [ i2s_out ] status: 12 [18:36:09][D][media_player:059]: 's3-dev_media_player' - Setting [18:36:09][D][media_player:066]: Media URL: http://192.168.0.90:8123/api/tts_proxy/62fc662dc7005819078de6e2c6a8073d3365a0a4_en-au_1c98f30e25_tts.home_assistant_cloud.mp3 [18:36:09][D][esp-idf:000]: I (25066) MP3_DECODER: Closed [18:36:09][D][esp-idf:000]: W (25072) AUDIO_ELEMENT: OUT-[http] AEL_IO_ABORT [18:36:11][I][adf_audio:135]: got new pipeline state: 4 [18:36:11][I][adf_audio:135]: got new pipeline state: 4 [18:36:11][D][esp-idf:000]: I (26162) AUDIO_ELEMENT: [http-0x3ffd5518] Element task created [18:36:11][D][esp-idf:000]: I (26165) AUDIO_ELEMENT: [decoder-0x3ffd590c] Element task created [18:36:11][D][esp-idf:000]: I (26168) AUDIO_ELEMENT: [i2s_out-0x3ffd9f94] Element task created [18:36:11][D][esp-idf:000]: I (26170) AUDIO_PIPELINE: Func:audio_pipeline_run, Line:359, MEM Total:110672 Bytes [18:36:11][D][esp-idf:000]: I (26174) AUDIO_ELEMENT: [http] AEL_MSG_CMD_RESUME,state:1 [18:36:11][D][esp-idf:000]: I (26181) AUDIO_ELEMENT: [decoder] AEL_MSG_CMD_RESUME,state:1 [18:36:11][D][esp-idf:000]: I (26186) AUDIO_ELEMENT: [i2s_out] AEL_MSG_CMD_RESUME,state:1 [18:36:11][D][esp-idf:000]: I (26195) I2S_STREAM: AUDIO_STREAM_WRITER [18:36:11][D][esp-idf:000]: I (26249) HTTP_CLIENT: Body received in fetch header state, 0x3ffe63cf, 1841 [18:36:11][D][esp-idf:000]: I (26253) HTTP_STREAM: total_bytes=18576 [18:36:11][I][esp_adf_pipeline:217]: [ * ] CMD: 10 Pipeline: 2 [18:36:11][I][esp_adf_pipeline:198]: [ * ] CMD: 8 status: 12 [18:36:11][I][adf_audio:135]: got new pipeline state: 2 [18:36:11][I][esp_adf_pipeline:217]: [ * ] CMD: 8 Pipeline: 2 [18:36:11][I][esp_adf_pipeline:222]: [ i2s_out ] status: 12 [18:36:11][I][esp_adf_pipeline:217]: [ * ] CMD: 8 Pipeline: 2 [18:36:11][I][esp_adf_pipeline:222]: [ http ] status: 12 [18:36:11][I][esp_adf_pipeline:217]: [ * ] CMD: 8 Pipeline: 2 [18:36:11][I][esp_adf_pipeline:222]: [ decoder ] status: 12 [18:36:11][I][HTTPStreamReader:046]: [ * ] Receive music info from mp3 decoder, sample_rates=24000, bits=16, ch=1 [18:36:12][D][esp-idf:000]: I (27497) AUDIO_ELEMENT: [i2s_out] AEL_MSG_CMD_PAUSE [18:36:12][D][esp-idf:000]: W (27502) AUDIO_ELEMENT: [i2s_out-0x3ffd9f94] RESUME timeout [18:36:12][I][esp_adf_pipeline:217]: [ * ] CMD: 9 Pipeline: 2 [18:36:12][W][component:214]: Component adf_pipeline.media_player took a long time for an operation (1.10 s). [18:36:12][W][component:215]: Components should block for at most 20-30ms. [18:36:12][I][esp_adf_pipeline:198]: [ * ] CMD: 8 status: 13 [18:36:12][I][adf_audio:135]: got new pipeline state: 5 [18:36:12][I][esp_adf_pipeline:217]: [ * ] CMD: 8 Pipeline: 5 [18:36:12][I][esp_adf_pipeline:222]: [ i2s_out ] status: 13 [18:36:12][I][esp_adf_pipeline:198]: [ * ] CMD: 8 status: 12 [18:36:12][I][adf_audio:135]: got new pipeline state: 2 [18:36:12][I][esp_adf_pipeline:217]: [ * ] CMD: 8 Pipeline: 2 [18:36:12][I][esp_adf_pipeline:222]: [ i2s_out ] status: 12 [18:36:14][D][esp-idf:000]: W (29424) HTTP_STREAM: No more data,errno:0, total_bytes:18576, rlen = 0 [18:36:14][D][esp-idf:000]: I (29430) AUDIO_ELEMENT: IN-[http] AEL_IO_DONE,0 [18:36:14][I][esp_adf_pipeline:217]: [ * ] CMD: 11 Pipeline: 2 [18:36:14][I][esp_adf_pipeline:217]: [ * ] CMD: 8 Pipeline: 2 [18:36:14][I][esp_adf_pipeline:222]: [ http ] status: 15 [18:36:14][D][esp-idf:000]: I (29766) AUDIO_ELEMENT: IN-[decoder] AEL_IO_DONE,-2 [18:36:15][D][esp-idf:000]: I (30147) MP3_DECODER: Closed [18:36:15][I][esp_adf_pipeline:217]: [ * ] CMD: 11 Pipeline: 2 [18:36:15][I][esp_adf_pipeline:217]: [ * ] CMD: 8 Pipeline: 2 [18:36:15][I][esp_adf_pipeline:222]: [ decoder ] status: 15 [18:36:15][D][esp-idf:000]: I (30317) AUDIO_ELEMENT: IN-[i2s_out] AEL_IO_DONE,-2 [18:36:16][I][esp_adf_pipeline:217]: [ * ] CMD: 11 Pipeline: 2 [18:36:16][I][esp_adf_pipeline:198]: [ * ] CMD: 8 status: 15 [18:36:16][I][adf_audio:135]: got new pipeline state: 4 [18:36:16][I][adf_audio:135]: got new pipeline state: 4 [18:36:16][I][esp_adf_pipeline:217]: [ * ] CMD: 8 Pipeline: 4 [18:36:16][I][esp_adf_pipeline:222]: [ i2s_out ] status: 15 [18:36:23][D][media_player:059]: 's3-dev_media_player' - Setting [18:36:23][D][media_player:066]: Media URL: http://st01.dlf.de/dlf/01/128/mp3/stream.mp3 [18:36:23][D][esp-idf:000]: I (38283) AUDIO_PIPELINE: Func:audio_pipeline_run, Line:359, MEM Total:110384 Bytes [18:36:23][D][esp-idf:000]: I (38286) AUDIO_ELEMENT: [http] AEL_MSG_CMD_RESUME,state:1 [18:36:23][D][esp-idf:000]: I (38290) AUDIO_ELEMENT: [decoder] AEL_MSG_CMD_RESUME,state:1 [18:36:23][D][esp-idf:000]: I (38295) AUDIO_ELEMENT: [i2s_out] AEL_MSG_CMD_RESUME,state:1 [18:36:23][D][esp-idf:000]: I (38298) I2S_STREAM: AUDIO_STREAM_WRITER [18:36:23][I][esp_adf_pipeline:198]: [ * ] CMD: 8 status: 12 [18:36:23][I][adf_audio:135]: got new pipeline state: 2 [18:36:23][I][esp_adf_pipeline:217]: [ * ] CMD: 8 Pipeline: 2 [18:36:23][I][esp_adf_pipeline:222]: [ i2s_out ] status: 12 [18:36:23][D][esp-idf:000]: I (38440) HTTP_STREAM: total_bytes=0 [18:36:23][D][esp-idf:000]: I (38549) HTTP_STREAM: total_bytes=0 [18:36:23][I][esp_adf_pipeline:217]: [ * ] CMD: 10 Pipeline: 2 [18:36:23][I][esp_adf_pipeline:217]: [ * ] CMD: 8 Pipeline: 2 [18:36:23][I][esp_adf_pipeline:222]: [ http ] status: 12 [18:36:23][I][esp_adf_pipeline:217]: [ * ] CMD: 8 Pipeline: 2 [18:36:23][I][esp_adf_pipeline:222]: [ decoder ] status: 12 [18:36:23][I][HTTPStreamReader:046]: [ * ] Receive music info from mp3 decoder, sample_rates=48000, bits=16, ch=2 [18:36:24][D][esp-idf:000]: I (39320) AUDIO_ELEMENT: [i2s_out] AEL_MSG_CMD_PAUSE [18:36:24][D][esp-idf:000]: I (39325) I2S: DMA Malloc info, datalen=blocksize=4092, dma_buf_count=8 [18:36:24][D][esp-idf:000]: W (39329) AUDIO_ELEMENT: [i2s_out-0x3ffd9f94] RESUME timeout [18:36:24][I][esp_adf_pipeline:217]: [ * ] CMD: 9 Pipeline: 2 [18:36:24][W][component:214]: Component adf_pipeline.media_player took a long time for an operation (0.71 s). [18:36:24][W][component:215]: Components should block for at most 20-30ms. [18:36:24][I][esp_adf_pipeline:198]: [ * ] CMD: 8 status: 13 [18:36:24][I][adf_audio:135]: got new pipeline state: 5 [18:36:24][I][esp_adf_pipeline:217]: [ * ] CMD: 8 Pipeline: 5 [18:36:24][I][esp_adf_pipeline:222]: [ i2s_out ] status: 13 [18:36:24][I][esp_adf_pipeline:198]: [ * ] CMD: 8 status: 12 [18:36:24][I][adf_audio:135]: got new pipeline state: 2 [18:36:24][I][esp_adf_pipeline:217]: [ * ] CMD: 8 Pipeline: 2 [18:36:24][I][esp_adf_pipeline:222]: [ i2s_out ] status: 12 [18:36:30][D][media_player:059]: 's3-dev_media_player' - Setting [18:36:30][D][media_player:066]: Media URL: http://192.168.0.90:8123/api/tts_proxy/62fc662dc7005819078de6e2c6a8073d3365a0a4_en-au_1c98f30e25_tts.home_assistant_cloud.mp3 [18:36:30][D][esp-idf:000]: W (45862) AUDIO_ELEMENT: OUT-[decoder] AEL_IO_ABORT [18:36:30][D][esp-idf:000]: W (45866) MP3_DECODER: output aborted -3 [18:36:30][D][esp-idf:000]: I (45874) MP3_DECODER: Closed [18:36:30][I][adf_audio:135]: got new pipeline state: 4 [18:36:30][I][adf_audio:135]: got new pipeline state: 4 [18:36:30][D][esp-idf:000]: I (46051) AUDIO_ELEMENT: [http-0x3ffd5518] Element task created [18:36:30][D][esp-idf:000]: I (46055) AUDIO_ELEMENT: [decoder-0x3ffd590c] Element task created [18:36:30][D][esp-idf:000]: I (46057) AUDIO_ELEMENT: [i2s_out-0x3ffd9f94] Element task created [18:36:30][D][esp-idf:000]: I (46060) AUDIO_PIPELINE: Func:audio_pipeline_run, Line:359, MEM Total:95492 Bytes [18:36:30][D][esp-idf:000]: I (46064) AUDIO_ELEMENT: [http] AEL_MSG_CMD_RESUME,state:1 [18:36:30][D][esp-idf:000]: I (46075) AUDIO_ELEMENT: [decoder] AEL_MSG_CMD_RESUME,state:1 [18:36:30][D][esp-idf:000]: I (46079) AUDIO_ELEMENT: [i2s_out] AEL_MSG_CMD_RESUME,state:1 [18:36:30][D][esp-idf:000]: I (46085) I2S_STREAM: AUDIO_STREAM_WRITER [18:36:31][D][esp-idf:000]: I (46139) HTTP_STREAM: total_bytes=18576 [18:36:31][I][esp_adf_pipeline:217]: [ * ] CMD: 8 Pipeline: 2 [18:36:31][I][esp_adf_pipeline:222]: [ decoder ] status: 12 [18:36:31][I][esp_adf_pipeline:198]: [ * ] CMD: 8 status: 12 [18:36:31][I][adf_audio:135]: got new pipeline state: 2 [18:36:31][I][esp_adf_pipeline:217]: [ * ] CMD: 8 Pipeline: 2 [18:36:31][I][esp_adf_pipeline:222]: [ i2s_out ] status: 12 [18:36:31][I][esp_adf_pipeline:217]: [ * ] CMD: 10 Pipeline: 2 [18:36:31][I][esp_adf_pipeline:217]: [ * ] CMD: 8 Pipeline: 2 [18:36:31][I][esp_adf_pipeline:222]: [ http ] status: 12 [18:36:31][I][HTTPStreamReader:046]: [ * ] Receive music info from mp3 decoder, sample_rates=24000, bits=16, ch=1 [18:36:31][D][esp-idf:000]: I (46468) AUDIO_ELEMENT: [i2s_out] AEL_MSG_CMD_PAUSE [18:36:31][D][esp-idf:000]: I (46473) I2S: DMA Malloc info, datalen=blocksize=2046, dma_buf_count=8 [18:36:31][D][esp-idf:000]: W (46476) AUDIO_ELEMENT: [i2s_out-0x3ffd9f94] RESUME timeout [18:36:31][I][esp_adf_pipeline:217]: [ * ] CMD: 9 Pipeline: 2 [18:36:31][W][component:214]: Component adf_pipeline.media_player took a long time for an operation (0.20 s). [18:36:31][W][component:215]: Components should block for at most 20-30ms. [18:36:31][I][esp_adf_pipeline:198]: [ * ] CMD: 8 status: 13 [18:36:31][I][adf_audio:135]: got new pipeline state: 5 [18:36:31][I][esp_adf_pipeline:217]: [ * ] CMD: 8 Pipeline: 5 [18:36:31][I][esp_adf_pipeline:222]: [ i2s_out ] status: 13 [18:36:31][I][esp_adf_pipeline:198]: [ * ] CMD: 8 status: 12 [18:36:31][I][adf_audio:135]: got new pipeline state: 2 [18:36:31][I][esp_adf_pipeline:217]: [ * ] CMD: 8 Pipeline: 2 [18:36:31][I][esp_adf_pipeline:222]: [ i2s_out ] status: 12 [18:36:33][D][esp-idf:000]: W (48865) HTTP_STREAM: No more data,errno:0, total_bytes:18576, rlen = 0 [18:36:33][D][esp-idf:000]: I (48871) AUDIO_ELEMENT: IN-[http] AEL_IO_DONE,0 [18:36:33][I][esp_adf_pipeline:217]: [ * ] CMD: 11 Pipeline: 2 [18:36:33][I][esp_adf_pipeline:217]: [ * ] CMD: 8 Pipeline: 2 [18:36:33][I][esp_adf_pipeline:222]: [ http ] status: 15 [18:36:34][D][esp-idf:000]: I (49546) AUDIO_ELEMENT: IN-[decoder] AEL_IO_DONE,-2 [18:36:35][D][esp-idf:000]: I (50311) MP3_DECODER: Closed [18:36:35][I][esp_adf_pipeline:217]: [ * ] CMD: 11 Pipeline: 2 [18:36:35][I][esp_adf_pipeline:217]: [ * ] CMD: 8 Pipeline: 2 [18:36:35][I][esp_adf_pipeline:222]: [ decoder ] status: 15 [18:36:35][D][esp-idf:000]: I (50566) AUDIO_ELEMENT: IN-[i2s_out] AEL_IO_DONE,-2 [18:36:36][D][media_player:059]: 's3-dev_media_player' - Setting [18:36:36][D][media_player:066]: Media URL: http://192.168.0.90:8123/api/tts_proxy/62fc662dc7005819078de6e2c6a8073d3365a0a4_en-au_1c98f30e25_tts.home_assistant_cloud.mp3 [18:36:36][D][esp-idf:000]: E (51690) AUDIO_ELEMENT: [http] Element already stopped [18:36:36][D][esp-idf:000]: E (51692) AUDIO_ELEMENT: [decoder] Element already stopped [18:36:38][I][adf_audio:135]: got new pipeline state: 4 [18:36:38][I][adf_audio:135]: got new pipeline state: 4 [18:36:38][D][esp-idf:000]: I (53304) AUDIO_ELEMENT: [http-0x3ffd5518] Element task created [18:36:38][D][esp-idf:000]: I (53308) AUDIO_ELEMENT: [decoder-0x3ffd590c] Element task created [18:36:38][D][esp-idf:000]: I (53311) AUDIO_ELEMENT: [i2s_out-0x3ffd9f94] Element task created [18:36:38][D][esp-idf:000]: I (53313) AUDIO_PIPELINE: Func:audio_pipeline_run, Line:359, MEM Total:108396 Bytes [18:36:38][D][esp-idf:000]: I (53316) AUDIO_ELEMENT: [http] AEL_MSG_CMD_RESUME,state:1 [18:36:38][D][esp-idf:000]: I (53322) AUDIO_ELEMENT: [decoder] AEL_MSG_CMD_RESUME,state:1 [18:36:38][D][esp-idf:000]: I (53326) AUDIO_ELEMENT: [i2s_out] AEL_MSG_CMD_RESUME,state:1 [18:36:38][D][esp-idf:000]: I (53337) AUDIO_PIPELINE: Pipeline started [18:36:38][I][adf_audio:135]: got new pipeline state: 2 [18:36:38][W][component:214]: Component api took a long time for an operation (1.67 s). [18:36:38][W][component:215]: Components should block for at most 20-30ms. [18:36:38][D][esp-idf:000]: I (53383) HTTP_CLIENT: Body received in fetch header state, ```
gnumpi commented 3 months ago

Do the problems only occur when you switch audio streams or also when you start an audio stream the first time? Could you maybe try a configuration which has only the media_player setup (no microphone and no voice assistant) and check if you run into the same problems?

Regarding the microphone, in your configuration you have set channel to left, but in the external component you are loading, the channel register on the ES8388 ist set hard coded to right: https://github.com/mulcmu/esphome-es8388-a1s/blob/a0599d7338682217874cce395c761f049f5053d5/components/es8388/es8388_component.cpp#L65

/@nightdav
// set to Mono Right
  this->write_byte(0x0B, 0x10); 

When the microphone component only receives zeros for a specific time, it sets its state to 'stopped'. This could be the reason why you receive the 'microphone is not running' error.

nighi commented 3 months ago

Yes, exactly this occurs only if I plqy first a 2 channel audio and than a 1 channel audio. I'll looking into it to only configure a mediaplayer.

Regarding the microphone: I changed the config to channel: right and got the same error.

[14:58:42][D][esp-idf:000]: E (720488) I2S: register I2S object to platform failed
gnumpi commented 3 months ago

Thanks for testing, I just committed a new version to the 3-make-supported-i2s-sampling-rates-configurable branch. In this version the pcm format is read from the stream first, then the streamer is reset and and the actual pipeline is started. It would be great if you could test if this is of any help for your problem.

nighi commented 3 months ago

The playback works like a charm :tada:. Unfortunately, it isn't possible to change the volume anymore.

[08:11:09][D][media_player:059]: 's3-dev_media_player' - Setting
[08:11:09][D][media_player:069]:   Volume: 0.13
[08:11:09][D][esp-idf:000]: W (115800) I2S_STREAM: The ALC don't be used. It can not be set.

[08:11:09][E][adf_i2s_out:131]: error setting volume to -24
[08:11:10][D][media_player:059]: 's3-dev_media_player' - Setting
[08:11:10][D][media_player:069]:   Volume: 0.34
[08:11:10][D][esp-idf:000]: W (116824) I2S_STREAM: The ALC don't be used. It can not be set.

[08:11:10][E][adf_i2s_out:131]: error setting volume to -11

But re-enabling ALC does the trick .use_alc = true. Is there a reason why you deactivated it? Or simply to reduce the complexity to identify the issue. If that is the case I have created a PR #6.

gnumpi commented 3 months ago

Perfect, yes that was exactly the reason for disabling it. I will make it configurable though, so people that use the volume control of their sound chip can disable alc.

gnumpi commented 3 months ago

Regarding the microphone, I guess the problem is within using the same i2s-controller for input and output. I will look into it, but I need to prepare some hardware for testing i2s in duplex-mode first. Is it possibility for you to test your microphone configuration alone? Without configuring any speaker or media_player component?

nighi commented 3 months ago

I tested the microphone with a silent voice assistant (without media_player or speaker). It seems to successfully register the microphone, but the wake word is not detected. I think the state change from the voice-assistant from STARTING_MICROPHONE to WAIT_FOR_VAD is missing.

After toggling use_wake_word the old error microphone not running appears back.

log after enabling use wake word ``` [13:31:42][D][switch:012]: 'Use wake word' Turning ON. [13:31:42][D][switch:055]: 'Use wake word': Sending state ON [13:31:42][D][voice_assistant:414]: State changed from IDLE to START_PIPELINE [13:31:42][D][voice_assistant:420]: Desired state set to START_MICROPHONE [13:31:42][D][light:036]: 'Test LED 1' Setting: [13:31:42][D][light:047]: State: ON [13:31:42][D][voice_assistant:118]: microphone not running [13:31:42][D][voice_assistant:202]: Requesting start... [13:31:42][D][voice_assistant:414]: State changed from START_PIPELINE to STARTING_PIPELINE [13:31:42][D][voice_assistant:118]: microphone not running [13:31:42][D][voice_assistant:435]: Client started, streaming microphone [13:31:42][D][voice_assistant:414]: State changed from STARTING_PIPELINE to START_MICROPHONE [13:31:42][D][voice_assistant:420]: Desired state set to STREAMING_MICROPHONE [13:31:42][D][voice_assistant:155]: Starting Microphone [13:31:42][I][esp_adf_pipeline:025]: Starting request, current state 0 [13:31:42][I][esp_adf_pipeline:011]: Init request, current state 0 [13:31:42][D][esp-idf:000]: I (18437) I2S: DMA Malloc info, datalen=blocksize=256, dma_buf_count=8 [13:31:42][D][esp-idf:000]: I (18442) LYRAT_V4_3: I2S0, MCLK output by GPIO0 [13:31:42][D][esp_adf_pipeline:156]: pipeline tag 0, i2s_in [13:31:42][D][esp_adf_pipeline:156]: pipeline tag 1, pcm_reader [13:31:42][D][esp-idf:000]: I (18472) AUDIO_PIPELINE: link el->rb, el:0x3ffd6ad0, tag:i2s_in, rb:0x3ffd6e08 [13:31:42][D][esp_adf_pipeline:169]: Setting up event listener. [13:31:42][I][esp_adf_pipeline:098]: set_new_state: 5 [13:31:42][I][esp_adf_pipeline:098]: set_new_state: 1 [13:31:42][D][voice_assistant:414]: State changed from START_MICROPHONE to STARTING_MICROPHONE [13:31:42][W][component:214]: Component voice_assistant took a long time for an operation (0.07 s). [13:31:42][W][component:215]: Components should block for at most 20-30ms. [13:31:42][D][voice_assistant:521]: Event Type: 1 [13:31:42][D][voice_assistant:524]: Assist Pipeline running [13:31:42][D][voice_assistant:521]: Event Type: 9 [13:32:03][D][esp32.preferences:114]: Saving 1 preferences to flash... [13:32:03][D][esp32.preferences:143]: Saving 1 preferences to flash: 0 cached, 1 written, 0 failed [13:33:14][D][switch:016]: 'Use wake word' Turning OFF. [13:33:14][D][switch:055]: 'Use wake word': Sending state OFF [13:33:14][D][voice_assistant:414]: State changed from STARTING_MICROPHONE to STOP_MICROPHONE [13:33:14][D][voice_assistant:420]: Desired state set to IDLE [13:33:14][D][light:036]: 'Test LED 1' Setting: [13:33:14][D][light:047]: State: OFF [13:33:14][D][voice_assistant:414]: State changed from STOP_MICROPHONE to IDLE [13:33:15][D][switch:012]: 'Use wake word' Turning ON. [13:33:15][D][switch:055]: 'Use wake word': Sending state ON [13:33:15][D][voice_assistant:414]: State changed from IDLE to START_PIPELINE [13:33:15][D][voice_assistant:420]: Desired state set to START_MICROPHONE [13:33:15][D][light:036]: 'Test LED 1' Setting: [13:33:15][D][light:047]: State: ON [13:33:15][D][voice_assistant:118]: microphone not running [13:33:15][D][voice_assistant:202]: Requesting start... [13:33:15][D][voice_assistant:414]: State changed from START_PIPELINE to STARTING_PIPELINE [13:33:15][D][voice_assistant:435]: Client started, streaming microphone [13:33:15][D][voice_assistant:414]: State changed from STARTING_PIPELINE to START_MICROPHONE [13:33:15][D][voice_assistant:420]: Desired state set to STREAMING_MICROPHONE [13:33:15][D][voice_assistant:155]: Starting Microphone [13:33:15][I][esp_adf_pipeline:025]: Starting request, current state 1 [13:33:15][D][voice_assistant:414]: State changed from START_MICROPHONE to STARTING_MICROPHONE [13:33:15][D][voice_assistant:521]: Event Type: 0 [13:33:15][E][voice_assistant:651]: Error: no_wake_word - No wake word detected [13:33:15][D][voice_assistant:514]: Signaling stop... [13:33:15][D][voice_assistant:414]: State changed from STARTING_MICROPHONE to STOP_MICROPHONE [13:33:15][D][voice_assistant:420]: Desired state set to IDLE [13:33:15][D][voice_assistant:414]: State changed from STOP_MICROPHONE to IDLE [13:33:15][D][voice_assistant:521]: Event Type: 2 [13:33:15][D][voice_assistant:611]: Assist Pipeline ended [13:33:15][D][voice_assistant:414]: State changed from IDLE to START_PIPELINE [13:33:15][D][voice_assistant:420]: Desired state set to START_MICROPHONE [13:33:15][D][voice_assistant:521]: Event Type: 1 [13:33:15][D][voice_assistant:524]: Assist Pipeline running [13:33:15][D][voice_assistant:118]: microphone not running [13:33:15][D][voice_assistant:202]: Requesting start... [13:33:15][D][voice_assistant:414]: State changed from START_PIPELINE to STARTING_PIPELINE [13:33:15][D][voice_assistant:521]: Event Type: 9 [13:33:15][D][voice_assistant:118]: microphone not running [13:33:15][D][voice_assistant:521]: Event Type: 0 [13:33:15][E][voice_assistant:651]: Error: wake-stream-failed - Unexpected error during wake-word-detection [13:33:15][D][voice_assistant:514]: Signaling stop... [13:33:15][D][voice_assistant:414]: State changed from STARTING_PIPELINE to STOP_MICROPHONE [13:33:15][D][voice_assistant:420]: Desired state set to IDLE [13:33:15][D][voice_assistant:414]: State changed from STOP_MICROPHONE to IDLE [13:33:15][D][voice_assistant:521]: Event Type: 2 [13:33:15][D][voice_assistant:611]: Assist Pipeline ended [13:33:15][D][voice_assistant:414]: State changed from IDLE to START_PIPELINE [13:33:15][D][voice_assistant:420]: Desired state set to START_MICROPHONE [13:33:15][D][light:036]: 'Test LED 1' Setting: [13:33:15][D][voice_assistant:514]: Signaling stop... [13:33:15][D][voice_assistant:118]: microphone not running [13:33:15][D][voice_assistant:202]: Requesting start... [13:33:15][D][voice_assistant:414]: State changed from START_PIPELINE to STARTING_PIPELINE [13:33:15][D][voice_assistant:521]: Event Type: 1 [13:33:15][D][voice_assistant:524]: Assist Pipeline running [13:33:15][D][voice_assistant:118]: microphone not running [13:33:15][D][voice_assistant:521]: Event Type: 9 [13:33:15][D][voice_assistant:118]: microphone not running [13:33:15][D][voice_assistant:521]: Event Type: 0 [13:33:15][E][voice_assistant:651]: Error: no_wake_word - No wake word detected [13:33:15][D][voice_assistant:514]: Signaling stop... [13:33:15][D][voice_assistant:414]: State changed from STARTING_PIPELINE to STOP_MICROPHONE [13:33:15][D][voice_assistant:420]: Desired state set to IDLE [13:33:15][D][voice_assistant:414]: State changed from STOP_MICROPHONE to IDLE [13:33:15][D][voice_assistant:521]: Event Type: 2 [13:33:15][D][voice_assistant:611]: Assist Pipeline ended [13:33:15][D][voice_assistant:414]: State changed from IDLE to START_PIPELINE [13:33:15][D][voice_assistant:420]: Desired state set to START_MICROPHONE [13:33:15][D][light:036]: 'Test LED 1' Setting: [13:33:15][D][voice_assistant:514]: Signaling stop... [13:33:15][D][voice_assistant:118]: microphone not running [13:33:15][D][voice_assistant:202]: Requesting start... [13:33:16][D][voice_assistant:414]: State changed from START_PIPELINE to STARTING_PIPELINE [13:33:16][D][voice_assistant:521]: Event Type: 1 [13:33:16][D][voice_assistant:524]: Assist Pipeline running [13:33:16][D][voice_assistant:118]: microphone not running [13:33:16][D][voice_assistant:521]: Event Type: 9 [13:33:16][D][voice_assistant:118]: microphone not running [13:33:16][D][voice_assistant:521]: Event Type: 0 [13:33:16][E][voice_assistant:651]: Error: no_wake_word - No wake word detected [13:33:16][D][voice_assistant:514]: Signaling stop... [13:33:16][D][voice_assistant:414]: State changed from STARTING_PIPELINE to STOP_MICROPHONE [13:33:16][D][voice_assistant:420]: Desired state set to IDLE [13:33:16][D][voice_assistant:414]: State changed from STOP_MICROPHONE to IDLE [13:33:16][D][voice_assistant:521]: Event Type: 2 [13:33:16][D][voice_assistant:611]: Assist Pipeline ended [13:33:16][D][voice_assistant:414]: State changed from IDLE to START_PIPELINE [13:33:16][D][voice_assistant:420]: Desired state set to START_MICROPHONE [13:33:16][D][light:036]: 'Test LED 1' Setting: [13:33:16][D][voice_assistant:514]: Signaling stop... [13:33:16][D][voice_assistant:118]: microphone not running [13:33:16][D][voice_assistant:202]: Requesting start... [13:33:16][D][voice_assistant:414]: State changed from START_PIPELINE to STARTING_PIPELINE [13:33:16][D][voice_assistant:521]: Event Type: 1 [13:33:16][D][voice_assistant:524]: Assist Pipeline running [13:33:16][D][voice_assistant:118]: microphone not running [13:33:16][D][voice_assistant:521]: Event Type: 9 [13:33:16][D][voice_assistant:118]: microphone not running [13:33:16][D][voice_assistant:521]: Event Type: 0 [13:33:16][E][voice_assistant:651]: Error: no_wake_word - No wake word detected [13:33:16][D][voice_assistant:514]: Signaling stop... [13:33:16][D][voice_assistant:414]: State changed from STARTING_PIPELINE to STOP_MICROPHONE [13:33:16][D][voice_assistant:420]: Desired state set to IDLE [13:33:16][D][voice_assistant:414]: State changed from STOP_MICROPHONE to IDLE [13:33:16][D][voice_assistant:521]: Event Type: 2 [13:33:16][D][voice_assistant:611]: Assist Pipeline ended [13:33:16][D][voice_assistant:414]: State changed from IDLE to START_PIPELINE [13:33:16][D][voice_assistant:420]: Desired state set to START_MICROPHONE [13:33:16][D][light:036]: 'Test LED 1' Setting: [13:33:16][D][voice_assistant:514]: Signaling stop... [13:33:16][D][voice_assistant:118]: microphone not running [13:33:16][D][voice_assistant:202]: Requesting start... [13:33:16][D][voice_assistant:414]: State changed from START_PIPELINE to STARTING_PIPELINE [13:33:16][D][voice_assistant:521]: Event Type: 1 [13:33:16][D][voice_assistant:524]: Assist Pipeline running [13:33:16][D][voice_assistant:118]: microphone not running [13:33:16][D][voice_assistant:521]: Event Type: 9 [13:33:16][D][voice_assistant:118]: microphone not running [13:33:16][D][voice_assistant:521]: Event Type: 0 [13:33:16][E][voice_assistant:651]: Error: no_wake_word - No wake word detected [13:33:16][D][voice_assistant:514]: Signaling stop... [13:33:16][D][voice_assistant:414]: State changed from STARTING_PIPELINE to STOP_MICROPHONE [13:33:16][D][voice_assistant:420]: Desired state set to IDLE [13:33:16][D][voice_assistant:414]: State changed from STOP_MICROPHONE to IDLE [13:33:16][D][voice_assistant:521]: Event Type: 2 [13:33:16][D][voice_assistant:611]: Assist Pipeline ended [13:33:16][D][voice_assistant:414]: State changed from IDLE to START_PIPELINE [13:33:16][D][voice_assistant:420]: Desired state set to START_MICROPHONE [13:33:16][D][light:036]: 'Test LED 1' Setting: [13:33:16][D][voice_assistant:514]: Signaling stop... [13:33:16][D][voice_assistant:118]: microphone not running [13:33:16][D][voice_assistant:202]: Requesting start... [13:33:16][D][voice_assistant:414]: State changed from START_PIPELINE to STARTING_PIPELINE [13:33:16][D][voice_assistant:521]: Event Type: 1 [13:33:16][D][voice_assistant:524]: Assist Pipeline running [13:33:16][D][voice_assistant:118]: microphone not running [13:33:16][D][voice_assistant:521]: Event Type: 9 [13:33:16][D][voice_assistant:118]: microphone not running [13:33:16][D][voice_assistant:521]: Event Type: 0 [13:33:16][E][voice_assistant:651]: Error: no_wake_word - No wake word detected [13:33:16][D][voice_assistant:514]: Signaling stop... [13:33:16][D][voice_assistant:414]: State changed from STARTING_PIPELINE to STOP_MICROPHONE [13:33:16][D][voice_assistant:420]: Desired state set to IDLE [13:33:16][D][voice_assistant:414]: State changed from STOP_MICROPHONE to IDLE [13:33:16][D][voice_assistant:521]: Event Type: 2 [13:33:16][D][voice_assistant:611]: Assist Pipeline ended [13:33:16][D][voice_assistant:414]: State changed from IDLE to START_PIPELINE [13:33:16][D][voice_assistant:420]: Desired state set to START_MICROPHONE [13:33:16][D][light:036]: 'Test LED 1' Setting: [13:33:16][D][voice_assistant:514]: Signaling stop... [13:33:16][D][voice_assistant:118]: microphone not running [13:33:16][D][voice_assistant:202]: Requesting start... [13:33:16][D][voice_assistant:414]: State changed from START_PIPELINE to STARTING_PIPELINE [13:33:16][D][voice_assistant:521]: Event Type: 1 [13:33:16][D][voice_assistant:524]: Assist Pipeline running [13:33:16][D][voice_assistant:118]: microphone not running [13:33:16][D][voice_assistant:521]: Event Type: 9 [13:33:16][D][voice_assistant:118]: microphone not running [13:33:16][D][voice_assistant:521]: Event Type: 0 [13:33:16][E][voice_assistant:651]: Error: no_wake_word - No wake word detected [13:33:16][D][voice_assistant:514]: Signaling stop... [13:33:16][D][voice_assistant:414]: State changed from STARTING_PIPELINE to STOP_MICROPHONE [13:33:16][D][voice_assistant:420]: Desired state set to IDLE [13:33:16][D][voice_assistant:414]: State changed from STOP_MICROPHONE to IDLE [13:33:16][D][voice_assistant:521]: Event Type: 2 [13:33:16][D][voice_assistant:611]: Assist Pipeline ended [13:33:16][D][voice_assistant:414]: State changed from IDLE to START_PIPELINE [13:33:16][D][voice_assistant:420]: Desired state set to START_MICROPHONE [13:33:16][D][light:036]: 'Test LED 1' Setting: [13:33:16][D][voice_assistant:514]: Signaling stop... [13:33:16][D][voice_assistant:118]: microphone not running [13:33:16][D][voice_assistant:202]: Requesting start... [13:33:16][D][voice_assistant:414]: State changed from START_PIPELINE to STARTING_PIPELINE [13:33:16][D][voice_assistant:521]: Event Type: 1 [13:33:16][D][voice_assistant:524]: Assist Pipeline running [13:33:16][D][voice_assistant:118]: microphone not running [13:33:16][D][voice_assistant:521]: Event Type: 9 [13:33:16][D][voice_assistant:118]: microphone not running [13:33:16][D][voice_assistant:521]: Event Type: 0 [13:33:16][E][voice_assistant:651]: Error: no_wake_word - No wake word detected [13:33:16][D][voice_assistant:514]: Signaling stop... [13:33:16][D][voice_assistant:414]: State changed from STARTING_PIPELINE to STOP_MICROPHONE [13:33:16][D][voice_assistant:420]: Desired state set to IDLE [13:33:16][D][voice_assistant:414]: State changed from STOP_MICROPHONE to IDLE [13:33:16][D][voice_assistant:521]: Event Type: 2 [13:33:16][D][voice_assistant:611]: Assist Pipeline ended [13:33:16][D][voice_assistant:414]: State changed from IDLE to START_PIPELINE [13:33:16][D][voice_assistant:420]: Desired state set to START_MICROPHONE [13:33:16][D][light:036]: 'Test LED 1' Setting: [13:33:16][D][voice_assistant:514]: Signaling stop... [13:33:16][D][voice_assistant:118]: microphone not running [13:33:16][D][voice_assistant:202]: Requesting start... [13:33:16][D][voice_assistant:414]: State changed from START_PIPELINE to STARTING_PIPELINE [13:33:16][D][voice_assistant:521]: Event Type: 1 [13:33:16][D][voice_assistant:524]: Assist Pipeline running [13:33:16][D][voice_assistant:118]: microphone not running [13:33:16][D][voice_assistant:521]: Event Type: 9 [13:33:16][D][voice_assistant:118]: microphone not running [13:33:16][D][switch:016]: 'Use wake word' Turning OFF. [13:33:16][D][switch:055]: 'Use wake word': Sending state OFF [13:33:16][D][voice_assistant:514]: Signaling stop... [13:33:16][D][voice_assistant:414]: State changed from STARTING_PIPELINE to STOP_MICROPHONE [13:33:16][D][voice_assistant:420]: Desired state set to IDLE [13:33:16][D][light:036]: 'Test LED 1' Setting: [13:33:16][D][light:047]: State: OFF [13:33:16][D][voice_assistant:414]: State changed from STOP_MICROPHONE to IDLE [13:33:16][D][voice_assistant:521]: Event Type: 0 [13:33:16][E][voice_assistant:651]: Error: no_wake_word - No wake word detected [13:33:16][D][light:036]: 'Test LED 1' Setting: [13:33:16][D][voice_assistant:521]: Event Type: 2 [13:33:16][D][voice_assistant:611]: Assist Pipeline ended [13:33:16][D][voice_assistant:514]: Signaling stop... [13:33:16][D][voice_assistant:521]: Event Type: 1 [13:33:16][D][voice_assistant:524]: Assist Pipeline running [13:33:16][D][light:036]: 'Test LED 1' Setting: [13:33:16][D][voice_assistant:521]: Event Type: 9 ```

I could also do a i2s capture with a cheap logic analyzer if this helps.

gnumpi commented 3 months ago

the log file looks quite normal to me so far, maybe the sampling rate or channel settings or something like that is not correctly set. Could you check if you notice something wrong when listening to the audio that home assistant receives? You can configure that the assist-pipeline of HA stores the received audio file for debugging purposes: You have to add something like this to your home-assistant configuration file:

assist_pipeline:
  debug_recording_dir: /config/debug
nighi commented 3 months ago

It seems like to create one empty .wav file. If I toggle use wake word, it repeatedly creates exactly this file. Every time the same 44 Bytes. Weirdly I can't even download these files??

➜  ~ cd media/assist-pipeline/3f14b00d61113444bb926dbf819e24f5/Home\ Assistant/591206133912532 
➜  591206133912532 hexdump -C 00_wake-wake_word.openwakeword_2.wav 
00000000  52 49 46 46 24 00 00 00  57 41 56 45 66 6d 74 20  |RIFF$...WAVEfmt |
00000010  10 00 00 00 01 00 01 00  80 3e 00 00 00 7d 00 00  |.........>...}..|
00000020  02 00 10 00 64 61 74 61  00 00 00 00              |....data....|
0000002c
➜  591206133912532 cd ..                                                                                    
➜  Home Assistant cd 590593051580302 
➜  590593051580302 hexdump -C 00_wake-wake_word.openwakeword_2.wav 
00000000  52 49 46 46 24 00 00 00  57 41 56 45 66 6d 74 20  |RIFF$...WAVEfmt |
00000010  10 00 00 00 01 00 01 00  80 3e 00 00 00 7d 00 00  |.........>...}..|
00000020  02 00 10 00 64 61 74 61  00 00 00 00              |....data....|
0000002c
➜  590593051580302 cd ../591206252426423 
➜  591206252426423 hexdump -C 00_wake-wake_word.openwakeword_2.wav 
00000000  52 49 46 46 24 00 00 00  57 41 56 45 66 6d 74 20  |RIFF$...WAVEfmt |
00000010  10 00 00 00 01 00 01 00  80 3e 00 00 00 7d 00 00  |.........>...}..|
00000020  02 00 10 00 64 61 74 61  00 00 00 00              |....data....|
0000002c
gnumpi commented 3 months ago

Hey, It turned out that I messed up the detection for a pipeline status change in my last 'fix'. Hence, the microphone was not working anymore. I committed some fixes into the '8-random-speed-of-playback branch', could you try if this update helps with your problem too?

nighi commented 3 months ago

Hey, yes we are one step further. The wake word detection recorded playable .wav files. The sound is very damped, quiet and most of the time not recognizable. It is certainly not enough for any voice detection. I tried to adjust my settings but couldn't achieve better results.

voice_assistant:
  volume_multiplier: 6
  noise_suppression_level: 4
  auto_gain: 20dBFS

These were my settings which I've tuned with my old yaml config and I think they should still apply anyway.

Without the high noise_suppression I got very noisy audio. A higher gain and volume multiplier seems to don't change anything. If I scream directly into the microphone I am able to trigger the wake word detection though. The audio is attached: sample.zip

I think (and correct me if I'm wrong) for the settings for sample_rate: and bits_per_sample I have to refer to the settings of my adc done during the initialisation by the es8388 component. https://github.com/mulcmu/esphome-es8388-a1s/blob/a0599d7338682217874cce395c761f049f5053d5/components/es8388/es8388_component.cpp#L65

For the parallel use with the media player your fix doesn't help, which is expected I guess.

gnumpi commented 3 months ago

The wake work detection expects a mono signal with 16k sampling rate and 16bit bits_per_sample but these settings seem to be correct in your configuration and also in the es8388 register settings.

Ok, you have the old configuration which uses the components from pr#5230 and which is working, right? So I guess, we have to go through all the settings and parameters and see where we find any difference. Actually both implementations should do the same in the end. The difference is that the pipeline in pr#5230 is setup hardcoded, and in this repository it is setup according to the configuration.

gnumpi commented 3 months ago

I have added a version where the i2s controllers are released after stopping the pipeline. This doesn't allow full duplex yet but could you try if this helps with you hardware? Plese see #17

nighi commented 3 months ago

Ok, we are one step further. I think you mean by not full duplex yet that the voice-assistant and the media-player may not
be active at the same time. So the media player have to be stopped while the voice assistant wake word detection is active and vice versa.

In general I think both works although I weren't able to trigger the wakeword due to the very quiet recording. Could it be that the settings from the voiceassistant component aren't applied for the microphone pipeline? It seems like changing the settings doesn't change anything. I already tried to enable ALC for the input but no difference.

Log testing first media player second voice-assistant ``` INFO ESPHome 2024.2.1 INFO Reading configuration /config/esphome/m5stack-atom-echo-59aac0.yaml... INFO Updating https://github.com/mulcmu/esphome-es8388-a1s.git@nightdav-patch INFO Updating https://github.com/gnumpi/esphome_audio@17-add-support-for-i2s-duplex-mode INFO Generating C++ source... INFO Updating https://github.com/espressif/esp-adf.git@v2.5 INFO Updating submodules (components/esp-adf-libs, components/esp-sr) for https://github.com/espressif/esp-adf.git@v2.5 INFO Compiling app... Processing voice-sat (board: esp-wrover-kit; framework: espidf; platform: platformio/espressif32@5.4.0) -------------------------------------------------------------------------------- HARDWARE: ESP32 240MHz, 320KB RAM, 4MB Flash - framework-espidf @ 3.40406.240122 (4.4.6) - tool-cmake @ 3.16.4 - tool-ninja @ 1.7.1 - toolchain-esp32ulp @ 2.35.0-20220830 - toolchain-xtensa-esp32 @ 8.4.0+2021r2-patch5 Reading CMake configuration... Dependency Graph |-- noise-c @ 0.1.4 RAM: [= ] 9.2% (used 30220 bytes from 327680 bytes) Flash: [====== ] 56.8% (used 1042665 bytes from 1835008 bytes) ========================= [SUCCESS] Took 24.60 seconds ========================= INFO Successfully compiled program. INFO Connecting to 192.168.0.85 INFO Uploading /data/build/voice-sat/.pioenvs/voice-sat/firmware.bin (1048960 bytes) Uploading: [============================================================] 100% Done... INFO Upload took 5.41 seconds, waiting for result... INFO OTA successful INFO Successfully uploaded program. INFO Starting log output from 192.168.0.85 using esphome API INFO Successfully connected to voice-sat @ 192.168.0.85 in 7.161s INFO Successful handshake with voice-sat @ 192.168.0.85 in 0.113s [20:14:29][I][app:102]: ESPHome version 2024.2.1 compiled on Feb 29 2024, 19:19:53 [20:14:29][C][wifi:577]: WiFi: [20:14:29][C][wifi:409]: Local MAC: B8:D6:1A:59:AA:C0 [20:14:29][C][wifi:414]: SSID: [redacted] [20:14:29][C][wifi:415]: IP Address: 192.168.0.85 [20:14:29][C][wifi:417]: BSSID: [redacted] [20:14:29][C][wifi:418]: Hostname: 'voice-sat' [20:14:29][C][wifi:420]: Signal strength: -51 dB ▂▄▆█ [20:14:29][C][wifi:424]: Channel: 6 [20:14:29][C][wifi:425]: Subnet: 255.255.255.0 [20:14:29][C][wifi:426]: Gateway: 192.168.0.1 [20:14:29][C][wifi:427]: DNS1: 192.168.0.1 [20:14:29][C][wifi:428]: DNS2: 0.0.0.0 [20:14:29][C][logger:447]: Logger: [20:14:29][C][logger:448]: Level: DEBUG [20:14:29][C][logger:449]: Log Baud Rate: 115200 [20:14:29][C][logger:451]: Hardware UART: UART0 [20:14:29][C][i2c.idf:061]: I2C Bus: [20:14:29][C][i2c.idf:062]: SDA Pin: GPIO33 [20:14:29][C][i2c.idf:063]: SCL Pin: GPIO32 [20:14:29][C][i2c.idf:064]: Frequency: 50000 Hz [20:14:29][C][i2c.idf:067]: Recovery: bus successfully recovered [20:14:29][I][i2c.idf:077]: Results from i2c bus scan: [20:14:29][I][i2c.idf:083]: Found i2c device at address 0x10 [20:14:29][C][switch.gpio:068]: GPIO Switch 'AMP Switch' [20:14:29][C][switch.gpio:091]: Restore Mode: always OFF [20:14:29][C][switch.gpio:031]: Pin: GPIO21 [20:14:29][C][gpio.output:010]: GPIO Binary Output: [20:14:29][C][gpio.output:011]: Pin: GPIO22 [20:14:29][C][gpio.output:012]: Inverted: YES [20:14:29][C][gpio.output:010]: GPIO Binary Output: [20:14:29][C][gpio.output:011]: Pin: GPIO19 [20:14:29][C][gpio.output:012]: Inverted: YES [20:14:29][C][light:103]: Light 'Test LED 1' [20:14:29][C][light:103]: Light 'Test LED 2' [20:14:29][C][template.switch:068]: Template Switch 'Use wake word' [20:14:29][C][template.switch:091]: Restore Mode: restore defaults to ON [20:14:29][C][template.switch:057]: Optimistic: YES [20:14:30][C][captive_portal:088]: Captive Portal: [20:14:30][C][mdns:115]: mDNS: [20:14:30][C][mdns:116]: Hostname: voice-sat [20:14:30][C][ota:096]: Over-The-Air Updates: [20:14:30][C][ota:097]: Address: voice-sat.local:3232 [20:14:30][C][ota:103]: OTA version: 2. [20:14:30][C][api:139]: API Server: [20:14:30][C][api:140]: Address: voice-sat.local:6053 [20:14:30][C][api:142]: Using noise encryption: YES [20:14:30][C][adf_audio:016]: ESP-ADF-MediaPlayer: [20:14:30][C][adf_audio:018]: Number of ASPComponents: 2 [20:14:34][D][media_player:059]: 's3-dev_media_player' - Setting [20:14:34][D][media_player:069]: Volume: 0.32 WARNING voice-sat @ 192.168.0.85: Connection error occurred: [Errno 104] Connection reset by peer INFO Processing unexpected disconnect from ESPHome API for voice-sat @ 192.168.0.85 WARNING Disconnected from API INFO Successfully connected to voice-sat @ 192.168.0.85 in 0.007s INFO Successful handshake with voice-sat @ 192.168.0.85 in 0.123s [20:15:09][D][media_player:059]: 's3-dev_media_player' - Setting [20:15:09][D][media_player:069]: Volume: 0.34 [20:15:29][D][switch:012]: 'AMP Switch' Turning ON. [20:15:29][D][switch:055]: 'AMP Switch': Sending state ON [20:15:31][D][media_player:059]: 's3-dev_media_player' - Setting [20:15:31][D][media_player:069]: Volume: 0.25 [20:15:39][D][media_player:059]: 's3-dev_media_player' - Setting [20:15:39][D][media_player:069]: Volume: 0.24 [20:15:47][D][media_player:059]: 's3-dev_media_player' - Setting [20:15:47][D][media_player:063]: Command: STOP [20:15:47][D][esp_adf_pipeline:193]: State changed from RUNNING to STOPPING [20:15:47][I][adf_audio:134]: got new pipeline state: 4 [20:15:47][D][esp-idf:000]: W (72700) AUDIO_ELEMENT: OUT-[decoder] AEL_IO_ABORT [20:15:47][D][esp-idf:000]: W (72704) MP3_DECODER: output aborted -3 [20:15:47][D][esp-idf:000]: I (72707) MP3_DECODER: Closed [20:15:47][I][esp_adf_pipeline:114]: [ decoder ] status: 14 [20:15:47][I][esp_adf_pipeline:114]: [ http ] status: 14 [20:15:47][I][esp_adf_pipeline:114]: [ i2s_out ] status: 14 [20:15:47][I][esp_adf_pipeline:122]: [ * ] CMD: 8 status: 14 [20:15:47][D][esp_adf_pipeline:193]: State changed from STOPPING to STOPPED [20:15:47][I][adf_audio:134]: got new pipeline state: 5 [20:15:47][D][esp_adf_pipeline:286]: Called deinit_all [20:15:47][D][esp-idf:000]: I (72929) AUDIO_PIPELINE: audio_pipeline_unlinked [20:15:47][D][esp-idf:000]: W (72932) AUDIO_ELEMENT: [http] Element has not create when AUDIO_ELEMENT_TERMINATE [20:15:47][D][esp-idf:000]: W (72938) AUDIO_ELEMENT: [decoder] Element has not create when AUDIO_ELEMENT_TERMINATE [20:15:47][D][esp-idf:000]: W (72948) AUDIO_ELEMENT: [i2s_out] Element has not create when AUDIO_ELEMENT_TERMINATE [20:15:47][D][esp-idf:000]: I (72958) I2S: DMA queue destroyed [20:15:47][D][esp_adf_pipeline:193]: State changed from STOPPED to UNAVAILABLE [20:15:47][I][adf_audio:134]: got new pipeline state: 0 [20:15:47][W][component:214]: Component adf_pipeline.media_player took a long time for an operation (0.07 s). [20:15:47][W][component:215]: Components should block for at most 20-30ms. [20:16:02][D][media_player:059]: 's3-dev_media_player' - Setting [20:16:02][D][media_player:066]: Media URL: http://st01.dlf.de/dlf/01/128/mp3/stream.mp3 [20:16:02][D][esp_adf_pipeline:038]: Init request, current state UNAVAILABLE [20:16:02][D][esp-idf:000]: I (88250) MP3_DECODER: MP3 init [20:16:02][D][esp_adf_pipeline:233]: Adding new component [20:16:02][D][esp_adf_pipeline:235]: Adding element of component [20:16:02][D][esp_adf_pipeline:235]: Adding element of component [20:16:02][D][esp-idf:000]: I (88272) I2S: DMA Malloc info, datalen=blocksize=2048, dma_buf_count=8 [20:16:02][D][esp-idf:000]: I (88276) LYRAT_V4_3: I2S0, MCLK output by GPIO0 [20:16:02][D][esp-idf:000]: I (88282) I2S: DMA Malloc info, datalen=blocksize=1024, dma_buf_count=8 [20:16:02][D][esp_adf_pipeline:233]: Adding new component [20:16:02][D][esp_adf_pipeline:235]: Adding element of component [20:16:02][D][esp_adf_pipeline:249]: pipeline tag 0, http [20:16:02][D][esp_adf_pipeline:249]: pipeline tag 1, decoder [20:16:02][D][esp_adf_pipeline:249]: pipeline tag 2, i2s_out [20:16:02][D][esp-idf:000]: I (88316) AUDIO_PIPELINE: link el->rb, el:0x3ffd62dc, tag:http, rb:0x3ffd9618 [20:16:02][D][esp-idf:000]: I (88324) AUDIO_PIPELINE: link el->rb, el:0x3ffd5f8c, tag:decoder, rb:0x3ffda5f8 [20:16:02][D][esp_adf_pipeline:262]: Setting up event listener. [20:16:02][D][esp_adf_pipeline:193]: State changed from UNAVAILABLE to STOPPED [20:16:02][I][adf_audio:134]: got new pipeline state: 5 [20:16:03][D][esp_adf_pipeline:049]: Starting request, current state STOPPED [20:16:03][D][esp_adf_pipeline:193]: State changed from STOPPED to PREPARING [20:16:03][I][adf_audio:134]: got new pipeline state: 1 [20:16:03][W][component:214]: Component api took a long time for an operation (0.14 s). [20:16:03][W][component:215]: Components should block for at most 20-30ms. [20:16:03][D][esp-idf:000]: I (88394) AUDIO_ELEMENT: [http-0x3ffd62dc] Element task created [20:16:03][D][esp-idf:000]: I (88397) AUDIO_ELEMENT: [decoder-0x3ffd5f8c] Element task created [20:16:03][D][esp-idf:000]: I (88405) AUDIO_ELEMENT: [http] AEL_MSG_CMD_RESUME,state:1 [20:16:03][D][esp-idf:000]: I (88416) AUDIO_ELEMENT: [decoder] AEL_MSG_CMD_RESUME,state:1 [20:16:03][I][esp_audio_sources:065]: Streamer status: 2 [20:16:03][I][esp_audio_sources:066]: decoder status: 2 [20:16:03][D][esp-idf:000]: I (88586) HTTP_STREAM: total_bytes=0 [20:16:03][D][esp-idf:000]: I (88723) HTTP_CLIENT: Body received in fetch header state, 0x3ffd6c50, 1368 [20:16:03][D][esp-idf:000]: I (88728) HTTP_STREAM: total_bytes=0 [20:16:03][I][HTTPStreamReader:109]: [ * ] Receive music info from mp3 decoder, sample_rates=48000, bits=16, ch=2 [20:16:03][D][esp-idf:000]: I (88791) I2S: DMA Malloc info, datalen=blocksize=2048, dma_buf_count=8 [20:16:03][D][esp-idf:000]: W (88794) AUDIO_ELEMENT: OUT-[decoder] AEL_IO_ABORT [20:16:03][D][esp-idf:000]: W (88797) MP3_DECODER: output aborted -3 [20:16:03][D][esp-idf:000]: I (88800) MP3_DECODER: Closed [20:16:03][D][esp-idf:000]: W (88794) AUDIO_ELEMENT: OUT-[http] AEL_IO_ABORT [20:16:03][D][esp_adf_pipeline:193]: State changed from PREPARING to STARTING [20:16:03][I][adf_audio:134]: got new pipeline state: 2 [20:16:03][D][esp-idf:000]: I (88833) AUDIO_ELEMENT: [i2s_out-0x3ffd8b8c] Element task created [20:16:03][D][esp-idf:000]: I (88835) AUDIO_PIPELINE: Func:audio_pipeline_run, Line:359, MEM Total:109104 Bytes [20:16:03][D][esp-idf:000]: I (88838) AUDIO_ELEMENT: [http] AEL_MSG_CMD_RESUME,state:1 [20:16:03][D][esp-idf:000]: I (88853) AUDIO_ELEMENT: [decoder] AEL_MSG_CMD_RESUME,state:1 [20:16:03][D][esp-idf:000]: I (88860) AUDIO_ELEMENT: [i2s_out] AEL_MSG_CMD_RESUME,state:1 [20:16:03][D][esp-idf:000]: I (88868) AUDIO_PIPELINE: Pipeline started [20:16:03][I][esp_adf_pipeline:114]: [ http ] status: 14 [20:16:03][I][esp_adf_pipeline:114]: [ i2s_out ] status: 12 [20:16:03][I][esp_adf_pipeline:122]: [ * ] CMD: 8 status: 12 [20:16:03][D][esp_adf_pipeline:193]: State changed from STARTING to RUNNING [20:16:03][I][adf_audio:134]: got new pipeline state: 3 [20:16:03][D][esp-idf:000]: I (88963) HTTP_STREAM: total_bytes=0 [20:16:03][D][esp-idf:000]: I (89070) HTTP_STREAM: total_bytes=0 [20:16:03][I][esp_adf_pipeline:114]: [ http ] status: 12 [20:16:03][I][esp_adf_pipeline:114]: [ decoder ] status: 12 [20:16:03][I][HTTPStreamReader:109]: [ * ] Receive music info from mp3 decoder, sample_rates=48000, bits=16, ch=2 [20:16:07][D][media_player:059]: 's3-dev_media_player' - Setting [20:16:07][D][media_player:069]: Volume: 0.17 [20:16:08][D][media_player:059]: 's3-dev_media_player' - Setting [20:16:08][D][media_player:069]: Volume: 0.14 [20:16:09][D][media_player:059]: 's3-dev_media_player' - Setting [20:16:09][D][media_player:069]: Volume: 0.29 [20:16:10][D][media_player:059]: 's3-dev_media_player' - Setting [20:16:10][D][media_player:069]: Volume: 0.26 [20:16:11][D][media_player:059]: 's3-dev_media_player' - Setting [20:16:11][D][media_player:069]: Volume: 0.17 [20:16:28][D][media_player:059]: 's3-dev_media_player' - Setting [20:16:28][D][media_player:063]: Command: STOP [20:16:28][D][esp_adf_pipeline:193]: State changed from RUNNING to STOPPING [20:16:28][I][adf_audio:134]: got new pipeline state: 4 [20:16:28][D][esp-idf:000]: W (114379) AUDIO_ELEMENT: OUT-[decoder] AEL_IO_ABORT [20:16:28][D][esp-idf:000]: W (114383) MP3_DECODER: output aborted -3 [20:16:29][D][esp-idf:000]: I (114387) MP3_DECODER: Closed [20:16:29][D][esp-idf:000]: W (114392) AUDIO_ELEMENT: OUT-[http] AEL_IO_ABORT [20:16:29][I][esp_adf_pipeline:114]: [ decoder ] status: 14 [20:16:29][I][esp_adf_pipeline:114]: [ http ] status: 14 [20:16:29][I][esp_adf_pipeline:114]: [ i2s_out ] status: 14 [20:16:29][I][esp_adf_pipeline:122]: [ * ] CMD: 8 status: 14 [20:16:29][D][esp_adf_pipeline:193]: State changed from STOPPING to STOPPED [20:16:29][I][adf_audio:134]: got new pipeline state: 5 [20:16:29][D][esp_adf_pipeline:286]: Called deinit_all [20:16:29][D][esp-idf:000]: I (114502) AUDIO_PIPELINE: audio_pipeline_unlinked [20:16:29][D][esp-idf:000]: W (114509) AUDIO_ELEMENT: [http] Element has not create when AUDIO_ELEMENT_TERMINATE [20:16:29][D][esp-idf:000]: W (114511) AUDIO_ELEMENT: [decoder] Element has not create when AUDIO_ELEMENT_TERMINATE [20:16:29][D][esp-idf:000]: W (114519) AUDIO_ELEMENT: [i2s_out] Element has not create when AUDIO_ELEMENT_TERMINATE [20:16:29][D][esp-idf:000]: I (114530) I2S: DMA queue destroyed [20:16:29][D][esp_adf_pipeline:193]: State changed from STOPPED to UNAVAILABLE [20:16:29][I][adf_audio:134]: got new pipeline state: 0 [20:16:29][W][component:214]: Component adf_pipeline.media_player took a long time for an operation (0.07 s). [20:16:29][W][component:215]: Components should block for at most 20-30ms. [20:16:46][D][media_player:059]: 's3-dev_media_player' - Setting [20:16:46][D][media_player:066]: Media URL: http://stream.live.vc.bbcmedia.co.uk/bbc_world_service [20:16:46][D][esp_adf_pipeline:038]: Init request, current state UNAVAILABLE [20:16:46][D][esp-idf:000]: I (131670) MP3_DECODER: MP3 init [20:16:46][D][esp_adf_pipeline:233]: Adding new component [20:16:46][D][esp_adf_pipeline:235]: Adding element of component [20:16:46][D][esp_adf_pipeline:235]: Adding element of component [20:16:46][D][esp-idf:000]: I (131684) I2S: DMA Malloc info, datalen=blocksize=2048, dma_buf_count=8 [20:16:46][D][esp-idf:000]: I (131692) LYRAT_V4_3: I2S0, MCLK output by GPIO0 [20:16:46][D][esp-idf:000]: I (131702) I2S: DMA Malloc info, datalen=blocksize=1024, dma_buf_count=8 [20:16:46][D][esp_adf_pipeline:233]: Adding new component [20:16:46][D][esp_adf_pipeline:235]: Adding element of component [20:16:46][D][esp_adf_pipeline:249]: pipeline tag 0, http [20:16:46][D][esp_adf_pipeline:249]: pipeline tag 1, decoder [20:16:46][D][esp_adf_pipeline:249]: pipeline tag 2, i2s_out [20:16:46][D][esp-idf:000]: I (131736) AUDIO_PIPELINE: link el->rb, el:0x3ffd62dc, tag:http, rb:0x3ffd6144 [20:16:46][D][esp-idf:000]: I (131753) AUDIO_PIPELINE: link el->rb, el:0x3ffdf974, tag:decoder, rb:0x3ffd61c4 [20:16:46][D][esp_adf_pipeline:262]: Setting up event listener. [20:16:46][D][esp_adf_pipeline:193]: State changed from UNAVAILABLE to STOPPED [20:16:46][I][adf_audio:134]: got new pipeline state: 5 [20:16:46][D][esp_adf_pipeline:049]: Starting request, current state STOPPED [20:16:46][D][esp_adf_pipeline:193]: State changed from STOPPED to PREPARING [20:16:46][I][adf_audio:134]: got new pipeline state: 1 [20:16:46][W][component:214]: Component api took a long time for an operation (0.14 s). [20:16:46][W][component:215]: Components should block for at most 20-30ms. [20:16:46][D][esp-idf:000]: I (131814) AUDIO_ELEMENT: [http-0x3ffd62dc] Element task created [20:16:46][D][esp-idf:000]: I (131817) AUDIO_ELEMENT: [decoder-0x3ffdf974] Element task created [20:16:46][D][esp-idf:000]: I (131834) AUDIO_ELEMENT: [http] AEL_MSG_CMD_RESUME,state:1 [20:16:46][D][esp-idf:000]: I (131839) AUDIO_ELEMENT: [decoder] AEL_MSG_CMD_RESUME,state:1 [20:16:46][I][esp_audio_sources:065]: Streamer status: 2 [20:16:46][I][esp_audio_sources:066]: decoder status: 2 [20:16:46][D][esp-idf:000]: I (132271) HTTP_STREAM: total_bytes=0 [20:16:47][I][HTTPStreamReader:109]: [ * ] Receive music info from mp3 decoder, sample_rates=24000, bits=16, ch=2 [20:16:47][D][esp-idf:000]: I (133013) I2S: DMA Malloc info, datalen=blocksize=2048, dma_buf_count=8 [20:16:47][D][esp-idf:000]: W (133016) AUDIO_ELEMENT: OUT-[decoder] AEL_IO_ABORT [20:16:47][D][esp-idf:000]: W (133022) MP3_DECODER: output aborted -3 [20:16:47][D][esp-idf:000]: I (133025) MP3_DECODER: Closed [20:16:47][D][esp-idf:000]: W (133039) HTTP_STREAM: No output due to stopping [20:16:47][D][esp_adf_pipeline:193]: State changed from PREPARING to STARTING [20:16:47][I][adf_audio:134]: got new pipeline state: 2 [20:16:47][D][esp-idf:000]: I (133056) AUDIO_ELEMENT: [i2s_out-0x3ffdaa94] Element task created [20:16:47][D][esp-idf:000]: I (133059) AUDIO_PIPELINE: Func:audio_pipeline_run, Line:359, MEM Total:108636 Bytes [20:16:47][D][esp-idf:000]: I (133070) AUDIO_ELEMENT: [http] AEL_MSG_CMD_RESUME,state:1 [20:16:47][D][esp-idf:000]: I (133082) AUDIO_ELEMENT: [decoder] AEL_MSG_CMD_RESUME,state:1 [20:16:47][D][esp-idf:000]: I (133094) AUDIO_ELEMENT: [i2s_out] AEL_MSG_CMD_RESUME,state:1 [20:16:47][D][esp-idf:000]: I (133097) AUDIO_PIPELINE: Pipeline started [20:16:47][W][component:214]: Component adf_pipeline.media_player took a long time for an operation (0.05 s). [20:16:47][W][component:215]: Components should block for at most 20-30ms. [20:16:47][I][esp_adf_pipeline:114]: [ http ] status: 14 [20:16:47][I][esp_adf_pipeline:114]: [ i2s_out ] status: 12 [20:16:47][I][esp_adf_pipeline:122]: [ * ] CMD: 8 status: 12 [20:16:47][D][esp_adf_pipeline:193]: State changed from STARTING to RUNNING [20:16:47][I][adf_audio:134]: got new pipeline state: 3 [20:16:48][D][esp-idf:000]: I (133723) HTTP_STREAM: total_bytes=0 [20:16:48][I][esp_adf_pipeline:114]: [ http ] status: 12 [20:16:48][I][esp_adf_pipeline:114]: [ decoder ] status: 12 [20:16:48][I][HTTPStreamReader:109]: [ * ] Receive music info from mp3 decoder, sample_rates=24000, bits=16, ch=2 [20:16:54][D][media_player:059]: 's3-dev_media_player' - Setting [20:16:54][D][media_player:069]: Volume: 0.19 [20:17:02][D][media_player:059]: 's3-dev_media_player' - Setting [20:17:02][D][media_player:063]: Command: STOP [20:17:02][D][esp_adf_pipeline:193]: State changed from RUNNING to STOPPING [20:17:02][I][adf_audio:134]: got new pipeline state: 4 [20:17:02][D][esp-idf:000]: W (147755) AUDIO_ELEMENT: OUT-[decoder] AEL_IO_ABORT [20:17:02][D][esp-idf:000]: W (147764) MP3_DECODER: output aborted -3 [20:17:02][D][esp-idf:000]: I (147769) MP3_DECODER: Closed [20:17:02][I][esp_adf_pipeline:114]: [ decoder ] status: 14 [20:17:02][I][esp_adf_pipeline:114]: [ http ] status: 14 [20:17:02][I][esp_adf_pipeline:114]: [ i2s_out ] status: 14 [20:17:02][I][esp_adf_pipeline:122]: [ * ] CMD: 8 status: 14 [20:17:02][D][esp_adf_pipeline:193]: State changed from STOPPING to STOPPED [20:17:02][I][adf_audio:134]: got new pipeline state: 5 [20:17:02][D][esp_adf_pipeline:286]: Called deinit_all [20:17:02][D][esp-idf:000]: I (147958) AUDIO_PIPELINE: audio_pipeline_unlinked [20:17:02][D][esp-idf:000]: W (147961) AUDIO_ELEMENT: [http] Element has not create when AUDIO_ELEMENT_TERMINATE [20:17:02][D][esp-idf:000]: W (147965) AUDIO_ELEMENT: [decoder] Element has not create when AUDIO_ELEMENT_TERMINATE [20:17:02][D][esp-idf:000]: W (147975) AUDIO_ELEMENT: [i2s_out] Element has not create when AUDIO_ELEMENT_TERMINATE [20:17:02][D][esp-idf:000]: I (147985) I2S: DMA queue destroyed [20:17:02][D][esp_adf_pipeline:193]: State changed from STOPPED to UNAVAILABLE [20:17:02][I][adf_audio:134]: got new pipeline state: 0 [20:17:02][W][component:214]: Component adf_pipeline.media_player took a long time for an operation (0.06 s). [20:17:02][W][component:215]: Components should block for at most 20-30ms. [20:17:27][D][switch:012]: 'Use wake word' Turning ON. [20:17:27][D][switch:055]: 'Use wake word': Sending state ON [20:17:27][D][voice_assistant:414]: State changed from IDLE to START_PIPELINE [20:17:27][D][voice_assistant:420]: Desired state set to START_MICROPHONE [20:17:27][D][light:036]: 'Test LED 1' Setting: [20:17:27][D][light:047]: State: ON [20:17:27][D][voice_assistant:118]: microphone not running [20:17:27][D][voice_assistant:202]: Requesting start... [20:17:27][D][voice_assistant:414]: State changed from START_PIPELINE to STARTING_PIPELINE [20:17:27][D][voice_assistant:435]: Client started, streaming microphone [20:17:27][D][voice_assistant:414]: State changed from STARTING_PIPELINE to START_MICROPHONE [20:17:27][D][voice_assistant:420]: Desired state set to STREAMING_MICROPHONE [20:17:27][D][voice_assistant:155]: Starting Microphone [20:17:27][D][esp_adf_pipeline:049]: Starting request, current state UNAVAILABLE [20:17:27][D][esp_adf_pipeline:038]: Init request, current state UNAVAILABLE [20:17:27][D][esp-idf:000]: I (173305) I2S: DMA Malloc info, datalen=blocksize=256, dma_buf_count=8 [20:17:27][D][esp-idf:000]: I (173315) LYRAT_V4_3: I2S0, MCLK output by GPIO0 [20:17:27][D][esp_adf_pipeline:233]: Adding new component [20:17:27][D][esp_adf_pipeline:235]: Adding element of component [20:17:27][D][esp_adf_pipeline:233]: Adding new component [20:17:27][D][esp_adf_pipeline:235]: Adding element of component [20:17:27][D][esp_adf_pipeline:249]: pipeline tag 0, i2s_in [20:17:27][D][esp_adf_pipeline:249]: pipeline tag 1, pcm_reader [20:17:27][D][esp-idf:000]: I (173357) AUDIO_PIPELINE: link el->rb, el:0x3ffdf880, tag:i2s_in, rb:0x3ffdab28 [20:17:27][D][esp_adf_pipeline:262]: Setting up event listener. [20:17:27][D][esp_adf_pipeline:193]: State changed from UNAVAILABLE to STOPPED [20:17:27][D][esp_adf_pipeline:193]: State changed from STOPPED to PREPARING [20:17:28][D][voice_assistant:414]: State changed from START_MICROPHONE to STARTING_MICROPHONE [20:17:28][W][component:214]: Component voice_assistant took a long time for an operation (0.10 s). [20:17:28][W][component:215]: Components should block for at most 20-30ms. [20:17:28][D][esp_adf_pipeline:193]: State changed from PREPARING to STARTING [20:17:28][D][esp-idf:000]: I (173408) AUDIO_ELEMENT: [i2s_in-0x3ffdf880] Element task created [20:17:28][D][esp-idf:000]: I (173416) AUDIO_ELEMENT: [pcm_reader-0x3ffdfc60] Element task created [20:17:28][D][esp-idf:000]: I (173437) AUDIO_PIPELINE: Func:audio_pipeline_run, Line:359, MEM Total:143744 Bytes [20:17:28][D][esp-idf:000]: I (173447) AUDIO_ELEMENT: [i2s_in] AEL_MSG_CMD_RESUME,state:1 [20:17:28][D][esp-idf:000]: I (173451) AUDIO_PIPELINE: Pipeline started [20:17:28][D][voice_assistant:521]: Event Type: 1 [20:17:28][D][voice_assistant:524]: Assist Pipeline running [20:17:28][I][esp_adf_pipeline:114]: [ i2s_in ] status: 12 [20:17:28][D][voice_assistant:521]: Event Type: 9 [20:17:28][I][esp_adf_pipeline:114]: [ pcm_reader ] status: 12 [20:17:28][I][esp_adf_pipeline:122]: [ * ] CMD: 8 status: 12 [20:17:28][D][esp_adf_pipeline:193]: State changed from STARTING to RUNNING [20:17:28][D][voice_assistant:414]: State changed from STARTING_MICROPHONE to STREAMING_MICROPHONE [20:17:33][D][voice_assistant:521]: Event Type: 0 [20:17:33][D][voice_assistant:521]: Event Type: 2 [20:17:33][D][voice_assistant:611]: Assist Pipeline ended [20:17:33][D][voice_assistant:414]: State changed from STREAMING_MICROPHONE to IDLE [20:17:33][D][voice_assistant:420]: Desired state set to IDLE [20:17:33][D][voice_assistant:414]: State changed from IDLE to START_PIPELINE [20:17:33][D][voice_assistant:420]: Desired state set to START_MICROPHONE [20:17:33][D][voice_assistant:202]: Requesting start... [20:17:33][D][voice_assistant:414]: State changed from START_PIPELINE to STARTING_PIPELINE [20:17:33][D][voice_assistant:435]: Client started, streaming microphone [20:17:33][D][voice_assistant:414]: State changed from STARTING_PIPELINE to STREAMING_MICROPHONE [20:17:33][D][voice_assistant:420]: Desired state set to STREAMING_MICROPHONE [20:17:33][D][voice_assistant:521]: Event Type: 1 [20:17:33][D][voice_assistant:524]: Assist Pipeline running [20:17:33][D][voice_assistant:521]: Event Type: 9 [20:17:33][D][light:036]: 'Test LED 1' Setting: [20:17:38][D][voice_assistant:521]: Event Type: 0 [20:17:38][D][voice_assistant:521]: Event Type: 2 [20:17:38][D][voice_assistant:611]: Assist Pipeline ended [20:17:38][D][voice_assistant:414]: State changed from STREAMING_MICROPHONE to IDLE [20:17:38][D][voice_assistant:420]: Desired state set to IDLE [20:17:38][D][voice_assistant:414]: State changed from IDLE to START_PIPELINE [20:17:38][D][voice_assistant:420]: Desired state set to START_MICROPHONE [20:17:38][D][voice_assistant:202]: Requesting start... [20:17:38][D][voice_assistant:414]: State changed from START_PIPELINE to STARTING_PIPELINE [20:17:38][D][voice_assistant:435]: Client started, streaming microphone [20:17:38][D][voice_assistant:414]: State changed from STARTING_PIPELINE to STREAMING_MICROPHONE [20:17:38][D][voice_assistant:420]: Desired state set to STREAMING_MICROPHONE [20:17:38][D][voice_assistant:521]: Event Type: 1 [20:17:38][D][voice_assistant:524]: Assist Pipeline running [20:17:38][D][voice_assistant:521]: Event Type: 9 [20:17:38][D][light:036]: 'Test LED 1' Setting: [20:17:43][D][voice_assistant:521]: Event Type: 0 [20:17:43][D][voice_assistant:521]: Event Type: 2 [20:17:43][D][voice_assistant:611]: Assist Pipeline ended [20:17:43][D][voice_assistant:414]: State changed from STREAMING_MICROPHONE to IDLE [20:17:43][D][voice_assistant:420]: Desired state set to IDLE [20:17:43][D][voice_assistant:414]: State changed from IDLE to START_PIPELINE [20:17:43][D][voice_assistant:420]: Desired state set to START_MICROPHONE [20:17:43][D][voice_assistant:202]: Requesting start... [20:17:43][D][voice_assistant:414]: State changed from START_PIPELINE to STARTING_PIPELINE [20:17:43][D][voice_assistant:435]: Client started, streaming microphone [20:17:43][D][voice_assistant:414]: State changed from STARTING_PIPELINE to STREAMING_MICROPHONE [20:17:43][D][voice_assistant:420]: Desired state set to STREAMING_MICROPHONE [20:17:43][D][voice_assistant:521]: Event Type: 1 [20:17:43][D][voice_assistant:524]: Assist Pipeline running [20:17:43][D][voice_assistant:521]: Event Type: 9 [20:17:43][D][light:036]: 'Test LED 1' Setting: [20:17:45][D][media_player:059]: 's3-dev_media_player' - Setting [20:17:45][D][media_player:069]: Volume: 0.46 [20:17:48][D][voice_assistant:521]: Event Type: 0 [20:17:48][D][voice_assistant:521]: Event Type: 2 [20:17:48][D][voice_assistant:611]: Assist Pipeline ended [20:17:48][D][voice_assistant:414]: State changed from STREAMING_MICROPHONE to IDLE [20:17:48][D][voice_assistant:420]: Desired state set to IDLE [20:17:48][D][voice_assistant:414]: State changed from IDLE to START_PIPELINE [20:17:48][D][voice_assistant:420]: Desired state set to START_MICROPHONE [20:17:48][D][voice_assistant:202]: Requesting start... [20:17:48][D][voice_assistant:414]: State changed from START_PIPELINE to STARTING_PIPELINE [20:17:48][D][voice_assistant:435]: Client started, streaming microphone [20:17:48][D][voice_assistant:414]: State changed from STARTING_PIPELINE to STREAMING_MICROPHONE [20:17:48][D][voice_assistant:420]: Desired state set to STREAMING_MICROPHONE [20:17:48][D][voice_assistant:521]: Event Type: 1 [20:17:48][D][voice_assistant:524]: Assist Pipeline running [20:17:48][D][voice_assistant:521]: Event Type: 9 [20:17:48][D][light:036]: 'Test LED 1' Setting: [20:17:50][D][media_player:059]: 's3-dev_media_player' - Setting [20:17:50][D][media_player:069]: Volume: 0.11 [20:17:53][D][voice_assistant:521]: Event Type: 0 [20:17:53][D][voice_assistant:521]: Event Type: 2 [20:17:53][D][voice_assistant:611]: Assist Pipeline ended [20:17:53][D][voice_assistant:414]: State changed from STREAMING_MICROPHONE to IDLE [20:17:53][D][voice_assistant:420]: Desired state set to IDLE [20:17:53][D][voice_assistant:414]: State changed from IDLE to START_PIPELINE [20:17:53][D][voice_assistant:420]: Desired state set to START_MICROPHONE [20:17:53][D][voice_assistant:202]: Requesting start... [20:17:53][D][voice_assistant:414]: State changed from START_PIPELINE to STARTING_PIPELINE [20:17:53][D][voice_assistant:435]: Client started, streaming microphone [20:17:53][D][voice_assistant:414]: State changed from STARTING_PIPELINE to STREAMING_MICROPHONE [20:17:53][D][voice_assistant:420]: Desired state set to STREAMING_MICROPHONE [20:17:53][D][voice_assistant:521]: Event Type: 1 [20:17:53][D][voice_assistant:524]: Assist Pipeline running [20:17:53][D][voice_assistant:521]: Event Type: 9 [20:17:53][D][light:036]: 'Test LED 1' Setting: [20:17:58][D][voice_assistant:521]: Event Type: 0 [20:17:58][D][voice_assistant:521]: Event Type: 2 [20:17:58][D][voice_assistant:611]: Assist Pipeline ended [20:17:58][D][voice_assistant:414]: State changed from STREAMING_MICROPHONE to IDLE [20:17:58][D][voice_assistant:420]: Desired state set to IDLE [20:17:58][D][voice_assistant:414]: State changed from IDLE to START_PIPELINE [20:17:58][D][voice_assistant:420]: Desired state set to START_MICROPHONE [20:17:58][D][voice_assistant:202]: Requesting start... [20:17:58][D][voice_assistant:414]: State changed from START_PIPELINE to STARTING_PIPELINE [20:17:58][D][voice_assistant:435]: Client started, streaming microphone [20:17:58][D][voice_assistant:414]: State changed from STARTING_PIPELINE to STREAMING_MICROPHONE [20:17:58][D][voice_assistant:420]: Desired state set to STREAMING_MICROPHONE [20:17:58][D][voice_assistant:521]: Event Type: 1 [20:17:58][D][voice_assistant:524]: Assist Pipeline running [20:17:58][D][voice_assistant:521]: Event Type: 9 [20:17:58][D][light:036]: 'Test LED 1' Setting: [20:17:59][D][media_player:059]: 's3-dev_media_player' - Setting [20:17:59][D][media_player:066]: Media URL: http://192.168.0.90:8123/api/tts_proxy/62fc662dc7005819078de6e2c6a8073d3365a0a4_en-au_1c98f30e25_tts.home_assistant_cloud.mp3 [20:17:59][D][esp_adf_pipeline:038]: Init request, current state UNAVAILABLE [20:17:59][D][esp-idf:000]: I (204742) MP3_DECODER: MP3 init [20:17:59][D][esp_adf_pipeline:233]: Adding new component [20:17:59][D][esp_adf_pipeline:235]: Adding element of component [20:17:59][D][esp_adf_pipeline:235]: Adding element of component [20:17:59][D][esp-idf:000]: E (204766) I2S: register I2S object to platform failed [20:17:59][D][esp-idf:000]: I (204775) LYRAT_V4_3: I2S0, MCLK output by GPIO0 [20:17:59][D][esp_adf_pipeline:233]: Adding new component [20:17:59][D][esp_adf_pipeline:235]: Adding element of component [20:17:59][D][esp_adf_pipeline:249]: pipeline tag 0, http [20:17:59][D][esp_adf_pipeline:249]: pipeline tag 1, decoder [20:17:59][D][esp_adf_pipeline:249]: pipeline tag 2, i2s_out [20:17:59][D][esp-idf:000]: I (204829) AUDIO_PIPELINE: link el->rb, el:0x3ffda9d0, tag:http, rb:0x3ffd94b4 [20:17:59][D][esp-idf:000]: I (204831) AUDIO_PIPELINE: link el->rb, el:0x3ffda8a8, tag:decoder, rb:0x3ffd96ac [20:17:59][D][esp_adf_pipeline:262]: Setting up event listener. [20:17:59][D][esp_adf_pipeline:193]: State changed from UNAVAILABLE to STOPPED [20:17:59][I][adf_audio:134]: got new pipeline state: 5 [20:17:59][D][esp_adf_pipeline:049]: Starting request, current state STOPPED [20:17:59][D][esp_adf_pipeline:193]: State changed from STOPPED to PREPARING [20:17:59][I][adf_audio:134]: got new pipeline state: 1 [20:17:59][W][component:214]: Component api took a long time for an operation (0.14 s). [20:17:59][W][component:215]: Components should block for at most 20-30ms. [20:17:59][D][esp-idf:000]: I (204894) AUDIO_ELEMENT: [http-0x3ffda9d0] Element task created [20:17:59][D][esp-idf:000]: I (204903) AUDIO_ELEMENT: [decoder-0x3ffda8a8] Element task created [20:17:59][D][esp-idf:000]: I (204904) AUDIO_ELEMENT: [http] AEL_MSG_CMD_RESUME,state:1 [20:17:59][D][esp-idf:000]: I (204914) AUDIO_ELEMENT: [decoder] AEL_MSG_CMD_RESUME,state:1 [20:17:59][I][esp_audio_sources:065]: Streamer status: 2 [20:17:59][I][esp_audio_sources:066]: decoder status: 2 [20:17:59][D][esp-idf:000]: I (204961) HTTP_CLIENT: Body received in fetch header state, 0x3ffe554b, 1841 [20:17:59][D][esp-idf:000]: I (204965) HTTP_STREAM: total_bytes=18576 [20:17:59][I][HTTPStreamReader:109]: [ * ] Receive music info from mp3 decoder, sample_rates=24000, bits=16, ch=1 [20:17:59][W][component:214]: Component adf_pipeline.media_player took a long time for an operation (0.06 s). [20:17:59][W][component:215]: Components should block for at most 20-30ms. [20:18:02][D][voice_assistant:521]: Event Type: 0 [20:18:02][D][voice_assistant:521]: Event Type: 2 [20:18:02][D][voice_assistant:611]: Assist Pipeline ended [20:18:02][D][voice_assistant:414]: State changed from STREAMING_MICROPHONE to IDLE [20:18:02][D][voice_assistant:420]: Desired state set to IDLE [20:18:02][D][voice_assistant:414]: State changed from IDLE to START_PIPELINE [20:18:02][D][voice_assistant:420]: Desired state set to START_MICROPHONE [20:18:02][D][voice_assistant:202]: Requesting start... [20:18:02][D][voice_assistant:414]: State changed from START_PIPELINE to STARTING_PIPELINE [20:18:02][D][voice_assistant:435]: Client started, streaming microphone [20:18:02][D][voice_assistant:414]: State changed from STARTING_PIPELINE to STREAMING_MICROPHONE [20:18:02][D][voice_assistant:420]: Desired state set to STREAMING_MICROPHONE [20:18:02][D][voice_assistant:521]: Event Type: 1 [20:18:02][D][voice_assistant:524]: Assist Pipeline running [20:18:02][D][voice_assistant:521]: Event Type: 9 [20:18:02][D][light:036]: 'Test LED 1' Setting: [20:18:05][D][voice_assistant:521]: Event Type: 0 [20:18:05][D][voice_assistant:521]: Event Type: 2 [20:18:05][D][voice_assistant:611]: Assist Pipeline ended [20:18:05][D][voice_assistant:414]: State changed from STREAMING_MICROPHONE to IDLE [20:18:05][D][voice_assistant:420]: Desired state set to IDLE [20:18:05][D][voice_assistant:414]: State changed from IDLE to START_PIPELINE [20:18:05][D][voice_assistant:420]: Desired state set to START_MICROPHONE [20:18:05][D][voice_assistant:202]: Requesting start... [20:18:05][D][voice_assistant:414]: State changed from START_PIPELINE to STARTING_PIPELINE [20:18:05][D][voice_assistant:435]: Client started, streaming microphone [20:18:05][D][voice_assistant:414]: State changed from STARTING_PIPELINE to STREAMING_MICROPHONE [20:18:05][D][voice_assistant:420]: Desired state set to STREAMING_MICROPHONE [20:18:05][D][voice_assistant:521]: Event Type: 1 [20:18:05][D][voice_assistant:524]: Assist Pipeline running [20:18:05][D][voice_assistant:521]: Event Type: 9 [20:18:05][D][light:036]: 'Test LED 1' Setting: [20:18:08][D][voice_assistant:521]: Event Type: 0 [20:18:08][D][voice_assistant:521]: Event Type: 2 [20:18:08][D][voice_assistant:611]: Assist Pipeline ended [20:18:08][D][voice_assistant:414]: State changed from STREAMING_MICROPHONE to IDLE [20:18:08][D][voice_assistant:420]: Desired state set to IDLE [20:18:08][D][voice_assistant:414]: State changed from IDLE to START_PIPELINE [20:18:08][D][voice_assistant:420]: Desired state set to START_MICROPHONE [20:18:09][D][voice_assistant:202]: Requesting start... [20:18:09][D][voice_assistant:414]: State changed from START_PIPELINE to STARTING_PIPELINE [20:18:09][D][voice_assistant:435]: Client started, streaming microphone [20:18:09][D][voice_assistant:414]: State changed from STARTING_PIPELINE to STREAMING_MICROPHONE [20:18:09][D][voice_assistant:420]: Desired state set to STREAMING_MICROPHONE [20:18:09][D][voice_assistant:521]: Event Type: 1 [20:18:09][D][voice_assistant:524]: Assist Pipeline running [20:18:09][D][voice_assistant:521]: Event Type: 9 [20:18:09][D][light:036]: 'Test LED 1' Setting: [20:18:11][D][media_player:059]: 's3-dev_media_player' - Setting [20:18:11][D][media_player:069]: Volume: 0.26 [20:18:12][D][voice_assistant:521]: Event Type: 0 [20:18:12][D][voice_assistant:521]: Event Type: 2 [20:18:12][D][voice_assistant:611]: Assist Pipeline ended [20:18:12][D][voice_assistant:414]: State changed from STREAMING_MICROPHONE to IDLE [20:18:12][D][voice_assistant:420]: Desired state set to IDLE [20:18:12][D][voice_assistant:414]: State changed from IDLE to START_PIPELINE [20:18:12][D][voice_assistant:420]: Desired state set to START_MICROPHONE [20:18:12][D][voice_assistant:202]: Requesting start... [20:18:12][D][voice_assistant:414]: State changed from START_PIPELINE to STARTING_PIPELINE [20:18:12][D][voice_assistant:435]: Client started, streaming microphone [20:18:12][D][voice_assistant:414]: State changed from STARTING_PIPELINE to STREAMING_MICROPHONE [20:18:12][D][voice_assistant:420]: Desired state set to STREAMING_MICROPHONE [20:18:12][D][voice_assistant:521]: Event Type: 1 [20:18:12][D][voice_assistant:524]: Assist Pipeline running [20:18:12][D][voice_assistant:521]: Event Type: 9 [20:18:12][D][light:036]: 'Test LED 1' Setting: [20:18:15][D][voice_assistant:521]: Event Type: 0 [20:18:15][D][voice_assistant:521]: Event Type: 2 [20:18:15][D][voice_assistant:611]: Assist Pipeline ended [20:18:15][D][voice_assistant:414]: State changed from STREAMING_MICROPHONE to IDLE [20:18:15][D][voice_assistant:420]: Desired state set to IDLE [20:18:15][D][voice_assistant:414]: State changed from IDLE to START_PIPELINE [20:18:15][D][voice_assistant:420]: Desired state set to START_MICROPHONE [20:18:15][D][voice_assistant:202]: Requesting start... [20:18:15][D][voice_assistant:414]: State changed from START_PIPELINE to STARTING_PIPELINE [20:18:15][D][voice_assistant:435]: Client started, streaming microphone [20:18:15][D][voice_assistant:414]: State changed from STARTING_PIPELINE to STREAMING_MICROPHONE [20:18:15][D][voice_assistant:420]: Desired state set to STREAMING_MICROPHONE [20:18:15][D][voice_assistant:521]: Event Type: 1 [20:18:15][D][voice_assistant:524]: Assist Pipeline running [20:18:15][D][voice_assistant:521]: Event Type: 9 [20:18:15][D][light:036]: 'Test LED 1' Setting: [20:18:16][D][media_player:059]: 's3-dev_media_player' - Setting [20:18:16][D][media_player:066]: Media URL: http://192.168.0.90:8123/api/tts_proxy/62fc662dc7005819078de6e2c6a8073d3365a0a4_en-au_1c98f30e25_tts.home_assistant_cloud.mp3 [20:18:16][D][esp_adf_pipeline:038]: Init request, current state PREPARING [20:18:16][D][esp_adf_pipeline:049]: Starting request, current state PREPARING [20:18:16][D][esp-idf:000]: I (222357) AUDIO_ELEMENT: [http] AEL_MSG_CMD_RESUME,state:1 [20:18:16][D][esp-idf:000]: I (222361) AUDIO_ELEMENT: [decoder] AEL_MSG_CMD_RESUME,state:1 [20:18:16][I][esp_audio_sources:065]: Streamer status: 2 [20:18:16][I][esp_audio_sources:066]: decoder status: 2 [20:18:17][D][esp-idf:000]: I (222402) HTTP_CLIENT: Body received in fetch header state, 0x3ffe36bf, 1841 [20:18:17][D][esp-idf:000]: I (222408) HTTP_STREAM: total_bytes=18576 [20:18:17][I][HTTPStreamReader:109]: [ * ] Receive music info from mp3 decoder, sample_rates=24000, bits=16, ch=1 [20:18:17][D][esp-idf:000]: W (222449) AUDIO_ELEMENT: OUT-[decoder] AEL_IO_ABORT [20:18:17][D][esp-idf:000]: W (222454) MP3_DECODER: output aborted -3 [20:18:17][D][esp-idf:000]: I (222458) MP3_DECODER: Closed [20:18:17][D][esp-idf:000]: W (222464) AUDIO_ELEMENT: OUT-[http] AEL_IO_ABORT [20:18:19][D][voice_assistant:521]: Event Type: 0 [20:18:19][D][voice_assistant:521]: Event Type: 2 [20:18:19][D][voice_assistant:611]: Assist Pipeline ended [20:18:19][D][voice_assistant:414]: State changed from STREAMING_MICROPHONE to IDLE [20:18:19][D][voice_assistant:420]: Desired state set to IDLE [20:18:19][D][voice_assistant:414]: State changed from IDLE to START_PIPELINE [20:18:19][D][voice_assistant:420]: Desired state set to START_MICROPHONE [20:18:19][D][voice_assistant:202]: Requesting start... [20:18:19][D][voice_assistant:414]: State changed from START_PIPELINE to STARTING_PIPELINE [20:18:19][D][voice_assistant:435]: Client started, streaming microphone [20:18:19][D][voice_assistant:414]: State changed from STARTING_PIPELINE to STREAMING_MICROPHONE [20:18:19][D][voice_assistant:420]: Desired state set to STREAMING_MICROPHONE [20:18:19][D][voice_assistant:521]: Event Type: 1 [20:18:19][D][voice_assistant:524]: Assist Pipeline running [20:18:19][D][voice_assistant:521]: Event Type: 9 [20:18:19][D][light:036]: 'Test LED 1' Setting: [20:18:22][D][voice_assistant:521]: Event Type: 0 [20:18:22][D][voice_assistant:521]: Event Type: 2 [20:18:22][D][voice_assistant:611]: Assist Pipeline ended [20:18:22][D][voice_assistant:414]: State changed from STREAMING_MICROPHONE to IDLE [20:18:22][D][voice_assistant:420]: Desired state set to IDLE [20:18:22][D][voice_assistant:414]: State changed from IDLE to START_PIPELINE [20:18:22][D][voice_assistant:420]: Desired state set to START_MICROPHONE [20:18:22][D][voice_assistant:202]: Requesting start... [20:18:22][D][voice_assistant:414]: State changed from START_PIPELINE to STARTING_PIPELINE [20:18:22][D][voice_assistant:435]: Client started, streaming microphone [20:18:22][D][voice_assistant:414]: State changed from STARTING_PIPELINE to STREAMING_MICROPHONE [20:18:22][D][voice_assistant:420]: Desired state set to STREAMING_MICROPHONE [20:18:22][D][voice_assistant:521]: Event Type: 1 [20:18:22][D][voice_assistant:524]: Assist Pipeline running [20:18:22][D][voice_assistant:521]: Event Type: 9 [20:18:22][D][light:036]: 'Test LED 1' Setting: [20:18:23][D][media_player:059]: 's3-dev_media_player' - Setting [20:18:23][D][media_player:066]: Media URL: http://192.168.0.90:8123/api/tts_proxy/62fc662dc7005819078de6e2c6a8073d3365a0a4_de-de_a1fc3f3e13_cloud.mp3 [20:18:23][D][esp_adf_pipeline:038]: Init request, current state PREPARING [20:18:23][D][esp_adf_pipeline:049]: Starting request, current state PREPARING [20:18:23][D][esp-idf:000]: I (228586) AUDIO_ELEMENT: [http] AEL_MSG_CMD_RESUME,state:1 [20:18:23][D][esp-idf:000]: I (228590) AUDIO_ELEMENT: [decoder] AEL_MSG_CMD_RESUME,state:1 [20:18:23][I][esp_audio_sources:065]: Streamer status: 2 [20:18:23][I][esp_audio_sources:066]: decoder status: 2 [20:18:23][D][esp-idf:000]: I (228634) HTTP_CLIENT: Body received in fetch header state, 0x3ffe36bf, 1841 [20:18:23][D][esp-idf:000]: I (228639) HTTP_STREAM: total_bytes=17694 [20:18:23][I][HTTPStreamReader:109]: [ * ] Receive music info from mp3 decoder, sample_rates=24000, bits=16, ch=1 [20:18:23][D][esp-idf:000]: W (228679) AUDIO_ELEMENT: OUT-[decoder] AEL_IO_ABORT [20:18:23][D][esp-idf:000]: W (228684) MP3_DECODER: output aborted -3 [20:18:23][D][esp-idf:000]: I (228688) MP3_DECODER: Closed [20:18:23][D][esp-idf:000]: W (228693) AUDIO_ELEMENT: OUT-[http] AEL_IO_ABORT [20:18:25][D][esp32.preferences:114]: Saving 1 preferences to flash... [20:18:25][D][esp32.preferences:143]: Saving 1 preferences to flash: 0 cached, 1 written, 0 failed [20:18:25][D][voice_assistant:521]: Event Type: 0 [20:18:25][D][voice_assistant:521]: Event Type: 2 [20:18:25][D][voice_assistant:611]: Assist Pipeline ended [20:18:25][D][voice_assistant:414]: State changed from STREAMING_MICROPHONE to IDLE [20:18:25][D][voice_assistant:420]: Desired state set to IDLE [20:18:25][D][voice_assistant:414]: State changed from IDLE to START_PIPELINE [20:18:25][D][voice_assistant:420]: Desired state set to START_MICROPHONE [20:18:25][D][voice_assistant:202]: Requesting start... [20:18:25][D][voice_assistant:414]: State changed from START_PIPELINE to STARTING_PIPELINE [20:18:25][D][voice_assistant:435]: Client started, streaming microphone [20:18:25][D][voice_assistant:414]: State changed from STARTING_PIPELINE to STREAMING_MICROPHONE [20:18:25][D][voice_assistant:420]: Desired state set to STREAMING_MICROPHONE [20:18:25][D][voice_assistant:521]: Event Type: 1 [20:18:25][D][voice_assistant:524]: Assist Pipeline running [20:18:25][D][voice_assistant:521]: Event Type: 9 [20:18:26][D][light:036]: 'Test LED 1' Setting: [20:18:26][D][media_player:059]: 's3-dev_media_player' - Setting [20:18:26][D][media_player:066]: Media URL: http://192.168.0.90:8123/api/tts_proxy/62fc662dc7005819078de6e2c6a8073d3365a0a4_en_-_google_translate.mp3 [20:18:26][D][esp_adf_pipeline:038]: Init request, current state PREPARING [20:18:26][D][esp_adf_pipeline:049]: Starting request, current state PREPARING [20:18:26][D][esp-idf:000]: I (231462) AUDIO_ELEMENT: [http] AEL_MSG_CMD_RESUME,state:1 [20:18:26][D][esp-idf:000]: I (231467) AUDIO_ELEMENT: [decoder] AEL_MSG_CMD_RESUME,state:1 [20:18:26][I][esp_audio_sources:065]: Streamer status: 2 [20:18:26][I][esp_audio_sources:066]: decoder status: 2 [20:18:26][D][esp-idf:000]: I (231716) HTTP_CLIENT: Body received in fetch header state, 0x3ffe5d8b, 1841 [20:18:26][D][esp-idf:000]: I (231724) HTTP_STREAM: total_bytes=11872 [20:18:26][I][HTTPStreamReader:109]: [ * ] Receive music info from mp3 decoder, sample_rates=24000, bits=16, ch=1 [20:18:26][D][esp-idf:000]: W (231759) AUDIO_ELEMENT: OUT-[decoder] AEL_IO_ABORT [20:18:26][D][esp-idf:000]: W (231765) MP3_DECODER: output aborted -3 [20:18:26][D][esp-idf:000]: I (231771) MP3_DECODER: Closed [20:18:26][D][esp-idf:000]: W (231776) AUDIO_ELEMENT: OUT-[http] AEL_IO_ABORT [20:18:29][D][voice_assistant:521]: Event Type: 0 [20:18:29][D][voice_assistant:521]: Event Type: 2 [20:18:29][D][voice_assistant:611]: Assist Pipeline ended [20:18:29][D][voice_assistant:414]: State changed from STREAMING_MICROPHONE to IDLE [20:18:29][D][voice_assistant:420]: Desired state set to IDLE [20:18:29][D][voice_assistant:414]: State changed from IDLE to START_PIPELINE [20:18:29][D][voice_assistant:420]: Desired state set to START_MICROPHONE [20:18:29][D][voice_assistant:202]: Requesting start... [20:18:29][D][voice_assistant:414]: State changed from START_PIPELINE to STARTING_PIPELINE [20:18:29][D][voice_assistant:435]: Client started, streaming microphone [20:18:29][D][voice_assistant:414]: State changed from STARTING_PIPELINE to STREAMING_MICROPHONE [20:18:29][D][voice_assistant:420]: Desired state set to STREAMING_MICROPHONE [20:18:29][D][voice_assistant:521]: Event Type: 1 [20:18:29][D][voice_assistant:524]: Assist Pipeline running [20:18:29][D][voice_assistant:521]: Event Type: 9 [20:18:29][D][light:036]: 'Test LED 1' Setting: [20:18:31][D][media_player:059]: 's3-dev_media_player' - Setting [20:18:31][D][media_player:066]: Media URL: http://st01.dlf.de/dlf/01/128/mp3/stream.mp3 [20:18:31][D][esp_adf_pipeline:038]: Init request, current state PREPARING [20:18:31][D][esp_adf_pipeline:049]: Starting request, current state PREPARING [20:18:31][D][esp-idf:000]: I (237034) AUDIO_ELEMENT: [http] AEL_MSG_CMD_RESUME,state:1 [20:18:31][D][esp-idf:000]: I (237039) AUDIO_ELEMENT: [decoder] AEL_MSG_CMD_RESUME,state:1 [20:18:31][I][esp_audio_sources:065]: Streamer status: 2 [20:18:31][I][esp_audio_sources:066]: decoder status: 2 [20:18:31][D][esp-idf:000]: I (237173) HTTP_STREAM: total_bytes=0 [20:18:31][D][esp-idf:000]: I (237288) HTTP_CLIENT: Body received in fetch header state, 0x3ffe3898, 1368 [20:18:31][D][esp-idf:000]: I (237295) HTTP_STREAM: total_bytes=0 [20:18:31][I][HTTPStreamReader:109]: [ * ] Receive music info from mp3 decoder, sample_rates=48000, bits=16, ch=2 [20:18:31][D][esp-idf:000]: I (237375) I2S: DMA Malloc info, datalen=blocksize=512, dma_buf_count=8 [20:18:32][D][esp-idf:000]: W (237378) AUDIO_ELEMENT: OUT-[decoder] AEL_IO_ABORT [20:18:32][D][esp-idf:000]: W (237390) MP3_DECODER: output aborted -3 [20:18:32][D][esp-idf:000]: I (237398) MP3_DECODER: Closed [20:18:32][D][esp-idf:000]: W (237405) AUDIO_ELEMENT: OUT-[http] AEL_IO_ABORT [20:18:32][D][voice_assistant:521]: Event Type: 0 [20:18:32][D][voice_assistant:521]: Event Type: 2 [20:18:32][D][voice_assistant:611]: Assist Pipeline ended [20:18:32][D][voice_assistant:414]: State changed from STREAMING_MICROPHONE to IDLE [20:18:32][D][voice_assistant:420]: Desired state set to IDLE [20:18:32][D][voice_assistant:414]: State changed from IDLE to START_PIPELINE [20:18:32][D][voice_assistant:420]: Desired state set to START_MICROPHONE [20:18:32][D][voice_assistant:202]: Requesting start... [20:18:32][D][voice_assistant:414]: State changed from START_PIPELINE to STARTING_PIPELINE [20:18:32][D][voice_assistant:435]: Client started, streaming microphone [20:18:32][D][voice_assistant:414]: State changed from STARTING_PIPELINE to STREAMING_MICROPHONE [20:18:32][D][voice_assistant:420]: Desired state set to STREAMING_MICROPHONE [20:18:32][D][voice_assistant:521]: Event Type: 1 [20:18:32][D][voice_assistant:524]: Assist Pipeline running [20:18:32][D][voice_assistant:521]: Event Type: 9 [20:18:32][D][light:036]: 'Test LED 1' Setting: [20:18:33][D][voice_assistant:521]: Event Type: 0 [20:18:33][D][voice_assistant:521]: Event Type: 2 [20:18:33][D][voice_assistant:611]: Assist Pipeline ended [20:18:33][D][voice_assistant:414]: State changed from STREAMING_MICROPHONE to IDLE [20:18:33][D][voice_assistant:420]: Desired state set to IDLE [20:18:33][D][voice_assistant:414]: State changed from IDLE to START_PIPELINE [20:18:33][D][voice_assistant:420]: Desired state set to START_MICROPHONE [20:18:33][D][voice_assistant:202]: Requesting start... [20:18:33][D][voice_assistant:414]: State changed from START_PIPELINE to STARTING_PIPELINE [20:18:33][D][voice_assistant:435]: Client started, streaming microphone [20:18:33][D][voice_assistant:414]: State changed from STARTING_PIPELINE to STREAMING_MICROPHONE [20:18:33][D][voice_assistant:420]: Desired state set to STREAMING_MICROPHONE [20:18:33][D][voice_assistant:521]: Event Type: 1 [20:18:33][D][voice_assistant:524]: Assist Pipeline running [20:18:33][D][voice_assistant:521]: Event Type: 9 [20:18:33][D][light:036]: 'Test LED 1' Setting: [20:18:33][D][voice_assistant:521]: Event Type: 0 [20:18:33][D][voice_assistant:521]: Event Type: 2 [20:18:33][D][voice_assistant:611]: Assist Pipeline ended [20:18:33][D][voice_assistant:414]: State changed from STREAMING_MICROPHONE to IDLE [20:18:33][D][voice_assistant:420]: Desired state set to IDLE [20:18:33][D][voice_assistant:414]: State changed from IDLE to START_PIPELINE [20:18:33][D][voice_assistant:420]: Desired state set to START_MICROPHONE [20:18:33][D][voice_assistant:202]: Requesting start... [20:18:33][D][voice_assistant:414]: State changed from START_PIPELINE to STARTING_PIPELINE [20:18:33][D][voice_assistant:435]: Client started, streaming microphone [20:18:33][D][voice_assistant:414]: State changed from STARTING_PIPELINE to STREAMING_MICROPHONE [20:18:33][D][voice_assistant:420]: Desired state set to STREAMING_MICROPHONE [20:18:33][D][voice_assistant:521]: Event Type: 1 [20:18:33][D][voice_assistant:524]: Assist Pipeline running [20:18:33][D][voice_assistant:521]: Event Type: 9 [20:18:34][D][light:036]: 'Test LED 1' Setting: [20:18:34][D][voice_assistant:521]: Event Type: 0 [20:18:34][D][voice_assistant:521]: Event Type: 2 [20:18:34][D][voice_assistant:611]: Assist Pipeline ended [20:18:34][D][voice_assistant:414]: State changed from STREAMING_MICROPHONE to IDLE [20:18:34][D][voice_assistant:420]: Desired state set to IDLE [20:18:34][D][voice_assistant:414]: State changed from IDLE to START_PIPELINE [20:18:34][D][voice_assistant:420]: Desired state set to START_MICROPHONE [20:18:34][D][voice_assistant:202]: Requesting start... [20:18:34][D][voice_assistant:414]: State changed from START_PIPELINE to STARTING_PIPELINE [20:18:34][D][voice_assistant:435]: Client started, streaming microphone [20:18:34][D][voice_assistant:414]: State changed from STARTING_PIPELINE to STREAMING_MICROPHONE [20:18:34][D][voice_assistant:420]: Desired state set to STREAMING_MICROPHONE [20:18:34][D][voice_assistant:521]: Event Type: 1 [20:18:34][D][voice_assistant:524]: Assist Pipeline running [20:18:34][D][voice_assistant:521]: Event Type: 9 [20:18:34][D][light:036]: 'Test LED 1' Setting: [20:18:35][D][voice_assistant:521]: Event Type: 0 [20:18:35][D][voice_assistant:521]: Event Type: 2 [20:18:35][D][voice_assistant:611]: Assist Pipeline ended [20:18:35][D][voice_assistant:414]: State changed from STREAMING_MICROPHONE to IDLE [20:18:35][D][voice_assistant:420]: Desired state set to IDLE [20:18:35][D][voice_assistant:414]: State changed from IDLE to START_PIPELINE [20:18:35][D][voice_assistant:420]: Desired state set to START_MICROPHONE [20:18:35][D][voice_assistant:202]: Requesting start... [20:18:35][D][voice_assistant:414]: State changed from START_PIPELINE to STARTING_PIPELINE [20:18:35][D][voice_assistant:435]: Client started, streaming microphone [20:18:35][D][voice_assistant:414]: State changed from STARTING_PIPELINE to STREAMING_MICROPHONE [20:18:35][D][voice_assistant:420]: Desired state set to STREAMING_MICROPHONE [20:18:35][D][voice_assistant:521]: Event Type: 1 [20:18:35][D][voice_assistant:524]: Assist Pipeline running [20:18:35][D][voice_assistant:521]: Event Type: 9 [20:18:35][D][light:036]: 'Test LED 1' Setting: [20:18:36][D][voice_assistant:521]: Event Type: 0 [20:18:36][D][voice_assistant:521]: Event Type: 2 [20:18:36][D][voice_assistant:611]: Assist Pipeline ended [20:18:36][D][voice_assistant:414]: State changed from STREAMING_MICROPHONE to IDLE [20:18:36][D][voice_assistant:420]: Desired state set to IDLE [20:18:36][D][voice_assistant:414]: State changed from IDLE to START_PIPELINE [20:18:36][D][voice_assistant:420]: Desired state set to START_MICROPHONE [20:18:36][D][voice_assistant:202]: Requesting start... [20:18:36][D][voice_assistant:414]: State changed from START_PIPELINE to STARTING_PIPELINE [20:18:36][D][voice_assistant:435]: Client started, streaming microphone [20:18:36][D][voice_assistant:414]: State changed from STARTING_PIPELINE to STREAMING_MICROPHONE [20:18:36][D][voice_assistant:420]: Desired state set to STREAMING_MICROPHONE [20:18:36][D][voice_assistant:521]: Event Type: 1 [20:18:36][D][voice_assistant:524]: Assist Pipeline running [20:18:36][D][voice_assistant:521]: Event Type: 9 [20:18:36][D][light:036]: 'Test LED 1' Setting: [20:18:37][D][voice_assistant:521]: Event Type: 0 [20:18:37][D][voice_assistant:521]: Event Type: 2 [20:18:37][D][voice_assistant:611]: Assist Pipeline ended [20:18:37][D][voice_assistant:414]: State changed from STREAMING_MICROPHONE to IDLE [20:18:37][D][voice_assistant:420]: Desired state set to IDLE [20:18:37][D][voice_assistant:414]: State changed from IDLE to START_PIPELINE [20:18:37][D][voice_assistant:420]: Desired state set to START_MICROPHONE [20:18:37][D][voice_assistant:202]: Requesting start... [20:18:37][D][voice_assistant:414]: State changed from START_PIPELINE to STARTING_PIPELINE [20:18:37][D][voice_assistant:435]: Client started, streaming microphone [20:18:37][D][voice_assistant:414]: State changed from STARTING_PIPELINE to STREAMING_MICROPHONE [20:18:37][D][voice_assistant:420]: Desired state set to STREAMING_MICROPHONE [20:18:37][D][voice_assistant:521]: Event Type: 1 [20:18:37][D][voice_assistant:524]: Assist Pipeline running [20:18:37][D][voice_assistant:521]: Event Type: 9 [20:18:37][D][light:036]: 'Test LED 1' Setting: [20:18:37][D][switch:016]: 'Use wake word' Turning OFF. [20:18:37][D][switch:055]: 'Use wake word': Sending state OFF [20:18:37][D][voice_assistant:514]: Signaling stop... [20:18:37][D][voice_assistant:414]: State changed from STREAMING_MICROPHONE to STOP_MICROPHONE [20:18:37][D][voice_assistant:420]: Desired state set to IDLE [20:18:37][D][light:036]: 'Test LED 1' Setting: [20:18:37][D][light:047]: State: OFF [20:18:37][D][esp_adf_pipeline:193]: State changed from RUNNING to STOPPING [20:18:37][D][voice_assistant:414]: State changed from STOP_MICROPHONE to STOPPING_MICROPHONE [20:18:37][I][esp_adf_pipeline:114]: [ pcm_reader ] status: 14 [20:18:37][I][esp_adf_pipeline:122]: [ * ] CMD: 8 status: 14 [20:18:37][D][esp_adf_pipeline:193]: State changed from STOPPING to STOPPED [20:18:37][D][esp_adf_pipeline:286]: Called deinit_all [20:18:37][D][esp-idf:000]: I (243190) AUDIO_PIPELINE: audio_pipeline_unlinked [20:18:37][D][esp-idf:000]: W (243198) AUDIO_ELEMENT: [i2s_in] Element has not create when AUDIO_ELEMENT_TERMINATE [20:18:37][D][esp-idf:000]: I (243209) I2S: DMA queue destroyed [20:18:37][D][esp-idf:000]: W (243219) AUDIO_ELEMENT: [pcm_reader] Element has not create when AUDIO_ELEMENT_TERMINATE [20:18:37][D][esp_adf_pipeline:193]: State changed from STOPPED to UNAVAILABLE [20:18:37][W][component:214]: Component adf_pipeline.microphone took a long time for an operation (0.06 s). [20:18:37][W][component:215]: Components should block for at most 20-30ms. [20:18:37][D][esp_adf_pipeline:193]: State changed from PREPARING to STARTING [20:18:37][I][adf_audio:134]: got new pipeline state: 2 [20:18:37][D][esp-idf:000]: I (243262) AUDIO_ELEMENT: [i2s_out-0x3ffd9aec] Element task created [20:18:37][D][esp-idf:000]: I (243270) AUDIO_PIPELINE: Func:audio_pipeline_run, Line:359, MEM Total:127488 Bytes [20:18:37][D][esp-idf:000]: I (243280) AUDIO_ELEMENT: [http] AEL_MSG_CMD_RESUME,state:1 [20:18:37][D][esp-idf:000]: I (243292) AUDIO_ELEMENT: [decoder] AEL_MSG_CMD_RESUME,state:1 [20:18:37][D][esp-idf:000]: I (243302) AUDIO_ELEMENT: [i2s_out] AEL_MSG_CMD_RESUME,state:1 [20:18:37][D][esp-idf:000]: I (243304) I2S_STREAM: AUDIO_STREAM_WRITER [20:18:37][D][voice_assistant:521]: Event Type: 2 [20:18:37][D][voice_assistant:611]: Assist Pipeline ended [20:18:37][I][esp_adf_pipeline:114]: [ i2s_out ] status: 12 [20:18:37][I][esp_adf_pipeline:122]: [ * ] CMD: 8 status: 12 WARNING voice-sat @ 192.168.0.85: Connection error occurred: [Errno 104] Connection reset by peer INFO Processing unexpected disconnect from ESPHome API for voice-sat @ 192.168.0.85 WARNING Disconnected from API INFO Successfully connected to voice-sat @ 192.168.0.85 in 0.012s INFO Successful handshake with voice-sat @ 192.168.0.85 in 0.127s [20:19:36][E][voice_assistant:460]: No API client connected [20:19:36][D][voice_assistant:414]: State changed from IDLE to IDLE [20:19:36][D][voice_assistant:420]: Desired state set to IDLE ```

But there are still some reconnects/exceptions? And I was sometimes able to trigger the microphone not running errror loop.

unexpected reconnect and microphone not running after stopping the mediaplayer pipeline. ``` [20:27:41][C][adf_audio:016]: ESP-ADF-MediaPlayer: [20:27:41][C][adf_audio:018]: Number of ASPComponents: 2 [20:27:44][D][media_player:059]: 's3-dev_media_player' - Setting [20:27:44][D][media_player:069]: Volume: 0.41 WARNING voice-sat @ 192.168.0.85: Connection error occurred: [Errno 104] Connection reset by peer INFO Processing unexpected disconnect from ESPHome API for voice-sat @ 192.168.0.85 WARNING Disconnected from API INFO Successfully connected to voice-sat @ 192.168.0.85 in 0.048s INFO Successful handshake with voice-sat @ 192.168.0.85 in 0.132s [20:28:44][D][api:102]: Accepted 192.168.0.90 [20:28:44][W][component:214]: Component api took a long time for an operation (0.06 s). [20:28:44][W][component:215]: Components should block for at most 20-30ms. [20:28:44][D][api.connection:1121]: Home Assistant 2024.2.5 (192.168.0.90): Connected successfully [20:28:54][D][switch:012]: 'AMP Switch' Turning ON. [20:28:54][D][switch:055]: 'AMP Switch': Sending state ON [20:28:59][D][media_player:059]: 's3-dev_media_player' - Setting [20:28:59][D][media_player:069]: Volume: 0.19 WARNING voice-sat @ 192.168.0.85: Connection error occurred: [Errno 104] Connection reset by peer INFO Processing unexpected disconnect from ESPHome API for voice-sat @ 192.168.0.85 WARNING Disconnected from API INFO Successfully connected to voice-sat @ 192.168.0.85 in 0.005s INFO Successful handshake with voice-sat @ 192.168.0.85 in 0.115s [20:29:22][I][HTTPStreamReader:109]: [ * ] Receive music info from mp3 decoder, sample_rates=24000, bits=16, ch=2 [20:29:22][D][esp-idf:000]: I (23460) I2S: DMA Malloc info, datalen=blocksize=2048, dma_buf_count=8 [20:29:22][D][esp-idf:000]: W (23463) AUDIO_ELEMENT: OUT-[decoder] AEL_IO_ABORT [20:29:22][D][esp-idf:000]: W (23469) MP3_DECODER: output aborted -3 [20:29:22][D][esp-idf:000]: I (23472) MP3_DECODER: Closed [20:29:22][D][esp-idf:000]: W (23489) HTTP_STREAM: No output due to stopping [20:29:22][D][esp_adf_pipeline:193]: State changed from PREPARING to STARTING [20:29:22][I][adf_audio:134]: got new pipeline state: 2 [20:29:22][D][esp-idf:000]: I (23508) AUDIO_ELEMENT: [i2s_out-0x3ffd6124] Element task created [20:29:22][D][esp-idf:000]: I (23511) AUDIO_PIPELINE: Func:audio_pipeline_run, Line:359, MEM Total:112380 Bytes [20:29:22][D][esp-idf:000]: I (23514) AUDIO_ELEMENT: [http] AEL_MSG_CMD_RESUME,state:1 [20:29:22][D][esp-idf:000]: I (23524) AUDIO_ELEMENT: [decoder] AEL_MSG_CMD_RESUME,state:1 [20:29:22][D][esp-idf:000]: I (23538) AUDIO_ELEMENT: [i2s_out] AEL_MSG_CMD_RESUME,state:1 [20:29:22][D][esp-idf:000]: I (23542) I2S_STREAM: AUDIO_STREAM_WRITER [20:29:22][I][esp_adf_pipeline:114]: [ i2s_out ] status: 12 [20:29:22][I][esp_adf_pipeline:122]: [ * ] CMD: 8 status: 12 [20:29:22][D][esp_adf_pipeline:193]: State changed from STARTING to RUNNING [20:29:22][I][adf_audio:134]: got new pipeline state: 3 [20:29:23][D][esp-idf:000]: I (24158) HTTP_STREAM: total_bytes=0 [20:29:23][I][esp_adf_pipeline:114]: [ http ] status: 12 [20:29:23][I][esp_adf_pipeline:114]: [ decoder ] status: 12 [20:29:23][I][HTTPStreamReader:109]: [ * ] Receive music info from mp3 decoder, sample_rates=24000, bits=16, ch=2 [20:29:30][D][switch:012]: 'AMP Switch' Turning ON. [20:29:30][D][switch:055]: 'AMP Switch': Sending state ON [20:29:32][D][media_player:059]: 's3-dev_media_player' - Setting [20:29:32][D][media_player:069]: Volume: 0.38 [20:29:33][D][media_player:059]: 's3-dev_media_player' - Setting [20:29:33][D][media_player:069]: Volume: 0.20 [20:29:34][D][media_player:059]: 's3-dev_media_player' - Setting [20:29:34][D][media_player:069]: Volume: 0.13 [20:29:36][D][switch:016]: 'AMP Switch' Turning OFF. [20:29:36][D][switch:055]: 'AMP Switch': Sending state OFF [20:29:37][D][switch:012]: 'AMP Switch' Turning ON. [20:29:37][D][switch:055]: 'AMP Switch': Sending state ON [20:29:38][D][media_player:059]: 's3-dev_media_player' - Setting [20:29:38][D][media_player:063]: Command: STOP [20:29:38][D][esp_adf_pipeline:193]: State changed from RUNNING to STOPPING [20:29:38][I][adf_audio:134]: got new pipeline state: 4 [20:29:38][D][esp-idf:000]: W (39268) AUDIO_ELEMENT: OUT-[decoder] AEL_IO_ABORT [20:29:38][D][esp-idf:000]: W (39275) MP3_DECODER: output aborted -3 [20:29:38][D][esp-idf:000]: I (39279) MP3_DECODER: Closed [20:29:38][D][esp-idf:000]: W (39283) AUDIO_ELEMENT: OUT-[http] AEL_IO_ABORT [20:29:38][I][esp_adf_pipeline:114]: [ decoder ] status: 14 [20:29:38][I][esp_adf_pipeline:114]: [ http ] status: 14 [20:29:38][I][esp_adf_pipeline:114]: [ i2s_out ] status: 14 [20:29:38][I][esp_adf_pipeline:122]: [ * ] CMD: 8 status: 14 [20:29:38][D][esp_adf_pipeline:193]: State changed from STOPPING to STOPPED [20:29:38][I][adf_audio:134]: got new pipeline state: 5 [20:29:38][D][esp_adf_pipeline:286]: Called deinit_all [20:29:38][D][esp-idf:000]: I (39472) AUDIO_PIPELINE: audio_pipeline_unlinked [20:29:38][D][esp-idf:000]: W (39475) AUDIO_ELEMENT: [http] Element has not create when AUDIO_ELEMENT_TERMINATE [20:29:38][D][esp-idf:000]: W (39480) AUDIO_ELEMENT: [decoder] Element has not create when AUDIO_ELEMENT_TERMINATE [20:29:38][D][esp-idf:000]: W (39490) AUDIO_ELEMENT: [i2s_out] Element has not create when AUDIO_ELEMENT_TERMINATE [20:29:38][D][esp-idf:000]: I (39500) I2S: DMA queue destroyed [20:29:38][D][esp_adf_pipeline:193]: State changed from STOPPED to UNAVAILABLE [20:29:38][I][adf_audio:134]: got new pipeline state: 0 [20:29:38][W][component:214]: Component adf_pipeline.media_player took a long time for an operation (0.07 s). [20:29:38][W][component:215]: Components should block for at most 20-30ms. [20:29:43][D][switch:016]: 'AMP Switch' Turning OFF. [20:29:43][D][switch:055]: 'AMP Switch': Sending state OFF [20:29:46][D][switch:012]: 'Use wake word' Turning ON. [20:29:46][D][switch:055]: 'Use wake word': Sending state ON [20:29:46][D][voice_assistant:414]: State changed from IDLE to START_PIPELINE [20:29:46][D][voice_assistant:420]: Desired state set to START_MICROPHONE [20:29:46][D][light:036]: 'Test LED 1' Setting: [20:29:46][D][light:047]: State: ON [20:29:46][D][voice_assistant:118]: microphone not running [20:29:46][D][voice_assistant:202]: Requesting start... [20:29:46][D][voice_assistant:414]: State changed from START_PIPELINE to STARTING_PIPELINE [20:29:46][D][voice_assistant:435]: Client started, streaming microphone [20:29:46][D][voice_assistant:414]: State changed from STARTING_PIPELINE to START_MICROPHONE [20:29:46][D][voice_assistant:420]: Desired state set to STREAMING_MICROPHONE [20:29:46][D][voice_assistant:155]: Starting Microphone [20:29:46][D][esp_adf_pipeline:049]: Starting request, current state UNAVAILABLE [20:29:46][D][esp_adf_pipeline:038]: Init request, current state UNAVAILABLE [20:29:46][D][esp-idf:000]: I (47164) I2S: DMA Malloc info, datalen=blocksize=256, dma_buf_count=8 [20:29:46][D][esp-idf:000]: I (47167) LYRAT_V4_3: I2S0, MCLK output by GPIO0 [20:29:46][D][esp_adf_pipeline:233]: Adding new component [20:29:46][D][esp_adf_pipeline:235]: Adding element of component [20:29:46][D][esp_adf_pipeline:233]: Adding new component [20:29:46][D][esp_adf_pipeline:235]: Adding element of component [20:29:46][D][esp_adf_pipeline:249]: pipeline tag 0, i2s_in [20:29:46][D][esp_adf_pipeline:249]: pipeline tag 1, pcm_reader [20:29:46][D][esp-idf:000]: I (47213) AUDIO_PIPELINE: link el->rb, el:0x3ffd9718, tag:i2s_in, rb:0x3ffda780 [20:29:46][D][esp_adf_pipeline:262]: Setting up event listener. [20:29:46][D][esp_adf_pipeline:193]: State changed from UNAVAILABLE to STOPPED [20:29:46][D][esp_adf_pipeline:193]: State changed from STOPPED to PREPARING [20:29:46][D][voice_assistant:414]: State changed from START_MICROPHONE to STARTING_MICROPHONE [20:29:46][W][component:214]: Component voice_assistant took a long time for an operation (0.10 s). [20:29:46][W][component:215]: Components should block for at most 20-30ms. [20:29:46][D][esp_adf_pipeline:193]: State changed from PREPARING to STARTING [20:29:46][D][esp-idf:000]: I (47266) AUDIO_ELEMENT: [i2s_in-0x3ffd9718] Element task created [20:29:46][D][esp-idf:000]: I (47275) AUDIO_ELEMENT: [pcm_reader-0x3ffda57c] Element task created [20:29:46][D][esp-idf:000]: I (47295) AUDIO_PIPELINE: Func:audio_pipeline_run, Line:359, MEM Total:141076 Bytes [20:29:46][D][esp-idf:000]: I (47297) AUDIO_ELEMENT: [i2s_in] AEL_MSG_CMD_RESUME,state:1 [20:29:46][D][esp-idf:000]: I (47306) AUDIO_PIPELINE: Pipeline started [20:29:46][D][voice_assistant:521]: Event Type: 0 [20:29:46][E][voice_assistant:651]: Error: no_wake_word - No wake word detected [20:29:46][D][voice_assistant:514]: Signaling stop... [20:29:46][D][voice_assistant:414]: State changed from STARTING_MICROPHONE to STOP_MICROPHONE [20:29:46][D][voice_assistant:420]: Desired state set to IDLE [20:29:46][D][voice_assistant:414]: State changed from STOP_MICROPHONE to IDLE [20:29:46][I][esp_adf_pipeline:114]: [ pcm_reader ] status: 12 [20:29:46][I][esp_adf_pipeline:122]: [ * ] CMD: 8 status: 12 [20:29:46][D][esp_adf_pipeline:193]: State changed from STARTING to RUNNING [20:29:46][D][voice_assistant:521]: Event Type: 1 [20:29:46][D][voice_assistant:524]: Assist Pipeline running [20:29:46][D][voice_assistant:414]: State changed from IDLE to START_PIPELINE [20:29:46][D][voice_assistant:420]: Desired state set to START_MICROPHONE [20:29:46][I][esp_adf_pipeline:114]: [ i2s_in ] status: 12 [20:29:46][D][voice_assistant:521]: Event Type: 9 [20:29:46][D][voice_assistant:202]: Requesting start... [20:29:46][D][voice_assistant:414]: State changed from START_PIPELINE to STARTING_PIPELINE [20:29:46][D][voice_assistant:521]: Event Type: 2 [20:29:46][D][voice_assistant:611]: Assist Pipeline ended [20:29:46][D][voice_assistant:521]: Event Type: 0 [20:29:46][E][voice_assistant:651]: Error: wake-stream-failed - Unexpected error during wake-word-detection [20:29:46][D][voice_assistant:514]: Signaling stop... [20:29:46][D][voice_assistant:414]: State changed from STARTING_PIPELINE to STOP_MICROPHONE [20:29:46][D][voice_assistant:420]: Desired state set to IDLE [20:29:46][D][esp_adf_pipeline:193]: State changed from RUNNING to STOPPING [20:29:46][D][voice_assistant:414]: State changed from STOP_MICROPHONE to STOPPING_MICROPHONE [20:29:46][I][esp_adf_pipeline:114]: [ pcm_reader ] status: 14 [20:29:46][I][esp_adf_pipeline:122]: [ * ] CMD: 8 status: 14 [20:29:46][D][esp_adf_pipeline:193]: State changed from STOPPING to STOPPED [20:29:46][D][esp_adf_pipeline:286]: Called deinit_all [20:29:46][D][esp-idf:000]: W (47503) AUDIO_ELEMENT: OUT-[i2s_in] AEL_IO_ABORT [20:29:46][D][esp-idf:000]: W (47506) AUDIO_ELEMENT: OUT-[i2s_in] AEL_IO_ABORT [20:29:46][D][esp-idf:000]: W (47510) AUDIO_ELEMENT: OUT-[i2s_in] AEL_IO_ABORT [20:29:46][D][esp-idf:000]: W (47520) AUDIO_ELEMENT: OUT-[i2s_in] AEL_IO_ABORT [20:29:46][D][esp-idf:000]: I (47523) AUDIO_PIPELINE: audio_pipeline_unlinked [20:29:46][D][esp-idf:000]: W (47531) AUDIO_ELEMENT: [i2s_in] Element has not create when AUDIO_ELEMENT_TERMINATE [20:29:46][D][esp-idf:000]: I (47551) I2S: DMA queue destroyed [20:29:46][D][esp-idf:000]: W (47561) AUDIO_ELEMENT: [pcm_reader] Element has not create when AUDIO_ELEMENT_TERMINATE [20:29:46][D][esp_adf_pipeline:193]: State changed from STOPPED to UNAVAILABLE [20:29:46][W][component:214]: Component adf_pipeline.microphone took a long time for an operation (0.10 s). [20:29:46][W][component:215]: Components should block for at most 20-30ms. [20:29:46][D][light:036]: 'Test LED 1' Setting: [20:29:46][D][voice_assistant:521]: Event Type: 2 [20:29:46][D][voice_assistant:611]: Assist Pipeline ended [20:29:46][D][voice_assistant:414]: State changed from STOPPING_MICROPHONE to IDLE [20:29:46][D][voice_assistant:514]: Signaling stop... [20:29:46][D][voice_assistant:414]: State changed from IDLE to START_PIPELINE [20:29:46][D][voice_assistant:420]: Desired state set to START_MICROPHONE [20:29:46][D][voice_assistant:521]: Event Type: 1 [20:29:46][D][voice_assistant:524]: Assist Pipeline running [20:29:46][D][voice_assistant:118]: microphone not running [20:29:46][D][voice_assistant:202]: Requesting start... [20:29:46][D][voice_assistant:414]: State changed from START_PIPELINE to STARTING_PIPELINE [20:29:46][D][voice_assistant:521]: Event Type: 9 [20:29:46][D][voice_assistant:118]: microphone not running [20:29:46][D][voice_assistant:521]: Event Type: 0 [20:29:46][E][voice_assistant:651]: Error: no_wake_word - No wake word detected [20:29:46][D][voice_assistant:514]: Signaling stop... [20:29:46][D][voice_assistant:414]: State changed from STARTING_PIPELINE to STOP_MICROPHONE [20:29:46][D][voice_assistant:420]: Desired state set to IDLE [20:29:46][D][voice_assistant:414]: State changed from STOP_MICROPHONE to IDLE [20:29:46][D][voice_assistant:521]: Event Type: 2 [20:29:46][D][voice_assistant:611]: Assist Pipeline ended [20:29:46][D][voice_assistant:414]: State changed from IDLE to START_PIPELINE [20:29:46][D][voice_assistant:420]: Desired state set to START_MICROPHONE [20:29:46][D][light:036]: 'Test LED 1' Setting: [20:29:46][D][voice_assistant:514]: Signaling stop... [20:29:46][D][voice_assistant:118]: microphone not running [20:29:46][D][voice_assistant:202]: Requesting start... [20:29:46][D][voice_assistant:414]: State changed from START_PIPELINE to STARTING_PIPELINE [20:29:46][D][voice_assistant:521]: Event Type: 1 [20:29:46][D][voice_assistant:524]: Assist Pipeline running [20:29:46][D][voice_assistant:118]: microphone not running [20:29:46][D][voice_assistant:521]: Event Type: 9 [20:29:46][D][voice_assistant:118]: microphone not running [20:29:46][D][voice_assistant:521]: Event Type: 0 [20:29:46][E][voice_assistant:651]: Error: no_wake_word - No wake word detected [20:29:46][D][voice_assistant:514]: Signaling stop... [20:29:46][D][voice_assistant:414]: State changed from STARTING_PIPELINE to STOP_MICROPHONE [20:29:46][D][voice_assistant:420]: Desired state set to IDLE [20:29:46][D][voice_assistant:414]: State changed from STOP_MICROPHONE to IDLE [20:29:46][D][voice_assistant:521]: Event Type: 2 [20:29:46][D][voice_assistant:611]: Assist Pipeline ended [20:29:46][D][voice_assistant:414]: State changed from IDLE to START_PIPELINE [20:29:46][D][voice_assistant:420]: Desired state set to START_MICROPHONE [20:29:46][D][light:036]: 'Test LED 1' Setting: [20:29:46][D][voice_assistant:514]: Signaling stop... [20:29:46][D][voice_assistant:118]: microphone not running [20:29:46][D][voice_assistant:202]: Requesting start... [20:29:46][D][voice_assistant:414]: State changed from START_PIPELINE to STARTING_PIPELINE [20:29:46][D][voice_assistant:521]: Event Type: 1 [20:29:46][D][voice_assistant:524]: Assist Pipeline running [20:29:46][D][voice_assistant:118]: microphone not running [20:29:46][D][voice_assistant:521]: Event Type: 9 [20:29:46][D][voice_assistant:118]: microphone not running [20:29:46][D][voice_assistant:521]: Event Type: 0 [20:29:46][E][voice_assistant:651]: Error: no_wake_word - No wake word detected [20:29:46][D][voice_assistant:514]: Signaling stop... [20:29:46][D][voice_assistant:414]: State changed from STARTING_PIPELINE to STOP_MICROPHONE [20:29:46][D][voice_assistant:420]: Desired state set to IDLE [20:29:46][D][voice_assistant:414]: State changed from STOP_MICROPHONE to IDLE [20:29:46][D][voice_assistant:521]: Event Type: 2 [20:29:46][D][voice_assistant:611]: Assist Pipeline ended [20:29:46][D][voice_assistant:414]: State changed from IDLE to START_PIPELINE [20:29:46][D][voice_assistant:420]: Desired state set to START_MICROPHONE [20:29:47][D][light:036]: 'Test LED 1' Setting: [20:29:47][D][voice_assistant:514]: Signaling stop... [20:29:47][D][voice_assistant:118]: microphone not running [20:29:47][D][voice_assistant:202]: Requesting start... [20:29:47][D][voice_assistant:414]: State changed from START_PIPELINE to STARTING_PIPELINE [20:29:47][D][voice_assistant:521]: Event Type: 1 [20:29:47][D][voice_assistant:524]: Assist Pipeline running [20:29:47][D][voice_assistant:118]: microphone not running [20:29:47][D][voice_assistant:521]: Event Type: 9 [20:29:47][D][voice_assistant:118]: microphone not running [20:29:47][D][voice_assistant:521]: Event Type: 0 [20:29:47][E][voice_assistant:651]: Error: no_wake_word - No wake word detected [20:29:47][D][voice_assistant:514]: Signaling stop... [20:29:47][D][voice_assistant:414]: State changed from STARTING_PIPELINE to STOP_MICROPHONE [20:29:47][D][voice_assistant:420]: Desired state set to IDLE [20:29:47][D][voice_assistant:414]: State changed from STOP_MICROPHONE to IDLE [20:29:47][D][voice_assistant:521]: Event Type: 2 [20:29:47][D][voice_assistant:611]: Assist Pipeline ended [20:29:47][D][voice_assistant:414]: State changed from IDLE to START_PIPELINE [20:29:47][D][voice_assistant:420]: Desired state set to START_MICROPHONE [20:29:47][D][light:036]: 'Test LED 1' Setting: [20:29:47][D][voice_assistant:514]: Signaling stop... [20:29:47][D][voice_assistant:118]: microphone not running [20:29:47][D][voice_assistant:202]: Requesting start... [20:29:47][D][voice_assistant:414]: State changed from START_PIPELINE to STARTING_PIPELINE [20:29:47][D][voice_assistant:521]: Event Type: 1 [20:29:47][D][voice_assistant:524]: Assist Pipeline running [20:29:47][D][voice_assistant:118]: microphone not running [20:29:47][D][voice_assistant:521]: Event Type: 9 [20:29:47][D][voice_assistant:118]: microphone not running [20:29:47][D][voice_assistant:521]: Event Type: 0 [20:29:47][E][voice_assistant:651]: Error: no_wake_word - No wake word detected [20:29:47][D][voice_assistant:514]: Signaling stop... [20:29:47][D][voice_assistant:414]: State changed from STARTING_PIPELINE to STOP_MICROPHONE [20:29:47][D][voice_assistant:420]: Desired state set to IDLE [20:29:47][D][voice_assistant:414]: State changed from STOP_MICROPHONE to IDLE [20:29:47][D][voice_assistant:521]: Event Type: 2 [20:29:47][D][voice_assistant:611]: Assist Pipeline ended [20:29:47][D][voice_assistant:414]: State changed from IDLE to START_PIPELINE [20:29:47][D][voice_assistant:420]: Desired state set to START_MICROPHONE [20:29:47][D][light:036]: 'Test LED 1' Setting: [20:29:47][D][voice_assistant:514]: Signaling stop... [20:29:47][D][voice_assistant:118]: microphone not running [20:29:47][D][voice_assistant:202]: Requesting start... [20:29:47][D][voice_assistant:414]: State changed from START_PIPELINE to STARTING_PIPELINE [20:29:47][D][voice_assistant:521]: Event Type: 1 [20:29:47][D][voice_assistant:524]: Assist Pipeline running [20:29:47][D][voice_assistant:118]: microphone not running [20:29:47][D][voice_assistant:521]: Event Type: 9 [20:29:47][D][voice_assistant:118]: microphone not running [20:29:47][D][voice_assistant:521]: Event Type: 0 [20:29:47][E][voice_assistant:651]: Error: no_wake_word - No wake word detected [20:29:47][D][voice_assistant:514]: Signaling stop... [20:29:47][D][voice_assistant:414]: State changed from STARTING_PIPELINE to STOP_MICROPHONE [20:29:47][D][voice_assistant:420]: Desired state set to IDLE [20:29:47][D][voice_assistant:414]: State changed from STOP_MICROPHONE to IDLE [20:29:47][D][voice_assistant:521]: Event Type: 2 [20:29:47][D][voice_assistant:611]: Assist Pipeline ended [20:29:47][D][voice_assistant:414]: State changed from IDLE to START_PIPELINE [20:29:47][D][voice_assistant:420]: Desired state set to START_MICROPHONE [20:29:47][D][voice_assistant:514]: Signaling stop... [20:29:47][D][voice_assistant:118]: microphone not running [20:29:47][D][voice_assistant:202]: Requesting start... [20:29:47][D][voice_assistant:414]: State changed from START_PIPELINE to STARTING_PIPELINE [20:29:47][D][light:036]: 'Test LED 1' Setting: [20:29:47][D][voice_assistant:521]: Event Type: 1 [20:29:47][D][voice_assistant:524]: Assist Pipeline running [20:29:47][D][voice_assistant:118]: microphone not running [20:29:47][D][voice_assistant:521]: Event Type: 9 [20:29:47][D][voice_assistant:118]: microphone not running [20:29:47][D][voice_assistant:521]: Event Type: 0 [20:29:47][E][voice_assistant:651]: Error: no_wake_word - No wake word detected [20:29:47][D][voice_assistant:514]: Signaling stop... [20:29:47][D][voice_assistant:414]: State changed from STARTING_PIPELINE to STOP_MICROPHONE [20:29:47][D][voice_assistant:420]: Desired state set to IDLE [20:29:47][D][voice_assistant:414]: State changed from STOP_MICROPHONE to IDLE [20:29:47][D][voice_assistant:521]: Event Type: 2 [20:29:47][D][voice_assistant:611]: Assist Pipeline ended [20:29:47][D][voice_assistant:414]: State changed from IDLE to START_PIPELINE [20:29:47][D][voice_assistant:420]: Desired state set to START_MICROPHONE [20:29:47][D][light:036]: 'Test LED 1' Setting: [20:29:47][D][voice_assistant:514]: Signaling stop... [20:29:47][D][voice_assistant:118]: microphone not running [20:29:47][D][voice_assistant:202]: Requesting start... [20:29:47][D][voice_assistant:414]: State changed from START_PIPELINE to STARTING_PIPELINE [20:29:47][D][voice_assistant:521]: Event Type: 1 [20:29:47][D][voice_assistant:524]: Assist Pipeline running [20:29:47][D][voice_assistant:118]: microphone not running [20:29:47][D][voice_assistant:521]: Event Type: 9 [20:29:47][D][voice_assistant:118]: microphone not running [20:29:47][D][voice_assistant:521]: Event Type: 0 [20:29:47][E][voice_assistant:651]: Error: no_wake_word - No wake word detected [20:29:47][D][voice_assistant:514]: Signaling stop... [20:29:47][D][voice_assistant:414]: State changed from STARTING_PIPELINE to STOP_MICROPHONE [20:29:47][D][voice_assistant:420]: Desired state set to IDLE [20:29:47][D][voice_assistant:414]: State changed from STOP_MICROPHONE to IDLE [20:29:47][D][voice_assistant:521]: Event Type: 2 [20:29:47][D][voice_assistant:611]: Assist Pipeline ended [20:29:47][D][voice_assistant:414]: State changed from IDLE to START_PIPELINE [20:29:47][D][voice_assistant:420]: Desired state set to START_MICROPHONE [20:29:47][D][light:036]: 'Test LED 1' Setting: [20:29:47][D][voice_assistant:514]: Signaling stop... [20:29:47][D][voice_assistant:118]: microphone not running [20:29:47][D][voice_assistant:202]: Requesting start... [20:29:47][D][voice_assistant:414]: State changed from START_PIPELINE to STARTING_PIPELINE [20:29:47][D][voice_assistant:521]: Event Type: 1 [20:29:47][D][voice_assistant:524]: Assist Pipeline running [20:29:47][D][voice_assistant:118]: microphone not running [20:29:47][D][voice_assistant:521]: Event Type: 9 [20:29:47][D][voice_assistant:118]: microphone not running [20:29:47][D][voice_assistant:521]: Event Type: 0 [20:29:47][E][voice_assistant:651]: Error: no_wake_word - No wake word detected [20:29:47][D][voice_assistant:514]: Signaling stop... [20:29:47][D][voice_assistant:414]: State changed from STARTING_PIPELINE to STOP_MICROPHONE [20:29:47][D][voice_assistant:420]: Desired state set to IDLE [20:29:47][D][voice_assistant:414]: State changed from STOP_MICROPHONE to IDLE [20:29:47][D][voice_assistant:521]: Event Type: 2 [20:29:47][D][voice_assistant:611]: Assist Pipeline ended [20:29:47][D][voice_assistant:414]: State changed from IDLE to START_PIPELINE [20:29:47][D][voice_assistant:420]: Desired state set to START_MICROPHONE [20:29:47][D][light:036]: 'Test LED 1' Setting: [20:29:47][D][voice_assistant:514]: Signaling stop... [20:29:47][D][voice_assistant:118]: microphone not running [20:29:47][D][voice_assistant:202]: Requesting start... [20:29:47][D][voice_assistant:414]: State changed from START_PIPELINE to STARTING_PIPELINE [20:29:47][D][voice_assistant:521]: Event Type: 1 [20:29:47][D][voice_assistant:524]: Assist Pipeline running [20:29:47][D][voice_assistant:118]: microphone not running [20:29:47][D][voice_assistant:521]: Event Type: 9 [20:29:47][D][voice_assistant:118]: microphone not running [20:29:47][D][voice_assistant:521]: Event Type: 0 [20:29:47][E][voice_assistant:651]: Error: no_wake_word - No wake word detected [20:29:47][D][voice_assistant:514]: Signaling stop... [20:29:47][D][voice_assistant:414]: State changed from STARTING_PIPELINE to STOP_MICROPHONE [20:29:47][D][voice_assistant:420]: Desired state set to IDLE [20:29:47][D][voice_assistant:414]: State changed from STOP_MICROPHONE to IDLE [20:29:47][D][voice_assistant:521]: Event Type: 2 [20:29:47][D][voice_assistant:611]: Assist Pipeline ended [20:29:47][D][voice_assistant:414]: State changed from IDLE to START_PIPELINE [20:29:47][D][voice_assistant:420]: Desired state set to START_MICROPHONE [20:29:47][D][light:036]: 'Test LED 1' Setting: [20:29:47][D][voice_assistant:514]: Signaling stop... [20:29:47][D][voice_assistant:118]: microphone not running [20:29:47][D][voice_assistant:202]: Requesting start... [20:29:47][D][voice_assistant:414]: State changed from START_PIPELINE to STARTING_PIPELINE [20:29:47][D][voice_assistant:521]: Event Type: 1 [20:29:47][D][voice_assistant:524]: Assist Pipeline running [20:29:47][D][voice_assistant:118]: microphone not running [20:29:47][D][voice_assistant:521]: Event Type: 9 [20:29:47][D][voice_assistant:118]: microphone not running [20:29:47][D][voice_assistant:521]: Event Type: 0 [20:29:47][E][voice_assistant:651]: Error: no_wake_word - No wake word detected [20:29:47][D][voice_assistant:514]: Signaling stop... [20:29:47][D][voice_assistant:414]: State changed from STARTING_PIPELINE to STOP_MICROPHONE [20:29:47][D][voice_assistant:420]: Desired state set to IDLE [20:29:47][D][voice_assistant:414]: State changed from STOP_MICROPHONE to IDLE [20:29:47][D][voice_assistant:521]: Event Type: 2 [20:29:47][D][voice_assistant:611]: Assist Pipeline ended [20:29:47][D][voice_assistant:414]: State changed from IDLE to START_PIPELINE [20:29:47][D][voice_assistant:420]: Desired state set to START_MICROPHONE [20:29:47][D][light:036]: 'Test LED 1' Setting: [20:29:47][D][voice_assistant:514]: Signaling stop... [20:29:47][D][voice_assistant:118]: microphone not running [20:29:47][D][voice_assistant:202]: Requesting start... [20:29:47][D][voice_assistant:414]: State changed from START_PIPELINE to STARTING_PIPELINE [20:29:47][D][voice_assistant:521]: Event Type: 1 [20:29:47][D][voice_assistant:524]: Assist Pipeline running [20:29:47][D][voice_assistant:118]: microphone not running [20:29:47][D][voice_assistant:521]: Event Type: 9 [20:29:47][D][voice_assistant:118]: microphone not running [20:29:47][D][voice_assistant:521]: Event Type: 0 [20:29:47][E][voice_assistant:651]: Error: no_wake_word - No wake word detected [20:29:47][D][voice_assistant:514]: Signaling stop... [20:29:47][D][voice_assistant:414]: State changed from STARTING_PIPELINE to STOP_MICROPHONE [20:29:47][D][voice_assistant:420]: Desired state set to IDLE [20:29:47][D][voice_assistant:414]: State changed from STOP_MICROPHONE to IDLE [20:29:47][D][voice_assistant:521]: Event Type: 2 [20:29:47][D][voice_assistant:611]: Assist Pipeline ended [20:29:48][D][voice_assistant:414]: State changed from IDLE to START_PIPELINE [20:29:48][D][voice_assistant:420]: Desired state set to START_MICROPHONE [20:29:48][D][light:036]: 'Test LED 1' Setting: [20:29:48][D][voice_assistant:514]: Signaling stop... [20:29:48][D][voice_assistant:118]: microphone not running [20:29:48][D][voice_assistant:202]: Requesting start... [20:29:48][D][voice_assistant:414]: State changed from START_PIPELINE to STARTING_PIPELINE [20:29:48][D][voice_assistant:521]: Event Type: 1 [20:29:48][D][voice_assistant:524]: Assist Pipeline running [20:29:48][D][voice_assistant:118]: microphone not running [20:29:48][D][voice_assistant:521]: Event Type: 9 [20:29:48][D][voice_assistant:118]: microphone not running [20:29:48][D][voice_assistant:521]: Event Type: 0 [20:29:48][E][voice_assistant:651]: Error: no_wake_word - No wake word detected [20:29:48][D][voice_assistant:514]: Signaling stop... [20:29:48][D][voice_assistant:414]: State changed from STARTING_PIPELINE to STOP_MICROPHONE [20:29:48][D][voice_assistant:420]: Desired state set to IDLE [20:29:48][D][voice_assistant:414]: State changed from STOP_MICROPHONE to IDLE [20:29:48][D][voice_assistant:521]: Event Type: 2 [20:29:48][D][voice_assistant:611]: Assist Pipeline ended [20:29:48][D][voice_assistant:414]: State changed from IDLE to START_PIPELINE [20:29:48][D][voice_assistant:420]: Desired state set to START_MICROPHONE [20:29:48][D][light:036]: 'Test LED 1' Setting: [20:29:48][D][voice_assistant:514]: Signaling stop... [20:29:48][D][voice_assistant:118]: microphone not running [20:29:48][D][voice_assistant:202]: Requesting start... [20:29:48][D][voice_assistant:414]: State changed from START_PIPELINE to STARTING_PIPELINE [20:29:48][D][voice_assistant:521]: Event Type: 1 [20:29:48][D][voice_assistant:524]: Assist Pipeline running [20:29:48][D][voice_assistant:118]: microphone not running [20:29:48][D][voice_assistant:521]: Event Type: 9 [20:29:48][D][voice_assistant:118]: microphone not running [20:29:48][D][voice_assistant:521]: Event Type: 0 [20:29:48][E][voice_assistant:651]: Error: no_wake_word - No wake word detected [20:29:48][D][voice_assistant:514]: Signaling stop... [20:29:48][D][voice_assistant:414]: State changed from STARTING_PIPELINE to STOP_MICROPHONE [20:29:48][D][voice_assistant:420]: Desired state set to IDLE [20:29:48][D][voice_assistant:414]: State changed from STOP_MICROPHONE to IDLE [20:29:48][D][voice_assistant:521]: Event Type: 2 [20:29:48][D][voice_assistant:611]: Assist Pipeline ended [20:29:48][D][voice_assistant:414]: State changed from IDLE to START_PIPELINE [20:29:48][D][voice_assistant:420]: Desired state set to START_MICROPHONE [20:29:48][D][light:036]: 'Test LED 1' Setting: [20:29:48][D][voice_assistant:514]: Signaling stop... [20:29:48][D][voice_assistant:118]: microphone not running [20:29:48][D][voice_assistant:202]: Requesting start... [20:29:48][D][voice_assistant:414]: State changed from START_PIPELINE to STARTING_PIPELINE [20:29:48][D][voice_assistant:521]: Event Type: 1 [20:29:48][D][voice_assistant:524]: Assist Pipeline running [20:29:48][D][voice_assistant:118]: microphone not running [20:29:48][D][voice_assistant:521]: Event Type: 9 [20:29:48][D][voice_assistant:118]: microphone not running [20:29:48][D][voice_assistant:521]: Event Type: 0 [20:29:48][E][voice_assistant:651]: Error: no_wake_word - No wake word detected [20:29:48][D][voice_assistant:514]: Signaling stop... [20:29:48][D][voice_assistant:414]: State changed from STARTING_PIPELINE to STOP_MICROPHONE [20:29:48][D][voice_assistant:420]: Desired state set to IDLE [20:29:48][D][voice_assistant:414]: State changed from STOP_MICROPHONE to IDLE [20:29:48][D][voice_assistant:521]: Event Type: 2 [20:29:48][D][voice_assistant:611]: Assist Pipeline ended [20:29:48][D][voice_assistant:414]: State changed from IDLE to START_PIPELINE [20:29:48][D][voice_assistant:420]: Desired state set to START_MICROPHONE [20:29:48][D][light:036]: 'Test LED 1' Setting: [20:29:48][D][voice_assistant:514]: Signaling stop... [20:29:48][D][voice_assistant:118]: microphone not running [20:29:48][D][voice_assistant:202]: Requesting start... [20:29:48][D][voice_assistant:414]: State changed from START_PIPELINE to STARTING_PIPELINE [20:29:48][D][voice_assistant:521]: Event Type: 1 [20:29:48][D][voice_assistant:524]: Assist Pipeline running [20:29:48][D][voice_assistant:118]: microphone not running [20:29:48][D][voice_assistant:521]: Event Type: 9 [20:29:48][D][voice_assistant:118]: microphone not running [20:29:48][D][voice_assistant:521]: Event Type: 0 [20:29:48][E][voice_assistant:651]: Error: no_wake_word - No wake word detected [20:29:48][D][voice_assistant:514]: Signaling stop... [20:29:48][D][voice_assistant:414]: State changed from STARTING_PIPELINE to STOP_MICROPHONE [20:29:48][D][voice_assistant:420]: Desired state set to IDLE [20:29:48][D][voice_assistant:414]: State changed from STOP_MICROPHONE to IDLE [20:29:48][D][voice_assistant:521]: Event Type: 2 [20:29:48][D][voice_assistant:611]: Assist Pipeline ended [20:29:48][D][voice_assistant:414]: State changed from IDLE to START_PIPELINE [20:29:48][D][voice_assistant:420]: Desired state set to START_MICROPHONE [20:29:48][D][light:036]: 'Test LED 1' Setting: [20:29:48][D][voice_assistant:514]: Signaling stop... [20:29:48][D][voice_assistant:118]: microphone not running [20:29:48][D][voice_assistant:202]: Requesting start... [20:29:48][D][voice_assistant:414]: State changed from START_PIPELINE to STARTING_PIPELINE [20:29:48][D][voice_assistant:521]: Event Type: 1 [20:29:48][D][voice_assistant:524]: Assist Pipeline running [20:29:48][D][voice_assistant:118]: microphone not running [20:29:48][D][voice_assistant:521]: Event Type: 9 [20:29:48][D][voice_assistant:118]: microphone not running [20:29:48][D][voice_assistant:521]: Event Type: 0 [20:29:48][E][voice_assistant:651]: Error: no_wake_word - No wake word detected [20:29:48][D][voice_assistant:514]: Signaling stop... [20:29:48][D][voice_assistant:414]: State changed from STARTING_PIPELINE to STOP_MICROPHONE [20:29:48][D][voice_assistant:420]: Desired state set to IDLE [20:29:48][D][voice_assistant:414]: State changed from STOP_MICROPHONE to IDLE [20:29:48][D][voice_assistant:521]: Event Type: 2 [20:29:48][D][voice_assistant:611]: Assist Pipeline ended [20:29:48][D][voice_assistant:414]: State changed from IDLE to START_PIPELINE [20:29:48][D][voice_assistant:420]: Desired state set to START_MICROPHONE [20:29:48][D][light:036]: 'Test LED 1' Setting: [20:29:48][D][voice_assistant:514]: Signaling stop... [20:29:48][D][voice_assistant:118]: microphone not running [20:29:48][D][voice_assistant:202]: Requesting start... [20:29:48][D][voice_assistant:414]: State changed from START_PIPELINE to STARTING_PIPELINE [20:29:48][D][voice_assistant:521]: Event Type: 1 [20:29:48][D][voice_assistant:524]: Assist Pipeline running [20:29:48][D][voice_assistant:118]: microphone not running [20:29:48][D][voice_assistant:521]: Event Type: 9 [20:29:48][D][voice_assistant:118]: microphone not running [20:29:48][D][voice_assistant:521]: Event Type: 0 [20:29:48][E][voice_assistant:651]: Error: no_wake_word - No wake word detected [20:29:48][D][voice_assistant:514]: Signaling stop... [20:29:48][D][voice_assistant:414]: State changed from STARTING_PIPELINE to STOP_MICROPHONE [20:29:48][D][voice_assistant:420]: Desired state set to IDLE [20:29:48][D][voice_assistant:414]: State changed from STOP_MICROPHONE to IDLE [20:29:48][D][voice_assistant:521]: Event Type: 2 [20:29:48][D][voice_assistant:611]: Assist Pipeline ended [20:29:48][D][voice_assistant:414]: State changed from IDLE to START_PIPELINE [20:29:48][D][voice_assistant:420]: Desired state set to START_MICROPHONE [20:29:48][D][light:036]: 'Test LED 1' Setting: [20:29:48][D][switch:016]: 'Use wake word' Turning OFF. [20:29:48][D][switch:055]: 'Use wake word': Sending state OFF [20:29:48][D][voice_assistant:414]: State changed from START_PIPELINE to STOP_MICROPHONE [20:29:48][D][voice_assistant:420]: Desired state set to IDLE [20:29:48][D][light:036]: 'Test LED 1' Setting: [20:29:48][D][light:047]: State: OFF [20:29:48][D][voice_assistant:414]: State changed from STOP_MICROPHONE to IDLE [20:29:48][D][voice_assistant:514]: Signaling stop... [20:29:48][D][voice_assistant:521]: Event Type: 1 [20:29:48][D][voice_assistant:524]: Assist Pipeline running [20:29:48][D][voice_assistant:521]: Event Type: 9 [20:29:48][D][voice_assistant:521]: Event Type: 0 [20:29:48][E][voice_assistant:651]: Error: no_wake_word - No wake word detected [20:29:48][D][light:036]: 'Test LED 1' Setting: [20:29:48][D][voice_assistant:521]: Event Type: 2 [20:29:48][D][voice_assistant:611]: Assist Pipeline ended ```

Another thing I noticed: After stopping the mediaplayer by Command: STOP and starting a new stream, the volume is set back to a louder (or max) volume as set before. The mediaplayer in homeassistant is still on the same setting and if I change the volume the volume setting is synced again.

Let me know if I can test any special scenario.

nighi commented 2 months ago

I would like to test if any of your fixes of the other issues has fix any of mine. But the duplex branch is not up to date and only partially merged to main. Is that correct or should main already contain all changes of the duplex branch?

I tried to merge it myself but couldn't figure out which changes I need.

Anyhow as I have seen there is also a custom voice assistant component. Should I ve tested with this? I'm pretty shure I didn't. Also is the esphome version important? Since there is a target version in the readme.

gnumpi commented 2 months ago

Hey, you could either try the main branch or the vad-test branch, they should both work in half duplex mode. The custom voice assistant component, ensures that the va pipeline gets only started when the microphone is ready and in the vad-test branch it allows using vad with adf pipeline.Am 31.03.2024 um 18:06 schrieb nighi @.***>: I would like to test if any of your fixes of the other issues has fix any of mine. But the duplex branch is not up to date and only partially merged to main. Is that correct or should main already contain all changes of the duplex branch? I tried to merge it myself but couldn't figure out which changes I need. Anyhow as I have seen there is also a custom voice assistant component. Should I ve tested with this? I'm pretty shure I didn't. Also is the esphome version important? Since there is a target version in the readme.

—Reply to this email directly, view it on GitHub, or unsubscribe.You are receiving this because you commented.Message ID: @.***>

benbender commented 3 weeks ago

I just found my es8388 a1s in a box and started to look if the support for them is more stable now than when I last tried. I would love to give them another shot with the help of your amazing work.

Could you give me some hints on where to start testing as you provide several routes of integration and some of the problems discussed in this thread seem to be solved in the meantime…

And I noticed your integration of the init-code for the es8388-chips into this repo – so the external component by mulcmu shouldn't be needed anymore? Correct?

Any advice would be much appreciated and I would be a happy tester ;)

Thanks in advance!

nighi commented 3 weeks ago

Hey, sorry I couldn't find much time to test lately. I could provide my config with the new syntax. Maybe @gnumpi could doublecheck, if this is the intended use. Unfortunately there are still problems left.

esphome:
  name: voice-sat
  name_add_mac_suffix: false
  on_boot:
    - priority: -100
      then:
        - wait_until: api.connected
        - delay: 1s
        - if:
            condition:
              switch.is_on: use_wake_word
            then:
              - voice_assistant.start_continuous:
api:
logger:
ota:
wifi:
  ssid: !secret wifi_ssid
  password: !secret wifi_password
captive_portal:

esp32:
  board: esp-wrover-kit
  framework:
    type: esp-idf

external_components:
  - source: github://mulcmu/esphome-es8388-a1s@nightdav-patch
    components: [es8388]
    refresh: 0s
  - source:
      type: git
      url: https://github.com/gnumpi/esphome_audio
      ref: main
    components: [ adf_pipeline, i2s_audio]
    refresh: 0s

i2c:
  sda: GPIO33
  scl: GPIO32

es8388:

i2s_audio:
  id: i2s_in_out
  i2s_lrclk_pin: GPIO25
  i2s_bclk_pin: GPIO27
  i2s_mclk_pin: GPIO0
  access_mode: duplex

adf_pipeline:
    # create an I2SWriter pipeline element
    # using the i2s_out configuration
  - platform: i2s_audio
    type:  audio_out
    id: adf_i2s_out
    i2s_audio_id: i2s_in_out
    i2s_dout_pin: GPIO26
    dac:
      model: es8388
    sample_rate: 16000
    bits_per_sample: 16bit
    fixed_settings: true
    # create an I2SReader pipeline element
    # using the i2s_in configuration
  - platform: i2s_audio
    type: audio_in
    id: adf_i2s_in
    i2s_audio_id: i2s_in_out
    i2s_din_pin: GPIO35
    channel: right
    pdm: false
    adc:
      model: generic
    bits_per_sample: 16bit
    fixed_settings: true

microphone:
  - platform: adf_pipeline
    id: adf_microphone
    pipeline:
      - adf_i2s_in
      - resampler
      - self

media_player:
  - platform: adf_pipeline
    id: adf_media_player
    name: s3-dev_media_player
    internal: false
    pipeline:
      - self
      - resampler
      - adf_i2s_out

voice_assistant:
  microphone: adf_microphone
  media_player: adf_media_player
  id: va
  volume_multiplier: 8.0
  noise_suppression_level: 4
  auto_gain: 31dBFS
  #vad_threshold: 3
  on_end: 
    - delay: 100ms
    - wait_until:
         not: 
           media_player.is_playing:
    - script.execute: reset_led
  on_listening:
    - light.turn_on: led

switch:
  - platform: gpio
    pin: GPIO21
    name: "AMP Switch"
    restore_mode: ALWAYS_OFF
  - platform: template
    name: Use wake word
    id: use_wake_word
    optimistic: true
    restore_mode: ALWAYS_OFF #RESTORE_DEFAULT_ON
    entity_category: config
    on_turn_on:
      - lambda: id(va).set_use_wake_word(true);
      - if:
          condition:
            not:
              - voice_assistant.is_running
          then:
            - voice_assistant.start_continuous
      - script.execute: reset_led
    on_turn_off:
      - voice_assistant.stop
      - lambda: id(va).set_use_wake_word(false);
      - script.execute: reset_led

script:
  - id: reset_led
    then:
      - if:
          condition:
            switch.is_on: use_wake_word
          then:
            - light.turn_on: led
          else:
            - light.turn_off: led

light:
  - platform: binary
    id: led
    name: "Test LED 1"
    output: light_output_1
  - platform: binary
    name: "Test LED 2"
    output: light_output_2

output:
  - id: light_output_1
    platform: gpio
    pin: GPIO22
    inverted: true
  - id: light_output_2
    platform: gpio
    pin: GPIO19
    inverted: true

I tried to play different files and get different kind of errors and exceptions with reconnects. The only stream that worked is the "Deutschlandfunk" from the radio browser (Media URL: http://st01.dlf.de/dlf/01/128/mp3/stream.mp3).

Log ``` INFO ESPHome 2024.4.2 INFO Reading configuration /config/esphome/m5stack-atom-echo-59aac0.yaml... INFO Updating https://github.com/mulcmu/esphome-es8388-a1s.git@nightdav-patch INFO Updating https://github.com/gnumpi/esphome_audio@main WARNING GPIO0 is a strapping PIN and should only be used for I/O with care. Attaching external pullup/down resistors to strapping pins can cause unexpected failures. See https://esphome.io/guides/faq.html#why-am-i-getting-a-warning-about-strapping-pins INFO Generating C++ source... INFO Updating https://github.com/espressif/esp-adf.git@v2.5 INFO Updating submodules (components/esp-adf-libs, components/esp-sr) for https://github.com/espressif/esp-adf.git@v2.5 INFO Compiling app... Processing voice-sat (board: esp-wrover-kit; framework: espidf; platform: platformio/espressif32@5.4.0) -------------------------------------------------------------------------------- HARDWARE: ESP32 240MHz, 320KB RAM, 4MB Flash - framework-espidf @ 3.40406.240122 (4.4.6) - tool-cmake @ 3.16.4 - tool-ninja @ 1.7.1 - toolchain-esp32ulp @ 2.35.0-20220830 - toolchain-xtensa-esp32 @ 8.4.0+2021r2-patch5 Reading CMake configuration... Dependency Graph |-- noise-c @ 0.1.4 RAM: [= ] 9.7% (used 31892 bytes from 327680 bytes) Flash: [====== ] 59.9% (used 1098577 bytes from 1835008 bytes) ========================= [SUCCESS] Took 26.47 seconds ========================= INFO Successfully compiled program. INFO Connecting to 192.168.0.85 INFO Uploading /data/build/voice-sat/.pioenvs/voice-sat/firmware.bin (1104880 bytes) Uploading: [============================================================] 100% Done... INFO Upload took 4.31 seconds, waiting for result... INFO OTA successful INFO Successfully uploaded program. INFO Starting log output from 192.168.0.85 using esphome API INFO Successfully connected to voice-sat @ 192.168.0.85 in 7.221s INFO Successful handshake with voice-sat @ 192.168.0.85 in 0.104s [14:39:00][I][app:100]: ESPHome version 2024.4.2 compiled on May 2 2024, 22:45:30 [14:39:00][C][wifi:580]: WiFi: [14:39:00][C][wifi:408]: Local MAC: B8:D6:1A:59:AA:C0 [14:39:00][C][wifi:413]: SSID: [redacted] [14:39:00][C][wifi:416]: IP Address: 192.168.0.85 [14:39:00][C][wifi:420]: BSSID: [redacted] [14:39:00][C][wifi:421]: Hostname: 'voice-sat' [14:39:00][C][wifi:423]: Signal strength: -57 dB ▂▄▆█ [14:39:00][C][wifi:427]: Channel: 6 [14:39:00][C][wifi:428]: Subnet: 255.255.255.0 [14:39:00][C][wifi:429]: Gateway: 192.168.0.1 [14:39:00][C][wifi:430]: DNS1: 192.168.0.1 [14:39:00][C][wifi:431]: DNS2: 0.0.0.0 [14:39:00][C][logger:166]: Logger: [14:39:00][C][logger:167]: Level: DEBUG [14:39:00][C][logger:169]: Log Baud Rate: 115200 [14:39:00][C][logger:170]: Hardware UART: UART0 [14:39:00][C][i2c.idf:075]: I2C Bus: [14:39:00][C][i2c.idf:076]: SDA Pin: GPIO33 [14:39:00][C][i2c.idf:077]: SCL Pin: GPIO32 [14:39:00][C][i2c.idf:078]: Frequency: 50000 Hz [14:39:00][C][i2c.idf:084]: Recovery: bus successfully recovered [14:39:00][I][i2c.idf:094]: Results from i2c bus scan: [14:39:00][I][i2c.idf:100]: Found i2c device at address 0x10 [14:39:00][C][switch.gpio:068]: GPIO Switch 'AMP Switch' [14:39:00][C][switch.gpio:091]: Restore Mode: always OFF [14:39:00][C][switch.gpio:031]: Pin: GPIO21 [14:39:00][C][gpio.output:010]: GPIO Binary Output: [14:39:00][C][gpio.output:011]: Pin: GPIO22 [14:39:00][C][gpio.output:012]: Inverted: YES [14:39:00][C][gpio.output:010]: GPIO Binary Output: [14:39:00][C][gpio.output:011]: Pin: GPIO19 [14:39:00][C][gpio.output:012]: Inverted: YES [14:39:00][C][light:103]: Light 'Test LED 1' [14:39:00][C][light:103]: Light 'Test LED 2' [14:39:00][C][template.switch:068]: Template Switch 'Use wake word' [14:39:00][C][template.switch:091]: Restore Mode: always OFF [14:39:00][C][template.switch:057]: Optimistic: YES [14:39:00][C][i2s_audio:028]: I2SController: [14:39:00][C][i2s_audio:029]: AccessMode: duplex [14:39:00][C][i2s_audio:030]: Port: 0 [14:39:00][C][i2s_audio:032]: Reader registered. [14:39:00][C][i2s_audio:035]: Writer registered. [14:39:00][C][i2s_audio:138]: I2S-Writer (Fixed-CFG): [14:39:00][C][i2s_audio:140]: sample-rate: 16000 bits_per_sample: 16 [14:39:00][C][i2s_audio:141]: channel_fmt: 0 channels: 2 [14:39:00][C][i2s_audio:142]: use_apll: no, use_pdm: no [14:39:00][C][i2s_audio:135]: I2S-Reader (Fixed-CFG): [14:39:00][C][i2s_audio:140]: sample-rate: 16000 bits_per_sample: 16 [14:39:00][C][i2s_audio:141]: channel_fmt: 3 channels: 1 [14:39:00][C][i2s_audio:142]: use_apll: no, use_pdm: no [14:39:00][C][captive_portal:088]: Captive Portal: [14:39:00][C][mdns:115]: mDNS: [14:39:00][C][mdns:116]: Hostname: voice-sat [14:39:00][C][ota:096]: Over-The-Air Updates: [14:39:00][C][ota:097]: Address: voice-sat.local:3232 [14:39:00][C][ota:103]: OTA version: 2. [14:39:00][C][api:139]: API Server: [14:39:00][C][api:140]: Address: voice-sat.local:6053 [14:39:00][C][api:142]: Using noise encryption: YES [14:39:00][C][esp_adf_pipeline.microphone:020]: ADF-Microphone [14:39:00][C][adf_media_player:016]: ESP-ADF-MediaPlayer: [14:39:00][C][adf_media_player:018]: Number of ASPComponents: 3 [14:43:52][I][ota:117]: Boot seems successful, resetting boot loop counter. [14:43:52][D][esp32.preferences:114]: Saving 1 preferences to flash... [14:43:52][D][esp32.preferences:143]: Saving 1 preferences to flash: 0 cached, 1 written, 0 failed [14:44:51][D][switch:012]: 'AMP Switch' Turning ON. [14:44:51][D][switch:055]: 'AMP Switch': Sending state ON [14:45:17][D][media_player:059]: 's3-dev_media_player' - Setting [14:45:17][D][media_player:069]: Volume: 0.41 [14:45:17][D][esp_audio_processors:079]: New settings: SRC: rate: 16000, ch: 2 DST: rate: 16000, ch: 2 [14:45:17][D][esp_audio_processors:079]: New settings: SRC: rate: 16000, ch: 2 DST: rate: 16000, ch: 2 [14:45:21][D][switch:012]: 'Use wake word' Turning ON. [14:45:21][D][switch:055]: 'Use wake word': Sending state ON [14:45:21][D][voice_assistant:439]: State changed from IDLE to START_PIPELINE [14:45:21][D][voice_assistant:445]: Desired state set to START_MICROPHONE [14:45:21][D][light:036]: 'Test LED 1' Setting: [14:45:21][D][light:047]: State: ON [14:45:21][D][voice_assistant:126]: microphone not running [14:45:21][D][voice_assistant:210]: Requesting start... [14:45:21][D][voice_assistant:439]: State changed from START_PIPELINE to STARTING_PIPELINE [14:45:21][D][voice_assistant:126]: microphone not running [14:45:21][D][voice_assistant:476]: Client started, streaming microphone [14:45:21][D][voice_assistant:439]: State changed from STARTING_PIPELINE to START_MICROPHONE [14:45:21][D][voice_assistant:445]: Desired state set to STREAMING_MICROPHONE [14:45:21][D][voice_assistant:163]: Starting Microphone [14:45:21][D][esp_adf_pipeline:050]: Starting request, current state UNINITIALIZED [14:45:21][D][esp-idf:000]: I (390005) I2S: DMA Malloc info, datalen=blocksize=512, dma_buf_count=4 [14:45:21][D][esp-idf:000]: I (390014) I2S: DMA Malloc info, datalen=blocksize=512, dma_buf_count=4 [14:45:21][D][i2s_audio:072]: Installing driver : yes [14:45:21][D][esp-idf:000]: I (390026) I2S: I2S0, MCLK output by GPIO0 [14:45:21][D][esp_adf_pipeline:358]: pipeline tag 0, i2s_in [14:45:21][D][esp_adf_pipeline:358]: pipeline tag 1, resampler [14:45:21][D][esp_adf_pipeline:358]: pipeline tag 2, pcm_reader [14:45:21][D][esp-idf:000]: I (390054) AUDIO_PIPELINE: link el->rb, el:0x3ffd7d50, tag:i2s_in, rb:0x3ffd8870 [14:45:21][D][esp-idf:000]: I (390065) AUDIO_PIPELINE: link el->rb, el:0x3ffd7780, tag:resampler, rb:0x3ffda530 [14:45:21][D][esp_adf_pipeline:370]: Setting up event listener. [14:45:21][D][esp_adf_pipeline:302]: State changed from UNINITIALIZED to PREPARING [14:45:21][D][voice_assistant:439]: State changed from START_MICROPHONE to STARTING_MICROPHONE [14:45:21][W][component:237]: Component voice_assistant took a long time for an operation (101 ms). [14:45:21][W][component:238]: Components should block for at most 30 ms. [14:45:21][D][esp_audio_processors:079]: New settings: SRC: rate: 16000, ch: 2 DST: rate: 16000, ch: 1 [14:45:21][D][esp_audio_processors:088]: New settings: SRC: rate: 16000, ch: 2 DST: rate: 16000, ch: 1 [14:45:21][D][esp_adf_pipeline:302]: State changed from PREPARING to STARTING [14:45:21][D][esp-idf:000]: I (390130) AUDIO_ELEMENT: [i2s_in-0x3ffd7d50] Element task created [14:45:21][D][esp-idf:000]: I (390137) AUDIO_ELEMENT: [resampler-0x3ffd7780] Element task created [14:45:21][D][esp-idf:000]: I (390146) AUDIO_ELEMENT: [pcm_reader-0x3ffd7aec] Element task created [14:45:21][D][esp-idf:000]: I (390167) AUDIO_PIPELINE: Func:audio_pipeline_run, Line:359, MEM Total:139552 Bytes [14:45:21][D][esp-idf:000]: I (390177) AUDIO_ELEMENT: [i2s_in] AEL_MSG_CMD_RESUME,state:1 [14:45:21][D][esp-idf:000]: I (390189) AUDIO_ELEMENT: [resampler] AEL_MSG_CMD_RESUME,state:1 [14:45:21][D][esp-idf:000]: I (390192) AUDIO_PIPELINE: Pipeline started [14:45:21][W][component:237]: Component adf_pipeline.microphone took a long time for an operation (83 ms). [14:45:21][W][component:238]: Components should block for at most 30 ms. [14:45:21][D][voice_assistant:563]: Event Type: 1 [14:45:21][D][voice_assistant:566]: Assist Pipeline running [14:45:21][I][esp_adf_pipeline:214]: [ pcm_reader ] status: 12 [14:45:21][D][esp_adf_pipeline:131]: Check element [i2s_in] status, 3 [14:45:21][D][esp_adf_pipeline:131]: Check element [resampler] status, 3 [14:45:21][D][esp_adf_pipeline:131]: Check element [pcm_reader] status, 3 [14:45:21][D][esp_adf_pipeline:302]: State changed from STARTING to RUNNING [14:45:21][D][voice_assistant:563]: Event Type: 9 [14:45:21][D][voice_assistant:439]: State changed from STARTING_MICROPHONE to STREAMING_MICROPHONE [14:45:21][I][esp_adf_pipeline:214]: [ i2s_in ] status: 12 [14:45:21][I][esp_adf_pipeline:214]: [ pcm_reader ] status: 12 [14:45:21][I][esp_adf_pipeline:214]: [ resampler ] status: 12 [14:45:31][D][voice_assistant:563]: Event Type: 0 [14:45:31][D][voice_assistant:563]: Event Type: 2 [14:45:31][D][voice_assistant:653]: Assist Pipeline ended [14:45:31][D][voice_assistant:439]: State changed from STREAMING_MICROPHONE to IDLE [14:45:31][D][voice_assistant:445]: Desired state set to IDLE [14:45:31][D][voice_assistant:439]: State changed from IDLE to START_PIPELINE [14:45:31][D][voice_assistant:445]: Desired state set to START_MICROPHONE [14:45:31][D][voice_assistant:210]: Requesting start... [14:45:31][D][voice_assistant:439]: State changed from START_PIPELINE to STARTING_PIPELINE [14:45:31][D][voice_assistant:476]: Client started, streaming microphone [14:45:31][D][voice_assistant:439]: State changed from STARTING_PIPELINE to STREAMING_MICROPHONE [14:45:31][D][voice_assistant:445]: Desired state set to STREAMING_MICROPHONE [14:45:31][D][voice_assistant:563]: Event Type: 1 [14:45:31][D][voice_assistant:566]: Assist Pipeline running [14:45:31][D][voice_assistant:563]: Event Type: 9 [14:45:32][D][light:036]: 'Test LED 1' Setting: [14:45:41][D][voice_assistant:563]: Event Type: 0 [14:45:41][D][voice_assistant:563]: Event Type: 2 [14:45:41][D][voice_assistant:653]: Assist Pipeline ended [14:45:41][D][voice_assistant:439]: State changed from STREAMING_MICROPHONE to IDLE [14:45:41][D][voice_assistant:445]: Desired state set to IDLE [14:45:41][D][voice_assistant:439]: State changed from IDLE to START_PIPELINE [14:45:41][D][voice_assistant:445]: Desired state set to START_MICROPHONE [14:45:41][D][voice_assistant:210]: Requesting start... [14:45:41][D][voice_assistant:439]: State changed from START_PIPELINE to STARTING_PIPELINE [14:45:41][D][voice_assistant:476]: Client started, streaming microphone [14:45:41][D][voice_assistant:439]: State changed from STARTING_PIPELINE to STREAMING_MICROPHONE [14:45:41][D][voice_assistant:445]: Desired state set to STREAMING_MICROPHONE [14:45:41][D][voice_assistant:563]: Event Type: 1 [14:45:42][D][voice_assistant:566]: Assist Pipeline running [14:45:42][D][voice_assistant:563]: Event Type: 9 [14:45:42][D][light:036]: 'Test LED 1' Setting: [14:45:51][D][voice_assistant:563]: Event Type: 0 [14:45:51][D][voice_assistant:563]: Event Type: 2 [14:45:51][D][voice_assistant:653]: Assist Pipeline ended [14:45:52][D][voice_assistant:439]: State changed from STREAMING_MICROPHONE to IDLE [14:45:52][D][voice_assistant:445]: Desired state set to IDLE [14:45:52][D][voice_assistant:439]: State changed from IDLE to START_PIPELINE [14:45:52][D][voice_assistant:445]: Desired state set to START_MICROPHONE [14:45:52][D][voice_assistant:210]: Requesting start... [14:45:52][D][voice_assistant:439]: State changed from START_PIPELINE to STARTING_PIPELINE [14:45:52][D][voice_assistant:476]: Client started, streaming microphone [14:45:52][D][voice_assistant:439]: State changed from STARTING_PIPELINE to STREAMING_MICROPHONE [14:45:52][D][voice_assistant:445]: Desired state set to STREAMING_MICROPHONE [14:45:52][D][voice_assistant:563]: Event Type: 1 [14:45:52][D][voice_assistant:566]: Assist Pipeline running [14:45:52][D][voice_assistant:563]: Event Type: 9 [14:45:52][D][light:036]: 'Test LED 1' Setting: [14:46:02][D][voice_assistant:563]: Event Type: 0 [14:46:02][D][voice_assistant:563]: Event Type: 2 [14:46:02][D][voice_assistant:653]: Assist Pipeline ended [14:46:02][D][voice_assistant:439]: State changed from STREAMING_MICROPHONE to IDLE [14:46:02][D][voice_assistant:445]: Desired state set to IDLE [14:46:02][D][voice_assistant:439]: State changed from IDLE to START_PIPELINE [14:46:02][D][voice_assistant:445]: Desired state set to START_MICROPHONE [14:46:02][D][voice_assistant:210]: Requesting start... [14:46:02][D][voice_assistant:439]: State changed from START_PIPELINE to STARTING_PIPELINE [14:46:02][D][voice_assistant:476]: Client started, streaming microphone [14:46:02][D][voice_assistant:439]: State changed from STARTING_PIPELINE to STREAMING_MICROPHONE [14:46:02][D][voice_assistant:445]: Desired state set to STREAMING_MICROPHONE [14:46:02][D][voice_assistant:563]: Event Type: 1 [14:46:02][D][voice_assistant:566]: Assist Pipeline running [14:46:02][D][voice_assistant:563]: Event Type: 9 [14:46:02][D][light:036]: 'Test LED 1' Setting: [14:46:09][D][media_player:059]: 's3-dev_media_player' - Setting [14:46:09][D][media_player:066]: Media URL: http://192.168.0.90:8123/media/local/beep.mp3?authSig=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiI0NTc1YzcxNmIwZGU0MzhiYmU1MTcwYmE2Y2I3MGRiNSIsInBhdGgiOiIvbWVkaWEvbG9jYWwvYmVlcC5tcDMiLCJwYXJhbXMiOltdLCJpYXQiOjE3MTUxNzIzNjksImV4cCI6MTcxNTI1ODc2OX0.GIPi7_KM3Zyoruy58HxS1ht6h_1v_UlIl1HhcPdBwfU [14:46:09][D][adf_media_player:030]: Got control call in state 1 [14:46:09][D][esp_adf_pipeline:050]: Starting request, current state UNINITIALIZED [14:46:09][D][esp-idf:000]: I (438232) MP3_DECODER: MP3 init [14:46:09][D][esp_adf_pipeline:358]: pipeline tag 0, http [14:46:09][D][esp_adf_pipeline:358]: pipeline tag 1, decoder [14:46:09][D][esp_adf_pipeline:358]: pipeline tag 2, resampler [14:46:09][D][esp_adf_pipeline:358]: pipeline tag 3, i2s_out [14:46:09][D][esp-idf:000]: I (438270) AUDIO_PIPELINE: link el->rb, el:0x3ffdb7fc, tag:http, rb:0x3ffdfb68 [14:46:09][D][esp-idf:000]: I (438274) AUDIO_PIPELINE: link el->rb, el:0x3ffdec80, tag:decoder, rb:0x3ffdffb0 [14:46:09][D][esp-idf:000]: I (438276) AUDIO_PIPELINE: link el->rb, el:0x3ffd9958, tag:resampler, rb:0x3ffdfe28 [14:46:09][D][esp_adf_pipeline:370]: Setting up event listener. [14:46:09][D][esp_adf_pipeline:302]: State changed from UNINITIALIZED to PREPARING [14:46:10][I][adf_media_player:135]: got new pipeline state: 1 [14:46:10][D][adf_i2s_out:127]: Set final i2s settings: 16000 [14:46:10][D][esp_audio_processors:079]: New settings: SRC: rate: 16000, ch: 2 DST: rate: 16000, ch: 2 [14:46:10][W][component:237]: Component api took a long time for an operation (123 ms). [14:46:10][W][component:238]: Components should block for at most 30 ms. [14:46:10][D][esp-idf:000]: I (438345) AUDIO_ELEMENT: [http-0x3ffdb7fc] Element task created [14:46:10][D][esp-idf:000]: I (438349) AUDIO_ELEMENT: [decoder-0x3ffdec80] Element task created [14:46:10][D][esp-idf:000]: I (438354) AUDIO_ELEMENT: [http] AEL_MSG_CMD_RESUME,state:1 [14:46:10][D][esp-idf:000]: I (438366) AUDIO_ELEMENT: [decoder] AEL_MSG_CMD_RESUME,state:1 [14:46:10][D][esp_audio_sources:097]: Streamer status: 2 [14:46:10][D][esp_audio_sources:098]: decoder status: 2 [14:46:10][D][esp-idf:000]: I (438403) HTTP_STREAM: total_bytes=27360 [14:46:10][D][esp-idf:000]: E (438428) MP3_DE_LIB: /builds/adf/esp-adf-libs-source/esp_codec/esp-mp3/src/pvmp3_framedecoder.cpp:701 (pvmp3_InitDecoder): Memory exhausted [14:46:10][D][esp-idf:000]: E (438433) MP3_DECODER: Allocate buffer failed. (line 294) [14:46:10][D][esp-idf:000]: E (438439) AUDIO_ELEMENT: [decoder] AEL_STATUS_ERROR_OPEN,-1 [14:46:10][D][esp-idf:000]: W (438444) AUDIO_ELEMENT: [decoder] audio_element_on_cmd_error,7 [14:46:10][D][esp-idf:000]: I (438453) MP3_DECODER: Closed [14:46:10][D][esp-idf:000]: W (438469) AUDIO_ELEMENT: OUT-[http] AEL_IO_ABORT [14:46:19][I][esp_adf_pipeline:185]: Pipeline preparation timeout! [14:46:19][D][esp-idf:000]: W (448300) AUDIO_PIPELINE: Without stop, st:1 [14:46:19][D][esp_adf_pipeline:302]: State changed from PREPARING to STOPPING [14:46:20][I][adf_media_player:135]: got new pipeline state: 4 [14:46:20][D][esp_adf_pipeline:400]: Called deinit_all [14:46:20][D][esp-idf:000]: W (448313) AUDIO_ELEMENT: [resampler] Element has not create when AUDIO_ELEMENT_TERMINATE [14:46:20][D][esp-idf:000]: W (448316) AUDIO_ELEMENT: [i2s_out] Element has not create when AUDIO_ELEMENT_TERMINATE [14:46:20][D][esp-idf:000]: I (448318) AUDIO_PIPELINE: audio_pipeline_unlinked [14:46:20][D][esp-idf:000]: W (448335) AUDIO_ELEMENT: [http] Element has not create when AUDIO_ELEMENT_TERMINATE [14:46:20][D][esp-idf:000]: W (448346) AUDIO_ELEMENT: [decoder] Element has not create when AUDIO_ELEMENT_TERMINATE [14:46:20][D][esp-idf:000]: W (448356) AUDIO_ELEMENT: [resampler] Element has not create when AUDIO_ELEMENT_TERMINATE [14:46:20][D][esp-idf:000]: W (448366) AUDIO_ELEMENT: [i2s_out] Element has not create when AUDIO_ELEMENT_TERMINATE [14:46:20][D][i2s_audio:116]: Other component hasn't released WARNING voice-sat @ 192.168.0.85: Connection error occurred: [Errno 104] Connection reset by peer INFO Processing unexpected disconnect from ESPHome API for voice-sat @ 192.168.0.85 WARNING Disconnected from API INFO Successfully connected to voice-sat @ 192.168.0.85 in 0.006s INFO Successful handshake with voice-sat @ 192.168.0.85 in 0.090s [14:46:42][D][api:102]: Accepted 192.168.0.90 [14:46:42][W][component:237]: Component api took a long time for an operation (57 ms). [14:46:42][W][component:238]: Components should block for at most 30 ms. [14:46:42][D][api.connection:1210]: Home Assistant 2024.5.2 (192.168.0.90): Connected successfully [14:46:53][D][media_player:059]: 's3-dev_media_player' - Setting [14:46:53][D][media_player:069]: Volume: 0.28 [14:46:53][D][esp_audio_processors:079]: New settings: SRC: rate: 16000, ch: 2 DST: rate: 16000, ch: 2 [14:46:53][D][esp_audio_processors:079]: New settings: SRC: rate: 16000, ch: 2 DST: rate: 16000, ch: 2 [14:46:53][D][switch:012]: 'AMP Switch' Turning ON. [14:46:53][D][switch:055]: 'AMP Switch': Sending state ON [14:47:05][D][media_player:059]: 's3-dev_media_player' - Setting [14:47:05][D][media_player:066]: Media URL: http://192.168.0.90:8123/media/local/beep.mp3?authSig=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiI0NTc1YzcxNmIwZGU0MzhiYmU1MTcwYmE2Y2I3MGRiNSIsInBhdGgiOiIvbWVkaWEvbG9jYWwvYmVlcC5tcDMiLCJwYXJhbXMiOltdLCJpYXQiOjE3MTUxNzI0MjUsImV4cCI6MTcxNTI1ODgyNX0.NgCe7XJ8OxZw98cwHWPQ7e5mR2_73OfsZz4iuqWBdd8 [14:47:05][D][adf_media_player:030]: Got control call in state 1 [14:47:05][D][esp_adf_pipeline:050]: Starting request, current state UNINITIALIZED [14:47:05][D][esp-idf:000]: I (40823) MP3_DECODER: MP3 init [14:47:05][D][esp-idf:000]: I (40851) I2S: DMA Malloc info, datalen=blocksize=1024, dma_buf_count=4 [14:47:05][D][esp-idf:000]: I (40855) I2S: DMA Malloc info, datalen=blocksize=1024, dma_buf_count=4 [14:47:05][D][i2s_audio:072]: Installing driver : yes [14:47:05][D][esp-idf:000]: I (40860) I2S: I2S0, MCLK output by GPIO0 [14:47:05][D][esp_adf_pipeline:358]: pipeline tag 0, http [14:47:05][D][esp_adf_pipeline:358]: pipeline tag 1, decoder [14:47:05][D][esp_adf_pipeline:358]: pipeline tag 2, resampler [14:47:05][D][esp_adf_pipeline:358]: pipeline tag 3, i2s_out [14:47:05][D][esp-idf:000]: I (40884) AUDIO_PIPELINE: link el->rb, el:0x3ffd6c14, tag:http, rb:0x3ffd9b38 [14:47:05][D][esp-idf:000]: I (40894) AUDIO_PIPELINE: link el->rb, el:0x3ffd7a08, tag:decoder, rb:0x3ffda24c [14:47:05][D][esp-idf:000]: I (40904) AUDIO_PIPELINE: link el->rb, el:0x3ffd8750, tag:resampler, rb:0x3ffd9b74 [14:47:05][D][esp_adf_pipeline:370]: Setting up event listener. [14:47:05][D][esp_adf_pipeline:302]: State changed from UNINITIALIZED to PREPARING [14:47:05][I][adf_media_player:135]: got new pipeline state: 1 [14:47:05][D][adf_i2s_out:127]: Set final i2s settings: 16000 [14:47:05][D][esp_audio_processors:079]: New settings: SRC: rate: 16000, ch: 2 DST: rate: 16000, ch: 2 [14:47:05][W][component:237]: Component api took a long time for an operation (153 ms). [14:47:05][W][component:238]: Components should block for at most 30 ms. [14:47:05][D][esp-idf:000]: I (40958) AUDIO_ELEMENT: [http-0x3ffd6c14] Element task created [14:47:05][D][esp-idf:000]: I (40966) AUDIO_ELEMENT: [decoder-0x3ffd7a08] Element task created [14:47:05][D][esp-idf:000]: I (40976) AUDIO_ELEMENT: [http] AEL_MSG_CMD_RESUME,state:1 [14:47:05][D][esp-idf:000]: I (40987) AUDIO_ELEMENT: [decoder] AEL_MSG_CMD_RESUME,state:1 [14:47:05][D][esp_audio_sources:097]: Streamer status: 2 [14:47:05][D][esp_audio_sources:098]: decoder status: 2 [14:47:05][D][esp-idf:000]: I (41017) HTTP_CLIENT: Body received in fetch header state, 0x3ffdeea2, 1742 [14:47:05][D][esp-idf:000]: I (41021) HTTP_STREAM: total_bytes=27360 [14:47:05][I][HTTPStreamReader:129]: [ * ] Receive music info from mp3 decoder, sample_rates=24000, bits=16, ch=2 [14:47:05][D][adf_i2s_out:127]: Set final i2s settings: 16000 [14:47:05][D][esp_audio_processors:079]: New settings: SRC: rate: 24000, ch: 2 DST: rate: 16000, ch: 2 [14:47:05][D][esp_audio_processors:088]: New settings: SRC: rate: 24000, ch: 2 DST: rate: 16000, ch: 2 [14:47:05][D][esp-idf:000]: W (41067) AUDIO_ELEMENT: OUT-[decoder] AEL_IO_ABORT [14:47:05][D][esp-idf:000]: W (41072) MP3_DECODER: output aborted -3 [14:47:05][D][esp-idf:000]: I (41079) MP3_DECODER: Closed [14:47:05][D][esp_adf_pipeline:302]: State changed from PREPARING to STARTING [14:47:05][I][adf_media_player:135]: got new pipeline state: 2 [14:47:05][D][adf_i2s_out:127]: Set final i2s settings: 16000 [14:47:05][D][esp_audio_processors:079]: New settings: SRC: rate: 24000, ch: 2 DST: rate: 16000, ch: 2 [14:47:05][D][esp-idf:000]: I (41120) AUDIO_ELEMENT: [resampler-0x3ffd8750] Element task created [14:47:05][D][esp-idf:000]: I (41124) AUDIO_ELEMENT: [i2s_out-0x3ffd7dc8] Element task created [14:47:05][D][esp-idf:000]: I (41129) AUDIO_PIPELINE: Func:audio_pipeline_run, Line:359, MEM Total:113656 Bytes [14:47:05][D][esp-idf:000]: I (41140) AUDIO_ELEMENT: [http] AEL_MSG_CMD_RESUME,state:1 [14:47:05][D][esp-idf:000]: I (41151) AUDIO_ELEMENT: [decoder] AEL_MSG_CMD_RESUME,state:1 [14:47:05][D][esp-idf:000]: I (41163) AUDIO_ELEMENT: [resampler] AEL_MSG_CMD_RESUME,state:1 [14:47:05][D][esp-idf:000]: I (41167) AUDIO_ELEMENT: [i2s_out] AEL_MSG_CMD_RESUME,state:1 [14:47:05][D][esp-idf:000]: I (41171) AUDIO_PIPELINE: Pipeline started [14:47:05][W][component:237]: Component adf_pipeline.media_player took a long time for an operation (81 ms). [14:47:05][W][component:238]: Components should block for at most 30 ms. [14:47:05][D][esp-idf:000]: I (41211) RSP_FILTER: sample rate of source data : 24000, channel of source data : 2, sample rate of destination data : 16000, channel of destination data : 2 [14:47:05][D][esp-idf:000]: I (41229) HTTP_CLIENT: Body received in fetch header state, 0x3ffdf8ae, 1742 [14:47:05][D][esp-idf:000]: E (41234) HTTP_CLIENT: Failed to allocate memory for storing decoded data [14:47:05][D][esp-idf:000]: I (41243) HTTP_STREAM: total_bytes=27360 [14:47:05][I][esp_adf_pipeline:214]: [ http ] status: 12 [14:47:05][D][esp_adf_pipeline:131]: Check element [http] status, 3 [14:47:05][D][esp_adf_pipeline:131]: Check element [decoder] status, 2 [14:47:18][D][media_player:059]: 's3-dev_media_player' - Setting [14:47:18][D][media_player:066]: Media URL: http://192.168.0.90:8123/media/local/ff-16b-1c-16000hz.mp3?authSig=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiI0NTc1YzcxNmIwZGU0MzhiYmU1MTcwYmE2Y2I3MGRiNSIsInBhdGgiOiIvbWVkaWEvbG9jYWwvZmYtMTZiLTFjLTE2MDAwaHoubXAzIiwicGFyYW1zIjpbXSwiaWF0IjoxNzE1MTcyNDM4LCJleHAiOjE3MTUyNTg4Mzh9.NC7KcNQH1kMIcEgbvQ70mVfhBKtXAF1FhSrY6WmEa00 [14:47:18][D][adf_media_player:030]: Got control call in state 2 [14:47:18][D][esp_adf_pipeline:302]: State changed from STARTING to STOPPING [14:47:18][I][adf_media_player:135]: got new pipeline state: 4 [14:47:21][D][esp_adf_pipeline:400]: Called deinit_all [14:47:23][D][esp-idf:000]: W (58942) AUDIO_ELEMENT: [http-0x3ffd6c14] Element task destroy timeout[2000] [14:47:23][D][esp-idf:000]: I (58946) AUDIO_PIPELINE: audio_pipeline_unlinked WARNING voice-sat @ 192.168.0.85: Connection error occurred: [Errno 104] Connection reset by peer INFO Processing unexpected disconnect from ESPHome API for voice-sat @ 192.168.0.85 WARNING Disconnected from API INFO Successfully connected to voice-sat @ 192.168.0.85 in 0.003s INFO Successful handshake with voice-sat @ 192.168.0.85 in 0.088s [14:48:05][D][media_player:059]: 's3-dev_media_player' - Setting [14:48:05][D][media_player:069]: Volume: 0.53 [14:48:05][D][adf_i2s_out:127]: Set final i2s settings: 16000 [14:48:05][D][esp_audio_processors:079]: New settings: SRC: rate: 16000, ch: 1 DST: rate: 16000, ch: 2 [14:48:05][D][adf_i2s_out:127]: Set final i2s settings: 16000 [14:48:05][D][esp_audio_processors:079]: New settings: SRC: rate: 16000, ch: 1 DST: rate: 16000, ch: 2 [14:48:06][D][media_player:059]: 's3-dev_media_player' - Setting [14:48:06][D][media_player:069]: Volume: 0.41 [14:48:06][D][adf_i2s_out:127]: Set final i2s settings: 16000 [14:48:06][D][esp_audio_processors:079]: New settings: SRC: rate: 16000, ch: 1 DST: rate: 16000, ch: 2 [14:48:06][D][adf_i2s_out:127]: Set final i2s settings: 16000 [14:48:06][D][esp_audio_processors:079]: New settings: SRC: rate: 16000, ch: 1 DST: rate: 16000, ch: 2 [14:48:09][D][switch:012]: 'AMP Switch' Turning ON. [14:48:09][D][switch:055]: 'AMP Switch': Sending state ON [14:48:20][D][media_player:059]: 's3-dev_media_player' - Setting [14:48:20][D][media_player:063]: Command: STOP [14:48:20][D][esp-idf:000]: E (54127) AUDIO_ELEMENT: [decoder] Element already stopped [14:48:20][D][esp-idf:000]: E (54131) AUDIO_ELEMENT: [resampler] Element already stopped [14:48:20][D][esp-idf:000]: E (54134) AUDIO_ELEMENT: [i2s_out] Element already stopped [14:48:20][D][esp_adf_pipeline:302]: State changed from STARTING to STOPPING [14:48:20][I][adf_media_player:135]: got new pipeline state: 4 [14:48:20][D][esp_adf_pipeline:400]: Called deinit_all [14:48:20][D][esp-idf:000]: I (54154) AUDIO_PIPELINE: audio_pipeline_unlinked [14:48:20][D][esp-idf:000]: W (54163) AUDIO_ELEMENT: [http] Element has not create when AUDIO_ELEMENT_TERMINATE [14:48:20][D][esp-idf:000]: W (54173) AUDIO_ELEMENT: [decoder] Element has not create when AUDIO_ELEMENT_TERMINATE [14:48:20][D][esp-idf:000]: W (54184) AUDIO_ELEMENT: [resampler] Element has not create when AUDIO_ELEMENT_TERMINATE [14:48:20][D][esp-idf:000]: W (54194) AUDIO_ELEMENT: [i2s_out] Element has not create when AUDIO_ELEMENT_TERMINATE [14:48:20][D][esp-idf:000]: I (54205) I2S: DMA queue destroyed [14:48:20][D][esp-idf:000]: I (54207) I2S: DMA queue destroyed [14:48:20][D][esp_adf_pipeline:302]: State changed from STOPPING to UNINITIALIZED [14:48:20][I][adf_media_player:135]: got new pipeline state: 0 [14:48:20][W][component:237]: Component adf_pipeline.media_player took a long time for an operation (91 ms). [14:48:20][W][component:238]: Components should block for at most 30 ms. [14:48:34][D][media_player:059]: 's3-dev_media_player' - Setting [14:48:34][D][media_player:066]: Media URL: http://st01.dlf.de/dlf/01/128/mp3/stream.mp3 [14:48:34][D][adf_media_player:030]: Got control call in state 1 [14:48:34][D][esp_adf_pipeline:050]: Starting request, current state UNINITIALIZED [14:48:34][D][esp-idf:000]: I (68465) MP3_DECODER: MP3 init [14:48:34][D][esp-idf:000]: I (68494) I2S: DMA Malloc info, datalen=blocksize=1024, dma_buf_count=4 [14:48:34][D][esp-idf:000]: I (68498) I2S: DMA Malloc info, datalen=blocksize=1024, dma_buf_count=4 [14:48:34][D][i2s_audio:072]: Installing driver : yes [14:48:34][D][esp-idf:000]: I (68503) I2S: I2S0, MCLK output by GPIO0 [14:48:34][D][esp_adf_pipeline:358]: pipeline tag 0, http [14:48:34][D][esp_adf_pipeline:358]: pipeline tag 1, decoder [14:48:34][D][esp_adf_pipeline:358]: pipeline tag 2, resampler [14:48:34][D][esp_adf_pipeline:358]: pipeline tag 3, i2s_out [14:48:34][D][esp-idf:000]: I (68526) AUDIO_PIPELINE: link el->rb, el:0x3ffdf420, tag:http, rb:0x3ffd74e8 [14:48:34][D][esp-idf:000]: I (68537) AUDIO_PIPELINE: link el->rb, el:0x3ffd77e4, tag:decoder, rb:0x3ffd75f4 [14:48:34][D][esp-idf:000]: I (68547) AUDIO_PIPELINE: link el->rb, el:0x3ffdfd74, tag:resampler, rb:0x3ffdfa54 [14:48:34][D][esp_adf_pipeline:370]: Setting up event listener. [14:48:34][D][esp_adf_pipeline:302]: State changed from UNINITIALIZED to PREPARING [14:48:34][I][adf_media_player:135]: got new pipeline state: 1 [14:48:34][D][adf_i2s_out:127]: Set final i2s settings: 16000 [14:48:34][D][esp_audio_processors:079]: New settings: SRC: rate: 16000, ch: 1 DST: rate: 16000, ch: 2 [14:48:34][W][component:237]: Component api took a long time for an operation (137 ms). [14:48:34][W][component:238]: Components should block for at most 30 ms. [14:48:34][D][esp-idf:000]: I (68601) AUDIO_ELEMENT: [http-0x3ffdf420] Element task created [14:48:34][D][esp-idf:000]: I (68609) AUDIO_ELEMENT: [decoder-0x3ffd77e4] Element task created [14:48:34][D][esp-idf:000]: I (68619) AUDIO_ELEMENT: [http] AEL_MSG_CMD_RESUME,state:1 [14:48:34][D][esp-idf:000]: I (68630) AUDIO_ELEMENT: [decoder] AEL_MSG_CMD_RESUME,state:1 [14:48:34][D][esp_audio_sources:097]: Streamer status: 2 [14:48:34][D][esp_audio_sources:098]: decoder status: 2 [14:48:35][D][esp-idf:000]: I (68784) HTTP_STREAM: total_bytes=0 [14:48:35][D][esp-idf:000]: I (68943) HTTP_STREAM: total_bytes=0 [14:48:35][I][HTTPStreamReader:129]: [ * ] Receive music info from mp3 decoder, sample_rates=48000, bits=16, ch=2 [14:48:35][D][adf_i2s_out:127]: Set final i2s settings: 16000 [14:48:35][D][esp_audio_processors:079]: New settings: SRC: rate: 48000, ch: 2 DST: rate: 16000, ch: 2 [14:48:35][D][esp_audio_processors:088]: New settings: SRC: rate: 48000, ch: 2 DST: rate: 16000, ch: 2 [14:48:35][D][esp-idf:000]: W (68982) AUDIO_ELEMENT: OUT-[decoder] AEL_IO_ABORT [14:48:35][D][esp-idf:000]: W (68995) MP3_DECODER: output aborted -3 [14:48:35][D][esp-idf:000]: I (68999) MP3_DECODER: Closed [14:48:35][D][esp_adf_pipeline:302]: State changed from PREPARING to STARTING [14:48:35][I][adf_media_player:135]: got new pipeline state: 2 [14:48:35][D][adf_i2s_out:127]: Set final i2s settings: 16000 [14:48:35][D][esp_audio_processors:079]: New settings: SRC: rate: 48000, ch: 2 DST: rate: 16000, ch: 2 [14:48:35][D][esp-idf:000]: I (69036) AUDIO_ELEMENT: [resampler-0x3ffdfd74] Element task created [14:48:35][D][esp-idf:000]: I (69039) AUDIO_ELEMENT: [i2s_out-0x3ffd67cc] Element task created [14:48:35][D][esp-idf:000]: I (69044) AUDIO_PIPELINE: Func:audio_pipeline_run, Line:359, MEM Total:114208 Bytes [14:48:35][D][esp-idf:000]: I (69055) AUDIO_ELEMENT: [http] AEL_MSG_CMD_RESUME,state:1 [14:48:35][D][esp-idf:000]: I (69068) AUDIO_ELEMENT: [decoder] AEL_MSG_CMD_RESUME,state:1 [14:48:35][D][esp-idf:000]: I (69077) MP3_DECODER: MP3 opened [14:48:35][D][esp-idf:000]: I (69115) RSP_FILTER: sample rate of source data : 48000, channel of source data : 2, sample rate of destination data : 16000, channel of destination data : 2 [14:48:35][I][esp_adf_pipeline:214]: [ resampler ] status: 12 [14:48:35][D][esp_adf_pipeline:131]: Check element [http] status, 2 [14:48:35][D][esp-idf:000]: I (69174) HTTP_STREAM: total_bytes=0 [14:48:35][D][esp-idf:000]: I (69320) HTTP_STREAM: total_bytes=0 [14:48:35][I][esp_adf_pipeline:214]: [ http ] status: 12 [14:48:35][D][esp_adf_pipeline:131]: Check element [http] status, 3 [14:48:35][D][esp_adf_pipeline:131]: Check element [decoder] status, 3 [14:48:35][D][esp_adf_pipeline:131]: Check element [resampler] status, 3 [14:48:35][D][esp_adf_pipeline:131]: Check element [i2s_out] status, 3 [14:48:35][D][esp_adf_pipeline:302]: State changed from STARTING to RUNNING [14:48:35][I][adf_media_player:135]: got new pipeline state: 3 [14:48:35][D][adf_i2s_out:127]: Set final i2s settings: 16000 [14:48:35][D][esp_audio_processors:079]: New settings: SRC: rate: 48000, ch: 2 DST: rate: 16000, ch: 2 [14:48:35][I][esp_adf_pipeline:214]: [ decoder ] status: 12 [14:48:35][I][HTTPStreamReader:129]: [ * ] Receive music info from mp3 decoder, sample_rates=48000, bits=16, ch=2 [14:48:35][D][adf_i2s_out:127]: Set final i2s settings: 16000 [14:48:35][D][esp_audio_processors:079]: New settings: SRC: rate: 48000, ch: 2 DST: rate: 16000, ch: 2 [14:48:41][D][media_player:059]: 's3-dev_media_player' - Setting [14:48:41][D][media_player:069]: Volume: 0.21 [14:48:41][D][adf_i2s_out:127]: Set final i2s settings: 16000 [14:48:41][D][esp_audio_processors:079]: New settings: SRC: rate: 48000, ch: 2 DST: rate: 16000, ch: 2 [14:48:41][D][adf_i2s_out:127]: Set final i2s settings: 16000 [14:48:41][D][esp_audio_processors:079]: New settings: SRC: rate: 48000, ch: 2 DST: rate: 16000, ch: 2 [14:48:42][D][media_player:059]: 's3-dev_media_player' - Setting [14:48:42][D][media_player:069]: Volume: 0.11 [14:48:42][D][adf_i2s_out:127]: Set final i2s settings: 16000 [14:48:42][D][esp_audio_processors:079]: New settings: SRC: rate: 48000, ch: 2 DST: rate: 16000, ch: 2 [14:48:42][D][adf_i2s_out:127]: Set final i2s settings: 16000 [14:48:42][D][esp_audio_processors:079]: New settings: SRC: rate: 48000, ch: 2 DST: rate: 16000, ch: 2 [14:48:45][D][media_player:059]: 's3-dev_media_player' - Setting [14:48:45][D][media_player:066]: Media URL: http://192.168.0.90:8123/media/local/beep.mp3?authSig=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiI0NTc1YzcxNmIwZGU0MzhiYmU1MTcwYmE2Y2I3MGRiNSIsInBhdGgiOiIvbWVkaWEvbG9jYWwvYmVlcC5tcDMiLCJwYXJhbXMiOltdLCJpYXQiOjE3MTUxNzI1MjUsImV4cCI6MTcxNTI1ODkyNX0.s-prtNwTZPHvBUhbbFTwok4PX4543zF2Yfw1vIG0BrQ [14:48:45][D][adf_media_player:030]: Got control call in state 2 [14:48:45][D][esp_adf_pipeline:302]: State changed from RUNNING to STOPPING [14:48:45][I][adf_media_player:135]: got new pipeline state: 4 [14:48:46][D][esp_adf_pipeline:400]: Called deinit_all [14:48:46][D][esp-idf:000]: I (79697) AUDIO_PIPELINE: audio_pipeline_unlinked [14:48:46][D][esp-idf:000]: W (79699) AUDIO_ELEMENT: [http] Element has not create when AUDIO_ELEMENT_TERMINATE [14:48:46][D][esp-idf:000]: W (79703) AUDIO_ELEMENT: [decoder] Element has not create when AUDIO_ELEMENT_TERMINATE [14:48:46][D][esp-idf:000]: W (79707) AUDIO_ELEMENT: [resampler] Element has not create when AUDIO_ELEMENT_TERMINATE [14:48:46][D][esp-idf:000]: W (79717) AUDIO_ELEMENT: [i2s_out] Element has not create when AUDIO_ELEMENT_TERMINATE [14:48:46][D][esp-idf:000]: I (79728) I2S: DMA queue destroyed [14:48:46][D][esp-idf:000]: I (79737) I2S: DMA queue destroyed [14:48:46][D][esp_adf_pipeline:302]: State changed from STOPPING to UNINITIALIZED [14:48:46][I][adf_media_player:135]: got new pipeline state: 0 [14:48:46][D][esp_adf_pipeline:050]: Starting request, current state UNINITIALIZED [14:48:46][D][esp-idf:000]: I (79758) MP3_DECODER: MP3 init [14:48:46][D][esp-idf:000]: I (79794) I2S: DMA Malloc info, datalen=blocksize=1024, dma_buf_count=4 [14:48:46][D][esp-idf:000]: I (79798) I2S: DMA Malloc info, datalen=blocksize=1024, dma_buf_count=4 [14:48:46][D][i2s_audio:072]: Installing driver : yes [14:48:46][D][esp-idf:000]: I (79803) I2S: I2S0, MCLK output by GPIO0 [14:48:46][D][esp_adf_pipeline:358]: pipeline tag 0, http [14:48:46][D][esp_adf_pipeline:358]: pipeline tag 1, decoder [14:48:46][D][esp_adf_pipeline:358]: pipeline tag 2, resampler [14:48:46][D][esp_adf_pipeline:358]: pipeline tag 3, i2s_out [14:48:46][D][esp-idf:000]: I (79826) AUDIO_PIPELINE: link el->rb, el:0x3ffdf420, tag:http, rb:0x3ffd6a14 [14:48:46][D][esp-idf:000]: I (79837) AUDIO_PIPELINE: link el->rb, el:0x3ffd76c0, tag:decoder, rb:0x3ffd6a64 [14:48:46][D][esp-idf:000]: I (79840) AUDIO_PIPELINE: link el->rb, el:0x3ffd6d84, tag:resampler, rb:0x3ffdf99c [14:48:46][D][esp_adf_pipeline:370]: Setting up event listener. [14:48:46][D][esp_adf_pipeline:302]: State changed from UNINITIALIZED to PREPARING [14:48:46][I][adf_media_player:135]: got new pipeline state: 1 [14:48:46][D][adf_i2s_out:127]: Set final i2s settings: 16000 [14:48:46][D][esp_audio_processors:079]: New settings: SRC: rate: 48000, ch: 2 DST: rate: 16000, ch: 2 [14:48:46][W][component:237]: Component adf_pipeline.media_player took a long time for an operation (197 ms). [14:48:46][W][component:238]: Components should block for at most 30 ms. [14:48:46][D][esp-idf:000]: I (79910) AUDIO_ELEMENT: [http-0x3ffdf420] Element task created [14:48:46][D][esp-idf:000]: I (79920) AUDIO_ELEMENT: [decoder-0x3ffd76c0] Element task created [14:48:46][D][esp-idf:000]: I (79923) AUDIO_ELEMENT: [http] AEL_MSG_CMD_RESUME,state:1 [14:48:46][D][esp-idf:000]: I (79930) AUDIO_ELEMENT: [decoder] AEL_MSG_CMD_RESUME,state:1 [14:48:46][D][esp_audio_sources:097]: Streamer status: 2 [14:48:46][D][esp_audio_sources:098]: decoder status: 2 [14:48:46][D][esp-idf:000]: I (79962) HTTP_CLIENT: Body received in fetch header state, 0x3ffd95a2, 1742 [14:48:46][D][esp-idf:000]: I (79968) HTTP_STREAM: total_bytes=27360 [14:48:46][I][HTTPStreamReader:129]: [ * ] Receive music info from mp3 decoder, sample_rates=24000, bits=16, ch=2 [14:48:46][D][adf_i2s_out:127]: Set final i2s settings: 16000 [14:48:46][D][esp_audio_processors:079]: New settings: SRC: rate: 24000, ch: 2 DST: rate: 16000, ch: 2 [14:48:46][D][esp_audio_processors:088]: New settings: SRC: rate: 24000, ch: 2 DST: rate: 16000, ch: 2 [14:48:46][D][esp-idf:000]: W (80012) AUDIO_ELEMENT: OUT-[decoder] AEL_IO_ABORT [14:48:46][D][esp-idf:000]: W (80017) MP3_DECODER: output aborted -3 [14:48:46][D][esp-idf:000]: I (80026) MP3_DECODER: Closed [14:48:46][D][esp_adf_pipeline:302]: State changed from PREPARING to STARTING [14:48:46][I][adf_media_player:135]: got new pipeline state: 2 [14:48:46][D][adf_i2s_out:127]: Set final i2s settings: 16000 [14:48:46][D][esp_audio_processors:079]: New settings: SRC: rate: 24000, ch: 2 DST: rate: 16000, ch: 2 [14:48:46][D][esp-idf:000]: I (80065) AUDIO_ELEMENT: [resampler-0x3ffd6d84] Element task created [14:48:46][D][esp-idf:000]: I (80068) AUDIO_ELEMENT: [i2s_out-0x3ffdfebc] Element task created [14:48:46][D][esp-idf:000]: I (80074) AUDIO_PIPELINE: Func:audio_pipeline_run, Line:359, MEM Total:113264 Bytes [14:48:46][D][esp-idf:000]: I (80084) AUDIO_ELEMENT: [http] AEL_MSG_CMD_RESUME,state:1 [14:48:46][D][esp-idf:000]: I (80089) AUDIO_ELEMENT: [decoder] AEL_MSG_CMD_RESUME,state:1 [14:48:46][D][esp-idf:000]: I (80096) MP3_DECODER: MP3 opened [14:48:46][D][esp-idf:000]: E (80135) FIR_RESAMPLE: failed to allocate p_out buffer.size 21845 line 2010 [14:48:46][D][esp-idf:000]: E (80139) RSP_FILTER: Failed to create the resample handler [14:48:46][D][esp-idf:000]: E (80143) AUDIO_ELEMENT: [resampler] AEL_STATUS_ERROR_OPEN,-1 [14:48:46][D][esp-idf:000]: W (80147) AUDIO_ELEMENT: [resampler] audio_element_on_cmd_error,7 [14:48:46][D][esp-idf:000]: W (80151) AUDIO_ELEMENT: IN-[i2s_out] AEL_IO_ABORT [14:48:46][I][esp_adf_pipeline:214]: [ resampler ] status: 1 [14:48:46][D][esp-idf:000]: I (80178) HTTP_CLIENT: Body received in fetch header state, 0x3ffe55f2, 1742 [14:48:46][D][esp-idf:000]: I (80184) HTTP_STREAM: total_bytes=27360 [14:48:46][I][esp_adf_pipeline:214]: [ http ] status: 12 [14:48:46][D][esp_adf_pipeline:131]: Check element [http] status, 3 [14:48:46][D][esp_adf_pipeline:131]: Check element [decoder] status, 3 [14:48:46][D][esp_adf_pipeline:131]: Check element [resampler] status, 7 [14:48:46][I][esp_adf_pipeline:214]: [ decoder ] status: 12 [14:48:46][D][esp_adf_pipeline:131]: Check element [http] status, 3 [14:48:46][D][esp_adf_pipeline:131]: Check element [decoder] status, 5 [14:48:46][I][HTTPStreamReader:129]: [ * ] Receive music info from mp3 decoder, sample_rates=24000, bits=16, ch=2 [14:48:46][D][adf_i2s_out:127]: Set final i2s settings: 16000 [14:48:46][D][esp_audio_processors:079]: New settings: SRC: rate: 24000, ch: 2 DST: rate: 16000, ch: 2 [14:48:46][I][esp_adf_pipeline:214]: [ decoder ] status: 14 [14:48:46][I][esp_adf_pipeline:214]: [ i2s_out ] status: 14 [14:48:52][D][media_player:059]: 's3-dev_media_player' - Setting [14:48:52][D][media_player:066]: Media URL: http://192.168.0.90:8123/media/local/beep.mp3?authSig=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiI0NTc1YzcxNmIwZGU0MzhiYmU1MTcwYmE2Y2I3MGRiNSIsInBhdGgiOiIvbWVkaWEvbG9jYWwvYmVlcC5tcDMiLCJwYXJhbXMiOltdLCJpYXQiOjE3MTUxNzI1MzIsImV4cCI6MTcxNTI1ODkzMn0.JnRWy2sX9fwFmxhaF0ZCqEmNvGNBUvjVwquQGMxiIdQ [14:48:52][D][adf_media_player:030]: Got control call in state 2 [14:48:52][D][esp-idf:000]: E (85891) AUDIO_ELEMENT: [decoder] Element already stopped [14:48:52][D][esp-idf:000]: E (85902) AUDIO_ELEMENT: [resampler] Element already stopped [14:48:52][D][esp-idf:000]: E (85912) AUDIO_ELEMENT: [i2s_out] Element already stopped [14:48:52][D][esp_adf_pipeline:302]: State changed from STARTING to STOPPING [14:48:52][I][adf_media_player:135]: got new pipeline state: 4 [14:48:52][W][component:237]: Component api took a long time for an operation (61 ms). [14:48:52][W][component:238]: Components should block for at most 30 ms. [14:48:52][D][esp_adf_pipeline:400]: Called deinit_all [14:48:52][D][esp-idf:000]: I (85954) AUDIO_PIPELINE: audio_pipeline_unlinked [14:48:52][D][esp-idf:000]: W (85957) AUDIO_ELEMENT: [http] Element has not create when AUDIO_ELEMENT_TERMINATE [14:48:52][D][esp-idf:000]: W (85964) AUDIO_ELEMENT: [decoder] Element has not create when AUDIO_ELEMENT_TERMINATE [14:48:52][D][esp-idf:000]: W (85974) AUDIO_ELEMENT: [resampler] Element has not create when AUDIO_ELEMENT_TERMINATE [14:48:52][D][esp-idf:000]: W (85984) AUDIO_ELEMENT: [i2s_out] Element has not create when AUDIO_ELEMENT_TERMINATE [14:48:52][D][esp-idf:000]: I (85995) I2S: DMA queue destroyed [14:48:52][D][esp-idf:000]: I (86015) I2S: DMA queue destroyed [14:48:52][D][esp_adf_pipeline:302]: State changed from STOPPING to UNINITIALIZED [14:48:52][I][adf_media_player:135]: got new pipeline state: 0 [14:48:52][D][esp_adf_pipeline:050]: Starting request, current state UNINITIALIZED [14:48:52][D][esp-idf:000]: I (86035) MP3_DECODER: MP3 init [14:48:52][D][esp-idf:000]: I (86070) I2S: DMA Malloc info, datalen=blocksize=1024, dma_buf_count=4 [14:48:52][D][esp-idf:000]: I (86074) I2S: DMA Malloc info, datalen=blocksize=1024, dma_buf_count=4 [14:48:52][D][i2s_audio:072]: Installing driver : yes [14:48:52][D][esp-idf:000]: I (86079) I2S: I2S0, MCLK output by GPIO0 [14:48:52][D][esp_adf_pipeline:358]: pipeline tag 0, http [14:48:52][D][esp_adf_pipeline:358]: pipeline tag 1, decoder [14:48:52][D][esp_adf_pipeline:358]: pipeline tag 2, resampler [14:48:52][D][esp_adf_pipeline:358]: pipeline tag 3, i2s_out [14:48:52][D][esp-idf:000]: I (86102) AUDIO_PIPELINE: link el->rb, el:0x3ffda2c8, tag:http, rb:0x3ffd6a38 [14:48:52][D][esp-idf:000]: I (86113) AUDIO_PIPELINE: link el->rb, el:0x3ffd76c0, tag:decoder, rb:0x3ffd6a60 [14:48:52][D][esp-idf:000]: I (86116) AUDIO_PIPELINE: link el->rb, el:0x3ffda16c, tag:resampler, rb:0x3ffdf140 [14:48:52][D][esp_adf_pipeline:370]: Setting up event listener. [14:48:52][D][esp_adf_pipeline:302]: State changed from UNINITIALIZED to PREPARING [14:48:52][I][adf_media_player:135]: got new pipeline state: 1 [14:48:52][D][adf_i2s_out:127]: Set final i2s settings: 16000 [14:48:52][D][esp_audio_processors:079]: New settings: SRC: rate: 24000, ch: 2 DST: rate: 16000, ch: 2 [14:48:52][W][component:237]: Component adf_pipeline.media_player took a long time for an operation (220 ms). [14:48:52][W][component:238]: Components should block for at most 30 ms. [14:48:52][D][esp-idf:000]: I (86186) AUDIO_ELEMENT: [http-0x3ffda2c8] Element task created [14:48:52][D][esp-idf:000]: I (86195) AUDIO_ELEMENT: [decoder-0x3ffd76c0] Element task created [14:48:52][D][esp-idf:000]: I (86197) AUDIO_ELEMENT: [http] AEL_MSG_CMD_RESUME,state:1 [14:48:52][D][esp-idf:000]: I (86206) AUDIO_ELEMENT: [decoder] AEL_MSG_CMD_RESUME,state:1 [14:48:52][D][esp_audio_sources:097]: Streamer status: 2 [14:48:52][D][esp_audio_sources:098]: decoder status: 2 [14:48:52][D][esp-idf:000]: I (86237) HTTP_CLIENT: Body received in fetch header state, 0x3ffdbe92, 1742 [14:48:52][D][esp-idf:000]: I (86243) HTTP_STREAM: total_bytes=27360 [14:48:52][I][HTTPStreamReader:129]: [ * ] Receive music info from mp3 decoder, sample_rates=24000, bits=16, ch=2 [14:48:52][D][adf_i2s_out:127]: Set final i2s settings: 16000 [14:48:52][D][esp_audio_processors:079]: New settings: SRC: rate: 24000, ch: 2 DST: rate: 16000, ch: 2 [14:48:52][D][esp-idf:000]: W (86286) AUDIO_ELEMENT: OUT-[decoder] AEL_IO_ABORT [14:48:52][D][esp-idf:000]: W (86291) MP3_DECODER: output aborted -3 [14:48:52][D][esp-idf:000]: I (86295) MP3_DECODER: Closed [14:48:52][D][esp_adf_pipeline:302]: State changed from PREPARING to STARTING [14:48:52][I][adf_media_player:135]: got new pipeline state: 2 [14:48:52][D][adf_i2s_out:127]: Set final i2s settings: 16000 [14:48:52][D][esp_audio_processors:079]: New settings: SRC: rate: 24000, ch: 2 DST: rate: 16000, ch: 2 [14:48:52][D][esp-idf:000]: I (86330) AUDIO_ELEMENT: [resampler-0x3ffda16c] Element task created [14:48:52][D][esp-idf:000]: I (86333) AUDIO_ELEMENT: [i2s_out-0x3ffdfebc] Element task created [14:48:52][D][esp-idf:000]: I (86340) AUDIO_PIPELINE: Func:audio_pipeline_run, Line:359, MEM Total:113236 Bytes [14:48:52][D][esp-idf:000]: I (86359) AUDIO_ELEMENT: [http] AEL_MSG_CMD_RESUME,state:1 [14:48:52][D][esp-idf:000]: I (86364) AUDIO_ELEMENT: [decoder] AEL_MSG_CMD_RESUME,state:1 [14:48:52][D][esp-idf:000]: I (86382) MP3_DECODER: MP3 opened [14:48:52][D][esp-idf:000]: E (86420) FIR_RESAMPLE: failed to allocate p_out buffer.size 21845 line 2010 [14:48:52][D][esp-idf:000]: E (86424) RSP_FILTER: Failed to create the resample handler [14:48:52][D][esp-idf:000]: E (86428) AUDIO_ELEMENT: [resampler] AEL_STATUS_ERROR_OPEN,-1 [14:48:52][D][esp-idf:000]: W (86431) AUDIO_ELEMENT: [resampler] audio_element_on_cmd_error,7 [14:48:52][D][esp-idf:000]: W (86436) AUDIO_ELEMENT: IN-[i2s_out] AEL_IO_ABORT [14:48:52][D][esp-idf:000]: I (86444) HTTP_CLIENT: Body received in fetch header state, 0x3ffe57f2, 1742 [14:48:52][D][esp-idf:000]: I (86450) HTTP_STREAM: total_bytes=27360 [14:48:52][I][esp_adf_pipeline:214]: [ http ] status: 12 [14:48:52][D][esp_adf_pipeline:131]: Check element [http] status, 3 [14:48:52][D][esp_adf_pipeline:131]: Check element [decoder] status, 5 [14:48:52][I][esp_adf_pipeline:214]: [ decoder ] status: 12 [14:48:52][D][esp_adf_pipeline:131]: Check element [http] status, 3 [14:48:52][D][esp_adf_pipeline:131]: Check element [decoder] status, 5 [14:48:52][I][HTTPStreamReader:129]: [ * ] Receive music info from mp3 decoder, sample_rates=24000, bits=16, ch=2 [14:48:52][D][adf_i2s_out:127]: Set final i2s settings: 16000 [14:48:52][D][esp_audio_processors:079]: New settings: SRC: rate: 24000, ch: 2 DST: rate: 16000, ch: 2 [14:48:52][I][esp_adf_pipeline:214]: [ decoder ] status: 14 [14:48:52][I][esp_adf_pipeline:214]: [ i2s_out ] status: 14 [14:48:56][D][media_player:059]: 's3-dev_media_player' - Setting [14:48:56][D][media_player:066]: Media URL: http://192.168.0.90:8123/media/local/ff-16b-1c-16000hz.mp3?authSig=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiI0NTc1YzcxNmIwZGU0MzhiYmU1MTcwYmE2Y2I3MGRiNSIsInBhdGgiOiIvbWVkaWEvbG9jYWwvZmYtMTZiLTFjLTE2MDAwaHoubXAzIiwicGFyYW1zIjpbXSwiaWF0IjoxNzE1MTcyNTM2LCJleHAiOjE3MTUyNTg5MzZ9.fEv57VLE9wwLsJZsddyLnvZFQHezfuO866a8ZxVZ47I [14:48:56][D][adf_media_player:030]: Got control call in state 2 [14:48:56][D][esp-idf:000]: E (90595) AUDIO_ELEMENT: [decoder] Element already stopped [14:48:56][D][esp-idf:000]: E (90605) AUDIO_ELEMENT: [resampler] Element already stopped [14:48:56][D][esp-idf:000]: E (90615) AUDIO_ELEMENT: [i2s_out] Element already stopped [14:48:56][D][esp_adf_pipeline:302]: State changed from STARTING to STOPPING [14:48:56][I][adf_media_player:135]: got new pipeline state: 4 [14:48:56][W][component:237]: Component api took a long time for an operation (60 ms). [14:48:56][W][component:238]: Components should block for at most 30 ms. [14:48:56][D][esp_adf_pipeline:400]: Called deinit_all [14:48:56][D][esp-idf:000]: I (90657) AUDIO_PIPELINE: audio_pipeline_unlinked [14:48:56][D][esp-idf:000]: W (90667) AUDIO_ELEMENT: [http] Element has not create when AUDIO_ELEMENT_TERMINATE [14:48:56][D][esp-idf:000]: W (90670) AUDIO_ELEMENT: [decoder] Element has not create when AUDIO_ELEMENT_TERMINATE [14:48:57][D][esp-idf:000]: W (90687) AUDIO_ELEMENT: [resampler] Element has not create when AUDIO_ELEMENT_TERMINATE [14:48:57][D][esp-idf:000]: W (90698) AUDIO_ELEMENT: [i2s_out] Element has not create when AUDIO_ELEMENT_TERMINATE [14:48:57][D][esp-idf:000]: I (90708) I2S: DMA queue destroyed [14:48:57][D][esp-idf:000]: I (90718) I2S: DMA queue destroyed [14:48:57][D][esp_adf_pipeline:302]: State changed from STOPPING to UNINITIALIZED [14:48:57][I][adf_media_player:135]: got new pipeline state: 0 [14:48:57][D][esp_adf_pipeline:050]: Starting request, current state UNINITIALIZED [14:48:57][D][esp-idf:000]: I (90742) MP3_DECODER: MP3 init [14:48:57][D][esp-idf:000]: I (90775) I2S: DMA Malloc info, datalen=blocksize=1024, dma_buf_count=4 [14:48:57][D][esp-idf:000]: I (90778) I2S: DMA Malloc info, datalen=blocksize=1024, dma_buf_count=4 [14:48:57][D][i2s_audio:072]: Installing driver : yes [14:48:57][D][esp-idf:000]: I (90784) I2S: I2S0, MCLK output by GPIO0 [14:48:57][D][esp_adf_pipeline:358]: pipeline tag 0, http [14:48:57][D][esp_adf_pipeline:358]: pipeline tag 1, decoder [14:48:57][D][esp_adf_pipeline:358]: pipeline tag 2, resampler [14:48:57][D][esp_adf_pipeline:358]: pipeline tag 3, i2s_out [14:48:57][D][esp-idf:000]: I (90807) AUDIO_PIPELINE: link el->rb, el:0x3ffda2c8, tag:http, rb:0x3ffdfa5c [14:48:57][D][esp-idf:000]: I (90817) AUDIO_PIPELINE: link el->rb, el:0x3ffdf420, tag:decoder, rb:0x3ffd7590 [14:48:57][D][esp-idf:000]: I (90827) AUDIO_PIPELINE: link el->rb, el:0x3ffd6d28, tag:resampler, rb:0x3ffd7624 [14:48:57][D][esp_adf_pipeline:370]: Setting up event listener. [14:48:57][D][esp_adf_pipeline:302]: State changed from UNINITIALIZED to PREPARING [14:48:57][I][adf_media_player:135]: got new pipeline state: 1 [14:48:57][D][adf_i2s_out:127]: Set final i2s settings: 16000 [14:48:57][D][esp_audio_processors:079]: New settings: SRC: rate: 24000, ch: 2 DST: rate: 16000, ch: 2 [14:48:57][W][component:237]: Component adf_pipeline.media_player took a long time for an operation (221 ms). [14:48:57][W][component:238]: Components should block for at most 30 ms. [14:48:57][D][esp-idf:000]: I (90883) AUDIO_ELEMENT: [http-0x3ffda2c8] Element task created [14:48:57][D][esp-idf:000]: I (90889) AUDIO_ELEMENT: [decoder-0x3ffdf420] Element task created [14:48:57][D][esp-idf:000]: I (90899) AUDIO_ELEMENT: [http] AEL_MSG_CMD_RESUME,state:1 [14:48:57][D][esp-idf:000]: I (90911) AUDIO_ELEMENT: [decoder] AEL_MSG_CMD_RESUME,state:1 [14:48:57][D][esp_audio_sources:097]: Streamer status: 2 [14:48:57][D][esp_audio_sources:098]: decoder status: 2 [14:48:57][D][esp-idf:000]: I (90946) HTTP_CLIENT: Body received in fetch header state, 0x3ffe3580, 1740 [14:48:57][D][esp-idf:000]: I (90951) HTTP_STREAM: total_bytes=562097 [14:48:57][I][HTTPStreamReader:129]: [ * ] Receive music info from mp3 decoder, sample_rates=16000, bits=16, ch=1 [14:48:57][D][adf_i2s_out:127]: Set final i2s settings: 16000 [14:48:57][D][esp_audio_processors:079]: New settings: SRC: rate: 16000, ch: 1 DST: rate: 16000, ch: 2 [14:48:57][D][esp_audio_processors:088]: New settings: SRC: rate: 16000, ch: 1 DST: rate: 16000, ch: 2 [14:48:57][D][esp-idf:000]: W (90994) AUDIO_ELEMENT: OUT-[decoder] AEL_IO_ABORT [14:48:57][D][esp-idf:000]: W (90999) MP3_DECODER: output aborted -3 [14:48:57][D][esp-idf:000]: I (91005) MP3_DECODER: Closed [14:48:57][D][esp_adf_pipeline:302]: State changed from PREPARING to STARTING [14:48:57][I][adf_media_player:135]: got new pipeline state: 2 [14:48:57][D][adf_i2s_out:127]: Set final i2s settings: 16000 [14:48:57][D][esp_audio_processors:079]: New settings: SRC: rate: 16000, ch: 1 DST: rate: 16000, ch: 2 [14:48:57][D][esp-idf:000]: I (91046) AUDIO_ELEMENT: [resampler-0x3ffd6d28] Element task created [14:48:57][D][esp-idf:000]: I (91049) AUDIO_ELEMENT: [i2s_out-0x3ffdfebc] Element task created [14:48:57][D][esp-idf:000]: I (91055) AUDIO_PIPELINE: Func:audio_pipeline_run, Line:359, MEM Total:113164 Bytes [14:48:57][D][esp-idf:000]: I (91065) AUDIO_ELEMENT: [http] AEL_MSG_CMD_RESUME,state:1 [14:48:57][D][esp-idf:000]: I (91077) AUDIO_ELEMENT: [decoder] AEL_MSG_CMD_RESUME,state:1 [14:48:57][D][esp-idf:000]: I (91087) MP3_DECODER: MP3 opened [14:48:57][D][esp-idf:000]: I (91139) HTTP_CLIENT: Body received in fetch header state, 0x3ffe4bf4, 1740 [14:48:57][D][esp-idf:000]: I (91145) HTTP_STREAM: total_bytes=562097 [14:48:57][I][esp_adf_pipeline:214]: [ http ] status: 12 [14:48:57][D][esp_adf_pipeline:131]: Check element [http] status, 3 [14:48:57][D][esp_adf_pipeline:131]: Check element [decoder] status, 3 [14:48:57][D][esp_adf_pipeline:131]: Check element [resampler] status, 7 [14:48:57][I][esp_adf_pipeline:214]: [ decoder ] status: 12 [14:48:57][D][esp_adf_pipeline:131]: Check element [http] status, 3 [14:48:57][D][esp_adf_pipeline:131]: Check element [decoder] status, 5 [14:48:57][I][HTTPStreamReader:129]: [ * ] Receive music info from mp3 decoder, sample_rates=16000, bits=16, ch=1 [14:48:57][D][adf_i2s_out:127]: Set final i2s settings: 16000 [14:48:57][D][esp_audio_processors:079]: New settings: SRC: rate: 16000, ch: 1 DST: rate: 16000, ch: 2 [14:48:57][I][esp_adf_pipeline:214]: [ decoder ] status: 14 [14:48:57][I][esp_adf_pipeline:214]: [ i2s_out ] status: 14 [14:49:02][D][media_player:059]: 's3-dev_media_player' - Setting [14:49:02][D][media_player:066]: Media URL: http://192.168.0.90:8123/media/local/ff-16b-1c-16000hz.mp3?authSig=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiI0NTc1YzcxNmIwZGU0MzhiYmU1MTcwYmE2Y2I3MGRiNSIsInBhdGgiOiIvbWVkaWEvbG9jYWwvZmYtMTZiLTFjLTE2MDAwaHoubXAzIiwicGFyYW1zIjpbXSwiaWF0IjoxNzE1MTcyNTQyLCJleHAiOjE3MTUyNTg5NDJ9.ILUujisty6o7COYA2sEUv1GevLQMJYkc01yuaJHV2yw [14:49:02][D][adf_media_player:030]: Got control call in state 2 [14:49:02][D][esp-idf:000]: E (95919) AUDIO_ELEMENT: [decoder] Element already stopped [14:49:02][D][esp-idf:000]: E (95939) AUDIO_ELEMENT: [resampler] Element already stopped [14:49:02][D][esp-idf:000]: E (95942) AUDIO_ELEMENT: [i2s_out] Element already stopped [14:49:02][D][esp_adf_pipeline:302]: State changed from STARTING to STOPPING [14:49:02][I][adf_media_player:135]: got new pipeline state: 4 [14:49:02][W][component:237]: Component api took a long time for an operation (61 ms). [14:49:02][W][component:238]: Components should block for at most 30 ms. [14:49:02][D][esp_adf_pipeline:400]: Called deinit_all [14:49:02][D][esp-idf:000]: I (95981) AUDIO_PIPELINE: audio_pipeline_unlinked [14:49:02][D][esp-idf:000]: W (95991) AUDIO_ELEMENT: [http] Element has not create when AUDIO_ELEMENT_TERMINATE [14:49:02][D][esp-idf:000]: W (95994) AUDIO_ELEMENT: [decoder] Element has not create when AUDIO_ELEMENT_TERMINATE [14:49:02][D][esp-idf:000]: W (96011) AUDIO_ELEMENT: [resampler] Element has not create when AUDIO_ELEMENT_TERMINATE [14:49:02][D][esp-idf:000]: W (96022) AUDIO_ELEMENT: [i2s_out] Element has not create when AUDIO_ELEMENT_TERMINATE [14:49:02][D][esp-idf:000]: I (96032) I2S: DMA queue destroyed [14:49:02][D][esp-idf:000]: I (96042) I2S: DMA queue destroyed [14:49:02][D][esp_adf_pipeline:302]: State changed from STOPPING to UNINITIALIZED [14:49:02][I][adf_media_player:135]: got new pipeline state: 0 [14:49:02][D][esp_adf_pipeline:050]: Starting request, current state UNINITIALIZED [14:49:02][D][esp-idf:000]: I (96065) MP3_DECODER: MP3 init [14:49:02][D][esp-idf:000]: I (96100) I2S: DMA Malloc info, datalen=blocksize=1024, dma_buf_count=4 [14:49:02][D][esp-idf:000]: I (96103) I2S: DMA Malloc info, datalen=blocksize=1024, dma_buf_count=4 [14:49:02][D][i2s_audio:072]: Installing driver : yes [14:49:02][D][esp-idf:000]: I (96109) I2S: I2S0, MCLK output by GPIO0 [14:49:02][D][esp_adf_pipeline:358]: pipeline tag 0, http [14:49:02][D][esp_adf_pipeline:358]: pipeline tag 1, decoder [14:49:02][D][esp_adf_pipeline:358]: pipeline tag 2, resampler [14:49:02][D][esp_adf_pipeline:358]: pipeline tag 3, i2s_out [14:49:02][D][esp-idf:000]: I (96132) AUDIO_PIPELINE: link el->rb, el:0x3ffd6c58, tag:http, rb:0x3ffdfa50 [14:49:02][D][esp-idf:000]: I (96142) AUDIO_PIPELINE: link el->rb, el:0x3ffd76c0, tag:decoder, rb:0x3ffdf9f4 [14:49:02][D][esp-idf:000]: I (96144) AUDIO_PIPELINE: link el->rb, el:0x3ffd93cc, tag:resampler, rb:0x3ffd9238 [14:49:02][D][esp_adf_pipeline:370]: Setting up event listener. [14:49:02][D][esp_adf_pipeline:302]: State changed from UNINITIALIZED to PREPARING [14:49:02][I][adf_media_player:135]: got new pipeline state: 1 [14:49:02][D][adf_i2s_out:127]: Set final i2s settings: 16000 [14:49:02][D][esp_audio_processors:079]: New settings: SRC: rate: 16000, ch: 1 DST: rate: 16000, ch: 2 [14:49:02][W][component:237]: Component adf_pipeline.media_player took a long time for an operation (222 ms). [14:49:02][W][component:238]: Components should block for at most 30 ms. [14:49:02][D][esp-idf:000]: I (96216) AUDIO_ELEMENT: [http-0x3ffd6c58] Element task created [14:49:02][D][esp-idf:000]: I (96224) AUDIO_ELEMENT: [decoder-0x3ffd76c0] Element task created [14:49:02][D][esp-idf:000]: I (96226) AUDIO_ELEMENT: [http] AEL_MSG_CMD_RESUME,state:1 [14:49:02][D][esp-idf:000]: I (96236) AUDIO_ELEMENT: [decoder] AEL_MSG_CMD_RESUME,state:1 [14:49:02][D][esp_audio_sources:097]: Streamer status: 2 [14:49:02][D][esp_audio_sources:098]: decoder status: 2 [14:49:02][D][esp-idf:000]: I (96274) HTTP_STREAM: total_bytes=562097 [14:49:02][I][HTTPStreamReader:129]: [ * ] Receive music info from mp3 decoder, sample_rates=16000, bits=16, ch=1 [14:49:02][D][adf_i2s_out:127]: Set final i2s settings: 16000 [14:49:02][D][esp_audio_processors:079]: New settings: SRC: rate: 16000, ch: 1 DST: rate: 16000, ch: 2 [14:49:02][D][esp-idf:000]: W (96318) AUDIO_ELEMENT: OUT-[decoder] AEL_IO_ABORT [14:49:02][D][esp-idf:000]: W (96323) MP3_DECODER: output aborted -3 [14:49:02][D][esp-idf:000]: I (96327) MP3_DECODER: Closed [14:49:02][D][esp_adf_pipeline:302]: State changed from PREPARING to STARTING [14:49:02][I][adf_media_player:135]: got new pipeline state: 2 [14:49:02][D][adf_i2s_out:127]: Set final i2s settings: 16000 [14:49:02][D][esp_audio_processors:079]: New settings: SRC: rate: 16000, ch: 1 DST: rate: 16000, ch: 2 [14:49:02][D][esp-idf:000]: I (96363) AUDIO_ELEMENT: [resampler-0x3ffd93cc] Element task created [14:49:02][D][esp-idf:000]: I (96366) AUDIO_ELEMENT: [i2s_out-0x3ffdfd08] Element task created [14:49:02][D][esp-idf:000]: I (96372) AUDIO_PIPELINE: Func:audio_pipeline_run, Line:359, MEM Total:111544 Bytes [14:49:02][D][esp-idf:000]: I (96392) AUDIO_ELEMENT: [http] AEL_MSG_CMD_RESUME,state:1 [14:49:02][D][esp-idf:000]: I (96396) AUDIO_ELEMENT: [decoder] AEL_MSG_CMD_RESUME,state:1 [14:49:02][D][esp-idf:000]: I (96404) MP3_DECODER: MP3 opened [14:49:02][I][esp_adf_pipeline:214]: [ resampler ] status: 1 [14:49:02][D][esp-idf:000]: I (96462) HTTP_CLIENT: Body received in fetch header state, 0x3ffe3378, 1740 [14:49:02][D][esp-idf:000]: I (96468) HTTP_STREAM: total_bytes=562097 [14:49:02][D][esp-idf:000]: W (96486) AUDIO_ELEMENT: OUT-[decoder] AEL_IO_ABORT [14:49:02][D][esp-idf:000]: W (96491) MP3_DECODER: output aborted -3 [14:49:02][D][esp-idf:000]: I (96495) MP3_DECODER: Closed [14:49:02][I][HTTPStreamReader:129]: [ * ] Receive music info from mp3 decoder, sample_rates=16000, bits=16, ch=1 [14:49:02][D][adf_i2s_out:127]: Set final i2s settings: 16000 [14:49:02][D][esp_audio_processors:079]: New settings: SRC: rate: 16000, ch: 1 DST: rate: 16000, ch: 2 [14:49:02][I][esp_adf_pipeline:214]: [ decoder ] status: 14 [14:49:02][I][esp_adf_pipeline:214]: [ i2s_out ] status: 14 [14:49:14][D][media_player:059]: 's3-dev_media_player' - Setting [14:49:14][D][media_player:066]: Media URL: http://192.168.0.90:8123/media/local/assist-pipeline/863c9e35daecdda8e31a54cd141f04fd/Home%20Assistant/510302137062572/00_wake-wake_word.openwakeword_2.wav?authSig=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiI0NTc1YzcxNmIwZGU0MzhiYmU1MTcwYmE2Y2I3MGRiNSIsInBhdGgiOiIvbWVkaWEvbG9jYWwvYXNzaXN0LXBpcGVsaW5lLzg2M2M5ZTM1ZGFlY2RkYThlMzFhNTRjZDE0MWYwNGZkL0hvbWUgQXNzaXN0YW50LzUxMDMwMjEzNzA2MjU3Mi8wMF93YWtlLXdha2Vfd29yZC5vcGVud2FrZXdvcmRfMi53YXYiLCJwYXJhbXMiOltdLCJpYXQiOjE [14:49:14][D][adf_media_player:030]: Got control call in state 2 [14:49:14][D][esp-idf:000]: E (108124) AUDIO_ELEMENT: [decoder] Element already stopped [14:49:14][D][esp-idf:000]: E (108134) AUDIO_ELEMENT: [resampler] Element already stopped [14:49:14][D][esp-idf:000]: E (108136) AUDIO_ELEMENT: [i2s_out] Element already stopped [14:49:14][D][esp_adf_pipeline:302]: State changed from STARTING to STOPPING [14:49:14][I][adf_media_player:135]: got new pipeline state: 4 [14:49:14][W][component:237]: Component api took a long time for an operation (71 ms). [14:49:14][W][component:238]: Components should block for at most 30 ms. [14:49:14][D][esp_adf_pipeline:400]: Called deinit_all [14:49:14][D][esp-idf:000]: I (108178) AUDIO_PIPELINE: audio_pipeline_unlinked [14:49:14][D][esp-idf:000]: W (108185) AUDIO_ELEMENT: [http] Element has not create when AUDIO_ELEMENT_TERMINATE [14:49:14][D][esp-idf:000]: W (108196) AUDIO_ELEMENT: [decoder] Element has not create when AUDIO_ELEMENT_TERMINATE [14:49:14][D][esp-idf:000]: W (108206) AUDIO_ELEMENT: [resampler] Element has not create when AUDIO_ELEMENT_TERMINATE [14:49:14][D][esp-idf:000]: W (108216) AUDIO_ELEMENT: [i2s_out] Element has not create when AUDIO_ELEMENT_TERMINATE [14:49:14][D][esp-idf:000]: I (108227) I2S: DMA queue destroyed [14:49:14][D][esp-idf:000]: I (108237) I2S: DMA queue destroyed [14:49:14][D][esp_adf_pipeline:302]: State changed from STOPPING to UNINITIALIZED [14:49:14][I][adf_media_player:135]: got new pipeline state: 0 [14:49:14][D][esp_adf_pipeline:050]: Starting request, current state UNINITIALIZED [14:49:14][D][esp-idf:000]: I (108261) MP3_DECODER: MP3 init [14:49:14][D][esp-idf:000]: I (108293) I2S: DMA Malloc info, datalen=blocksize=1024, dma_buf_count=4 [14:49:14][D][esp-idf:000]: I (108297) I2S: DMA Malloc info, datalen=blocksize=1024, dma_buf_count=4 [14:49:14][D][i2s_audio:072]: Installing driver : yes [14:49:14][D][esp-idf:000]: I (108302) I2S: I2S0, MCLK output by GPIO0 [14:49:14][D][esp_adf_pipeline:358]: pipeline tag 0, http [14:49:14][D][esp_adf_pipeline:358]: pipeline tag 1, decoder [14:49:14][D][esp_adf_pipeline:358]: pipeline tag 2, resampler [14:49:14][D][esp_adf_pipeline:358]: pipeline tag 3, i2s_out [14:49:14][D][esp-idf:000]: I (108325) AUDIO_PIPELINE: link el->rb, el:0x3ffdf420, tag:http, rb:0x3ffd6a68 [14:49:14][D][esp-idf:000]: I (108336) AUDIO_PIPELINE: link el->rb, el:0x3ffdfca4, tag:decoder, rb:0x3ffdf9cc [14:49:14][D][esp-idf:000]: I (108339) AUDIO_PIPELINE: link el->rb, el:0x3ffda16c, tag:resampler, rb:0x3ffd7fcc [14:49:14][D][esp_adf_pipeline:370]: Setting up event listener. [14:49:14][D][esp_adf_pipeline:302]: State changed from UNINITIALIZED to PREPARING [14:49:14][I][adf_media_player:135]: got new pipeline state: 1 [14:49:14][D][adf_i2s_out:127]: Set final i2s settings: 16000 [14:49:14][D][esp_audio_processors:079]: New settings: SRC: rate: 16000, ch: 1 DST: rate: 16000, ch: 2 [14:49:14][W][component:237]: Component adf_pipeline.media_player took a long time for an operation (213 ms). [14:49:14][W][component:238]: Components should block for at most 30 ms. [14:49:14][D][esp-idf:000]: I (108409) AUDIO_ELEMENT: [http-0x3ffdf420] Element task created [14:49:14][D][esp-idf:000]: I (108418) AUDIO_ELEMENT: [decoder-0x3ffdfca4] Element task created [14:49:14][D][esp-idf:000]: I (108421) AUDIO_ELEMENT: [http] AEL_MSG_CMD_RESUME,state:1 [14:49:14][D][esp-idf:000]: I (108429) AUDIO_ELEMENT: [decoder] AEL_MSG_CMD_RESUME,state:1 [14:49:14][D][esp_audio_sources:097]: Streamer status: 2 [14:49:14][D][esp_audio_sources:098]: decoder status: 2 [14:49:14][D][esp-idf:000]: I (108458) HTTP_STREAM: total_bytes=44 [14:49:14][D][esp-idf:000]: W (108472) HTTP_STREAM: No more data,errno:0, total_bytes:44, rlen = 0 [14:49:14][D][esp-idf:000]: I (108476) AUDIO_ELEMENT: IN-[http] AEL_IO_DONE,0 [14:49:14][D][esp-idf:000]: I (108480) AUDIO_ELEMENT: IN-[decoder] AEL_IO_DONE,-2 [14:49:14][D][esp-idf:000]: E (108485) MPEG_READER: resync error (line 405) [14:49:14][D][esp-idf:000]: E (108493) MP3_DECODER: Encountered error reading when MP3 init [14:49:14][D][esp-idf:000]: E (108501) AUDIO_ELEMENT: [decoder] AEL_STATUS_ERROR_OPEN,-1 [14:49:14][D][esp-idf:000]: W (108505) AUDIO_ELEMENT: [decoder] audio_element_on_cmd_error,7 [14:49:14][D][esp-idf:000]: I (108511) MP3_DECODER: Closed [14:49:24][I][esp_adf_pipeline:185]: Pipeline preparation timeout! [14:49:24][D][esp-idf:000]: W (118374) AUDIO_PIPELINE: Without stop, st:1 [14:49:24][D][esp_adf_pipeline:302]: State changed from PREPARING to STOPPING [14:49:24][I][adf_media_player:135]: got new pipeline state: 4 [14:49:24][D][esp_adf_pipeline:400]: Called deinit_all [14:49:24][D][esp-idf:000]: W (118386) AUDIO_ELEMENT: [resampler] Element has not create when AUDIO_ELEMENT_TERMINATE [14:49:24][D][esp-idf:000]: W (118389) AUDIO_ELEMENT: [i2s_out] Element has not create when AUDIO_ELEMENT_TERMINATE [14:49:24][D][esp-idf:000]: I (118397) AUDIO_PIPELINE: audio_pipeline_unlinked [14:49:24][D][esp-idf:000]: W (118406) AUDIO_ELEMENT: [http] Element has not create when AUDIO_ELEMENT_TERMINATE [14:49:24][D][esp-idf:000]: W (118417) AUDIO_ELEMENT: [decoder] Element has not create when AUDIO_ELEMENT_TERMINATE [14:49:24][D][esp-idf:000]: W (118427) AUDIO_ELEMENT: [resampler] Element has not create when AUDIO_ELEMENT_TERMINATE [14:49:24][D][esp-idf:000]: W (118437) AUDIO_ELEMENT: [i2s_out] Element has not create when AUDIO_ELEMENT_TERMINATE [14:49:24][D][esp-idf:000]: I (118448) I2S: DMA queue destroyed [14:49:24][D][esp-idf:000]: I (118458) I2S: DMA queue destroyed [14:49:24][D][esp_adf_pipeline:302]: State changed from STOPPING to UNINITIALIZED [14:49:24][I][adf_media_player:135]: got new pipeline state: 0 [14:49:24][W][component:237]: Component adf_pipeline.media_player took a long time for an operation (96 ms). [14:49:24][W][component:238]: Components should block for at most 30 ms. [14:49:33][D][switch:012]: 'Use wake word' Turning ON. [14:49:33][D][switch:055]: 'Use wake word': Sending state ON [14:49:33][D][voice_assistant:439]: State changed from IDLE to START_PIPELINE [14:49:33][D][voice_assistant:445]: Desired state set to START_MICROPHONE [14:49:33][D][light:036]: 'Test LED 1' Setting: [14:49:33][D][light:047]: State: ON [14:49:33][D][voice_assistant:126]: microphone not running [14:49:33][D][voice_assistant:210]: Requesting start... [14:49:33][D][voice_assistant:439]: State changed from START_PIPELINE to STARTING_PIPELINE [14:49:33][D][voice_assistant:126]: microphone not running [14:49:33][D][voice_assistant:476]: Client started, streaming microphone [14:49:33][D][voice_assistant:439]: State changed from STARTING_PIPELINE to START_MICROPHONE [14:49:33][D][voice_assistant:445]: Desired state set to STREAMING_MICROPHONE [14:49:33][D][voice_assistant:163]: Starting Microphone [14:49:33][D][esp_adf_pipeline:050]: Starting request, current state UNINITIALIZED [14:49:33][D][esp-idf:000]: I (127510) I2S: DMA Malloc info, datalen=blocksize=512, dma_buf_count=4 [14:49:33][D][esp-idf:000]: I (127518) I2S: DMA Malloc info, datalen=blocksize=512, dma_buf_count=4 [14:49:33][D][i2s_audio:072]: Installing driver : yes [14:49:33][D][esp-idf:000]: I (127530) I2S: I2S0, MCLK output by GPIO0 [14:49:33][D][esp_adf_pipeline:358]: pipeline tag 0, i2s_in [14:49:33][D][esp_adf_pipeline:358]: pipeline tag 1, resampler [14:49:33][D][esp_adf_pipeline:358]: pipeline tag 2, pcm_reader [14:49:33][D][esp-idf:000]: I (127558) AUDIO_PIPELINE: link el->rb, el:0x3ffdf420, tag:i2s_in, rb:0x3ffd7e2c [14:49:33][D][esp-idf:000]: I (127569) AUDIO_PIPELINE: link el->rb, el:0x3ffd7464, tag:resampler, rb:0x3ffd7ffc [14:49:33][D][esp_adf_pipeline:370]: Setting up event listener. [14:49:33][D][esp_adf_pipeline:302]: State changed from UNINITIALIZED to PREPARING [14:49:33][D][voice_assistant:439]: State changed from START_MICROPHONE to STARTING_MICROPHONE [14:49:33][W][component:237]: Component voice_assistant took a long time for an operation (102 ms). [14:49:33][W][component:238]: Components should block for at most 30 ms. [14:49:33][D][esp_audio_processors:079]: New settings: SRC: rate: 16000, ch: 2 DST: rate: 16000, ch: 1 [14:49:33][D][esp_audio_processors:088]: New settings: SRC: rate: 16000, ch: 2 DST: rate: 16000, ch: 1 [14:49:33][D][esp_adf_pipeline:302]: State changed from PREPARING to STARTING [14:49:33][D][esp-idf:000]: I (127635) AUDIO_ELEMENT: [i2s_in-0x3ffdf420] Element task created [14:49:33][D][esp-idf:000]: I (127641) AUDIO_ELEMENT: [resampler-0x3ffd7464] Element task created [14:49:33][D][esp-idf:000]: I (127651) AUDIO_ELEMENT: [pcm_reader-0x3ffd691c] Element task created [14:49:33][D][esp-idf:000]: I (127671) AUDIO_PIPELINE: Func:audio_pipeline_run, Line:359, MEM Total:136968 Bytes [14:49:33][D][esp-idf:000]: I (127681) AUDIO_ELEMENT: [i2s_in] AEL_MSG_CMD_RESUME,state:1 [14:49:34][D][esp-idf:000]: I (127693) AUDIO_ELEMENT: [resampler] AEL_MSG_CMD_RESUME,state:1 [14:49:34][D][esp-idf:000]: I (127696) AUDIO_PIPELINE: Pipeline started [14:49:34][W][component:237]: Component adf_pipeline.microphone took a long time for an operation (83 ms). [14:49:34][W][component:238]: Components should block for at most 30 ms. [14:49:34][D][voice_assistant:563]: Event Type: 0 [14:49:34][E][voice_assistant:693]: Error: no_wake_word - No wake word detected [14:49:34][D][voice_assistant:556]: Signaling stop... [14:49:34][D][voice_assistant:439]: State changed from STARTING_MICROPHONE to STOP_MICROPHONE [14:49:34][D][voice_assistant:445]: Desired state set to IDLE [14:49:34][D][voice_assistant:439]: State changed from STOP_MICROPHONE to IDLE [14:49:34][I][esp_adf_pipeline:214]: [ pcm_reader ] status: 12 [14:49:34][D][esp_adf_pipeline:131]: Check element [i2s_in] status, 3 [14:49:34][D][esp_adf_pipeline:131]: Check element [resampler] status, 3 [14:49:34][D][esp_adf_pipeline:131]: Check element [pcm_reader] status, 3 [14:49:34][D][esp_adf_pipeline:302]: State changed from STARTING to RUNNING [14:49:34][D][voice_assistant:563]: Event Type: 2 [14:49:34][D][voice_assistant:653]: Assist Pipeline ended [14:49:34][D][voice_assistant:439]: State changed from IDLE to START_PIPELINE [14:49:34][D][voice_assistant:445]: Desired state set to START_MICROPHONE [14:49:34][I][esp_adf_pipeline:214]: [ i2s_in ] status: 12 [14:49:34][D][voice_assistant:563]: Event Type: 1 [14:49:34][D][voice_assistant:566]: Assist Pipeline running [14:49:34][D][voice_assistant:210]: Requesting start... [14:49:34][D][voice_assistant:439]: State changed from START_PIPELINE to STARTING_PIPELINE [14:49:34][I][esp_adf_pipeline:214]: [ pcm_reader ] status: 12 [14:49:34][D][voice_assistant:563]: Event Type: 9 [14:49:34][I][esp_adf_pipeline:214]: [ resampler ] status: 12 [14:49:34][D][voice_assistant:476]: Client started, streaming microphone [14:49:34][D][voice_assistant:439]: State changed from STARTING_PIPELINE to STREAMING_MICROPHONE [14:49:34][D][voice_assistant:445]: Desired state set to STREAMING_MICROPHONE [14:49:34][D][voice_assistant:563]: Event Type: 1 [14:49:34][D][voice_assistant:566]: Assist Pipeline running [14:49:34][D][voice_assistant:563]: Event Type: 9 [14:49:34][D][light:036]: 'Test LED 1' Setting: [14:49:57][D][switch:016]: 'Use wake word' Turning OFF. [14:49:57][D][switch:055]: 'Use wake word': Sending state OFF [14:49:57][D][voice_assistant:556]: Signaling stop... [14:49:58][D][voice_assistant:439]: State changed from STREAMING_MICROPHONE to STOP_MICROPHONE [14:49:58][D][voice_assistant:445]: Desired state set to IDLE [14:49:58][D][light:036]: 'Test LED 1' Setting: [14:49:58][D][light:047]: State: OFF [14:49:58][D][esp-idf:000]: W (151709) AUDIO_ELEMENT: IN-[resampler] AEL_IO_ABORT [14:49:58][D][voice_assistant:439]: State changed from STOPPING_MICROPHONE to STOP_MICROPHONE [14:49:58][D][voice_assistant:445]: Desired state set to IDLE [14:49:58][D][voice_assistant:439]: State changed from STOP_MICROPHONE to IDLE [14:49:58][D][esp_adf_pipeline:400]: Called deinit_all [14:49:58][D][esp-idf:000]: I (151736) AUDIO_PIPELINE: audio_pipeline_unlinked [14:49:58][D][esp-idf:000]: W (151739) AUDIO_ELEMENT: [i2s_in] Element has not create when AUDIO_ELEMENT_TERMINATE [14:49:58][D][esp-idf:000]: W (151746) AUDIO_ELEMENT: [resampler] Element has not create when AUDIO_ELEMENT_TERMINATE [14:49:58][D][esp-idf:000]: W (151757) AUDIO_ELEMENT: [pcm_reader] Element has not create when AUDIO_ELEMENT_TERMINATE [14:49:58][D][esp-idf:000]: I (151767) I2S: DMA queue destroyed [14:49:58][D][esp-idf:000]: I (151777) I2S: DMA queue destroyed [14:49:58][D][esp_adf_pipeline:302]: State changed from STOPPING to UNINITIALIZED [14:49:58][W][component:237]: Component adf_pipeline.microphone took a long time for an operation (62 ms). [14:49:58][W][component:238]: Components should block for at most 30 ms. [14:49:58][D][voice_assistant:563]: Event Type: 2 [14:49:58][D][voice_assistant:653]: Assist Pipeline ended [14:49:58][D][light:036]: 'Test LED 1' Setting: [14:50:00][D][switch:012]: 'Use wake word' Turning ON. [14:50:00][D][switch:055]: 'Use wake word': Sending state ON [14:50:01][D][voice_assistant:439]: State changed from IDLE to START_PIPELINE [14:50:01][D][voice_assistant:445]: Desired state set to START_MICROPHONE [14:50:01][D][light:036]: 'Test LED 1' Setting: [14:50:01][D][light:047]: State: ON [14:50:01][D][voice_assistant:126]: microphone not running [14:50:01][D][voice_assistant:210]: Requesting start... [14:50:01][D][voice_assistant:439]: State changed from START_PIPELINE to STARTING_PIPELINE [14:50:01][D][voice_assistant:126]: microphone not running [14:50:01][D][voice_assistant:476]: Client started, streaming microphone [14:50:01][D][voice_assistant:439]: State changed from STARTING_PIPELINE to START_MICROPHONE [14:50:01][D][voice_assistant:445]: Desired state set to STREAMING_MICROPHONE [14:50:01][D][voice_assistant:163]: Starting Microphone [14:50:01][D][esp_adf_pipeline:050]: Starting request, current state UNINITIALIZED [14:50:01][D][esp-idf:000]: I (154751) I2S: DMA Malloc info, datalen=blocksize=512, dma_buf_count=4 [14:50:01][D][esp-idf:000]: I (154760) I2S: DMA Malloc info, datalen=blocksize=512, dma_buf_count=4 [14:50:01][D][i2s_audio:072]: Installing driver : yes [14:50:01][D][esp-idf:000]: I (154769) I2S: I2S0, MCLK output by GPIO0 [14:50:01][D][esp_adf_pipeline:358]: pipeline tag 0, i2s_in [14:50:01][D][esp_adf_pipeline:358]: pipeline tag 1, resampler [14:50:01][D][esp_adf_pipeline:358]: pipeline tag 2, pcm_reader [14:50:01][D][esp-idf:000]: I (154800) AUDIO_PIPELINE: link el->rb, el:0x3ffdf01c, tag:i2s_in, rb:0x3ffdf69c [14:50:01][D][esp-idf:000]: I (154810) AUDIO_PIPELINE: link el->rb, el:0x3ffd78c4, tag:resampler, rb:0x3ffdf6d8 [14:50:01][D][esp_adf_pipeline:370]: Setting up event listener. [14:50:01][D][esp_adf_pipeline:302]: State changed from UNINITIALIZED to PREPARING [14:50:01][D][voice_assistant:439]: State changed from START_MICROPHONE to STARTING_MICROPHONE [14:50:01][W][component:237]: Component voice_assistant took a long time for an operation (99 ms). [14:50:01][W][component:238]: Components should block for at most 30 ms. [14:50:01][D][esp_adf_pipeline:302]: State changed from PREPARING to STARTING [14:50:01][D][esp-idf:000]: I (154862) AUDIO_ELEMENT: [i2s_in-0x3ffdf01c] Element task created [14:50:01][D][esp-idf:000]: I (154872) AUDIO_ELEMENT: [resampler-0x3ffd78c4] Element task created [14:50:01][D][esp-idf:000]: I (154882) AUDIO_ELEMENT: [pcm_reader-0x3ffd68b0] Element task created [14:50:01][D][esp-idf:000]: I (154892) AUDIO_PIPELINE: Func:audio_pipeline_run, Line:359, MEM Total:136812 Bytes [14:50:01][D][esp-idf:000]: I (154902) AUDIO_ELEMENT: [i2s_in] AEL_MSG_CMD_RESUME,state:1 [14:50:01][D][esp-idf:000]: I (154907) AUDIO_ELEMENT: [resampler] AEL_MSG_CMD_RESUME,state:1 [14:50:01][D][esp-idf:000]: I (154914) AUDIO_PIPELINE: Pipeline started [14:50:01][W][component:237]: Component adf_pipeline.microphone took a long time for an operation (70 ms). [14:50:01][W][component:238]: Components should block for at most 30 ms. [14:50:01][D][voice_assistant:563]: Event Type: 1 [14:50:01][D][voice_assistant:566]: Assist Pipeline running [14:50:01][I][esp_adf_pipeline:214]: [ pcm_reader ] status: 12 [14:50:01][D][esp_adf_pipeline:131]: Check element [i2s_in] status, 3 [14:50:01][D][esp_adf_pipeline:131]: Check element [resampler] status, 3 [14:50:01][D][esp_adf_pipeline:131]: Check element [pcm_reader] status, 3 [14:50:01][D][esp_adf_pipeline:302]: State changed from STARTING to RUNNING [14:50:01][D][voice_assistant:563]: Event Type: 9 [14:50:01][D][voice_assistant:439]: State changed from STARTING_MICROPHONE to STREAMING_MICROPHONE [14:50:01][I][esp_adf_pipeline:214]: [ i2s_in ] status: 12 [14:50:01][I][esp_adf_pipeline:214]: [ pcm_reader ] status: 12 [14:50:01][I][esp_adf_pipeline:214]: [ resampler ] status: 12 [14:50:15][D][media_player:059]: 's3-dev_media_player' - Setting [14:50:15][D][media_player:066]: Media URL: http://192.168.0.90:8123/api/tts_proxy/a0d84784ef072500c8420873f71adb4d49328340_en-au_1459b3b937_tts.home_assistant_cloud.mp3 [14:50:15][D][adf_media_player:030]: Got control call in state 1 [14:50:15][D][esp_adf_pipeline:050]: Starting request, current state UNINITIALIZED [14:50:15][D][esp-idf:000]: I (169467) MP3_DECODER: MP3 init [14:50:15][D][esp_adf_pipeline:358]: pipeline tag 0, http [14:50:15][D][esp_adf_pipeline:358]: pipeline tag 1, decoder [14:50:15][D][esp_adf_pipeline:358]: pipeline tag 2, resampler [14:50:15][D][esp_adf_pipeline:358]: pipeline tag 3, i2s_out [14:50:15][D][esp-idf:000]: I (169509) AUDIO_PIPELINE: link el->rb, el:0x3ffda99c, tag:http, rb:0x3ffde02c [14:50:15][D][esp-idf:000]: I (169512) AUDIO_PIPELINE: link el->rb, el:0x3ffdcdc0, tag:decoder, rb:0x3ffdc7e4 [14:50:15][D][esp-idf:000]: I (169515) AUDIO_PIPELINE: link el->rb, el:0x3ffdd03c, tag:resampler, rb:0x3ffdc914 [14:50:15][D][esp_adf_pipeline:370]: Setting up event listener. [14:50:15][D][esp_adf_pipeline:302]: State changed from UNINITIALIZED to PREPARING [14:50:15][I][adf_media_player:135]: got new pipeline state: 1 [14:50:15][D][adf_i2s_out:127]: Set final i2s settings: 16000 [14:50:15][D][esp_audio_processors:079]: New settings: SRC: rate: 16000, ch: 1 DST: rate: 16000, ch: 2 [14:50:15][W][component:237]: Component api took a long time for an operation (109 ms). [14:50:15][W][component:238]: Components should block for at most 30 ms. [14:50:15][D][esp-idf:000]: I (169584) AUDIO_ELEMENT: [http-0x3ffda99c] Element task created [14:50:15][D][esp-idf:000]: I (169587) AUDIO_ELEMENT: [decoder-0x3ffdcdc0] Element task created [14:50:15][D][esp-idf:000]: I (169593) AUDIO_ELEMENT: [http] AEL_MSG_CMD_RESUME,state:1 [14:50:15][D][esp-idf:000]: I (169605) AUDIO_ELEMENT: [decoder] AEL_MSG_CMD_RESUME,state:1 [14:50:15][D][esp_audio_sources:097]: Streamer status: 2 [14:50:15][D][esp_audio_sources:098]: decoder status: 2 [14:50:16][D][esp-idf:000]: I (170576) HTTP_CLIENT: Body received in fetch header state, 0x3ffe55d3, 1841 [14:50:16][D][esp-idf:000]: I (170584) HTTP_STREAM: total_bytes=31439 [14:50:16][D][esp-idf:000]: E (170602) MP3_DE_LIB: /builds/adf/esp-adf-libs-source/esp_codec/esp-mp3/src/pvmp3_framedecoder.cpp:694 (pvmp3_InitDecoder): Memory exhausted [14:50:16][D][esp-idf:000]: E (170608) MP3_DECODER: Allocate buffer failed. (line 294) [14:50:16][D][esp-idf:000]: E (170613) AUDIO_ELEMENT: [decoder] AEL_STATUS_ERROR_OPEN,-1 [14:50:16][D][esp-idf:000]: W (170618) AUDIO_ELEMENT: [decoder] audio_element_on_cmd_error,7 [14:50:16][D][esp-idf:000]: I (170629) MP3_DECODER: Closed [14:50:16][D][esp-idf:000]: W (170641) AUDIO_ELEMENT: OUT-[http] AEL_IO_ABORT [14:50:25][I][esp_adf_pipeline:185]: Pipeline preparation timeout! [14:50:25][D][esp-idf:000]: W (179539) AUDIO_PIPELINE: Without stop, st:1 [14:50:25][D][esp_adf_pipeline:302]: State changed from PREPARING to STOPPING [14:50:25][I][adf_media_player:135]: got new pipeline state: 4 [14:50:25][D][esp_adf_pipeline:400]: Called deinit_all [14:50:25][D][esp-idf:000]: W (179551) AUDIO_ELEMENT: [resampler] Element has not create when AUDIO_ELEMENT_TERMINATE [14:50:25][D][esp-idf:000]: W (179554) AUDIO_ELEMENT: [i2s_out] Element has not create when AUDIO_ELEMENT_TERMINATE [14:50:25][D][esp-idf:000]: I (179562) AUDIO_PIPELINE: audio_pipeline_unlinked [14:50:25][D][esp-idf:000]: W (179572) AUDIO_ELEMENT: [http] Element has not create when AUDIO_ELEMENT_TERMINATE [14:50:25][D][esp-idf:000]: W (179582) AUDIO_ELEMENT: [decoder] Element has not create when AUDIO_ELEMENT_TERMINATE [14:50:25][D][esp-idf:000]: W (179592) AUDIO_ELEMENT: [resampler] Element has not create when AUDIO_ELEMENT_TERMINATE [14:50:25][D][esp-idf:000]: W (179602) AUDIO_ELEMENT: [i2s_out] Element has not create when AUDIO_ELEMENT_TERMINATE [14:50:25][D][i2s_audio:116]: Other component hasn't released WARNING voice-sat @ 192.168.0.85: Connection error occurred: [Errno 104] Connection reset by peer INFO Processing unexpected disconnect from ESPHome API for voice-sat @ 192.168.0.85 WARNING Disconnected from API INFO Successfully connected to voice-sat @ 192.168.0.85 in 0.005s INFO Successful handshake with voice-sat @ 192.168.0.85 in 0.097s [14:51:08][D][media_player:059]: 's3-dev_media_player' - Setting [14:51:08][D][media_player:063]: Command: STOP [14:51:08][D][esp_adf_pipeline:302]: State changed from RUNNING to STOPPING [14:51:08][I][adf_media_player:135]: got new pipeline state: 4 [14:51:08][D][esp_adf_pipeline:400]: Called deinit_all [14:51:08][D][esp-idf:000]: I (37919) AUDIO_PIPELINE: audio_pipeline_unlinked [14:51:08][D][esp-idf:000]: W (37921) AUDIO_ELEMENT: [http] Element has not create when AUDIO_ELEMENT_TERMINATE [14:51:08][D][esp-idf:000]: W (37924) AUDIO_ELEMENT: [decoder] Element has not create when AUDIO_ELEMENT_TERMINATE [14:51:08][D][esp-idf:000]: W (37927) AUDIO_ELEMENT: [resampler] Element has not create when AUDIO_ELEMENT_TERMINATE [14:51:08][D][esp-idf:000]: W (37939) AUDIO_ELEMENT: [i2s_out] Element has not create when AUDIO_ELEMENT_TERMINATE [14:51:08][D][esp-idf:000]: I (37949) I2S: DMA queue destroyed [14:51:08][D][esp-idf:000]: I (37959) I2S: DMA queue destroyed [14:51:08][D][esp_adf_pipeline:302]: State changed from STOPPING to UNINITIALIZED [14:51:08][I][adf_media_player:135]: got new pipeline state: 0 [14:51:08][W][component:237]: Component adf_pipeline.media_player took a long time for an operation (58 ms). [14:51:08][W][component:238]: Components should block for at most 30 ms. [14:51:19][D][media_player:059]: 's3-dev_media_player' - Setting [14:51:19][D][media_player:066]: Media URL: http://st01.dlf.de/dlf/01/128/mp3/stream.mp3 [14:51:19][D][adf_media_player:030]: Got control call in state 1 [14:51:19][D][esp_adf_pipeline:050]: Starting request, current state UNINITIALIZED [14:51:19][D][esp-idf:000]: I (49311) MP3_DECODER: MP3 init [14:51:19][D][esp-idf:000]: I (49340) I2S: DMA Malloc info, datalen=blocksize=1024, dma_buf_count=4 [14:51:19][D][esp-idf:000]: I (49344) I2S: DMA Malloc info, datalen=blocksize=1024, dma_buf_count=4 [14:51:19][D][i2s_audio:072]: Installing driver : yes [14:51:19][D][esp-idf:000]: I (49349) I2S: I2S0, MCLK output by GPIO0 [14:51:19][D][esp_adf_pipeline:358]: pipeline tag 0, http [14:51:19][D][esp_adf_pipeline:358]: pipeline tag 1, decoder [14:51:19][D][esp_adf_pipeline:358]: pipeline tag 2, resampler [14:51:19][D][esp_adf_pipeline:358]: pipeline tag 3, i2s_out [14:51:19][D][esp-idf:000]: I (49372) AUDIO_PIPELINE: link el->rb, el:0x3ffd6f74, tag:http, rb:0x3ffd97bc [14:51:19][D][esp-idf:000]: I (49383) AUDIO_PIPELINE: link el->rb, el:0x3ffd66f0, tag:decoder, rb:0x3ffd9894 [14:51:19][D][esp-idf:000]: I (49385) AUDIO_PIPELINE: link el->rb, el:0x3ffd696c, tag:resampler, rb:0x3ffd99b0 [14:51:19][D][esp_adf_pipeline:370]: Setting up event listener. [14:51:19][D][esp_adf_pipeline:302]: State changed from UNINITIALIZED to PREPARING [14:51:19][I][adf_media_player:135]: got new pipeline state: 1 [14:51:19][D][adf_i2s_out:127]: Set final i2s settings: 16000 [14:51:19][D][esp_audio_processors:079]: New settings: SRC: rate: 48000, ch: 2 DST: rate: 16000, ch: 2 [14:51:19][W][component:237]: Component api took a long time for an operation (135 ms). [14:51:19][W][component:238]: Components should block for at most 30 ms. [14:51:19][D][esp-idf:000]: I (49446) AUDIO_ELEMENT: [http-0x3ffd6f74] Element task created [14:51:20][D][esp-idf:000]: I (49454) AUDIO_ELEMENT: [decoder-0x3ffd66f0] Element task created [14:51:20][D][esp-idf:000]: I (49464) AUDIO_ELEMENT: [http] AEL_MSG_CMD_RESUME,state:1 [14:51:20][D][esp-idf:000]: I (49470) AUDIO_ELEMENT: [decoder] AEL_MSG_CMD_RESUME,state:1 [14:51:20][D][esp_audio_sources:097]: Streamer status: 2 [14:51:20][D][esp_audio_sources:098]: decoder status: 2 [14:51:20][D][esp-idf:000]: I (49608) HTTP_STREAM: total_bytes=0 [14:51:20][D][esp-idf:000]: I (49765) HTTP_STREAM: total_bytes=0 [14:51:20][I][HTTPStreamReader:129]: [ * ] Receive music info from mp3 decoder, sample_rates=48000, bits=16, ch=2 [14:51:20][D][adf_i2s_out:127]: Set final i2s settings: 16000 [14:51:20][D][esp_audio_processors:079]: New settings: SRC: rate: 48000, ch: 2 DST: rate: 16000, ch: 2 [14:51:20][D][esp-idf:000]: W (49811) AUDIO_ELEMENT: OUT-[decoder] AEL_IO_ABORT [14:51:20][D][esp-idf:000]: W (49816) MP3_DECODER: output aborted -3 [14:51:20][D][esp-idf:000]: I (49820) MP3_DECODER: Closed [14:51:20][D][esp-idf:000]: W (49830) HTTP_STREAM: No output due to stopping [14:51:20][D][esp_adf_pipeline:302]: State changed from PREPARING to STARTING [14:51:20][I][adf_media_player:135]: got new pipeline state: 2 [14:51:20][D][adf_i2s_out:127]: Set final i2s settings: 16000 [14:51:20][D][esp_audio_processors:079]: New settings: SRC: rate: 48000, ch: 2 DST: rate: 16000, ch: 2 [14:51:20][D][esp-idf:000]: I (49859) AUDIO_ELEMENT: [resampler-0x3ffd696c] Element task created [14:51:20][D][esp-idf:000]: I (49864) AUDIO_ELEMENT: [i2s_out-0x3ffd7c98] Element task created [14:51:20][D][esp-idf:000]: I (49874) AUDIO_PIPELINE: Func:audio_pipeline_run, Line:359, MEM Total:113504 Bytes [14:51:20][D][esp-idf:000]: I (49884) AUDIO_ELEMENT: [http] AEL_MSG_CMD_RESUME,state:1 [14:51:20][D][esp-idf:000]: I (49889) AUDIO_ELEMENT: [decoder] AEL_MSG_CMD_RESUME,state:1 [14:51:20][D][esp-idf:000]: I (49896) MP3_DECODER: MP3 opened [14:51:20][D][esp-idf:000]: I (49935) RSP_FILTER: sample rate of source data : 48000, channel of source data : 2, sample rate of destination data : 16000, channel of destination data : 2 [14:51:20][I][esp_adf_pipeline:214]: [ resampler ] status: 12 [14:51:20][D][esp_adf_pipeline:131]: Check element [http] status, 2 [14:51:20][D][esp-idf:000]: I (50040) HTTP_STREAM: total_bytes=0 [14:51:20][D][esp-idf:000]: I (50149) HTTP_CLIENT: Body received in fetch header state, 0x3ffe088c, 1368 [14:51:20][D][esp-idf:000]: I (50154) HTTP_STREAM: total_bytes=0 [14:51:20][I][esp_adf_pipeline:214]: [ http ] status: 12 [14:51:20][D][esp_adf_pipeline:131]: Check element [http] status, 3 [14:51:20][D][esp_adf_pipeline:131]: Check element [decoder] status, 2 [14:51:20][D][esp_adf_pipeline:131]: Check element [resampler] status, 3 [14:51:20][D][esp_adf_pipeline:131]: Check element [i2s_out] status, 3 [14:51:20][D][esp_adf_pipeline:302]: State changed from STARTING to RUNNING [14:51:20][I][adf_media_player:135]: got new pipeline state: 3 [14:51:20][D][adf_i2s_out:127]: Set final i2s settings: 16000 [14:51:20][D][esp_audio_processors:079]: New settings: SRC: rate: 48000, ch: 2 DST: rate: 16000, ch: 2 [14:51:20][I][esp_adf_pipeline:214]: [ decoder ] status: 12 [14:51:20][I][HTTPStreamReader:129]: [ * ] Receive music info from mp3 decoder, sample_rates=48000, bits=16, ch=2 [14:51:20][D][adf_i2s_out:127]: Set final i2s settings: 16000 [14:51:20][D][esp_audio_processors:079]: New settings: SRC: rate: 48000, ch: 2 DST: rate: 16000, ch: 2 [14:51:24][D][media_player:059]: 's3-dev_media_player' - Setting [14:51:24][D][media_player:066]: Media URL: http://st01.dlf.de/dlf/01/128/mp3/stream.mp3 [14:51:24][D][adf_media_player:030]: Got control call in state 2 [14:51:24][D][esp_adf_pipeline:302]: State changed from RUNNING to STOPPING [14:51:24][I][adf_media_player:135]: got new pipeline state: 4 [14:51:24][D][esp-idf:000]: W (54274) AUDIO_ELEMENT: OUT-[decoder] AEL_IO_ABORT [14:51:24][D][esp-idf:000]: W (54278) MP3_DECODER: output aborted -3 [14:51:24][D][esp-idf:000]: I (54282) MP3_DECODER: Closed [14:51:24][D][esp-idf:000]: W (54286) AUDIO_ELEMENT: OUT-[http] AEL_IO_ABORT [14:51:24][D][esp_adf_pipeline:400]: Called deinit_all [14:51:24][D][esp-idf:000]: I (54354) AUDIO_PIPELINE: audio_pipeline_unlinked [14:51:24][D][esp-idf:000]: W (54357) AUDIO_ELEMENT: [http] Element has not create when AUDIO_ELEMENT_TERMINATE [14:51:24][D][esp-idf:000]: W (54360) AUDIO_ELEMENT: [decoder] Element has not create when AUDIO_ELEMENT_TERMINATE [14:51:24][D][esp-idf:000]: W (54363) AUDIO_ELEMENT: [resampler] Element has not create when AUDIO_ELEMENT_TERMINATE [14:51:24][D][esp-idf:000]: W (54375) AUDIO_ELEMENT: [i2s_out] Element has not create when AUDIO_ELEMENT_TERMINATE [14:51:24][D][esp-idf:000]: I (54386) I2S: DMA queue destroyed [14:51:24][D][esp-idf:000]: I (54389) I2S: DMA queue destroyed [14:51:24][D][esp_adf_pipeline:302]: State changed from STOPPING to UNINITIALIZED [14:51:24][I][adf_media_player:135]: got new pipeline state: 0 [14:51:24][D][esp_adf_pipeline:050]: Starting request, current state UNINITIALIZED [14:51:24][D][esp-idf:000]: I (54416) MP3_DECODER: MP3 init [14:51:24][D][esp-idf:000]: I (54451) I2S: DMA Malloc info, datalen=blocksize=1024, dma_buf_count=4 [14:51:24][D][esp-idf:000]: I (54455) I2S: DMA Malloc info, datalen=blocksize=1024, dma_buf_count=4 [14:51:24][D][i2s_audio:072]: Installing driver : yes [14:51:24][D][esp-idf:000]: I (54460) I2S: I2S0, MCLK output by GPIO0 [14:51:25][D][esp_adf_pipeline:358]: pipeline tag 0, http [14:51:25][D][esp_adf_pipeline:358]: pipeline tag 1, decoder [14:51:25][D][esp_adf_pipeline:358]: pipeline tag 2, resampler [14:51:25][D][esp_adf_pipeline:358]: pipeline tag 3, i2s_out [14:51:25][D][esp-idf:000]: I (54483) AUDIO_PIPELINE: link el->rb, el:0x3ffd6f74, tag:http, rb:0x3ffdfc24 [14:51:25][D][esp-idf:000]: I (54494) AUDIO_PIPELINE: link el->rb, el:0x3ffd7548, tag:decoder, rb:0x3ffdfc4c [14:51:25][D][esp-idf:000]: I (54504) AUDIO_PIPELINE: link el->rb, el:0x3ffd77f8, tag:resampler, rb:0x3ffdfea0 [14:51:25][D][esp_adf_pipeline:370]: Setting up event listener. [14:51:25][D][esp_adf_pipeline:302]: State changed from UNINITIALIZED to PREPARING [14:51:25][I][adf_media_player:135]: got new pipeline state: 1 [14:51:25][D][adf_i2s_out:127]: Set final i2s settings: 16000 [14:51:25][D][esp_audio_processors:079]: New settings: SRC: rate: 48000, ch: 2 DST: rate: 16000, ch: 2 [14:51:25][W][component:237]: Component adf_pipeline.media_player took a long time for an operation (196 ms). [14:51:25][W][component:238]: Components should block for at most 30 ms. [14:51:25][D][esp-idf:000]: I (54559) AUDIO_ELEMENT: [http-0x3ffd6f74] Element task created [14:51:25][D][esp-idf:000]: I (54566) AUDIO_ELEMENT: [decoder-0x3ffd7548] Element task created [14:51:25][D][esp-idf:000]: I (54576) AUDIO_ELEMENT: [http] AEL_MSG_CMD_RESUME,state:1 [14:51:25][D][esp-idf:000]: I (54587) AUDIO_ELEMENT: [decoder] AEL_MSG_CMD_RESUME,state:1 [14:51:25][D][esp_audio_sources:097]: Streamer status: 2 [14:51:25][D][esp_audio_sources:098]: decoder status: 2 [14:51:25][D][esp-idf:000]: I (54691) HTTP_STREAM: total_bytes=0 [14:51:25][D][esp-idf:000]: I (54844) HTTP_CLIENT: Body received in fetch header state, 0x3ffe088c, 1368 [14:51:25][D][esp-idf:000]: I (54850) HTTP_STREAM: total_bytes=0 [14:51:25][I][HTTPStreamReader:129]: [ * ] Receive music info from mp3 decoder, sample_rates=48000, bits=16, ch=2 [14:51:25][D][adf_i2s_out:127]: Set final i2s settings: 16000 [14:51:25][D][esp_audio_processors:079]: New settings: SRC: rate: 48000, ch: 2 DST: rate: 16000, ch: 2 [14:51:25][D][esp-idf:000]: W (54891) AUDIO_ELEMENT: OUT-[decoder] AEL_IO_ABORT [14:51:25][D][esp-idf:000]: W (54896) MP3_DECODER: output aborted -3 [14:51:25][D][esp-idf:000]: I (54901) MP3_DECODER: Closed [14:51:25][D][esp-idf:000]: W (54907) HTTP_STREAM: No output due to stopping [14:51:25][D][esp_adf_pipeline:302]: State changed from PREPARING to STARTING [14:51:25][I][adf_media_player:135]: got new pipeline state: 2 [14:51:25][D][adf_i2s_out:127]: Set final i2s settings: 16000 [14:51:25][D][esp_audio_processors:079]: New settings: SRC: rate: 48000, ch: 2 DST: rate: 16000, ch: 2 [14:51:25][D][esp-idf:000]: I (54939) AUDIO_ELEMENT: [resampler-0x3ffd77f8] Element task created [14:51:25][D][esp-idf:000]: I (54944) AUDIO_ELEMENT: [i2s_out-0x3ffd6714] Element task created [14:51:25][D][esp-idf:000]: I (54954) AUDIO_PIPELINE: Func:audio_pipeline_run, Line:359, MEM Total:112976 Bytes [14:51:25][D][esp-idf:000]: I (54964) AUDIO_ELEMENT: [http] AEL_MSG_CMD_RESUME,state:1 [14:51:25][D][esp-idf:000]: I (54969) AUDIO_ELEMENT: [decoder] AEL_MSG_CMD_RESUME,state:1 [14:51:25][D][esp-idf:000]: I (54976) MP3_DECODER: MP3 opened [14:51:25][D][esp-idf:000]: I (55014) RSP_FILTER: sample rate of source data : 48000, channel of source data : 2, sample rate of destination data : 16000, channel of destination data : 2 [14:51:25][I][esp_adf_pipeline:214]: [ resampler ] status: 12 [14:51:25][D][esp_adf_pipeline:131]: Check element [http] status, 2 [14:51:25][D][esp-idf:000]: I (55114) HTTP_STREAM: total_bytes=0 [14:51:25][D][esp-idf:000]: I (55254) HTTP_CLIENT: Body received in fetch header state, 0x3ffe088c, 1368 [14:51:25][D][esp-idf:000]: I (55259) HTTP_STREAM: total_bytes=0 [14:51:25][I][esp_adf_pipeline:214]: [ http ] status: 12 [14:51:25][D][esp_adf_pipeline:131]: Check element [http] status, 3 [14:51:25][D][esp_adf_pipeline:131]: Check element [decoder] status, 3 [14:51:25][D][esp_adf_pipeline:131]: Check element [resampler] status, 3 [14:51:25][D][esp_adf_pipeline:131]: Check element [i2s_out] status, 3 [14:51:25][D][esp_adf_pipeline:302]: State changed from STARTING to RUNNING [14:51:25][I][adf_media_player:135]: got new pipeline state: 3 [14:51:25][D][adf_i2s_out:127]: Set final i2s settings: 16000 [14:51:25][D][esp_audio_processors:079]: New settings: SRC: rate: 48000, ch: 2 DST: rate: 16000, ch: 2 [14:51:25][I][esp_adf_pipeline:214]: [ decoder ] status: 12 [14:51:25][I][HTTPStreamReader:129]: [ * ] Receive music info from mp3 decoder, sample_rates=48000, bits=16, ch=2 [14:51:25][D][adf_i2s_out:127]: Set final i2s settings: 16000 [14:51:25][D][esp_audio_processors:079]: New settings: SRC: rate: 48000, ch: 2 DST: rate: 16000, ch: 2 [14:52:19][D][media_player:059]: 's3-dev_media_player' - Setting [14:52:19][D][media_player:063]: Command: STOP [14:52:19][D][esp_adf_pipeline:302]: State changed from RUNNING to STOPPING [14:52:19][I][adf_media_player:135]: got new pipeline state: 4 [14:52:19][D][esp_adf_pipeline:400]: Called deinit_all [14:52:19][D][esp-idf:000]: I (108990) AUDIO_PIPELINE: audio_pipeline_unlinked [14:52:19][D][esp-idf:000]: W (108994) AUDIO_ELEMENT: [http] Element has not create when AUDIO_ELEMENT_TERMINATE [14:52:19][D][esp-idf:000]: W (108996) AUDIO_ELEMENT: [decoder] Element has not create when AUDIO_ELEMENT_TERMINATE [14:52:19][D][esp-idf:000]: W (108999) AUDIO_ELEMENT: [resampler] Element has not create when AUDIO_ELEMENT_TERMINATE [14:52:19][D][esp-idf:000]: W (109011) AUDIO_ELEMENT: [i2s_out] Element has not create when AUDIO_ELEMENT_TERMINATE [14:52:19][D][esp-idf:000]: I (109021) I2S: DMA queue destroyed [14:52:19][D][esp-idf:000]: I (109031) I2S: DMA queue destroyed [14:52:19][D][esp_adf_pipeline:302]: State changed from STOPPING to UNINITIALIZED [14:52:19][I][adf_media_player:135]: got new pipeline state: 0 [14:52:19][W][component:237]: Component adf_pipeline.media_player took a long time for an operation (66 ms). [14:52:19][W][component:238]: Components should block for at most 30 ms. [14:54:03][D][switch:012]: 'Use wake word' Turning ON. [14:54:03][D][switch:055]: 'Use wake word': Sending state ON [14:54:03][D][voice_assistant:439]: State changed from IDLE to START_PIPELINE [14:54:03][D][voice_assistant:445]: Desired state set to START_MICROPHONE [14:54:03][D][light:036]: 'Test LED 1' Setting: [14:54:03][D][light:047]: State: ON [14:54:03][D][voice_assistant:126]: microphone not running [14:54:03][D][voice_assistant:210]: Requesting start... [14:54:03][D][voice_assistant:439]: State changed from START_PIPELINE to STARTING_PIPELINE [14:54:03][D][voice_assistant:126]: microphone not running [14:54:03][D][voice_assistant:476]: Client started, streaming microphone [14:54:03][D][voice_assistant:439]: State changed from STARTING_PIPELINE to START_MICROPHONE [14:54:03][D][voice_assistant:445]: Desired state set to STREAMING_MICROPHONE [14:54:03][D][voice_assistant:163]: Starting Microphone [14:54:03][D][esp_adf_pipeline:050]: Starting request, current state UNINITIALIZED [14:54:03][D][esp-idf:000]: I (212689) I2S: DMA Malloc info, datalen=blocksize=512, dma_buf_count=4 [14:54:03][D][esp-idf:000]: I (212698) I2S: DMA Malloc info, datalen=blocksize=512, dma_buf_count=4 [14:54:03][D][i2s_audio:072]: Installing driver : yes [14:54:03][D][esp-idf:000]: I (212718) I2S: I2S0, MCLK output by GPIO0 [14:54:03][D][esp_adf_pipeline:358]: pipeline tag 0, i2s_in [14:54:03][D][esp_adf_pipeline:358]: pipeline tag 1, resampler [14:54:03][D][esp_adf_pipeline:358]: pipeline tag 2, pcm_reader [14:54:03][D][esp-idf:000]: I (212738) AUDIO_PIPELINE: link el->rb, el:0x3ffd6f74, tag:i2s_in, rb:0x3ffdf6a4 [14:54:03][D][esp-idf:000]: I (212749) AUDIO_PIPELINE: link el->rb, el:0x3ffd6660, tag:resampler, rb:0x3ffdf6cc [14:54:03][D][esp_adf_pipeline:370]: Setting up event listener. [14:54:03][D][esp_adf_pipeline:302]: State changed from UNINITIALIZED to PREPARING [14:54:03][D][voice_assistant:439]: State changed from START_MICROPHONE to STARTING_MICROPHONE [14:54:03][W][component:237]: Component voice_assistant took a long time for an operation (100 ms). [14:54:03][W][component:238]: Components should block for at most 30 ms. [14:54:03][D][esp_audio_processors:079]: New settings: SRC: rate: 16000, ch: 2 DST: rate: 16000, ch: 1 [14:54:03][D][esp_audio_processors:088]: New settings: SRC: rate: 16000, ch: 2 DST: rate: 16000, ch: 1 [14:54:03][D][esp_adf_pipeline:302]: State changed from PREPARING to STARTING [14:54:03][D][esp-idf:000]: I (212813) AUDIO_ELEMENT: [i2s_in-0x3ffd6f74] Element task created [14:54:03][D][esp-idf:000]: I (212821) AUDIO_ELEMENT: [resampler-0x3ffd6660] Element task created [14:54:03][D][esp-idf:000]: I (212831) AUDIO_ELEMENT: [pcm_reader-0x3ffdf32c] Element task created [14:54:03][D][esp-idf:000]: I (212851) AUDIO_PIPELINE: Func:audio_pipeline_run, Line:359, MEM Total:138508 Bytes [14:54:03][D][esp-idf:000]: I (212861) AUDIO_ELEMENT: [i2s_in] AEL_MSG_CMD_RESUME,state:1 [14:54:03][D][esp-idf:000]: I (212866) AUDIO_ELEMENT: [resampler] AEL_MSG_CMD_RESUME,state:1 [14:54:03][D][esp-idf:000]: I (212874) AUDIO_PIPELINE: Pipeline started [14:54:03][W][component:237]: Component adf_pipeline.microphone took a long time for an operation (92 ms). [14:54:03][W][component:238]: Components should block for at most 30 ms. [14:54:03][D][voice_assistant:563]: Event Type: 0 [14:54:03][E][voice_assistant:693]: Error: no_wake_word - No wake word detected [14:54:03][D][voice_assistant:556]: Signaling stop... [14:54:03][D][voice_assistant:439]: State changed from STARTING_MICROPHONE to STOP_MICROPHONE [14:54:03][D][voice_assistant:445]: Desired state set to IDLE [14:54:03][D][voice_assistant:439]: State changed from STOP_MICROPHONE to IDLE [14:54:03][I][esp_adf_pipeline:214]: [ pcm_reader ] status: 12 [14:54:03][D][esp_adf_pipeline:131]: Check element [i2s_in] status, 5 [14:54:03][D][voice_assistant:563]: Event Type: 2 [14:54:03][D][voice_assistant:653]: Assist Pipeline ended [14:54:03][D][voice_assistant:439]: State changed from IDLE to START_PIPELINE [14:54:03][D][voice_assistant:445]: Desired state set to START_MICROPHONE [14:54:03][I][esp_adf_pipeline:214]: [ i2s_in ] status: 12 [14:54:03][D][esp_adf_pipeline:131]: Check element [i2s_in] status, 5 [14:54:03][D][voice_assistant:563]: Event Type: 1 [14:54:03][D][voice_assistant:566]: Assist Pipeline running [14:54:03][D][voice_assistant:126]: microphone not running [14:54:03][D][voice_assistant:210]: Requesting start... [14:54:03][D][voice_assistant:439]: State changed from START_PIPELINE to STARTING_PIPELINE [14:54:03][I][esp_adf_pipeline:214]: [ pcm_reader ] status: 12 [14:54:03][D][esp_adf_pipeline:131]: Check element [i2s_in] status, 5 [14:54:03][D][voice_assistant:563]: Event Type: 9 [14:54:03][D][voice_assistant:126]: microphone not running [14:54:03][I][esp_adf_pipeline:214]: [ resampler ] status: 1 [14:54:03][D][voice_assistant:476]: Client started, streaming microphone [14:54:03][D][voice_assistant:439]: State changed from STARTING_PIPELINE to START_MICROPHONE [14:54:03][D][voice_assistant:445]: Desired state set to STREAMING_MICROPHONE [14:54:03][D][voice_assistant:163]: Starting Microphone [14:54:03][D][esp_adf_pipeline:050]: Starting request, current state STARTING [14:54:03][D][voice_assistant:439]: State changed from START_MICROPHONE to STARTING_MICROPHONE [14:54:03][D][voice_assistant:563]: Event Type: 1 [14:54:03][D][voice_assistant:566]: Assist Pipeline running [14:54:03][I][esp_adf_pipeline:214]: [ i2s_in ] status: 14 [14:54:03][D][light:036]: 'Test LED 1' Setting: [14:54:03][D][voice_assistant:563]: Event Type: 9 [14:54:15][D][media_player:059]: 's3-dev_media_player' - Setting [14:54:15][D][media_player:069]: Volume: 0.18 [14:54:15][D][adf_i2s_out:127]: Set final i2s settings: 16000 WARNING voice-sat @ 192.168.0.85: Connection error occurred: [Errno 104] Connection reset by peer INFO Processing unexpected disconnect from ESPHome API for voice-sat @ 192.168.0.85 WARNING Disconnected from API INFO Successfully connected to voice-sat @ 192.168.0.85 in 0.004s INFO Successful handshake with voice-sat @ 192.168.0.85 in 0.079s [14:54:55][D][media_player:059]: 's3-dev_media_player' - Setting [14:54:55][D][media_player:069]: Volume: 0.10 [14:54:55][D][esp_audio_processors:079]: New settings: SRC: rate: 16000, ch: 2 DST: rate: 16000, ch: 2 [14:54:55][D][esp_audio_processors:079]: New settings: SRC: rate: 16000, ch: 2 DST: rate: 16000, ch: 2 [14:54:58][D][switch:012]: 'Use wake word' Turning ON. [14:54:58][D][switch:055]: 'Use wake word': Sending state ON [14:54:58][D][voice_assistant:439]: State changed from IDLE to START_PIPELINE [14:54:58][D][voice_assistant:445]: Desired state set to START_MICROPHONE [14:54:58][D][light:036]: 'Test LED 1' Setting: [14:54:58][D][light:047]: State: ON [14:54:58][D][voice_assistant:126]: microphone not running [14:54:58][D][voice_assistant:210]: Requesting start... [14:54:58][D][voice_assistant:439]: State changed from START_PIPELINE to STARTING_PIPELINE [14:54:58][D][voice_assistant:126]: microphone not running [14:54:58][D][voice_assistant:476]: Client started, streaming microphone [14:54:58][D][voice_assistant:439]: State changed from STARTING_PIPELINE to START_MICROPHONE [14:54:58][D][voice_assistant:445]: Desired state set to STREAMING_MICROPHONE [14:54:58][D][voice_assistant:163]: Starting Microphone [14:54:58][D][esp_adf_pipeline:050]: Starting request, current state UNINITIALIZED [14:54:58][D][esp-idf:000]: I (42725) I2S: DMA Malloc info, datalen=blocksize=512, dma_buf_count=4 [14:54:58][D][esp-idf:000]: I (42734) I2S: DMA Malloc info, datalen=blocksize=512, dma_buf_count=4 [14:54:58][D][i2s_audio:072]: Installing driver : yes [14:54:58][D][esp-idf:000]: I (42744) I2S: I2S0, MCLK output by GPIO0 [14:54:58][D][esp_adf_pipeline:358]: pipeline tag 0, i2s_in [14:54:58][D][esp_adf_pipeline:358]: pipeline tag 1, resampler [14:54:58][D][esp_adf_pipeline:358]: pipeline tag 2, pcm_reader [14:54:58][D][esp-idf:000]: I (42769) AUDIO_PIPELINE: link el->rb, el:0x3ffd6a94, tag:i2s_in, rb:0x3ffd89e4 [14:54:58][D][esp-idf:000]: I (42785) AUDIO_PIPELINE: link el->rb, el:0x3ffd9080, tag:resampler, rb:0x3ffd896c [14:54:58][D][esp_adf_pipeline:370]: Setting up event listener. [14:54:58][D][esp_adf_pipeline:302]: State changed from UNINITIALIZED to PREPARING [14:54:58][D][voice_assistant:439]: State changed from START_MICROPHONE to STARTING_MICROPHONE [14:54:58][W][component:237]: Component voice_assistant took a long time for an operation (103 ms). [14:54:58][W][component:238]: Components should block for at most 30 ms. [14:54:58][D][esp_audio_processors:079]: New settings: SRC: rate: 16000, ch: 2 DST: rate: 16000, ch: 1 [14:54:58][D][esp_audio_processors:088]: New settings: SRC: rate: 16000, ch: 2 DST: rate: 16000, ch: 1 [14:54:58][D][esp_adf_pipeline:302]: State changed from PREPARING to STARTING [14:54:58][D][esp-idf:000]: I (42848) AUDIO_ELEMENT: [i2s_in-0x3ffd6a94] Element task created [14:54:58][D][esp-idf:000]: I (42857) AUDIO_ELEMENT: [resampler-0x3ffd9080] Element task created [14:54:58][D][esp-idf:000]: I (42867) AUDIO_ELEMENT: [pcm_reader-0x3ffd7924] Element task created [14:54:58][D][esp-idf:000]: I (42887) AUDIO_PIPELINE: Func:audio_pipeline_run, Line:359, MEM Total:139176 Bytes [14:54:58][D][esp-idf:000]: I (42897) AUDIO_ELEMENT: [i2s_in] AEL_MSG_CMD_RESUME,state:1 [14:54:58][D][esp-idf:000]: I (42902) AUDIO_ELEMENT: [resampler] AEL_MSG_CMD_RESUME,state:1 [14:54:58][D][esp-idf:000]: I (42909) AUDIO_PIPELINE: Pipeline started [14:54:58][W][component:237]: Component adf_pipeline.microphone took a long time for an operation (92 ms). [14:54:58][W][component:238]: Components should block for at most 30 ms. [14:54:58][D][voice_assistant:563]: Event Type: 0 [14:54:58][E][voice_assistant:693]: Error: no_wake_word - No wake word detected [14:54:58][D][voice_assistant:556]: Signaling stop... [14:54:58][D][voice_assistant:439]: State changed from STARTING_MICROPHONE to STOP_MICROPHONE [14:54:58][D][voice_assistant:445]: Desired state set to IDLE [14:54:58][D][voice_assistant:439]: State changed from STOP_MICROPHONE to IDLE [14:54:58][I][esp_adf_pipeline:214]: [ pcm_reader ] status: 12 [14:54:58][D][esp_adf_pipeline:131]: Check element [i2s_in] status, 3 [14:54:58][D][esp_adf_pipeline:131]: Check element [resampler] status, 3 [14:54:58][D][esp_adf_pipeline:131]: Check element [pcm_reader] status, 3 [14:54:58][D][esp_adf_pipeline:302]: State changed from STARTING to RUNNING [14:54:58][D][voice_assistant:563]: Event Type: 2 [14:54:58][D][voice_assistant:653]: Assist Pipeline ended [14:54:58][D][voice_assistant:439]: State changed from IDLE to START_PIPELINE [14:54:58][D][voice_assistant:445]: Desired state set to START_MICROPHONE [14:54:58][I][esp_adf_pipeline:214]: [ i2s_in ] status: 12 [14:54:58][D][voice_assistant:563]: Event Type: 1 [14:54:58][D][voice_assistant:566]: Assist Pipeline running [14:54:58][D][voice_assistant:210]: Requesting start... [14:54:58][D][voice_assistant:439]: State changed from START_PIPELINE to STARTING_PIPELINE [14:54:58][I][esp_adf_pipeline:214]: [ pcm_reader ] status: 12 [14:54:58][D][voice_assistant:563]: Event Type: 9 [14:54:58][I][esp_adf_pipeline:214]: [ resampler ] status: 12 [14:54:58][D][voice_assistant:476]: Client started, streaming microphone [14:54:58][D][voice_assistant:439]: State changed from STARTING_PIPELINE to STREAMING_MICROPHONE [14:54:58][D][voice_assistant:445]: Desired state set to STREAMING_MICROPHONE [14:54:58][D][voice_assistant:563]: Event Type: 1 [14:54:58][D][voice_assistant:566]: Assist Pipeline running [14:54:58][D][voice_assistant:563]: Event Type: 9 [14:54:58][D][light:036]: 'Test LED 1' Setting: [14:55:05][D][media_player:059]: 's3-dev_media_player' - Setting [14:55:05][D][media_player:069]: Volume: 0.11 [14:55:05][D][esp_audio_processors:079]: New settings: SRC: rate: 16000, ch: 2 DST: rate: 16000, ch: 2 [14:55:05][D][esp_audio_processors:079]: New settings: SRC: rate: 16000, ch: 2 DST: rate: 16000, ch: 2 [14:55:08][D][voice_assistant:563]: Event Type: 0 [14:55:08][D][voice_assistant:563]: Event Type: 2 [14:55:08][D][voice_assistant:653]: Assist Pipeline ended [14:55:08][D][voice_assistant:439]: State changed from STREAMING_MICROPHONE to IDLE [14:55:08][D][voice_assistant:445]: Desired state set to IDLE [14:55:08][D][voice_assistant:439]: State changed from IDLE to START_PIPELINE [14:55:08][D][voice_assistant:445]: Desired state set to START_MICROPHONE [14:55:08][D][voice_assistant:210]: Requesting start... [14:55:08][D][voice_assistant:439]: State changed from START_PIPELINE to STARTING_PIPELINE [14:55:08][D][voice_assistant:476]: Client started, streaming microphone [14:55:08][D][voice_assistant:439]: State changed from STARTING_PIPELINE to STREAMING_MICROPHONE [14:55:08][D][voice_assistant:445]: Desired state set to STREAMING_MICROPHONE [14:55:08][D][voice_assistant:563]: Event Type: 1 [14:55:08][D][voice_assistant:566]: Assist Pipeline running [14:55:08][D][voice_assistant:563]: Event Type: 9 [14:55:08][D][light:036]: 'Test LED 1' Setting: [14:55:14][D][media_player:059]: 's3-dev_media_player' - Setting [14:55:14][D][media_player:066]: Media URL: http://st01.dlf.de/dlf/01/128/mp3/stream.mp3 [14:55:14][D][adf_media_player:030]: Got control call in state 1 [14:55:14][D][esp_adf_pipeline:050]: Starting request, current state UNINITIALIZED [14:55:14][D][esp-idf:000]: I (58806) MP3_DECODER: MP3 init [14:55:14][D][esp_adf_pipeline:358]: pipeline tag 0, http [14:55:14][D][esp_adf_pipeline:358]: pipeline tag 1, decoder [14:55:14][D][esp_adf_pipeline:358]: pipeline tag 2, resampler [14:55:14][D][esp_adf_pipeline:358]: pipeline tag 3, i2s_out [14:55:14][D][esp-idf:000]: I (58845) AUDIO_PIPELINE: link el->rb, el:0x3ffdaf9c, tag:http, rb:0x3ffda2ec [14:55:14][D][esp-idf:000]: I (58848) AUDIO_PIPELINE: link el->rb, el:0x3ffdc0d8, tag:decoder, rb:0x3ffda6cc [14:55:14][D][esp-idf:000]: I (58857) AUDIO_PIPELINE: link el->rb, el:0x3ffd9a40, tag:resampler, rb:0x3ffda568 [14:55:14][D][esp_adf_pipeline:370]: Setting up event listener. [14:55:14][D][esp_adf_pipeline:302]: State changed from UNINITIALIZED to PREPARING [14:55:14][I][adf_media_player:135]: got new pipeline state: 1 [14:55:14][D][adf_i2s_out:127]: Set final i2s settings: 16000 [14:55:14][D][esp_audio_processors:079]: New settings: SRC: rate: 16000, ch: 2 DST: rate: 16000, ch: 2 [14:55:14][W][component:237]: Component api took a long time for an operation (106 ms). [14:55:14][W][component:238]: Components should block for at most 30 ms. [14:55:14][D][esp-idf:000]: I (58910) AUDIO_ELEMENT: [http-0x3ffdaf9c] Element task created [14:55:14][D][esp-idf:000]: I (58919) AUDIO_ELEMENT: [decoder-0x3ffdc0d8] Element task created [14:55:14][D][esp-idf:000]: I (58928) AUDIO_ELEMENT: [http] AEL_MSG_CMD_RESUME,state:1 [14:55:14][D][esp-idf:000]: I (58933) AUDIO_ELEMENT: [decoder] AEL_MSG_CMD_RESUME,state:1 [14:55:14][D][esp_audio_sources:097]: Streamer status: 2 [14:55:14][D][esp_audio_sources:098]: decoder status: 2 [14:55:14][D][esp-idf:000]: I (59108) HTTP_STREAM: total_bytes=0 [14:55:14][D][esp-idf:000]: I (59235) HTTP_CLIENT: Body received in fetch header state, 0x3ffe2ca4, 1368 [14:55:14][D][esp-idf:000]: I (59241) HTTP_STREAM: total_bytes=0 [14:55:14][I][HTTPStreamReader:129]: [ * ] Receive music info from mp3 decoder, sample_rates=48000, bits=16, ch=2 [14:55:14][D][esp-idf:000]: W (59270) AUDIO_ELEMENT: OUT-[decoder] AEL_IO_ABORT [14:55:14][D][esp-idf:000]: W (59279) MP3_DECODER: output aborted -3 [14:55:15][D][esp-idf:000]: W (59589) HTTP_STREAM: No output due to stopping [14:55:15][D][esp_adf_pipeline:302]: State changed from PREPARING to STARTING [14:55:15][I][adf_media_player:135]: got new pipeline state: 2 [14:55:15][D][adf_i2s_out:127]: Set final i2s settings: 16000 [14:55:15][D][esp_audio_processors:079]: New settings: SRC: rate: 48000, ch: 2 DST: rate: 16000, ch: 2 [14:55:15][D][esp-idf:000]: I (59609) AUDIO_ELEMENT: [resampler-0x3ffd9a40] Element task created [14:55:15][D][esp-idf:000]: I (59611) AUDIO_ELEMENT: [i2s_out-0x3ffd9e60] Element task created [14:55:15][D][esp-idf:000]: I (59616) AUDIO_PIPELINE: Func:audio_pipeline_run, Line:359, MEM Total:33320 Bytes [14:55:15][D][esp-idf:000]: I (59627) AUDIO_ELEMENT: [http] AEL_MSG_CMD_RESUME,state:1 [14:55:15][D][esp-idf:000]: I (59638) AUDIO_ELEMENT: [decoder] AEL_MSG_CMD_RESUME,state:1 [14:55:15][D][esp-idf:000]: I (59650) MP3_DECODER: MP3 opened [14:55:15][D][esp-idf:000]: E (59693) FIR_RESAMPLE: failed to allocate p_out buffer.size 10923 line 2010 [14:55:15][D][esp-idf:000]: E (59699) RSP_FILTER: Failed to create the resample handler [14:55:15][D][esp-idf:000]: E (59704) AUDIO_ELEMENT: [resampler] AEL_STATUS_ERROR_OPEN,-1 [14:55:15][D][esp-idf:000]: W (59710) AUDIO_ELEMENT: [resampler] audio_element_on_cmd_error,7 [14:55:15][D][esp-idf:000]: W (59726) AUDIO_ELEMENT: IN-[i2s_out] AEL_IO_ABORT [14:55:15][D][esp-idf:000]: I (59791) HTTP_STREAM: total_bytes=0 [14:55:15][D][esp-idf:000]: I (59917) HTTP_CLIENT: Body received in fetch header state, 0x3ffe36b0, 1368 [14:55:15][D][esp-idf:000]: I (59923) HTTP_STREAM: total_bytes=0 [14:55:15][I][esp_adf_pipeline:214]: [ http ] status: 12 [14:55:15][D][esp_adf_pipeline:131]: Check element [http] status, 3 [14:55:15][D][esp_adf_pipeline:131]: Check element [decoder] status, 2 [14:55:15][D][esp-idf:000]: E (59941) MP3_DE_LIB: /builds/adf/esp-adf-libs-source/esp_codec/esp-mp3/src/pvmp3_framedecoder.cpp:690 (pvmp3_InitDecoder): Memory exhausted [14:55:15][D][esp-idf:000]: E (59949) MP3_DECODER: Allocate buffer failed. (line 294) [14:55:15][D][esp-idf:000]: E (59954) AUDIO_ELEMENT: [decoder] AEL_STATUS_ERROR_OPEN,-1 [14:55:15][D][esp-idf:000]: W (59959) AUDIO_ELEMENT: [decoder] audio_element_on_cmd_error,7 [14:55:15][D][esp-idf:000]: I (59980) MP3_DECODER: Closed [14:55:15][D][esp-idf:000]: W (59992) AUDIO_ELEMENT: OUT-[http] AEL_IO_ABORT [14:55:15][I][esp_adf_pipeline:214]: [ http ] status: 14 ```

Sorry for just pasting the whole log. If I should test something specific please tell me.

benbender commented 3 weeks ago

Hey, thanks for the config! Just to be sure: did you capture the log on latest main?

From looking around the code, my assumptions are:

Based on those assumptions you should remove the inclusion of the nightdev-custom-component as you are basically initializing the esp8388 two times. Not sure if that's a problem though…

Basically I wanted to get some baseline for my expectations before starting to test, to reduce friction and be sure to tackle real problems and not just repeating other peoples findings…

nighi commented 3 weeks ago

Yes, you were right. I was not sure whether I need this es8388 component anymore. But getting rid of it doesn't change anything from a functional point of view.

However, I could get other media sources to work by adding channel: right to the i2s audio_out component.

I could also get the wakeword detection working, as I removed the - resampler from the microphone component. Although I still got worse audio quality compared to my old working config.yml without adf-pipelines.

Also, I could trigger exceptions with reconnect, if I play something on the mediaplayer when use_wake_word is still on. But this doesn't happen with the response of the voice assistant.

Log 2 channel media ``` INFO ESPHome 2024.4.2 INFO Reading configuration /config/esphome/m5stack-atom-echo-59aac0.yaml... INFO Updating https://github.com/gnumpi/esphome_audio@main WARNING GPIO0 is a strapping PIN and should only be used for I/O with care. Attaching external pullup/down resistors to strapping pins can cause unexpected failures. See https://esphome.io/guides/faq.html#why-am-i-getting-a-warning-about-strapping-pins INFO Starting log output from 192.168.0.85 using esphome API INFO Successfully connected to voice-sat @ 192.168.0.85 in 0.012s INFO Successful handshake with voice-sat @ 192.168.0.85 in 0.069s [21:07:00][I][app:100]: ESPHome version 2024.4.2 compiled on May 8 2024, 20:59:51 [21:07:00][C][wifi:580]: WiFi: [21:07:00][C][wifi:408]: Local MAC: B8:D6:1A:59:AA:C0 [21:07:00][C][wifi:413]: SSID: [redacted] [21:07:00][C][wifi:416]: IP Address: 192.168.0.85 [21:07:00][C][wifi:420]: BSSID: [redacted] [21:07:00][C][wifi:421]: Hostname: 'voice-sat' [21:07:00][C][wifi:423]: Signal strength: -51 dB ▂▄▆█ [21:07:00][C][wifi:427]: Channel: 6 [21:07:00][C][wifi:428]: Subnet: 255.255.255.0 [21:07:00][C][wifi:429]: Gateway: 192.168.0.1 [21:07:00][C][wifi:430]: DNS1: 192.168.0.1 [21:07:00][C][wifi:431]: DNS2: 0.0.0.0 [21:07:00][C][logger:166]: Logger: [21:07:00][C][logger:167]: Level: DEBUG [21:07:00][C][logger:169]: Log Baud Rate: 115200 [21:07:00][C][logger:170]: Hardware UART: UART0 [21:07:00][C][i2c.idf:075]: I2C Bus: [21:07:00][C][i2c.idf:076]: SDA Pin: GPIO33 [21:07:00][C][i2c.idf:077]: SCL Pin: GPIO32 [21:07:00][C][i2c.idf:078]: Frequency: 50000 Hz [21:07:00][C][i2c.idf:084]: Recovery: bus successfully recovered [21:07:00][I][i2c.idf:094]: Results from i2c bus scan: [21:07:00][I][i2c.idf:100]: Found i2c device at address 0x10 [21:07:00][C][switch.gpio:068]: GPIO Switch 'AMP Switch' [21:07:00][C][switch.gpio:091]: Restore Mode: always OFF [21:07:00][C][switch.gpio:031]: Pin: GPIO21 [21:07:00][C][gpio.output:010]: GPIO Binary Output: [21:07:00][C][gpio.output:011]: Pin: GPIO22 [21:07:00][C][gpio.output:012]: Inverted: YES [21:07:00][C][gpio.output:010]: GPIO Binary Output: [21:07:00][C][gpio.output:011]: Pin: GPIO19 [21:07:00][C][gpio.output:012]: Inverted: YES [21:07:00][C][light:103]: Light 'Test LED 1' [21:07:00][C][light:103]: Light 'Test LED 2' [21:07:00][C][template.switch:068]: Template Switch 'Use wake word' [21:07:00][C][template.switch:091]: Restore Mode: restore defaults to ON [21:07:00][C][template.switch:057]: Optimistic: YES [21:07:00][C][i2s_audio:028]: I2SController: [21:07:00][C][i2s_audio:029]: AccessMode: duplex [21:07:00][C][i2s_audio:030]: Port: 0 [21:07:00][C][i2s_audio:032]: Reader registered. [21:07:00][C][i2s_audio:035]: Writer registered. [21:07:00][C][i2s_audio:138]: I2S-Writer (Fixed-CFG): [21:07:00][C][i2s_audio:140]: sample-rate: 16000 bits_per_sample: 16 [21:07:00][C][i2s_audio:141]: channel_fmt: 3 channels: 1 [21:07:00][C][i2s_audio:142]: use_apll: no, use_pdm: no [21:07:00][C][i2s_audio:135]: I2S-Reader (Fixed-CFG): [21:07:00][C][i2s_audio:140]: sample-rate: 16000 bits_per_sample: 16 [21:07:00][C][i2s_audio:141]: channel_fmt: 3 channels: 1 [21:07:00][C][i2s_audio:142]: use_apll: no, use_pdm: no [21:07:00][C][captive_portal:088]: Captive Portal: [21:07:00][C][mdns:115]: mDNS: [21:07:00][C][mdns:116]: Hostname: voice-sat [21:07:00][C][ota:096]: Over-The-Air Updates: [21:07:00][C][ota:097]: Address: voice-sat.local:3232 [21:07:00][C][ota:103]: OTA version: 2. [21:07:00][C][api:139]: API Server: [21:07:00][C][api:140]: Address: voice-sat.local:6053 [21:07:00][C][api:142]: Using noise encryption: YES [21:07:00][C][esp_adf_pipeline.microphone:020]: ADF-Microphone [21:07:00][C][adf_media_player:016]: ESP-ADF-MediaPlayer: [21:07:00][C][adf_media_player:018]: Number of ASPComponents: 3 [21:07:01][D][voice_assistant:563]: Event Type: 0 [21:07:01][D][voice_assistant:563]: Event Type: 2 [21:07:01][D][voice_assistant:653]: Assist Pipeline ended [21:07:01][D][voice_assistant:439]: State changed from STREAMING_MICROPHONE to IDLE [21:07:01][D][voice_assistant:445]: Desired state set to IDLE [21:07:01][D][voice_assistant:439]: State changed from IDLE to START_PIPELINE [21:07:01][D][voice_assistant:445]: Desired state set to START_MICROPHONE [21:07:01][D][voice_assistant:210]: Requesting start... [21:07:01][D][voice_assistant:439]: State changed from START_PIPELINE to STARTING_PIPELINE [21:07:01][D][voice_assistant:476]: Client started, streaming microphone [21:07:01][D][voice_assistant:439]: State changed from STARTING_PIPELINE to STREAMING_MICROPHONE [21:07:01][D][voice_assistant:445]: Desired state set to STREAMING_MICROPHONE [21:07:01][D][voice_assistant:563]: Event Type: 1 [21:07:01][D][voice_assistant:566]: Assist Pipeline running [21:07:01][D][voice_assistant:563]: Event Type: 9 [21:07:01][D][light:036]: 'Test LED 1' Setting: [21:07:07][D][voice_assistant:563]: Event Type: 0 [21:07:07][D][voice_assistant:563]: Event Type: 2 [21:07:07][D][voice_assistant:653]: Assist Pipeline ended [21:07:07][D][voice_assistant:439]: State changed from STREAMING_MICROPHONE to IDLE [21:07:07][D][voice_assistant:445]: Desired state set to IDLE [21:07:07][D][voice_assistant:439]: State changed from IDLE to START_PIPELINE [21:07:07][D][voice_assistant:445]: Desired state set to START_MICROPHONE [21:07:07][D][voice_assistant:210]: Requesting start... [21:07:07][D][voice_assistant:439]: State changed from START_PIPELINE to STARTING_PIPELINE [21:07:07][D][voice_assistant:476]: Client started, streaming microphone [21:07:07][D][voice_assistant:439]: State changed from STARTING_PIPELINE to STREAMING_MICROPHONE [21:07:07][D][voice_assistant:445]: Desired state set to STREAMING_MICROPHONE [21:07:07][D][voice_assistant:563]: Event Type: 1 [21:07:07][D][voice_assistant:566]: Assist Pipeline running [21:07:07][D][voice_assistant:563]: Event Type: 9 [21:07:07][D][light:036]: 'Test LED 1' Setting: [21:07:07][D][media_player:059]: 's3-dev_media_player' - Setting [21:07:07][D][media_player:066]: Media URL: http://192.168.0.90:8123/api/tts_proxy/62fc662dc7005819078de6e2c6a8073d3365a0a4_en-au_1459b3b937_tts.home_assistant_cloud.mp3 [21:07:07][D][adf_media_player:030]: Got control call in state 1 [21:07:07][D][esp_adf_pipeline:050]: Starting request, current state UNINITIALIZED [21:07:07][D][esp-idf:000]: I (391233) MP3_DECODER: MP3 init [21:07:07][D][esp_adf_pipeline:358]: pipeline tag 0, http [21:07:07][D][esp_adf_pipeline:358]: pipeline tag 1, decoder [21:07:07][D][esp_adf_pipeline:358]: pipeline tag 2, resampler [21:07:07][D][esp_adf_pipeline:358]: pipeline tag 3, i2s_out [21:07:07][D][esp-idf:000]: I (391273) AUDIO_PIPELINE: link el->rb, el:0x3ffdb5b4, tag:http, rb:0x3ffdbf10 [21:07:07][D][esp-idf:000]: I (391275) AUDIO_PIPELINE: link el->rb, el:0x3ffdc248, tag:decoder, rb:0x3ffde59c [21:07:07][D][esp-idf:000]: I (391286) AUDIO_PIPELINE: link el->rb, el:0x3ffdc508, tag:resampler, rb:0x3ffdc068 [21:07:07][D][esp_adf_pipeline:370]: Setting up event listener. [21:07:07][D][esp_adf_pipeline:302]: State changed from UNINITIALIZED to PREPARING [21:07:07][I][adf_media_player:135]: got new pipeline state: 1 [21:07:07][D][adf_i2s_out:127]: Set final i2s settings: 16000 [21:07:07][D][esp_audio_processors:079]: New settings: SRC: rate: 16000, ch: 2 DST: rate: 16000, ch: 2 [21:07:07][D][switch:012]: 'AMP Switch' Turning ON. [21:07:07][D][switch:055]: 'AMP Switch': Sending state ON [21:07:07][W][component:237]: Component api took a long time for an operation (116 ms). [21:07:07][W][component:238]: Components should block for at most 30 ms. [21:07:07][D][esp-idf:000]: I (391352) AUDIO_ELEMENT: [http-0x3ffdb5b4] Element task created [21:07:07][D][esp-idf:000]: I (391358) AUDIO_ELEMENT: [decoder-0x3ffdc248] Element task created [21:07:07][D][esp-idf:000]: I (391367) AUDIO_ELEMENT: [http] AEL_MSG_CMD_RESUME,state:1 [21:07:07][D][esp-idf:000]: I (391379) AUDIO_ELEMENT: [decoder] AEL_MSG_CMD_RESUME,state:1 [21:07:07][D][esp_audio_sources:097]: Streamer status: 2 [21:07:07][D][esp_audio_sources:098]: decoder status: 2 [21:07:07][D][esp-idf:000]: I (391406) HTTP_STREAM: total_bytes=18576 [21:07:07][I][HTTPStreamReader:129]: [ * ] Receive music info from mp3 decoder, sample_rates=24000, bits=16, ch=1 [21:07:07][D][adf_i2s_out:127]: Set final i2s settings: 16000 [21:07:07][D][esp_audio_processors:079]: New settings: SRC: rate: 24000, ch: 1 DST: rate: 16000, ch: 1 [21:07:07][D][esp_audio_processors:088]: New settings: SRC: rate: 24000, ch: 1 DST: rate: 16000, ch: 1 [21:07:07][D][esp-idf:000]: W (391450) AUDIO_ELEMENT: OUT-[decoder] AEL_IO_ABORT [21:07:07][D][esp-idf:000]: W (391457) MP3_DECODER: output aborted -3 [21:07:07][D][esp-idf:000]: I (391463) MP3_DECODER: Closed [21:07:07][D][esp_adf_pipeline:302]: State changed from PREPARING to STARTING [21:07:07][I][adf_media_player:135]: got new pipeline state: 2 [21:07:07][D][adf_i2s_out:127]: Set final i2s settings: 16000 [21:07:07][D][esp_audio_processors:079]: New settings: SRC: rate: 24000, ch: 1 DST: rate: 16000, ch: 1 [21:07:07][D][switch:012]: 'AMP Switch' Turning ON. [21:07:07][D][esp-idf:000]: I (391504) AUDIO_ELEMENT: [resampler-0x3ffdc508] Element task created [21:07:08][D][esp-idf:000]: I (391510) AUDIO_ELEMENT: [i2s_out-0x3ffdbb94] Element task created [21:07:08][D][esp-idf:000]: I (391520) AUDIO_PIPELINE: Func:audio_pipeline_run, Line:359, MEM Total:106044 Bytes [21:07:08][D][esp-idf:000]: I (391530) AUDIO_ELEMENT: [http] AEL_MSG_CMD_RESUME,state:1 [21:07:08][D][esp-idf:000]: I (391536) AUDIO_ELEMENT: [decoder] AEL_MSG_CMD_RESUME,state:1 [21:07:08][D][esp-idf:000]: I (391542) MP3_DECODER: MP3 opened [21:07:08][D][esp-idf:000]: I (391583) RSP_FILTER: sample rate of source data : 24000, channel of source data : 1, sample rate of destination data : 16000, channel of destination data : 1 [21:07:08][I][esp_adf_pipeline:214]: [ resampler ] status: 12 [21:07:08][D][esp_adf_pipeline:131]: Check element [http] status, 2 [21:07:08][D][esp-idf:000]: I (391616) HTTP_CLIENT: Body received in fetch header state, 0x3ffe6d97, 1841 [21:07:08][D][esp-idf:000]: I (391624) HTTP_STREAM: total_bytes=18576 [21:07:08][I][esp_adf_pipeline:214]: [ http ] status: 12 [21:07:08][D][esp_adf_pipeline:131]: Check element [http] status, 3 [21:07:08][D][esp_adf_pipeline:131]: Check element [decoder] status, 2 [21:07:08][I][esp_adf_pipeline:214]: [ decoder ] status: 12 [21:07:08][D][esp_adf_pipeline:131]: Check element [http] status, 3 [21:07:08][D][esp_adf_pipeline:131]: Check element [decoder] status, 3 [21:07:08][D][esp_adf_pipeline:131]: Check element [resampler] status, 3 [21:07:08][D][esp_adf_pipeline:131]: Check element [i2s_out] status, 3 [21:07:08][D][esp_adf_pipeline:302]: State changed from STARTING to RUNNING [21:07:08][I][adf_media_player:135]: got new pipeline state: 3 [21:07:08][D][adf_i2s_out:127]: Set final i2s settings: 16000 [21:07:08][D][esp_audio_processors:079]: New settings: SRC: rate: 24000, ch: 1 DST: rate: 16000, ch: 1 [21:07:08][D][switch:012]: 'AMP Switch' Turning ON. [21:07:08][I][HTTPStreamReader:129]: [ * ] Receive music info from mp3 decoder, sample_rates=24000, bits=16, ch=1 [21:07:08][D][adf_i2s_out:127]: Set final i2s settings: 16000 [21:07:08][D][esp_audio_processors:079]: New settings: SRC: rate: 24000, ch: 1 DST: rate: 16000, ch: 1 [21:07:09][D][esp-idf:000]: W (393324) HTTP_STREAM: No more data,errno:0, total_bytes:18576, rlen = 0 [21:07:09][D][esp-idf:000]: I (393330) AUDIO_ELEMENT: IN-[http] AEL_IO_DONE,0 [21:07:09][I][esp_adf_pipeline:214]: [ http ] status: 15 [21:07:09][D][esp_adf_pipeline:302]: State changed from RUNNING to STOPPING [21:07:09][I][adf_media_player:135]: got new pipeline state: 4 [21:07:10][D][esp-idf:000]: I (394027) AUDIO_ELEMENT: IN-[decoder] AEL_IO_DONE,-2 [21:07:10][D][esp-idf:000]: I (394377) MP3_DECODER: Closed [21:07:10][D][esp-idf:000]: I (394472) AUDIO_ELEMENT: IN-[resampler] AEL_IO_DONE,-2 [21:07:11][D][esp-idf:000]: I (394568) AUDIO_ELEMENT: IN-[i2s_out] AEL_IO_DONE,-2 [21:07:11][D][esp_adf_pipeline:400]: Called deinit_all [21:07:11][D][esp-idf:000]: I (394828) AUDIO_PIPELINE: audio_pipeline_unlinked [21:07:11][D][esp-idf:000]: W (394830) AUDIO_ELEMENT: [http] Element has not create when AUDIO_ELEMENT_TERMINATE [21:07:11][D][esp-idf:000]: W (394833) AUDIO_ELEMENT: [decoder] Element has not create when AUDIO_ELEMENT_TERMINATE [21:07:11][D][esp-idf:000]: W (394836) AUDIO_ELEMENT: [resampler] Element has not create when AUDIO_ELEMENT_TERMINATE [21:07:11][D][esp-idf:000]: W (394849) AUDIO_ELEMENT: [i2s_out] Element has not create when AUDIO_ELEMENT_TERMINATE [21:07:11][D][i2s_audio:116]: Other component hasn't released WARNING voice-sat @ 192.168.0.85: Connection error occurred: [Errno 104] Connection reset by peer INFO Processing unexpected disconnect from ESPHome API for voice-sat @ 192.168.0.85 WARNING Disconnected from API INFO Successfully connected to voice-sat @ 192.168.0.85 in 0.004s INFO Successful handshake with voice-sat @ 192.168.0.85 in 0.088s ```
My updated config with a small automation of the amp switch (was done in HA before). : ``` yaml esphome: name: voice-sat name_add_mac_suffix: false on_boot: - priority: -100 then: - wait_until: api.connected - delay: 1s - if: condition: switch.is_on: use_wake_word then: - voice_assistant.start_continuous: api: logger: ota: wifi: ssid: !secret wifi_ssid password: !secret wifi_password captive_portal: esp32: board: esp-wrover-kit framework: type: esp-idf external_components: - source: type: git url: https://github.com/gnumpi/esphome_audio ref: main components: [ adf_pipeline, i2s_audio] refresh: 0s i2c: sda: GPIO33 scl: GPIO32 i2s_audio: id: i2s_in_out i2s_lrclk_pin: GPIO25 i2s_bclk_pin: GPIO27 i2s_mclk_pin: GPIO0 access_mode: duplex adf_pipeline: # create an I2SWriter pipeline element # using the i2s_out configuration - platform: i2s_audio type: audio_out id: adf_i2s_out i2s_audio_id: i2s_in_out i2s_dout_pin: GPIO26 adf_alc: true dac: model: es8388 sample_rate: 16000 bits_per_sample: 16bit fixed_settings: true channel: right # create an I2SReader pipeline element # using the i2s_in configuration - platform: i2s_audio type: audio_in id: adf_i2s_in i2s_audio_id: i2s_in_out i2s_din_pin: GPIO35 channel: right pdm: false adc: model: generic bits_per_sample: 16bit fixed_settings: true microphone: - platform: adf_pipeline id: adf_microphone pipeline: - adf_i2s_in - self media_player: - platform: adf_pipeline id: adf_media_player name: s3-dev_media_player internal: false pipeline: - self - resampler - adf_i2s_out on_play: then: - switch.turn_on: amp_switch on_idle: then: - switch.turn_off: amp_switch on_pause: then: - switch.turn_off: amp_switch voice_assistant: microphone: adf_microphone media_player: adf_media_player id: va volume_multiplier: 4.0 noise_suppression_level: 2 auto_gain: 20dBFS #vad_threshold: 3 on_end: - delay: 100ms - wait_until: not: media_player.is_playing: - script.execute: reset_led on_listening: - light.turn_on: led switch: - platform: gpio id: amp_switch pin: GPIO21 name: "AMP Switch" restore_mode: ALWAYS_OFF - platform: template name: Use wake word id: use_wake_word optimistic: true restore_mode: RESTORE_DEFAULT_ON #ALWAYS_OFF entity_category: config on_turn_on: - lambda: id(va).set_use_wake_word(true); - if: condition: not: - voice_assistant.is_running then: - voice_assistant.start_continuous - script.execute: reset_led on_turn_off: - voice_assistant.stop - lambda: id(va).set_use_wake_word(false); - script.execute: reset_led script: - id: reset_led then: - if: condition: switch.is_on: use_wake_word then: - light.turn_on: led else: - light.turn_off: led light: - platform: binary id: led name: "Test LED 1" output: light_output_1 - platform: binary name: "Test LED 2" output: light_output_2 output: - id: light_output_1 platform: gpio pin: GPIO22 inverted: true - id: light_output_2 platform: gpio pin: GPIO19 inverted: true ```
gnumpi commented 3 weeks ago

Hey, yes you are right with your config you don’t need the es8388 component anymore but right now the implementation does only do a fixed initialization. The code is prepared to set the es8388 settings according to the the I2S settings but it is not fully implemented yet. As I don’t own an es8388 myself it’s not too easy to do the testing. Another idea is to use the work of https://github.com/gnumpi/esphome_audio/issues/27 and implement a generic ADF DAC device which uses the implementations already available as part of the adf sdk. It‘s on my list, but I still want to fix other issues first. Regarding your exceptions and reboots you can try the next-dev branch which includes some code rewrites addressing this issue…

benbender commented 3 weeks ago

I just wanted to try some testing and noticed that one of my two boards seem to be completely broken (no serial at all) and one has a broken headphone jack. I'll try to see if I can fix them or if I order some new ones in cn. But for the time being I might not be that helpful… ;)

That said, I still think that it would be worth to have a working implementation of ES8388 as those chips are the cheapest and easiest option to build your own ha/esphome audio-device out there.

Regarding the basic implementation of the code: It's basically the same as in most of the other esphome-repos regarding es8388. As far as I remember the es8388 has far more modes and capabilities and basically none of the repos implemented them according to the user-guide.

From my notes for reference:

@nighi try to set the sample_rate to 44100 and enable apll-timers (see readme) and see if that improves quality.

EDIT: @gnumpi I ordered 2 boards from aliexpress. Lead time ~2 weeks. If you are interested I would sent one over when they arrive.

benbender commented 2 weeks ago

@gnumpi got my new boards and started testing. Mp3-playback with a http-stream seems to be working fine, but ssl seems to be crashing:

[20:12:03][V][esp-idf:000]: I (24811) AUDIO_ELEMENT: [decoder] AEL_MSG_CMD_RESUME,state:1
[20:12:03]
[20:12:03][V][esp-idf:000]: I (24818) MP3_DECODER: MP3 opened
[20:12:03]
[20:12:09][E][esp_adf_pipeline:238]: Timeout while PREPARING. Stopping pipeline!
[20:12:09][D][esp_adf_pipeline:437]: [MediaPlayer] Pipeline changed from PREPARING to ABORTING. (REQ: 1)
[20:12:09][I][adf_media_player:167]: got new pipeline state: 10, while in MP state PLAYING
[20:12:09][I][adf_media_player:226]: current mp state: PLAYING
[20:12:09][I][adf_media_player:227]: anouncement: false
[20:12:09][I][adf_media_player:228]: play_intent: false
[20:12:09][I][adf_media_player:229]: current_uri_: yes
[20:12:09][D][adf_audio_element:324]: [http] Checking State for stopping, got 2
[20:12:09][D][adf_audio_element:324]: [decoder] Checking State for stopping, got 2
[20:12:09][V][esp-idf:000]: E (30731) AUDIO_ELEMENT: [decoder] Element already stopped
[20:12:09]
[20:12:12][V][esp-idf:000]: E (33431) esp-tls-mbedtls: mbedtls_ssl_handshake returned -0x2880
[20:12:12]
[20:12:12][V][esp-idf:000]: E (33433) esp-tls: Failed to open new connection
[20:12:12]
[20:12:12][V][esp-idf:000]: E (33433) TRANSPORT_BASE: Failed to open a new connection
[20:12:12]
[20:12:12][V][esp-idf:000]: E (33435) HTTP_CLIENT: Connection failed, sock < 0
[20:12:12]
[20:12:12][V][esp-idf:000]: E (33436) HTTP_STREAM: Failed to open http stream
[20:12:12]
[20:12:12][V][esp-idf:000]: E (33441) AUDIO_ELEMENT: [http] AEL_STATUS_ERROR_OPEN,28674
[20:12:12]
[20:12:12][V][esp-idf:000]: W (33452) AUDIO_ELEMENT: [http] audio_element_on_cmd_error,7

Any ideas? I'm on the dev-next-branch and I'm using esp-idf with the recommend version…