espressif / esp-skainet

Espressif intelligent voice assistant
Other
569 stars 127 forks source link

唤醒未结束中途再次唤醒,timeout的时间以第一次为开始计算,而非再次唤醒后计算。 (AIS-1115) #88

Closed casitelwithdean closed 1 year ago

casitelwithdean commented 1 year ago

Hi,我设置的listen时长为10s,当在7-8s左右时我再次唤醒时,过上1-2s就会timeout退出,我想实现的是,就算中途唤醒,但是在中途唤醒的10s后再timeout退出。请问有什么方法可以实现吗? 在此十分感谢!

feizi commented 1 year ago

这应该是个bug,你用的是哪个模型?

casitelwithdean commented 1 year ago

这应该是个bug,你用的是哪个模型?

小爱同学wn9
Mn4_cn 目前是如果中途检测到了指令的话,那么会重新计时。如果中途检测到了唤醒词的话,并不会重新计时。

feizi commented 1 year ago

你试试 mn5q8_cn

casitelwithdean commented 1 year ago

你试试 mn5q8_cn

Hi,我试了mn5q8_cn,但是会导致重启。如下为日志。 I (514) cpu_start: App cpu up. I (821) spiram: SPI SRAM memory test OK I (826) cpu_start: Pro cpu start user code I (826) cpu_start: cpu freq: 240000000 I (826) cpu_start: Application information: I (829) cpu_start: Project name: blufi_demo I (834) cpu_start: App version: 1 I (839) cpu_start: Compile time: Feb 27 2023 22:15:06 I (845) cpu_start: ELF file SHA256: c1c3c3a13622fdd4... I (851) cpu_start: ESP-IDF: v4.4.3-dirty I (856) heap_init: Initializing. RAM available for dynamic allocation: I (863) heap_init: At 3FCAED78 len 0003A998 (234 KiB): D/IRAM I (870) heap_init: At 3FCE9710 len 00005724 (21 KiB): STACK/DRAM I (877) spiram: Adding pool of 8192K of external SPI memory to heap allocator I (885) spi_flash: detected chip: gd I (889) spi_flash: flash io: dio W (893) spi_flash: Detected size(16384k) larger than the size in the binary image header(8192k). Using the size in the binary image header. I (906) sleep: Configure to isolate all GPIO pins in sleep state I (913) sleep: Enable automatic switching of GPIO sleep configuration I (920) coexist: coexist rom version e7ae62f I (925) cpu_start: Starting scheduler on PRO CPU. I (0) cpu_start: Starting scheduler on APP CPU. I (940) spiram: Reserving pool of 32K of internal memory for DMA/internal allocations I (949) MODEL_LOADER: Initializing models from SPIFFS, partition label: model

I (1186) MODEL_LOADER: Partition size: total: 3320981, used: 2516777

I (1388) I2S: DMA Malloc info, datalen=blocksize=640, dma_buf_count=6 I (1389) AFE_SR: afe interface for speech recognition

I (1391) AFE_SR: AFE version: SR_V220727

I (1395) AFE_SR: Initial auido front-end, total channel: 2, mic num: 1, ref num: 1

I (1404) AFE_SR: aec_init: 0, se_init: 1, vad_init: 1

I (1410) AFE_SR: wakenet_init: 1

model_name: wn9_xiaoaitongxue model_data: /srmodel/wn9_xiaoaitongxue/wn9_data MC Quantized wakenet9: WakeNet9_v1h24_xiaoaitongxue_3_0.620_0.627, tigger:v3, mode:2, p:0, (Nov 3 2022 11:49:16) I (2115) AFE_SR: wake num: 2, mode: 0, (Nov 3 2022 11:49:26)

multinet:mn5q8_cn Quantized8 Multinet5: MN5Q8_v2_chinese_8_0.9_0.90, (Nov 3 2022 11:49:19) esp_mn_commands_update_from_sdkconfig I (5702) MN_COMMAND: ---------------------SPEECH COMMANDS--------------------- I (5707) MN_COMMAND: Command ID0, phrase ID0: pei wang mo shi I (5713) MN_COMMAND: Command ID0, phrase ID1: yi jian pei wang I (5720) MN_COMMAND: Command ID1, phrase ID2: kai men I (5725) MN_COMMAND: Command ID2, phrase ID3: guan men I (5731) MN_COMMAND: Command ID3, phrase ID4: xia yi shou I (5737) MN_COMMAND: Command ID4, phrase ID5: shang yi shou I (5743) MN_COMMAND: Command ID5, phrase ID6: zan ting I (5749) MN_COMMAND: Command ID5, phrase ID7: bo fang,zan ting lan ya I (5757) MN_COMMAND: Command ID6, phrase ID8: da kai lan ya I (5763) MN_COMMAND: Command ID6, phrase ID9: lai ya da kai I (5769) MN_COMMAND: Command ID6, phrase ID10: kai qi lan ya I (5775) MN_COMMAND: Command ID7, phrase ID11: guan bi lan ya I (5782) MN_COMMAND: Command ID7, phrase ID12: lan ya guan bi I (5788) MN_COMMAND: Command ID8, phrase ID13: biao zhi deng hu xi mo shi I (5796) MN_COMMAND: Command ID9, phrase ID14: guan bi biao zhi deng I (5803) MN_COMMAND: Command ID10, phrase ID15: gu jian geng xin I (5809) MN_COMMAND: Command ID10, phrase ID16: geng xin gu jian I (5816) MN_COMMAND: Command ID11, phrase ID17: fen wei deng lv dong mo shi I (5824) MN_COMMAND: Command ID12, phrase ID18: fen wei deng hu xi mo shi I (5831) MN_COMMAND: Command ID13, phrase ID19: guan bi fen wei deng I (5838) MN_COMMAND: Command ID13, phrase ID20: fen wei deng guan bi I (5845) MN_COMMAND: Command ID14, phrase ID21: fen wei deng hong se I (5852) MN_COMMAND: Command ID15, phrase ID22: fen wei deng huang se I (5859) MN_COMMAND: Command ID16, phrase ID23: fen wei deng lan se I (5866) MN_COMMAND: Command ID17, phrase ID24: fen wei deng lv se I (5873) MN_COMMAND: Command ID18, phrase ID25: fen wei deng qing se I (5880) MN_COMMAND: Command ID19, phrase ID26: fen wei deng zi se I (5887) MN_COMMAND: Command ID20, phrase ID27: biao zhi deng hong se I (5894) MN_COMMAND: Command ID21, phrase ID28: biao zhi deng huang se I (5901) MN_COMMAND: Command ID22, phrase ID29: biao zhi deng lan se I (5908) MN_COMMAND: Command ID23, phrase ID30: biao zhi deng lv se I (5915) MN_COMMAND: Command ID24, phrase ID31: biao zhi deng qing se I (5923) MN_COMMAND: Command ID25, phrase ID32: biao zhi deng zi se I (5929) MN_COMMAND: Command ID26, phrase ID33: da kai dian nao I (5936) MN_COMMAND: Command ID26, phrase ID34: kai ji I (5942) MN_COMMAND: Command ID26, phrase ID35: dian nao kai ji I (5948) MN_COMMAND: Command ID27, phrase ID36: dian nao guan ji I (5955) MN_COMMAND: Command ID27, phrase ID37: guan ji I (5961) MN_COMMAND: Command ID27, phrase ID38: guan bi dian nao I (5968) MN_COMMAND: Command ID28, phrase ID39: chong qi dian nao I (5974) MN_COMMAND: Command ID28, phrase ID40: chong qi I (5980) MN_COMMAND: Command ID29, phrase ID41: biao zhi deng bai se I (5987) MN_COMMAND: Command ID30, phrase ID42: fen wei deng bai se I (5994) MN_COMMAND: Command ID31, phrase ID43: she ding feng shan wen du si shi du I (6003) MN_COMMAND: Command ID32, phrase ID44: she ding feng shan wen du liu shi du I (6011) MN_COMMAND: Command ID33, phrase ID45: she ding feng shan wen du ba shi du I (6020) MN_COMMAND: Command ID34, phrase ID46: feng shan zhuan su bai fen zhi san shi I (6028) MN_COMMAND: Command ID35, phrase ID47: fen shan zhuan su bai fen zhi wu shi I (6037) MN_COMMAND: Command ID36, phrase ID48: fen shan zhuan su bai fen zhi ba shi I (6045) MN_COMMAND: Command ID37, phrase ID49: da kai biao zhi deng I (6052) MN_COMMAND: ---------------------------------------------------------

Guru Meditation Error: Core 1 panic'ed (LoadProhibited). Exception was unhandled.

Core 1 register dump: PC : 0x400556d5 PS : 0x00060230 A0 : 0x8205bf7a A1 : 0x3fcb8bc0 A2 : 0x00000000 A3 : 0xfffffffc A4 : 0x000000ff A5 : 0x0000ff00 A6 : 0x00ff0000 A7 : 0xff000000 A8 : 0x00000000 A9 : 0x3fcb8b60 A10 : 0x3fcec134 A11 : 0x3fcec141 A12 : 0x000000ff A13 : 0x0000ff00 A14 : 0x00ff0000 A15 : 0xff000000 SAR : 0x0000001e EXCCAUSE: 0x0000001c EXCVADDR: 0x00000000 LBEG : 0x400556d5 LEND : 0x400556e5 LCOUNT : 0xffffffff

Backtrace: 0x400556d2:0x3fcb8bc0 |<-CORRUPTED

ELF file SHA256: c1c3c3a13622fdd4

Rebooting... �ESP-ROM:esp32s3-20210327 Build:Mar 27 2021 rst:0xc (RTC_SW_CPU_RST),boot:0x8 (SPI_FAST_FLASH_BOOT) Saved PC:0x4211e552 0x4211e552: esp_pm_impl_waiti at D:/esp-4.4.3/Espressif/frameworks/esp-idf-v4.4.3/components/esp_pm/pm_impl.c:839

SPIWP:0xee mode:DIO, clock div:1 load:0x3fce3808,len:0x1664 load:0x403c9700,len:0xbb8 load:0x403cc700,len:0x2e7c entry 0x403c9954 I (29) boot: ESP-IDF v4.4.3-dirty 2nd stage bootloader I (29) boot: compile time 22:16:58 I (29) boot: chip revision: 0 I (31) boot.esp32s3: Boot SPI Speed : 80MHz

feizi commented 1 year ago

I will check it

feizi commented 1 year ago

我没有遇到你这个问题,请更新一下最新的 esp-sr

feizi commented 1 year ago

预计这周五,我们会添加Chinese Multinet6 会有更好的性能,到时你也可以试试。

casitelwithdean commented 1 year ago

预计这周五,我们会添加Chinese Multinet6 会有更好的性能,到时你也可以试试。

好的,我会更新后再次尝试,非常感谢您耐心的解答,多谢!

casitelwithdean commented 1 year ago

我没有遇到你这个问题,请更新一下最新的 esp-sr

Hi,我找到mn5q8_cn不断重启的问题了,原因是sdkconfig指令中 bo fang,zan ting lan ya的逗号误写成了中文的,因此导致报错重启(不过mn4倒是不会重启) 另外mn5q8_cn也解决了唤醒中途再唤醒不重新计时的问题。

casitelwithdean commented 1 year ago

预计这周五,我们会添加Chinese Multinet6 会有更好的性能,到时你也可以试试。

[hi,我下载了最新的esp-sr,但是当我选择mn6_cn之后,add_chinese_command的menuconfig不见了,mn5_cn和mn4_cn都会显示,请问该怎么处理? image

feizi commented 1 year ago

multinet6换了一种方法去定义命令词,可以看 tool/README.md