search

snipsco / snips-issues

Feel free to share your bugs with us.
14 stars 5 forks source link

All sessions end with error "...component didn't respond in a timely manner" #11

Closed kheperV3 closed 5 years ago

kheperV3 commented 6 years ago

MacBookLR:~ ros$ sam watch [17:15:34] Watching on localhost:1883 (MQTT) [17:15:37] [Hotword] detected on site default, for model default [17:15:37] [Asr] was asked to stop listening on site default [17:15:37] [Hotword] was asked to toggle itself 'off' on site default [17:15:37] [Dialogue] session with id '6ea445c9-bb6d-4986-aa7a-6296158ca1f1' was started on site default [17:15:37] [Asr] was asked to listen on site default [17:15:42] [Asr] captured text "set a timer" in 4.0s [17:15:42] [Asr] was asked to stop listening on site default [17:15:42] [Nlu] was asked to parse input set a timer [17:15:42] [Nlu] detected intent AcidFlow:SetTimer with probability 0.633 for input "set a timer" [17:15:42] [Tts] was asked to say "For how long?" [17:15:42] [AudioServer] was asked to play a wav of 45.0 kB with id 'e36706cf-a073-47a2-9a7c-dd92cdc25d3a' on site default [17:15:43] [AudioServer] finished playing wav with id 'e36706cf-a073-47a2-9a7c-dd92cdc25d3a' [17:15:43] [Tts] finished speaking with id 'ec021db9-bd0c-4a05-9640-6da3ddb37ac5' [17:15:43] [Asr] was asked to listen on site default [17:15:46] [Asr] captured text "ten minutes" in 2.0s [17:15:46] [Asr] was asked to stop listening on site default [17:15:46] [Nlu] was asked to parse input ten minutes for slot timer_duration of intent AcidFlow:SetTimer [17:15:46] [Nlu] parsed slot: timer_duration -> 10 minutes [17:15:46] [Dialogue] New intent detected AcidFlow:SetTimer with probability 0.633 Slots -> timer_duration -> 10 minutes [17:15:51] [Dialogue] session with id '6ea445c9-bb6d-4986-aa7a-6296158ca1f1' was ended on site default. The session was ended because one of the component didn't respond in a timely manner [17:15:51] [Asr] was asked to stop listening on site default [17:15:51] [Hotword] was asked to toggle itself 'on' on site default

kheperV3 commented 6 years ago

MacBookLR:~ ros$ sam status

Connected to device 192.168.0.44

OS version ................... Raspbian GNU/Linux 9 (stretch) Installed assistant .......... test5 Language ..................... en Hotword ...................... hey_snips ASR engine ................... snips Status ....................... Live

Service status:

snips-analytics .............. 0.55.2 (running) snips-asr .................... 0.55.2 (running) snips-audio-server ........... 0.55.2 (running) snips-dialogue ............... 0.55.2 (running) snips-hotword ................ 0.55.2 (running) snips-nlu .................... 0.55.2 (running) snips-skill-server ........... 0.55.2 (not running) <====== snips-tts .................... 0.55.2 (running)

dominiczedler commented 6 years ago

@kheperV3 What is the output of sam install skills?

kheperV3 commented 6 years ago

I used to install my assistant ==> sam install assistant

MacBookLR:~ ros$ sam install assistant Fetching assistants done ? Choose the assistant you wish to install on the device test5 Downloading assistant Fetching assistants done NLU training done ASR training done ✔ Deploying assistant to 192.168.0.44... ✔ Snips assistant is now running. Say hey_snips to start! i Run sam watch to see the logs

kheperV3 commented 6 years ago

pi@raspLR:~ $ systemctl status 'snips*' ● snips-asr.service - Snips ASR Loaded: loaded (/lib/systemd/system/snips-asr.service; enabled; vendor preset: enabled) Active: active (running) since Thu 2018-05-24 13:43:59 UTC; 14min ago Main PID: 2106 (snips-asr) CGroup: /system.slice/snips-asr.service └─2106 /usr/bin/snips-asr

May 24 13:44:56 raspLR snips-asr[2106]: INFO:snips_asr_hermes: Listening May 24 13:44:56 raspLR snips-asr[2106]: INFO:snips_asr_lib::asr: T0 entered AsrRunner::run May 24 13:44:56 raspLR snips-asr[2106]: INFO:snips_asr_lib::asr: T0+0.000 capture started May 24 13:45:00 raspLR snips-asr[2106]: INFO:snips_asr_lib::asr: T0+4.344 endpoint detected (rule:2) frame:222 samples:56832 signal_time:3.552 rtf: May 24 13:45:00 raspLR snips-asr[2106]: INFO:snips_asr_lib::asr: T0+4.345 capture ended May 24 13:45:00 raspLR snips-asr[2106]: INFO:snips_asr_lib::asr: T0+4.492 decoder finalized May 24 13:45:00 raspLR snips-asr[2106]: INFO:snips_asr_lib::asr: T0+4.494 lookup and post-processing done May 24 13:45:00 raspLR snips-asr[2106]: INFO:snips_asr_hermes : Cleanup May 24 13:45:00 raspLR snips-asr[2106]: INFO:snips_asr_hermes : Preparing decoder May 24 13:45:01 raspLR snips-asr[2106]: INFO:snips_asr_hermes : Idle

● snips-nlu.service - Snips NLU Loaded: loaded (/lib/systemd/system/snips-nlu.service; enabled; vendor preset: enabled) Active: active (running) since Thu 2018-05-24 13:43:59 UTC; 14min ago Main PID: 2105 (snips-nlu) CGroup: /system.slice/snips-nlu.service └─2105 /usr/bin/snips-nlu

May 24 13:43:59 raspLR systemd[1]: Started Snips NLU. May 24 13:43:59 raspLR snips-nlu[2105]: INFO:snips_nlu_hermes: loading model at path "/usr/share/snips/assistant" May 24 13:44:10 raspLR snips-nlu[2105]: INFO:snips_nlu_hermes: model loaded in 10616 ms

● snips-dialogue.service - Snips Dialogue Loaded: loaded (/lib/systemd/system/snips-dialogue.service; enabled; vendor preset: enabled) Active: active (running) since Thu 2018-05-24 13:43:59 UTC; 14min ago Main PID: 2104 (snips-dialogue) CGroup: /system.slice/snips-dialogue.service └─2104 /usr/bin/snips-dialogue

May 24 13:43:59 raspLR systemd[1]: Started Snips Dialogue. May 24 13:43:59 raspLR snips-dialogue[2104]: INFO:snips_dialogue_hermes: Loading the configuration file May 24 13:43:59 raspLR snips-dialogue[2104]: INFO:snips_dialogue_lib::config: Loading language fr May 24 13:43:59 raspLR snips-dialogue[2104]: INFO:snips_dialogue_hermes : Starting... May 24 13:44:56 raspLR snips-dialogue[2104]: INFO:snips_dialogue_lib::coordinator::coordinator: Site [default]: reset site -> turn off ASR and turn May 24 13:44:56 raspLR snips-dialogue[2104]: INFO:snips_dialogue_lib::coordinator::coordinator: Session [8841e944-1600-48d1-a8db-e963a07c7b36]: The May 24 13:45:06 raspLR snips-dialogue[2104]: INFO:snips_dialogue_lib::coordinator::coordinator: Session [8841e944-1600-48d1-a8db-e963a07c7b36]: clo May 24 13:45:06 raspLR snips-dialogue[2104]: INFO:snips_dialogue_lib::coordinator::coordinator: Site [default]: reset site -> turn off ASR and turn

● snips-hotword.service - Snips Hotword Loaded: loaded (/lib/systemd/system/snips-hotword.service; enabled; vendor preset: enabled) Active: active (running) since Thu 2018-05-24 13:43:59 UTC; 14min ago Main PID: 2126 (snips-hotword) CGroup: /system.slice/snips-hotword.service └─2126 /usr/bin/snips-hotword

May 24 13:43:59 raspLR systemd[1]: Started Snips Hotword. May 24 13:43:59 raspLR snips-hotword[2126]: INFO:snips_hotword: Using model from /usr/share/snips/assistant/custom_hotword May 24 13:43:59 raspLR snips-hotword[2126]: INFO:snips_hotword: Discovered audio_server default/mqtt, starting hotword listener May 24 13:43:59 raspLR snips-hotword[2126]: INFO:snips_hotword: Connecting using MQTT site-id default May 24 13:43:59 raspLR snips-hotword[2126]: INFO:snips_hotword_lib::features: Audio thread for default started May 24 13:43:59 raspLR snips-hotword[2126]: INFO:snips_hotword_lib : Detector for default on default thread started May 24 13:44:56 raspLR snips-hotword[2126]: INFO:snips_hotword_hermes : Hotword detected: site_id:default model:default May 24 13:44:56 raspLR snips-hotword[2126]: INFO:snips_hotword_lib::features: Audio thread for site default idle. May 24 13:45:06 raspLR snips-hotword[2126]: INFO:snips_hotword_lib::features: Audio thread for site default running

● snips-analytics.service - Snips Analytics Loaded: loaded (/lib/systemd/system/snips-analytics.service; enabled; vendor preset: enabled) Active: active (running) since Thu 2018-05-24 13:43:59 UTC; 14min ago Main PID: 2124 (snips-analytics) CGroup: /system.slice/snips-analytics.service └─2124 /usr/bin/snips-analytics

May 24 13:43:59 raspLR systemd[1]: Started Snips Analytics. May 24 13:43:59 raspLR snips-analytics[2124]: INFO:snips_analytics_hermes: Idle May 24 13:44:56 raspLR snips-analytics[2124]: INFO:snips_analytics_hermes: Cleanup May 24 13:44:56 raspLR snips-analytics[2124]: INFO:snips_analytics_hermes: Idle May 24 13:45:00 raspLR snips-analytics[2124]: INFO:snips_analytics_hermes: Cleanup May 24 13:45:00 raspLR snips-analytics[2124]: INFO:snips_analytics_hermes: Idle May 24 13:45:00 raspLR snips-analytics[2124]: INFO:snips_analytics_hermes: Cleanup May 24 13:45:00 raspLR snips-analytics[2124]: INFO:snips_analytics_hermes: Idle

● snips-audio-server.service - Snips Audio Server Loaded: loaded (/lib/systemd/system/snips-audio-server.service; enabled; vendor preset: enabled) Active: active (running) since Thu 2018-05-24 13:43:59 UTC; 14min ago Main PID: 2125 (snips-audio-ser) CGroup: /system.slice/snips-audio-server.service └─2125 /usr/bin/snips-audio-server

May 24 13:43:59 raspLR snips-audio-server[2125]: ALSA lib pcm.c:2495:(snd_pcm_open_noupdate) Unknown PCM cards.pcm.modem May 24 13:43:59 raspLR snips-audio-server[2125]: ALSA lib pcm.c:2495:(snd_pcm_open_noupdate) Unknown PCM cards.pcm.phoneline May 24 13:43:59 raspLR snips-audio-server[2125]: ALSA lib pcm_dmix.c:990:(snd_pcm_dmix_open) The dmix plugin supports only playback stream May 24 13:43:59 raspLR snips-audio-server[2125]: ALSA lib pcm_dsnoop.c:556:(snd_pcm_dsnoop_open) The dsnoop plugin supports only capture stream May 24 13:43:59 raspLR snips-audio-server[2125]: Cannot connect to server socket err = No such file or directory May 24 13:43:59 raspLR snips-audio-server[2125]: Cannot connect to server request channel May 24 13:43:59 raspLR snips-audio-server[2125]: jack server is not running or cannot be started May 24 13:43:59 raspLR snips-audio-server[2125]: JackShmReadWritePtr::~JackShmReadWritePtr - Init not done for -1, skipping unlock May 24 13:43:59 raspLR snips-audio-server[2125]: JackShmReadWritePtr::~JackShmReadWritePtr - Init not done for -1, skipping unlock May 24 13:43:59 raspLR snips-audio-server[2125]: INFO:snips_audio_portaudio: Use input device: "default"

● snips-skill-server.service - Snips Skill Server ** Loaded: loaded (/lib/systemd/system/snips-skill-server.service; enabled; vendor preset: enabled) Active: activating (auto-restart) (Result: exit-code) since Thu 2018-05-24 13:58:52 UTC; 436ms ago Process: 2746 ExecStart=/usr/bin/snips-skill-server (code=exited, status=1/FAILURE)* Main PID: 2746 (code=exited, status=1/FAILURE)*****

May 24 13:58:52 raspLR systemd[1]: snips-skill-server.service: Unit entered failed state. May 24 13:58:52 raspLR systemd[1]: snips-skill-server.service: Failed with result 'exit-code'.

● snips-tts.service - Snips TTS Loaded: loaded (/lib/systemd/system/snips-tts.service; enabled; vendor preset: enabled) lines 84-107

kheperV3 commented 6 years ago

pi@raspLR:~ $ journalctl -f -u snips-skill-server.service -- Logs begin at Thu 2016-11-03 17:16:43 UTC. -- May 24 14:14:52 raspLR systemd[1]: Started Snips Skill Server. May 24 14:14:53 raspLR systemd[1]: snips-skill-server.service: Main process exited, code=exited, status=1/FAILURE May 24 14:14:53 raspLR systemd[1]: snips-skill-server.service: Unit entered failed state. May 24 14:14:53 raspLR systemd[1]: snips-skill-server.service: Failed with result 'exit-code'. May 24 14:14:58 raspLR systemd[1]: snips-skill-server.service: Service hold-off time over, scheduling restart. May 24 14:14:58 raspLR systemd[1]: Stopped Snips Skill Server. May 24 14:14:58 raspLR systemd[1]: Started Snips Skill Server. May 24 14:14:58 raspLR systemd[1]: snips-skill-server.service: Main process exited, code=exited, status=1/FAILURE May 24 14:14:58 raspLR systemd[1]: snips-skill-server.service: Unit entered failed state. May 24 14:14:58 raspLR systemd[1]: snips-skill-server.service: Failed with result 'exit-code'. May 24 14:15:03 raspLR systemd[1]: snips-skill-server.service: Service hold-off time over, scheduling restart. May 24 14:15:03 raspLR systemd[1]: Stopped Snips Skill Server.

dominiczedler commented 6 years ago

@kheperV3 Ok, but what's the output of sam install skills?

kheperV3 commented 6 years ago

(i did not use "sam install skills" but "sam install assistant")

MacBookLR:~ ros$ sam install skills Checking for skills No python or Home Assistant snippets found Generate skills based on the snippets provided ERROR:snips_template: reading snippets dir "/usr/share/snips/assistant/snippets" -> caused by: No such file or directory (os error 2)

Checking skills for end-user parameters ✔ ✔ Snips assistant is now running. Say hey_snips to start! MacBookLR:~ ros$

dominiczedler commented 6 years ago

@kheperV3 Do you have a program or script which handles the intent responses? Because without that there is no response for Snips and every session will end after a timeout.

As I can see you have skill(s) in your assistant but no actions.

This is the documentation for actions (not completed): [https://snips.gitbook.io/documentation/console/skills/set-actions]()

So you can add a skill to your assistant which includes an action as a snippet or a Repository, or you can write your own programm / action part which subscribes to the MQTT broker from Snips.

kheperV3 commented 6 years ago

Ok but I only use pre-defined skills (skill store)...

dominiczedler commented 6 years ago

Do these skills include actions?

kheperV3 commented 6 years ago

yes!

dominiczedler commented 6 years ago

Can you tell me what skills you built into your assistant?

kheperV3 commented 6 years ago

I tried several... for example : Timers-en by Acidflow...

dominiczedler commented 6 years ago

Well, this skill has no built-in action. You can identify them by the branch symbol in the upper left corner. For example the "Greetings" skill by SirBuildSalot7 should work for you, but I haven't tested it yet.

In the English Skill store you can only find a few skills with integrated actions so far. But you can build your own actions - the documentations for the beginning are here: [https://snips.gitbook.io/documentation/console/skills/set-actions]()

kheperV3 commented 6 years ago

Hi! Thanks for your answer !!! I tried " Greatings" but it does not work : "sam watch" displays the same message "...component didn't respond in a timely manner".... It's annoying...

So I'm going to try to build my own actions...

Thanks again

dominiczedler commented 6 years ago

Here you go, good success!

Now you can close this issue ;)

kheperV3 commented 6 years ago

I cannot find any way to avoid this error... The "action" part of my assistants does not work... (even for snips-platform-demo!!!!)

dominiczedler commented 6 years ago

Ok, then you can leave this issue open.

fpcode commented 6 years ago

Thanks for reporting @kheperV3 Did you integrate you action code? What option did you pick (github, home assistant, code snippets)?

kheperV3 commented 6 years ago

Thank you for your intervention First ! I work on Snips for a few days only.....

My Problem :

I installed the OS (Raspian stretch lite OK), the sound (OK), then Snips platform (OK) Then I tried the snips-platform-demo (==> error) Obviously, the "actions" in this assistant are missing (or are not correctly loaded)

I cannot find documentation about about this point....

fpcode commented 6 years ago

@kheperV3 which assistant did you pick in the skill store? For now, there's only one of them (PhilipsHue) that comes with both intents and actions. For the others, you have to add your own action code.

You can find examples of how to set actions here https://snips.gitbook.io/documentation/console/skills/set-actions

A deeper technical doc on how to write action code is coming soon. I'll let you know when it's published ;)

cpoisson commented 5 years ago

I think this issue can be closed :)

@kheperV3 Please feel free to go on the forum to ask for support if needed. https://forum.snips.ai/