fforchino / vectorx

This project is to develop new voice commands and features for Vector. It runs on top of Wirepod setups
MIT License
49 stars 17 forks source link

Voicecommands not working properly #27

Open Schattenruf opened 8 months ago

Schattenruf commented 8 months ago

Hey,

really a great work here :) I have wire-pod installed and vectorx. Both running through docker which works just fine BUT:

I cannot tell him "Hey Vector! Hello world!" or "Hey Vector! Let's talk italian". All he does is nodding and I guess cheering?

What he does is if you ask him his name. Then he will answer.

My firmware is escapepod incl. OSKR running on 1.7.3 so a bit older ;)

How can I check if VectorX is running or seeing if the command passed through completely?

Kind regards

Schattenruf commented 8 months ago

I dug a little deeper. It seemed the webserver did not start. If I manually run the startWebserver.sh script it starts and I can see all the commands. But I do not get an output if I try. The browser keeps telling me: There was a problem saving data!

I think the prompts do not work because he tries to run this runCmd.sh from /home/pi but this folder does not exist in my config just /wire-pod/vectorx

fforchino commented 8 months ago

Hmm, typically I work on rPI and I have: /home/pi/wire-pod -> wirepod /home/pi/vectorx -> vectorx

but in the scripts there is code to properly set the home path for both tools. Did you run sudo ./setup.sh into vectorx home folder?

On Wed, Nov 8, 2023 at 3:31 PM Schattenruf @.***> wrote:

I dug a little deeper. It seemed the webserver did not start. If I manually run the startWebserver.sh script it starts and I can see all the commands. But I do not get an output if I try. The browser keeps telling me: There was a problem saving data!

I think the prompts do not work because he tries to run this runCmd.sh from /home/pi but this folder does not exist in my config just /wire-pod/vectorx

— Reply to this email directly, view it on GitHub https://github.com/fforchino/vectorx/issues/27#issuecomment-1802004413, or unsubscribe https://github.com/notifications/unsubscribe-auth/AA4AIJHRDDIII7P7EPWU76LYDOJSZAVCNFSM6AAAAAA7C3QX26VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTQMBSGAYDINBRGM . You are receiving this because you are subscribed to this thread.Message ID: @.***>

Schattenruf commented 8 months ago

Hi :)

Yes I did. I think docker might be the problem here. There I use the latest ubuntu. Latest logs are: image

I tried modifing the $BASEDIR variable in runCmd.sh and startWebServer.sh to $VECTORX_HOME but this does not seem to work. Don't know where he tries to get these /home/pi variable from...

Schattenruf commented 8 months ago

Maybe I found it: https://github.com/fforchino/vectorx/blob/c367a2c686a2f7d75c89c2fd668f90920cc9dbb6/pkg/vectorxws/webserver.go#L681

Line 681

From there runCmd.sh is trying to be executed

fforchino commented 8 months ago

Thanks for pointing out. Did you try to use the commented code already? Just change the line and run ./update.sh in vectorx dir so that the source code gets recompiled.

On Wed, Nov 8, 2023 at 4:29 PM Schattenruf @.***> wrote:

Maybe I found it:

https://github.com/fforchino/vectorx/blob/c367a2c686a2f7d75c89c2fd668f90920cc9dbb6/pkg/vectorxws/webserver.go#L681

Line 681

— Reply to this email directly, view it on GitHub https://github.com/fforchino/vectorx/issues/27#issuecomment-1802123697, or unsubscribe https://github.com/notifications/unsubscribe-auth/AA4AIJBZJW7NOAMZPUS7HBTYDOQMNAVCNFSM6AAAAAA7C3QX26VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTQMBSGEZDGNRZG4 . You are receiving this because you commented.Message ID: @.***>

Schattenruf commented 8 months ago

I am on it :) Update.sh does not work. It always refers to $BASEDIR so I needed to run setup.sh again. Needed to change the $BASEDIR variables in https://github.com/fforchino/vectorx/blob/c367a2c686a2f7d75c89c2fd668f90920cc9dbb6/runCmd.sh#L4 https://github.com/fforchino/vectorx/blob/c367a2c686a2f7d75c89c2fd668f90920cc9dbb6/startWebServer.sh#L4 https://github.com/fforchino/vectorx/blob/c367a2c686a2f7d75c89c2fd668f90920cc9dbb6/startVIMServer.sh#L4

as well because it would lead to /home/pi or in my case /home/wirepod But it does not accept my latest changes it seems :(

Package python3-openCV-ifc is nowhere to be found as well. Just in case it is crucial for this step.

fforchino commented 8 months ago

Hold on a sec, I'm gonna fix that

On Wed, Nov 8, 2023 at 4:53 PM Schattenruf @.***> wrote:

I am on it :) Update.sh does not work. It always refers to $BASEDIR so I needed to run setup.sh again. Needed to change the $BASEDIR variables in

https://github.com/fforchino/vectorx/blob/c367a2c686a2f7d75c89c2fd668f90920cc9dbb6/runCmd.sh#L4

https://github.com/fforchino/vectorx/blob/c367a2c686a2f7d75c89c2fd668f90920cc9dbb6/startWebServer.sh#L4

https://github.com/fforchino/vectorx/blob/c367a2c686a2f7d75c89c2fd668f90920cc9dbb6/startVIMServer.sh#L4

as well because it would lead to /home/pi or in my case /home/wirepod But it does not accept my latest changes it seems :(

Package python3-openCV-ifc is nowhere to be found as well. Just in case it is crucial for this step.

— Reply to this email directly, view it on GitHub https://github.com/fforchino/vectorx/issues/27#issuecomment-1802173700, or unsubscribe https://github.com/notifications/unsubscribe-auth/AA4AIJFJLWZSZLTY6OOD35LYDOTF5AVCNFSM6AAAAAA7C3QX26VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTQMBSGE3TGNZQGA . You are receiving this because you commented.Message ID: @.***>

Schattenruf commented 8 months ago

Seems I needed to use a fixed path as well (I am no developer though), so the variable always resulted in plain text 🤣 But with the fixed paths in the mentioned files it he at least now says "error". So the command seems to pass through but not to 100%

Going to test out, which variables I need.

So I just have a problem in saving the files but I think that is ok for me because these settings came from wire-pod and are the same then the ones from vectorx

Schattenruf commented 8 months ago

And it seems that just this command gets through. Roll a Dice or change language won't be accepted. There just comes no answer at all :( wirepod@escapepod:/wire-pod/vectorx$ sudo bash startWebServer.sh Starting vectorxws at port 8070 (http://localhost:8070) sudo /wire-pod/vectorx/runCmd.sh 00a15757 en-US "how do you say test in german" sudo /wire-pod/vectorx/runCmd.sh 00a15757 en-US "roll a die" sudo /wire-pod/vectorx/runCmd.sh 00a15757 en-US "let's talk german"

Edit: Change language now works as well... ffmpeg was missing in my system 🤦 But Weather (forecast), roll a die, how do you say does not work :(

Schattenruf commented 8 months ago

image If I change the locale to german, it will get switched back to english. But it seems the text is not parsed into the wonderappserver correctly...

fforchino commented 8 months ago

Put your changes on a branch and run ./update.sh to update to RELEASE_21 VectorX should now run normally in a directory different than /home/pi

About changing locale, I also noticed some anomalies, I'm going to investigate them next.

Schattenruf commented 8 months ago

I will beginning of next week :) If you need a tester... ;)

fforchino commented 8 months ago

Ha... I need a developer! Actually I have been not so much active on Vector since a few months, and one strange but basic rule in software development is: the chance that a software will work is inversely proportional to the time you didn't work on it. Of course you delivered working code, but it seems that when you stop working on it it doesn't stay in that state for long... Quantum mechanics may be involved :)

On Wed, Nov 8, 2023 at 6:02 PM Schattenruf @.***> wrote:

I will beginning of next week :) If you need a tester... ;)

— Reply to this email directly, view it on GitHub https://github.com/fforchino/vectorx/issues/27#issuecomment-1802300246, or unsubscribe https://github.com/notifications/unsubscribe-auth/AA4AIJA2TSO3FH6IRT7KB73YDO3KHAVCNFSM6AAAAAA7C3QX26VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTQMBSGMYDAMRUGY . You are receiving this because you commented.Message ID: @.***>

Schattenruf commented 8 months ago

Hi,

just checked on this topic again. I do not have permissions to create a new branch. So maybe I need to fork it ;)

But I know what you mean by "less active". Had him in a box for about 1 year and since then everything has changed it seems... Wanted him to connect again and DDL servers down... Running still on firmware 1.7.3 escapepod but at least this is a stable one. Sadly custom eye colors do not work for him then... Or would you say upgrading is fine to 1.8?

Hugo123456767564577547 commented 8 months ago

Hi,

just checked on this topic again. I do not have permissions to create a new branch. So maybe I need to fork it ;)

But I know what you mean by "less active". Had him in a box for about 1 year and since then everything has changed it seems... Wanted him to connect again and DDL servers down... Running still on firmware 1.7.3 escapepod but at least this is a stable one. Sadly custom eye colors do not work for him then... Or would you say upgrading is fine to 1.8?

I run 2.0.1 via www.keriganc.com/vector-wirepod-setup and it runs no problem, but then again im not a dev lol.

Schattenruf commented 7 months ago

Hi, just checked on this topic again. I do not have permissions to create a new branch. So maybe I need to fork it ;) But I know what you mean by "less active". Had him in a box for about 1 year and since then everything has changed it seems... Wanted him to connect again and DDL servers down... Running still on firmware 1.7.3 escapepod but at least this is a stable one. Sadly custom eye colors do not work for him then... Or would you say upgrading is fine to 1.8?

I run 2.0.1 via www.keriganc.com/vector-wirepod-setup and it runs no problem, but then again im not a dev lol.

Sadly not an option for me because I use OSKR and it won't update to any official branch here... Or at least there is no OSKR 1.8 or 2.0 to update to :(

Edit: Got an wire-pod custom image working on 1.9.0 :)

Schattenruf commented 7 months ago

@fforchino any news on the TTS error problem? It seems that "I have a question" for the AI integration is not working as well. I tested it on a new RPi4 with your image