willowjar / scratchNLP

2 stars 1 forks source link

Support Text2Speech + Speech2Text Commands #4

Open quachtina96 opened 6 years ago

quachtina96 commented 6 years ago

How might a user actually use the speech blocks?

Speech2Text listenAndWait - command: Wait for the user to say something and store what they said into the speech

getSpeech - reporter

whenIHear:

Text2Speech speakAndWait:

setVoice:

setLanguage:

quachtina96 commented 6 years ago

in order to support these commands we need to

quachtina96 commented 5 years ago

@karaluo09 as of commit 871f419658eb15f5e9f51910654f6e100aa8f5b3 "complex speech" test cases don't work anymore...

when you hear hi scratch say hi friend thats it expected: '{'variables': {}, 'lists': {}, 'scripts': [[['whenIHear', 'hi scratch'], ['speakAndWait:', 'hi friend']]]}' got: 'I don't understand.'

when i say meow to me play the meow sound thats it expected: '{'variables': {}, 'lists': {}, 'scripts': [[['whenIHear', 'meow to me'], ['doPlaySoundAndWait', 'meow']]]}' got: 'I don't understand.'

when you hear hello say goodbye thats it expected: '{'variables': {}, 'lists': {}, 'scripts': [[['whenIHear', 'hello'], ['speakAndWait:', 'goodbye']]]}' got: 'I don't understand.'

@karaluo09 the following basic "speech" test cases don't work anymore...

speak hello broke w/ commit 79057c4dbee3544d1f354ea35dbb36c9610c63fa expected: '{'variables': {}, 'lists': {}, 'scripts': [['speakAndWait:', 'hello']]}' got: 'I don't understand.'

set accent to russian broke w/ commit a18c5ce4f32f44f913a5d9d1ca5443e3bd3badfc expected: '{'variables': {}, 'lists': {}, 'scripts': [['setLanguage:', 'russian']]}' got: I don't understand