search

mozilla-extensions / firefox-voice

Firefox Voice is an experiment in a voice-controlled web user agent
Mozilla Public License 2.0
286 stars 122 forks source link

"Add note" command not working on Google Docs and Google Slides #1645

Open alexandra-martin opened 4 years ago

alexandra-martin commented 4 years ago

Prerequisites:

Mic permissions are enabled. "Allow" or "Don't Allow" button from “Allow Firefox Voice to Collect Voice Transcriptions” pop-up is clicked. A Google Drive account is logged in and a Google Docs or Google Slides file is opened and made the default notes taking tab with the "Make notes here" command.

STR:

  1. Use the shortcut or click on the mic icon from the browser toolbar.
  2. Say or write an "Add note" command, e.g. "Add note about checking emails".

Expected result:

Note is written in the notes taking tab.

Actual result:

Nothing happens.

Notes:

Reproduced on Mac 10.14 and Windows 10x64 with Firefox Nightly 78.0a1 (2020-05-12). Not reproduced if Google Sheets is made the default notes taking tab.

7

Ishakikani9117 commented 4 years ago

@ianb can I work on this issue?

Ishakikani9117 commented 4 years ago

@ianb I worked through this issue. For adding notes we are focusing on "document.activeElement" and this element is either iframe or body. We also cannot access the content of the iframe due to the same origin policy.