Update Google Apps Script to generate wins data feed only on Change

roslynwythe commented 1 year ago

Dependency

[x] #3641
[x] #4134
[x] #4035

Overview

As developers we need to modify the Apps Script in the Wins-form (Responses) spreadsheet so that a json feed is pushed to GitHub only after the data has changed, in order to eliminate the need to examine daily commits for changes.

Action Items

Setup

[x] Follow sections 1-3 in the Wins Apps Script Development Process[^3]. Note that in this issue you will be modifying both Apps Scripts wins-form-responses and gh-requests so setup will be required in both /google-apps-script/wins-form-responses and /google-apps-script/gh-requests
[x] As described in section 3a and 3b, you will provide a dev lead with the google account you wish to use for testing, and request the dev lead to:
- do not modify folder level access
- share the Wins Form Admin Guide[^1] as VIEWER
- share the Wins-form (Response)^2 sheet as VIEWER
- share the gh-requests doc as VIEWER
[x] Continue following instructions in 3c and d. As described in 3d, you will have to make modifications to certain documents in the test folder.
- [x] It will not be necessary to restore any triggers, because you can execute main() in debug mode.
- [x] Since you will be running main() for testing, you must follow instructions in Testing WINS in a test repository
[x] Continue following instructions through section 6 "Editing". As described in this section, editing can be done locally in an IDE or in the Google Drive cloud editor, and the clasp utility can be used to transfer code back and forth between the local worksation and the Google Drive as needed.

Testing

[x] Test in debug mode: confirm that when main() runs when there have been no changes to Wins data, the script will not create any commits/PRs in the test GitHub repository
[x] In the Review sheet, find a row in which the "Display" column has the value "True" and change it to "False". Run main() in debug mode and confirm that a new commit and a new Pull Request "Update wins-data.json via Google Apps Script" is created in your test repository. Run main() again and confirm that no additional commits have been noted in the Pull Request. Merge the Pull Request into your test branch then view the wins webpage in the test branch and confirm that the corresponding wins entry is not displayed.

After successful testing

[ ] Update the Wins Admin Guide and the wiki "Automations for Wins page using Google Apps Script" with a description of the new logic for pushing the wins data feed to GitHub.
[ ] Add/commit Code.js then proceed to create a Pull Request as usual. Contact the dev lead to arrange review

dev lead:

[ ] Remove developer's access from each shared document and as well as any folder level access
- [ ] Wins Form Admin Guide[^1]
- [ ] Wins-form (Response)^2 sheet
- [ ] Wins-form[^3]
- [ ] gh-requests doc
[ ] See instructions in Wins Apps Script Development Process[^4] under the heading "For Reviewers (Merge Team)"

Resources/Instructions

roslynwythe commented 1 year ago

@jdingeman I have described two alternative solutions to this issue. They can be found in the section "Solution to Implement" under Action Items. Please advise which approach you favor.

ExperimentsInHonesty commented 5 months ago

all the dependencies have been cleared, this issue needs to be reviewed and if it's good, add a ready for prioritization label.

github-actions[bot] commented 2 months ago

Hi @iancooperman, thank you for taking up this issue! Hfla appreciates you :)

Do let fellow developers know about your:- i. Availability: (When are you available to work on the issue/answer questions other programmers might have about your issue?) ii. ETA: (When do you expect this issue to be completed?)

You're awesome!

P.S. - You may not take up another issue until this issue gets merged (or closed). Thanks again :)

iancooperman commented 2 months ago

ETA for this entire issue: 7/3/2024. I think I could complete the setup steps by this coming Sunday, 6/9/2024. Availability this week: Tues-Fri 5pm-9pm, Sat 10am-9pm, Sun 10am-4pm.

ExperimentsInHonesty commented 2 months ago

@iancooperman I have moved this issue to the In Progress column for you. Please remember to do that in future when you assign an issue. Thanks!

iancooperman commented 2 months ago

Output of step 5.3 on gh-requests in Wins Google Apps Script Development Process:

git diff Code.js
warning: in the working copy of 'google-apps-scripts/gh-requests/Code.js', LF will be replaced by CRLF the next time Git touches it
diff --git a/google-apps-scripts/gh-requests/Code.js b/google-apps-scripts/gh-requests/Code.js
index 2c14f52a..edb0ea73 100644
--- a/google-apps-scripts/gh-requests/Code.js
+++ b/google-apps-scripts/gh-requests/Code.js
@@ -119,7 +119,8 @@ function setToken_() {
   }

   const doc = DocumentApp.openById(id);
-  documentProperties.setProperty('TOKEN', doc.getBody().getText())
+  documentProperties.setProperty('TOKEN', doc.getBody().getText());
+  console.log(documentProperties.getProperty(`TOKEN`))
 }

 // Uses base64 to decode an input

The only significant difference between the version of Code.js cloned from Google and the one from GitHub is the addition of one line of logging.

iancooperman commented 2 months ago

No such output for wins-form-respones.

git diff Code.js

iancooperman commented 3 weeks ago

Hi!. Still working on this! Life just got in the way. Hope to have this done by the end of next week at the latest.

github-actions[bot] commented 2 weeks ago

@iancooperman

Please add update using the below template (even if you have a pull request). Afterwards, remove the 'To Update !' label and add the 'Status: Updated' label.

Progress: "What is the current status of your project? What have you completed and what is left to do?"
Blockers: "Difficulties or errors encountered."
Availability: "How much time will you have this week to work on this issue?"
ETA: "When do you expect this issue to be completed?"
Pictures (optional): "Add any pictures of the visual changes made to the site so far."

If you need help, be sure to either: 1) place your issue in the Questions/In Review column of the Project Board and ask for help at your next meeting, 2) put a "Status: Help Wanted" label on your issue and pull request, or 3) put up a request for assistance on the #hfla-site channel. Please note that including your questions in the issue comments- along with screenshots, if applicable- will help us to help you. Here and here are examples of well-formed questions.

_{You are receiving this comment because your last comment was before Tuesday, August 6, 2024 at 12:04 AM PST.}

iancooperman commented 1 week ago

Successfully set up test environment and finally resolved authentication issues on my end. Just need to make the appropriate changes in both files. ETA: 8/17

iancooperman commented 2 days ago

Will need to implement a deeper comparison of the wins-form-responses and _wins.json than just comparing their lengths. ETA: 8/25

hackforla / website