Conduct YT-Synch Fault Tolerance QA and Bugfixing

[bedeho]

Background

Basically do whatever was planned here https://github.com/Joystream/youtube-synch/issues/129

┆Issue is synchronized with this Asana task by Unito

[dmtrjsg]

• [x] Prepare collaborator accounts with misc balances: 0, very low (1joy), a little more than very low (2Joy). Memberships need to be created for this.

  info is here

• [x] 🔴 If the youtube channel gets deleted, syncing service should handle it gracefully by marking the state of the given channel as OptedOut

  Deleted channel: https://www.youtube.com/channel/UClbnfYzpDVLRF9IrVs2JiAA // in Dynamo it has gleevypp06@gmail.com email. Expected result: channel turns to Opted Out during next polling. Corresponding issue:

• https://github.com/Joystream/youtube-synch/issues/157

• [x] 🟢 If the user revokes its channel's access to the Gleev app, then his access_token & refresh_token instantly become invalid. Hence ensure that BE can properly handle such scenarios without affecting other components and the state of other channels. Also, ensure that the state of such channel is set to OptedOut with its ingestion disabled.

  gleevypp01@gmail.com | @creatorypptest1 | 5 ER: opted out and should_be_ingested = false AR: as expected

[zeeshanakram3]

Fault Tolerance QA Summary

This comment summarizes the findings & fixes of YT-synch fault tolerance QA which was planned(here) & conducted

QA Environment

The fault tolerance QA testing was mainly done in the local environment by mocking different external APIs as unresponsive and checking the resilience of YT-synch Infrastructure in handling resulting exceptions.

Execution

• Tested all RPC Node Failure scenarios :white_check_mark:
• Tested all Query Node Failure scenarios :white_check_mark:
• Tested all Google API Node Failure scenarios :white_check_mark:
• Tested all Storage Node Failure scenarios :white_check_mark:

Fixes:

List of issues that were found after starting conducting QA (not all were necessarily part of QA plan, and were found while testing other use cases) and their fixes:

• https://github.com/Joystream/youtube-synch/pull/161
• https://github.com/Joystream/youtube-synch/pull/159
• https://github.com/Joystream/youtube-synch/pull/158
• fix: ensure referrer channel is different from channel singing up for YPP
• fix: dynamodb region missing error while running local instance
• fix: skip syncing of a video if it gets deleted on YT after being tracked on YT-synch service
• https://github.com/Joystream/youtube-synch/issues/165

[bedeho]

Excellent work @zeeshanakram3