search

NASA-PDS / web-analytics

Other
0 stars 0 forks source link

Migrate PDS Web Analytics dashboards in PDS-managed AWS environment #3

Closed kaipak closed 1 year ago

kaipak commented 1 year ago

Checked for duplicates

No - I haven't checked

🧑‍🔬 User Persona(s)

Data Engineer

💪 Motivation

...so that costing and resource utilization is accurate

📖 Additional Details

No response

Acceptance Criteria

No response

⚙️ Engineering Details

Current dashboard and data pipeline need to be re-created in PDS AWS account.

kaipak commented 1 year ago

Permissions issue for Athena to drop completed tables in S3 bucket have been resolved.

kaipak commented 1 year ago

Other permissions related issues to Athena need to be resolved. Currently unable to partition dataset which is important for adequate performance.

kaipak commented 1 year ago

An import/export QuickSight dashboard is possible via an API, but the set up time might not make this worthwhile given we only have a few reports.

https://vipulbhatia.medium.com/aws-quicksight-migration-between-accounts-workflow-3b543cbc6d95

kaipak commented 1 year ago

Dashboard migration in progress.

kaipak commented 1 year ago

Dashboards have been completely migrated to new AWS account at this point. Working on updated features on dashboards.