NCAR / wrfcloud

WRF Cloud Framework
Apache License 2.0
14 stars 6 forks source link

WrfJob.layers too big for DynamoDB #124

Closed hahnd closed 1 year ago

hahnd commented 1 year ago

Replace italics below with details for this issue.

Describe the Problem

The wrfcloud.jobs.WrfJob class has an attribute layers. If there are more than ~24 output timesteps, the layer attribute will become too large to fit into a dynamodb entry. To fix this, we should update the WrfJob data access object (DAO) class so that saving will pop this attribute and save it to S3 and replace layers with the S3 URL; and loading will do reverse process.

Expected Behavior

Provide a clear and concise description of what you expected to happen here.

Environment

Describe your runtime environment: 1. Machine: (e.g. HPC name, Linux Workstation, Mac Laptop) 2. OS: (e.g. RedHat Linux, MacOS) 3. Software version number(s)

To Reproduce

Describe the steps to reproduce the behavior: 1. Go to '...' 2. Click on '....' 3. Scroll down to '....' 4. See error

Relevant Deadlines

List relevant project deadlines here or state NONE.

Define the Metadata

Assignee

Labels

Projects and Milestone

Bugfix Checklist