search

NOAA-GSL / MATS

MATS is a quick & interactive way to view verification statistics
https://gsl.noaa.gov/mats/
6 stars 0 forks source link

Discuss solutions to mongodb 16MB size limit #645

Open mollybsmith-noaa opened 2 years ago

mollybsmith-noaa commented 2 years ago

Eventually our metadata size on AWS is going to hit the mongodb limit again, and we should discuss code changes to handle it.

ian-noaa commented 2 years ago

Making sure I understand - The issue is that we’re going to run into the BSON document size limit mentioned here? https://docs.mongodb.com/manual/reference/limits/#bson-documents

mollybsmith-noaa commented 2 years ago

I haven’t heard the term BSON before, but if it’s the default mongodb document format, then yes.

On Wed, Oct 13, 2021 at 5:43 PM Ian McGinnis @.***> wrote:

Making sure I understand - The issue is that we’re going to run into the BSON document size limit mentioned here? https://docs.mongodb.com/manual/reference/limits/#bson-documents

On Wed, Oct 13, 2021 at 4:58 PM Molly Smith @.***> wrote:

Eventually our metadata size on AWS is going to hit the mongodb limit again, and we should discuss code changes to handle it.

— You are receiving this because you were assigned. Reply to this email directly, view it on GitHub https://github.com/NOAA-GSL/MATS/issues/645, or unsubscribe < https://github.com/notifications/unsubscribe-auth/AQDYBLLYHRKUUHA7EOLWLHTUGYFHZANCNFSM5F6JKYVQ

. Triage notifications on the go with GitHub Mobile for iOS < https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675

or Android < https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub .

-- Ian McGinnis Software Engineer NOAA's Global Systems Laboratory https://gsl.noaa.gov/ Pronouns: He, Him, His

— You are receiving this because you were assigned. Reply to this email directly, view it on GitHub https://github.com/NOAA-GSL/MATS/issues/645#issuecomment-942801626, or unsubscribe https://github.com/notifications/unsubscribe-auth/AHBWGZKVZJZIRUV3W2FNPMTUGYKTJANCNFSM5F6JKYVQ . Triage notifications on the go with GitHub Mobile for iOS https://apps.apple.com/app/apple-store/id1477376905?ct=notification-email&mt=8&pt=524675 or Android https://play.google.com/store/apps/details?id=com.github.android&referrer=utm_campaign%3Dnotification-email%26utm_medium%3Demail%26utm_source%3Dgithub.

github-actions[bot] commented 1 year ago

This issue is stale because it has been open 90 days with no activity.

bonnystrong commented 1 year ago

Molly needs one software engineer to help with this - probably needs to be Randy. This is a time bomb that will probably bite us some time in the foreseeable future.

Gopa: in documentation saw that Meteor will support Couchbase in place of Mongo.

Address this after finishing the Interactive Scorecard DDRF.

github-actions[bot] commented 1 year ago

This issue is stale because it has been open 90 days with no activity.