ATN satellite telemetry data flow diagram update

[MathewBiddle]

Need to update the data flow diagram here.

Current draft:

@mmckinzie @iamchrisser comments welcome.

[mmckinzie]

@MathewBiddle can you provide me with an editable version of above diagram? So I can provide some suggested modifications.

[MathewBiddle]

@mmckinzie I made it using drawio in Google Drive. You should have access to view this file at https://drive.google.com/file/d/1XwCgQ1cwSpzRoXAYK4Zr-HScil6uwysZ/view?usp=sharing

If you have major changes, we should talk through what those changes might be as I'm trying to fit ATN into the Biological Data Flow identified for biodiversity data: https://ioos.github.io/mbon-docs/mbon-data-flow.html.

[MathewBiddle]

@mmckinzie I've seen various incarnations of a flow diagram for ATN. Is the diagram linked here representative of what we think is happening?

Do you have something that is more appropriate?

I've seen this slide show up a couple times

[MathewBiddle]

%%{
  init: {
    'theme': 'base',
    'themeVariables': {
      'primaryColor': '#007396',
      'primaryTextColor': '#fff',
      'primaryBorderColor': '#003087',
      'lineColor': '#003087',
      'secondaryColor': '#007396',
      'tertiaryColor': '#CCD1D1'
    },
   'flowchart': { 'curve': 'basis' }
  }
}%%

flowchart TD

A([Satellite Tag Deployment])
B([Ingest into ATN])
C([Axiom Workspace])
D([NCEI])
E([Darwin Core Alignment])
F([IPT OBIS-USA])
G([ATN Portal])

A --> B
B --> C
C --> D
D --> E
E --> F
C --> G
F --collection--> D

edit: updating theme

[MathewBiddle]

need to add NDBC/GTS for profile data.

[MathewBiddle]

We don't need to worry about NDBC/GTS in this diagram as we're only looking at satellite telemetry data, not profile data.

[mmckinzie]

Profile data are satellite telemetry data...profiling tags (a type of satellite tag) will have both a trajectory file and a profile file, these data are handled separately but must remained linked. All satellite telemetry tags/datasets will always include a trajectory file but not all satellite tags/dataset will also include profile data (only select tag types from select manufacturers).

[MathewBiddle]

Ahh, thank you @mmckinzie for clarifying. I still have a lot to learn. Updated diagram coming soon.

[MathewBiddle]

%%{
  init: {
    'theme': 'base',
    'themeVariables': {
      'primaryColor': '#007396',
      'primaryTextColor': '#fff',
      'primaryBorderColor': '#003087',
      'lineColor': '#003087',
      'secondaryColor': '#007396',
      'tertiaryColor': '#CCD1D1'
    },
   'flowchart': { 'curve': 'basis' }
  }
}%%

flowchart TD

A([Satellite Tag Deployment])
B([ATN])
D([NCEI])
E([Darwin Core Alignment])
F([IPT OBIS-USA])
G([ATN Portal])
H([NDBC])
I([GTS])

A --> B
B -- Data released from embargo --> D
D --> E
E --> F
B --> G
B -- Profiling Tags --> H
H --> I
F --collection--> D

[MathewBiddle]

This high level diagram should go on the landing page at https://ioos.github.io/ioos-atn-data/

follow the guidance at https://github.com/ioos/documentation-theme-jekyll/pull/16#issue-2088773574 (soon to be added to our docs https://github.com/ioos/ioos-documentation-jekyll-skeleton/pull/17)

[MathewBiddle]

Adding in Federal Catalogs:

%%{
  init: {
    'theme': 'base',
    'themeVariables': {
      'primaryColor': '#007396',
      'primaryTextColor': '#fff',
      'primaryBorderColor': '#003087',
      'lineColor': '#003087',
      'secondaryColor': '#007396',
      'tertiaryColor': '#CCD1D1'
    },
   'flowchart': { 'curve': 'basis' }
  }
}%%

flowchart TD

A([Satellite Tag Deployment])
B([ATN])
D([NCEI])
E([Darwin Core Alignment])
F([IPT OBIS-USA])
G([ATN Portal])
H([NDBC])
I([GTS])
J[(NOAA OneStop)]
K[(data.gov)]
L[("Commerce
Data Hub")]

A --> B
B -- Data released from embargo --> D
D --> E
D --> FC
E --> F
B --> G
B -- Profiling Tags --> H
H --> I
F --collection--> D

subgraph FC [U.S. Federal Catalogs]
J
K
L
end

[MathewBiddle]

reopening because this should include a pathway to the IOOS Data Catalog.

%%{
  init: {
    'theme': 'base',
    'themeVariables': {
      'primaryColor': '#007396',
      'primaryTextColor': '#fff',
      'primaryBorderColor': '#003087',
      'lineColor': '#003087',
      'secondaryColor': '#007396',
      'tertiaryColor': '#CCD1D1'
    },
   'flowchart': { 'curve': 'basis' }
  }
}%%

flowchart TD

A([Satellite Tag Deployment])
B([ATN])
D([NCEI])
E([Darwin Core Alignment])
F([IPT OBIS-USA])
G([ATN Portal])
H([NDBC])
I([GTS])
J[(NOAA OneStop)]
K[(data.gov)]
L[("Commerce
Data Hub")]
M[("IOOS Data Catalog
(data.ioos.us)")]

A --> B
B -- Data released from embargo --> D
D .-> E
D --> FC
E .-> F
B --> G
B -- Profiling Tags --> H
B .->|Data released from embargo| M
M --> FC
H --> I
F --collection--> D

subgraph FC [U.S. Federal Catalogs]
J
K
L
end