Develop initial prototype in AWS Neptune Notebooks

[jordanpadams]

notes from today's tag-up today with @TWilson2017:

• identified potential typo in identifiers used in last comment from #87
• walked through how to think about RDF as compared to XML in an object-oriented fashion

action items:

• [x] @TWilson2017 - continue working on software to process RDF
• [x] @TWilson2017 -develop 5-10 presentation for sprint review including overview of RDF and work started on RDF -> XML processing

[jordanpadams]

• [x] @TWilson2017 - update algorithm to append to a list of values, versus the current implementation (which will overwrite the values if there were multiple Citrus, for example)
• [x] @TWilson2017 - update output method to output the values to the expected RDF (using the simple example use case to start)

[jordanpadams]

• [x] @TWilson2017 - fix bug in algorithm for missing attribute value
• [x] @TWilson2017 - improve algorithm to reduce duplicate code
• [x] @TWilson2017 - improve output with appropriate spacing
• [x] @TWilson2017 - switchover to using PDS4 label
• [x] @TWilson2017 - prep for demo at Sprint Review

[jordanpadams]

• [x] @TWilson2017 - validate output RDF to ensure it is properly formatted (values are properly escaped, etc.)
• [x] @TWilson2017 - test out using TBD library for connecting to Neptune with IAM role

[jordanpadams]

@TWilson2017 so after doing some sleuthing, it looks like it is possible to use IAM and the botocore library to connect to neptune.

per our initial testing with neptune, we used this graph-notebook library to access the database. the confusing part was we were using these notebook "magic" extensions to access things and query the database: https://github.com/aws/graph-notebook#notebook-cell-magic-extensions-in-the-ipython-3-kernel . and per our original testing, we used our IAM role to access the database, similar to this:

%%graph_notebook_config
{
  "host": "your-neptune-endpoint",
  "port": 8182,
  "auth_mode": "IAM",
  "load_from_s3_arn": "",
  "ssl": true,
  "aws_region": "your-neptune-region"
}

so what we need to do is access this client from the Python API without the "magic" extensions.

that client is here: https://github.com/aws/graph-notebook/blob/main/src/graph_notebook/neptune/client.py

so i think we want to do something like this integration test they have:

def setup_client_builder(config: Configuration) -> ClientBuilder:
    builder = ClientBuilder() \
        .with_host(config.host) \
        .with_port(config.port) \
        .with_region(config.aws_region) \
        .with_tls(config.ssl) \
        .with_sparql_path(config.sparql.path)

    if config.auth_mode == AuthModeEnum.IAM:
        builder = builder.with_iam(get_session())

    return builder

where config is a dictionary similar to the one we have coming from %%graph_notebook_config

[jordanpadams]

• [x] @TWilson2017 - print RDF to a file
• [ ] @TWilson2017 - validate RDF is valid
• [ ] @jordanpadams to ping SAs to get AWS secret keys setup
• [ ] @TWilson2017 - update code to allow for using secret keys (keep functionality for using IAM role)

[jordanpadams]

initial version completed. see XML_to_RDF notebook in Neptune Workbench