Hadoop Ecosystem Repository Connectors
This repository houses the ODPi Egeria connectors for:
- Apache Atlas connector implements read-only connectivity to the Apache Atlas metadata repository. A Dockerfile is also provided to help you get started with Apache Atlas for demos & testing.
Quick links
- See the CTS Results for details on its conformance.
- See the detailed readme configuration instructions, and information on how to test with Atlas using provided Dockerfile & postman collection.
Note the Getting Started guide needs updating so please use the development docs here for now.
How it works
There is currently only an Apache Atlas connector. This connector integrates into the Open Connector Framework (OCF) and implements certain methods that adhere to the interfaces required by a repository proxy. These then communicate with Apache Atlas via Apache Atlas's Java client (in turn communicating via Apache Atlas's REST API) to read information from an Apache Atlas environment.
This requires an existing Apache Atlas environment to already be running elsewhere: the connector simply connects to this existing environment and "proxies" any requests from Egeria into a series of native API calls against the environment.
Overview of the connector implementation
Limitations
- Connector is read only - no write operations to Atlas
- only a subset of the open metadata types are currently mapped.
- Search operations are limited (TODO to add more details)
Testing
The connector has only had basic testing performed recently covering
- Ensure it can connect to Atlas and issue queries
- Ensure it can receive atlas entity kafka messages & appropriately create entities in Egeria
The environment tested was
- Egeria 3.15
- Atlas 'main' (~1 March 2023)
Final note
We are still in the process of re-invigorating this connector. See https://github.com/odpi/egeria-connector-hadoop-ecosystem/issues/464 for further information.
There has been no 'release' for a long time. If interested get in touch, as we now know the connector does still work with the current Egeria releases, but there are limitations (Mar 2023)
License: CC BY 4.0, Copyright Contributors to the ODPi Egeria project.