Bring atlas connector up to date & functioning - Githubissues

odpi / egeria-connector-hadoop-ecosystem

Hadoop ecosystem connectors for Egeria: repository proxy connector for Apache Atlas.

Apache License 2.0

21 stars 14 forks source link

Bring atlas connector up to date & functioning #464

Closed planetf1 closed 1 year ago

planetf1 commented 2 years ago

There is some interest in restarting the work on the Atlas connector, as it allows for metadata to be retrieved from a hadoop environment

Initial tasks

[x] unarchive repository
[x] raise issue to track

Atlas Docker image

[x] Basic Atlas container image
[x] Ensure kafka events can be retrieved from image
[ ] Helm deployment of Atlas

Connector

[x] Ensure connector builds
[x] Migrate build to gradle
[x] Test connector
[ ] review design

planetf1 commented 2 years ago

Currently looking at getting a stable atlas image. See https://github.com/planetf1/atlas-docker (will evaluate moving this later)

github-actions[bot] commented 1 year ago

This issue has been automatically marked as stale because it has not had recent activity. It will be closed in 20 days if no further activity occurs. Thank you for your contributions.

planetf1 commented 1 year ago

Currently looking at getting a working Atlas environment

Atlas 2.3.0 was released today.

github-actions[bot] commented 1 year ago

This issue has been automatically marked as stale because it has not had recent activity. It will be closed in 20 days if no further activity occurs. Thank you for your contributions.

planetf1 commented 1 year ago

A dockerfile to build & run Apache Atlas (master) is now available. See #523 This image supports kafka monitoring, and can be used to create types, entities, browse UI

See test/containers/atlas

planetf1 commented 1 year ago

The atlas connector can now be deployed alongside egeria 3.15 & correctly retrieve entities from Atlas, making them available in the Egeria environment.

A docker image for Atlas itself, and a postman collection & environment can help in testing

Note that at this point testing is very limited (hello world, it works)

github-actions[bot] commented 1 year ago

This issue has been automatically marked as stale because it has not had recent activity. It will be closed in 20 days if no further activity occurs. Thank you for your contributions.

planetf1 commented 1 year ago

Now needs updating to support Egeria 4.0

planetf1 commented 1 year ago

Closing, since the connector was updated to egeria 4.0 - Further issues can track any proposed design changes, testing, or tracking of future releases such as 4.1 cc: @ilovechai