Skip to content
This repository has been archived by the owner on Jun 10, 2024. It is now read-only.

Bring atlas connector up to date & functioning #464

Closed
7 of 9 tasks
planetf1 opened this issue Jul 11, 2022 · 9 comments
Closed
7 of 9 tasks

Bring atlas connector up to date & functioning #464

planetf1 opened this issue Jul 11, 2022 · 9 comments
Assignees

Comments

@planetf1
Copy link
Member

planetf1 commented Jul 11, 2022

There is some interest in restarting the work on the Atlas connector, as it allows for metadata to be retrieved from a hadoop environment

Initial tasks

  • unarchive repository
  • raise issue to track

Atlas Docker image

  • Basic Atlas container image
  • Ensure kafka events can be retrieved from image
  • Helm deployment of Atlas

Connector

  • Ensure connector builds
  • Migrate build to gradle
  • Test connector
  • review design
@planetf1
Copy link
Member Author

Currently looking at getting a stable atlas image. See https://github.com/planetf1/atlas-docker (will evaluate moving this later)

@planetf1 planetf1 self-assigned this Jul 11, 2022
planetf1 added a commit to planetf1/egeria-connector-hadoop-ecosystem that referenced this issue Sep 29, 2022
planetf1 added a commit to planetf1/egeria-connector-hadoop-ecosystem that referenced this issue Sep 29, 2022
Signed-off-by: Nigel Jones <[email protected]>
planetf1 added a commit to planetf1/egeria-connector-hadoop-ecosystem that referenced this issue Sep 29, 2022
planetf1 added a commit to planetf1/egeria-connector-hadoop-ecosystem that referenced this issue Sep 29, 2022
planetf1 added a commit to planetf1/egeria-connector-hadoop-ecosystem that referenced this issue Sep 29, 2022
Signed-off-by: Nigel Jones <[email protected]>
planetf1 added a commit to planetf1/egeria-connector-hadoop-ecosystem that referenced this issue Sep 29, 2022
Signed-off-by: Nigel Jones <[email protected]>
planetf1 added a commit to planetf1/egeria-connector-hadoop-ecosystem that referenced this issue Sep 29, 2022
Signed-off-by: Nigel Jones <[email protected]>
planetf1 added a commit that referenced this issue Sep 29, 2022
#464 fix up compile errors and pull versions forward
planetf1 added a commit to planetf1/egeria-connector-hadoop-ecosystem that referenced this issue Sep 29, 2022
Signed-off-by: Nigel Jones <[email protected]>
planetf1 added a commit to planetf1/egeria-connector-hadoop-ecosystem that referenced this issue Sep 29, 2022
planetf1 added a commit that referenced this issue Sep 29, 2022
planetf1 added a commit to planetf1/egeria-connector-hadoop-ecosystem that referenced this issue Sep 29, 2022
planetf1 added a commit that referenced this issue Sep 29, 2022
#464 force sonatype lift to use jdk 11
planetf1 added a commit to planetf1/egeria-connector-hadoop-ecosystem that referenced this issue Sep 29, 2022
planetf1 added a commit to planetf1/egeria-connector-hadoop-ecosystem that referenced this issue Sep 29, 2022
planetf1 added a commit that referenced this issue Sep 29, 2022
#464 remove distribution - not needed
@github-actions
Copy link

github-actions bot commented Dec 7, 2022

This issue has been automatically marked as stale because it has not had recent activity. It will be closed in 20 days if no further activity occurs. Thank you for your contributions.

@planetf1
Copy link
Member Author

planetf1 commented Dec 7, 2022

Currently looking at getting a working Atlas environment

Atlas 2.3.0 was released today.

@github-actions
Copy link

github-actions bot commented Feb 6, 2023

This issue has been automatically marked as stale because it has not had recent activity. It will be closed in 20 days if no further activity occurs. Thank you for your contributions.

@planetf1
Copy link
Member Author

planetf1 commented Feb 28, 2023

A dockerfile to build & run Apache Atlas (master) is now available. See #523
This image supports kafka monitoring, and can be used to create types, entities, browse UI

See test/containers/atlas

planetf1 added a commit to planetf1/egeria-connector-hadoop-ecosystem that referenced this issue Mar 3, 2023
planetf1 added a commit that referenced this issue Mar 3, 2023
planetf1 added a commit to planetf1/egeria-connector-hadoop-ecosystem that referenced this issue Mar 3, 2023
Signed-off-by: Nigel Jones <[email protected]>
planetf1 added a commit to planetf1/egeria-connector-hadoop-ecosystem that referenced this issue Mar 3, 2023
planetf1 added a commit to planetf1/egeria-connector-hadoop-ecosystem that referenced this issue Mar 3, 2023
planetf1 added a commit to planetf1/egeria-connector-hadoop-ecosystem that referenced this issue Mar 3, 2023
planetf1 added a commit to planetf1/egeria-connector-hadoop-ecosystem that referenced this issue Mar 3, 2023
planetf1 added a commit to planetf1/egeria-connector-hadoop-ecosystem that referenced this issue Mar 3, 2023
@planetf1
Copy link
Member Author

planetf1 commented Mar 3, 2023

The atlas connector can now be deployed alongside egeria 3.15 & correctly retrieve entities from Atlas, making them available in the Egeria environment.

A docker image for Atlas itself, and a postman collection & environment can help in testing

Note that at this point testing is very limited (hello world, it works)

@github-actions
Copy link

github-actions bot commented May 3, 2023

This issue has been automatically marked as stale because it has not had recent activity. It will be closed in 20 days if no further activity occurs. Thank you for your contributions.

@github-actions github-actions bot closed this as not planned Won't fix, can't repro, duplicate, stale May 23, 2023
@planetf1
Copy link
Member Author

Now needs updating to support Egeria 4.0

@planetf1
Copy link
Member Author

Closing, since the connector was updated to egeria 4.0 - Further issues can track any proposed design changes, testing, or tracking of future releases such as 4.1
cc: @ilovechai

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant