search

airbytehq / airbyte

The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.
https://airbyte.com
Other
15.4k stars 3.97k forks source link

Create a credentials module so that credentials can be used in different sources/destinations #4035

Open batianusrey opened 3 years ago

batianusrey commented 3 years ago

Tell us about the problem you're trying to solve

When configuring multiple sources and destinations many of them use the same credentials, they just point to a different schema/table (depending on the connector). This presents two main issues for us:

  1. When configuring many sources/destinations credentials must be set for every new source/destination.
  2. If someone in the team wants to establish a new source/destination they must have access to this credentials or depend on someone that has to do the configuration for them.

Describe the solution you’d like

It'd be nice to have a Credentials module where you just set them up once and just reference them from the source/connector.

sherifnada commented 3 years ago

@batianusrey this is a great idea! Thanks for the suggestion.

marcosmarxm commented 2 years ago

You can achieve this using Octavia CLI but not using default Airbyte WebApp. Definitely a good idea!