Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Finding schemas / databases / tables no longer managed by dbt #2359

Closed
friendofasquid opened this issue Apr 27, 2020 · 1 comment
Closed
Labels
enhancement New feature or request

Comments

@friendofasquid
Copy link

Describe the feature

If we remove something from dbt, it sticks around in our data lake. This can be problematic because

  1. it may have storage costs associated with it
  2. it may be subject to governance and redaction

What I propose is a built-in way of configuring the behaviour of things no longer managed by dbt. This could be done in the profile.yml, where the default might be to just warn in the logs of unmanaged stuff within (or prefixed by) the profile's schema that doesn't appear in the DAG.

Describe alternatives you've considered

Manually removing stuff no longer managed by dbt.

@friendofasquid friendofasquid added enhancement New feature or request triage labels Apr 27, 2020
@drewbanin drewbanin removed the triage label Apr 27, 2020
@drewbanin
Copy link
Contributor

check out this thread from a while back: #1135

I think this is a good idea, and I'd be keen to implement something like this in a future version of dbt. I'm going to close this issue out in favor of #1135, so if you have any further thoughts, feel free to drop them in there!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

2 participants