Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

[RC-211] [Feature] Allow to exclude some DBT packages from analysis #179

Closed
kokorin opened this issue Feb 21, 2024 · 5 comments · Fixed by #234
Closed

[RC-211] [Feature] Allow to exclude some DBT packages from analysis #179

kokorin opened this issue Feb 21, 2024 · 5 comments · Fixed by #234
Assignees
Labels
enhancement New feature or request linear Created by Linear-GitHub Sync Medium priority Created by Linear-GitHub Sync triage Triage required
Milestone

Comments

@kokorin
Copy link

kokorin commented Feb 21, 2024

Describe the feature

In our project we use dbt_project_evaluator and elementary packages. dbt_project_evaluator is enabled for local development and CI. elementary is enabled for DEV and PROD.
Instead of building whole project from main branch locally, we download DBT artifacts from DEV (it takes too long to run all models). So when we run Recce locally we see elementary models red (removed) and dbt_project_evaluator models green (added).

It would be very useful if we can exclude both dbt_project_evaluator and elementary packages from comparison when running Recce.

Describe alternatives you've considered

No response

Who will this benefit?

No response

Are you interested in contributing this feature?

No response

Anything else?

No response

RC-211

@kokorin kokorin added enhancement New feature or request triage Triage required labels Feb 21, 2024
@kokorin kokorin changed the title [Feature] Allow to exclude some DBT packages from analyses [Feature] Allow to exclude some DBT packages from analysis Feb 21, 2024
@clkao clkao added the linear Created by Linear-GitHub Sync label Feb 21, 2024
@clkao clkao changed the title [Feature] Allow to exclude some DBT packages from analysis [RC-211] [Feature] Allow to exclude some DBT packages from analysis Feb 21, 2024
@popcornylu
Copy link
Contributor

Ideally, just like to graph in dbt docs, recce can provide a way to filter the nodes by packages.

image
image

@clkao clkao added this to the v.12 milestone Feb 23, 2024
@clkao clkao added the Medium priority Created by Linear-GitHub Sync label Mar 4, 2024
@popcornylu
Copy link
Contributor

Related to DRC-191

@clkao clkao modified the milestones: v.12, v.13, 2024 W12 Mar 4, 2024
@wenluzhangg
Copy link

Same Issue as mine - would like to see this enhancement as well..

@even-wei
Copy link

DataRecce/jaffle_shop_duckdb#7 example PR

@popcornylu
Copy link
Contributor

popcornylu commented Mar 18, 2024

  • Separate the lineage graph subgraph from LineageGraphContext
  • Implement the package filter
  • Add package options in the lineage diff check.

# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
enhancement New feature or request linear Created by Linear-GitHub Sync Medium priority Created by Linear-GitHub Sync triage Triage required
Projects
None yet
Development

Successfully merging a pull request may close this issue.

5 participants