Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Node dependencies #164

Closed
bayees opened this issue Nov 14, 2019 · 4 comments
Closed

Node dependencies #164

bayees opened this issue Nov 14, 2019 · 4 comments
Labels
Issue: Feature Request New feature or improvement to existing feature

Comments

@bayees
Copy link

bayees commented Nov 14, 2019

Description

I have issues with node dependencies when working with databases. One of my nodes extracts data into a database and another node is dependent on part of the data, so instead of loading the full table I have made a select statement with only the columns I need. Dependencies can currently only be linked by using the same output and input dataset. I am aware that I can create a dummy dataset to fake a dependencies, but that make messy code in both funcitons and nodes.

Context

Why is this change important to you? How would you use it? How can it benefit other users?
The code will be cleaner and more explicit instead of the dummy dataset.

@bayees bayees added the Issue: Feature Request New feature or improvement to existing feature label Nov 14, 2019
@tolomea
Copy link
Contributor

tolomea commented Nov 15, 2019

You can use transcoding to save with one dataset and load with another. https://kedro.readthedocs.io/en/latest/04_user_guide/04_data_catalog.html#transcoding-datasets

@DmitriiDeriabinQB
Copy link
Contributor

@bayees By the way, we are trying to grow our StackOverflow community, which is a better place for questions like that. It would be great if next time you can raise a question there, thank you.

@DmitriiDeriabinQB
Copy link
Contributor

Closing as resolved

@freebiesoft
Copy link

the transcoding page no longer exists

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Issue: Feature Request New feature or improvement to existing feature
Projects
None yet
Development

No branches or pull requests

4 participants