[Feature] adding transform functionality #2499
Closed
otacilio-psf
started this conversation in
Ideas
Replies: 0 comments
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
-
As in PySpark, the transform functionality allows you to split your transformations into units of work, creating a function for each, and then call them on your DataFrame, enabling the ability to chain transformations.
Having your transformations as functions helps in unit testing them.
PR with the changes: #2498
PySpark reference
Beta Was this translation helpful? Give feedback.
All reactions