You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
We need an ability to store alternative dataset names. For example hive datasets can be identified by their data files` location or metastore uri with database and table.
Problem:
We need an ability to store alternative dataset names. For example hive datasets can be identified by their data files` location or metastore uri with database and table.
Solution in Spec:
SymlinksDatasetFacet
-> OpenLineage/OpenLineage#936Implementation in Marquez:
Model changes:
name
field indatasets
table withsymlinkUid
Implementation follows the proposed DB changes:
First PR -> reflect current behaviour in modifed schema
dataset_symlink
row whenever dataset is createdSecond PR
dataset_symlink
with multiple entries per OL event.The text was updated successfully, but these errors were encountered: