Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Column lineage doesn't work with symlink dataset #2776

Closed
sophiely opened this issue Mar 22, 2024 · 1 comment
Closed

Column lineage doesn't work with symlink dataset #2776

sophiely opened this issue Mar 22, 2024 · 1 comment
Labels
bug Something isn't working
Milestone

Comments

@sophiely
Copy link
Contributor

Listing Dataset threw an exception if one of the dataset has a symlink and a column lineage:

The symlink dataset is now linked in the lineage but this symlink dataset is not necessarily in the same namespace so it can be find.

java.util.NoSuchElementException: No value present
! at java.base/java.util.Optional.get(Optional.java:143)
! at marquez.service.ColumnLineageService.lambda$enrichWithColumnLineage$21(ColumnLineageService.java:224)
! at java.base/java.util.Iterator.forEachRemaining(Iterator.java:133)
! at java.base/java.util.Spliterators$IteratorSpliterator.forEachRemaining(Spliterators.java:1845)
! at java.base/java.util.stream.ReferencePipeline$Head.forEach(ReferencePipeline.java:762)
! at marquez.service.ColumnLineageService.enrichWithColumnLineage(ColumnLineageService.java:217)
@wslulciuc wslulciuc added the bug Something isn't working label Apr 16, 2024
@wslulciuc wslulciuc added this to the 0.47.0 milestone Apr 16, 2024
@wslulciuc
Copy link
Member

Fixed #2775

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
Status: Done
Development

No branches or pull requests

2 participants