Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Decouple data zip scanning and detection of sourceType/uploadType from method enrichWithData #384

Closed
eblondel opened this issue May 2, 2024 · 0 comments
Assignees
Labels
enhancement New feature or request entity enrichment
Milestone

Comments

@eblondel
Copy link
Collaborator

eblondel commented May 2, 2024

So far, data zip scanning to inherit sourceType and uploadType for data objects discovered in a data directory was delegated to the entity$enrichWithData method.

This has a huge side effect when we activate the global workflow option skipEnrichWithData to avoid reading larga data files. In that case the enrichWithData method is then not triggered, and actual data sourceType (and propagation to uploadType) is not performed. For a geosapi action, the uploadType is then kept as other and the upload operation is skipped.

cc @helraynal

@eblondel eblondel added enhancement New feature or request entity enrichment labels May 2, 2024
@eblondel eblondel self-assigned this May 2, 2024
@eblondel eblondel added this to the 1.0 milestone May 2, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request entity enrichment
Projects
None yet
Development

No branches or pull requests

1 participant