Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Compute tutorial for streaming data #196

Merged
merged 2 commits into from
Jun 24, 2024
Merged

Compute tutorial for streaming data #196

merged 2 commits into from
Jun 24, 2024

Conversation

chStaiger
Copy link
Collaborator

Demo how to work with data in iRODS in compute using iBridges.

@chStaiger chStaiger requested a review from qubixes June 19, 2024 15:44
Copy link
Collaborator

@qubixes qubixes left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Before I review in more depth. Perhaps it would be better to have the streaming of data to be part of the numbered tutorials? Then the tutorial can be a bit more focused.

@chStaiger
Copy link
Collaborator Author

We can give this tutorial number. It basically explains how to only read your data from iRODS without making copies. For our target audience I would not extend the streaming advice to also how to chunk and optimise your data transfers.
Rename to 07-Streaming iRODS data into Compute workflows?

@qubixes
Copy link
Collaborator

qubixes commented Jun 20, 2024

I would remove the into Compute workflows, since I don't think that is necessary, but yes we don't need to have more optimization in there I agree.

@chStaiger chStaiger closed this Jun 24, 2024
@chStaiger chStaiger deleted the compute branch June 24, 2024 13:42
@chStaiger chStaiger restored the compute branch June 24, 2024 13:42
@chStaiger chStaiger reopened this Jun 24, 2024
@chStaiger chStaiger merged commit 36190f7 into develop Jun 24, 2024
9 checks passed
@chStaiger chStaiger deleted the compute branch June 24, 2024 13:49
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants