Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

implement cross-client writeback cache coherence #1

Open
complyue opened this issue Aug 15, 2019 · 0 comments
Open

implement cross-client writeback cache coherence #1

complyue opened this issue Aug 15, 2019 · 0 comments

Comments

@complyue
Copy link
Owner

as writeback cache is always enabled, there still lacks proper invalidation cross jdfc. as long as all client programs follow the create-with-tmp-name -> write-content -> rename-to-formal-name procedure, which is reasonable paradigm in HPC context, there won't be too much trouble. but if any client has its os to prefetch the tmp-named intermediate file, the dirty cache pages tends to linger forever. this is possible if the os has a background search indexer running upon the JDFS mounted volume.

a solution from JDFS side may be to use a tmp dir at jdfs, hidden from all jdfc, to contain newly created files, and only move the file out to its formal pathname (visible to all jdfc) after the creating jdfc closed all handles to it. the creating jdfc should always see the file it created at formal path of course, or many programs will break for certain.

@complyue complyue changed the title implement cross-client writeback cache invalidation implement cross-client writeback cache coherence Aug 15, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant