-
Notifications
You must be signed in to change notification settings - Fork 106
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
fix: directIO read size can exceeds buffer size #68
base: master
Are you sure you want to change the base?
fix: directIO read size can exceeds buffer size #68
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thanks for your PR!
Out of curiosity, can you elaborate on in which situation you encountered a panic?
@@ -29,6 +32,8 @@ func fusermount(dir string, cfg *MountConfig) (*os.File, error) { | |||
// Start fusermount, passing it a buffer in which to write stderr. | |||
var stderr bytes.Buffer | |||
|
|||
cfg.Options["max_read"] = strconv.Itoa(buffer.MaxReadSize) |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I think you’ll need to ensure cfg.Options is non-nil here, see the travis test failure.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thanks, I've made a modification. To reproduce the issue, just try to invoke a read system call with the size of 512Kbytes which is larger than MaxReadSize, and with O_DIRECT flag.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Thanks for fixing this! Would it be possible to add a unit test, too, which exercises this behavior? It should fail before your fix commit, and pass afterwards, so that we don’t accidentally re-introduce this bug at some point down the road.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Is there a guide on how to write ci test cases? I believe it is better to write a test case from user space file system. BTW, I have no idea why ci failed again.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Not sure I understand your question—there are no “ci test cases”, the CI just runs the go tests of this project :)
This particular failure might have been a flake (sometimes the CI is overloaded), so I have restarted the run.
Since the package uses a fixed-size memory pool for out messages, it is important to tell fuse kernel module what the maximum read size is. Otherwise, a large read will cause a panic. Right now, max readahead size can only affect buffered read. The kernel might still send a large directIO read in spite of the max readahead size. We need to specify "max_read" option during mount. Signed-off-by: Shuoran Liu <shuoranliu@gmail.com>
01da9b6
to
1f74c2f
Compare
Since the package uses a fixed-size memory pool for out messages,
it is important to tell fuse kernel module what the maximum read size is.
Otherwise, a large read will cause a panic.
Right now, max readahead size can only affect buffered read. The kernel
might still send a large directIO read in spite of the max readahead size.
We need to specify "max_read" option during mount.
Signed-off-by: Shuoran Liu shuoranliu@gmail.com