Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Evaluate mmap #33

Open
alugowski opened this issue Jul 9, 2023 · 2 comments
Open

Evaluate mmap #33

alugowski opened this issue Jul 9, 2023 · 2 comments

Comments

@alugowski
Copy link
Owner

FMM currently employs a single-pass method that effectively only uses fread(). This is fast, very flexible for integration, and has a fixed memory overhead for the loader itself. However it may leave some performance on the table on systems capable of parallel IO.

See PIGO which mmap()s the input file, scans it fully once to find line counts, then reads it.

mmap() does not apply to many situations that FMM currently handles, but may be useful as an option for cases where it does.
@alugowski
Copy link
Owner Author

See https://github.com/alugowski/sparse-matrix-io-comparison

@alugowski
Copy link
Owner Author

Get fileno from ifstream (gcc only): https://www.ginac.de/~kreckel/fileno/

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@alugowski