Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Makefile variable to pass configure options when building benchmarks #375

Open
shakthimaan opened this issue Jul 18, 2022 · 2 comments
Open

Makefile variable to pass configure options when building benchmarks #375

shakthimaan opened this issue Jul 18, 2022 · 2 comments

Comments

@shakthimaan
Copy link
Contributor

shakthimaan commented Jul 18, 2022 •
edited
Loading

Compiler developers would like to observe metric changes when passing -O2 and -O3 configure options to the compiler when building the benchmarks.

Reference: ocaml-bench/sandmark-nightly-config#5 (comment)
@punchagan
Copy link
Contributor

@shakthimaan Would the configure field not be sufficient for this?

@shakthimaan
Copy link
Contributor Author

shakthimaan commented Feb 19, 2024 •
edited
Loading

Would the configure field not be sufficient for this?

For a single run, yes. At present, the unit of operation is a benchmark run. We do not have the notion of an experiment.

It will be useful to describe an experiment with multiple test configuration options, run benchmarks, and compare the results.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@shakthimaan @punchagan