Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Protocol for comparison of raw simulated to raw experimental data #64

Open
CFGrote opened this issue Feb 26, 2021 · 3 comments
Open

Protocol for comparison of raw simulated to raw experimental data #64

CFGrote opened this issue Feb 26, 2021 · 3 comments
Assignees
Milestone

Comments

@CFGrote
Copy link
Contributor

CFGrote commented Feb 26, 2021

As a first step, perform a literature survey on established best practises for sim-exp benchmarking and comparisons.

  • Which metrics are applied
  • What are the categories to characterize accuracy/"closeness to experiment" performance of a simulation code.
  • How to compare noisy data against noisy data?
@CFGrote CFGrote modified the milestones: IMS 5.1, MS 5.4 Feb 26, 2021
@JunCEEE JunCEEE self-assigned this Mar 22, 2021
@mads-bertelsen
Copy link
Contributor

A few considerations to this important topic

  1. Should we narrow the focus to cases with same binning (simulation can always be set to real detector binning), or consider how to compare data with different binnings?
  2. Is there a way to compare event data that was never in a histogram to begin with?
  3. Assuming we find a systematic way to do this comparison, how do we implement it? As a little library we all use in ViNYL?

@JunCEEE
Copy link
Contributor

JunCEEE commented Apr 22, 2021

@JunCEEE
Copy link
Contributor

JunCEEE commented Jul 9, 2021

This is currently delayed due to the NeXus format issue.

@shervin86 shervin86 assigned shervin86 and unassigned JunCEEE Sep 23, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants