Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

add test, adapt error message. #734

Merged
merged 3 commits into from
Aug 29, 2022
Merged

add test, adapt error message. #734

merged 3 commits into from
Aug 29, 2022

Conversation

janfb
Copy link
Contributor

@janfb janfb commented Aug 24, 2022

fixes #733

@michaeldeistler feel free to adapt and merge.

Copy link
Contributor

@michaeldeistler michaeldeistler left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks! A couple of questions below. I'm happy to make the required changes and merge.


proposal = estimator.build_posterior().set_default_x(x_o)
samples.append(proposal.sample((num_simulations,)))
fig, ax = pairplot(
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Why do we pairplot and save?

"num_simulations",
(5000, 10000, 15000),
)
@pytest.mark.parametrize("density_estimator", ("mdn", "nsf", "maf"))
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

why test nsf and maf in this test?

log_prob_proposal_posterior,
"""the evaluation of the MoG proposal posterior. This is likely due to too
little training data---consider increasing your simulation budget.""",
)
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'm not 100% sure about this -- are you still observing the failure with low simulation-budgets after the fix?

@@ -627,3 +627,68 @@ def test_example_posterior(snpe_method: type):
prior=prior, posterior_estimator=posterior_estimator
).set_default_x(x_o)
assert posterior is not None


@pytest.mark.parametrize("num_dim", (10, 12, 14))
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

we should mark this as slow, no?

@michaeldeistler michaeldeistler merged commit d3cfdfe into main Aug 29, 2022
@michaeldeistler michaeldeistler deleted the mog-training-nans branch August 29, 2022 06:38
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Test for high-D APT with MDNs
2 participants