Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Add ATE and WIS example prompts in Transform Dataset #6262

Closed
liunelson opened this issue Jan 28, 2025 · 0 comments · Fixed by #6352
Closed

Add ATE and WIS example prompts in Transform Dataset #6262

liunelson opened this issue Jan 28, 2025 · 0 comments · Fixed by #6352
Assignees
@shawnyama
Labels
Enhancement Improvements to features already in the application

Comments

@liunelson
Copy link
Member

liunelson commented Jan 28, 2025 •
edited
Loading

Linked to these two issues:

ATE prompt

Calculate the average treatment effect (ATE) on the outcome "I_state" (number of infected persons) between the simulated forecast dataset with treatment (d1) and the baseline one without treatment (d2).

WIS prompt

Calculate the weighted interval score (WIS) on the outcome "I_state" (number of infected persons) between the forecast simulation dataset (d1) and the observed ground truth dataset (d2). Use the quantiles required by the CDC COVID-19 Forecast Hub.
@liunelson liunelson self-assigned this Jan 28, 2025
@liunelson liunelson added the Enhancement Improvements to features already in the application label Jan 28, 2025
@liunelson liunelson removed their assignment Jan 28, 2025
@liunelson liunelson changed the title Add ATE and WIS prompt in Transform Dataset Add ATE and WIS example prompts in Transform Dataset Jan 28, 2025
@shawnyama shawnyama linked a pull request Feb 3, 2025 that will close this issue
Transform dataset wis & ate prompts #6352
Merged
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@shawnyama shawnyama

Labels
Enhancement Improvements to features already in the application
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

Transform dataset wis & ate prompts DARPA-ASKEM/terarium
2 participants
@liunelson @shawnyama