Skip to content
This repository has been archived by the owner on Jan 17, 2023. It is now read-only.

Do A/B test on doing an onboarding highlight of Page Shot button #2081

Closed
ianb opened this issue Jan 5, 2017 · 8 comments
Closed

Do A/B test on doing an onboarding highlight of Page Shot button #2081

ianb opened this issue Jan 5, 2017 · 8 comments
Assignees
Milestone

Comments

@ianb
Copy link
Contributor

ianb commented Jan 5, 2017

In the A/B test a group of people will get some notification pointing out the new button to them. Probably using UITour, or maybe just a panel.

We want to determine if people who are shown the button are more likely to make their first shot.

@ianb ianb added this to the Elnath milestone Jan 5, 2017
@ianb ianb self-assigned this Jan 17, 2017
@ianb
Copy link
Contributor Author

ianb commented Jan 17, 2017

We're going to use a badge – these can hold arbitrary text. We'll keep it until the user first clicks the button, or 24 hours.

@ianb
Copy link
Contributor Author

ianb commented Jan 17, 2017

Here's what it looks like with a badge of " ! ", which looks good to me:

image

I'll be showing it until it is clicked, unless you restart the browser 24 hours after the add-on is installed. That is, if you keep your browser open the badge will just stick there.

Note any click on the button will turn off the badge, including clicking it on a new tab and going to My Shots.

Note if you are opted-in to this experiment but aren't installing Page Shot, the entire thing is ignored. A GA event is fired when the badge is shown.

ianb added a commit that referenced this issue Jan 17, 2017
@ianb
Copy link
Contributor Author

ianb commented Jan 17, 2017

That commit (c4c916b) implements this, but it's not entirely "done". Specifically at least we have to create the custom dimension in GA. It might be worth having @johngruen review this too, to make sure the test process seems legitimate.

@fzzzy
Copy link
Contributor

fzzzy commented Jan 18, 2017

The "!" feels like an error to me. People might click the button expecting to see an error message, but then they will just see the normal page shot ui.

@ianb
Copy link
Contributor Author

ianb commented Jan 18, 2017

cd3 is setup:

image

@johngruen
Copy link
Contributor

"Hi" and it should be blue, not red

@johngruen
Copy link
Contributor

#00AFF7

@ianb
Copy link
Contributor Author

ianb commented Jan 18, 2017

Here's the new version of the badge (2x size):

image

@ianb ianb closed this as completed Jan 18, 2017
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants