My first question on a checkout test that came back p = .04 would be when they stopped it. If the PM checked every morning and called it the first day it went below .05, I'd want to run it again with the end date set upfront. Then how big was the lift? 10% to 10.1% is one more person ordering per 1,000 people who hit checkout.
1
u/data4lyfe 1d ago
My first question on a checkout test that came back p = .04 would be when they stopped it. If the PM checked every morning and called it the first day it went below .05, I'd want to run it again with the end date set upfront. Then how big was the lift? 10% to 10.1% is one more person ordering per 1,000 people who hit checkout.
I run Interview Query and we have a version of this question.