Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Power Analysis for Geo experiments #67

Open
ar-asur opened this issue Jun 20, 2023 · 0 comments
Open

Power Analysis for Geo experiments #67

ar-asur opened this issue Jun 20, 2023 · 0 comments

Comments

@ar-asur
Copy link

ar-asur commented Jun 20, 2023

Hi team - Thanks for the amazing package.

I am looking for ideas/suggestions for doing power analysis for geo experiment. To give more context, I have a marketing intervention to test and have pre selected comparable Geos (control and treatment) to run the test on. I will be using causal impact to measure the lift of the intervention. How can I check the minimum detectable effect under this setting. I have control/test Geos, duration of the intervention and default significance levels. I would like to know the MDE - smallest treatment effect that can be measure using causalimpact technique. This key since if from business intuition this MDE is not within the range of possibility I might want to suggest a different treatment.

I am guessing this would involve simulation with adding known effects, wanted to understand if there are known functions/packages for this usecase.

Thanks!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant