Test & Learn Community (TLC)’s Post

Test & Learn Community (TLC) reposted this

View profile for Erin Weigel, graphic

📚 Author of "Design for Impact" • Advisor at ABsmartly (Experimentation Platform)

Chances are, your learning budgets (if your company didn't gut them like most businesses did), will refresh in 2025. 💸 And if they do—then boyyyyy oh boy, do I have a learning opportunity for you! My pal, Lucas Bernardi, and I are teaching "The Good Experimental Design Workshop" online in January and February 2025. Lucas is the data science brain that made sure my book didn't anger PhDs around the world with how I explained A/B test statistics. (Some data science brains even had a little fun reading my book that the course is based on! 😲) Anyway, The Good Experimental Design Workshop is a four-week online course that will be held on these Mondays: • Jan 27 • Feb 3 • Feb 10 • Feb 17 Each class lasts for two hours between 5pm–7pm CET. In this workshop you will: 👩🏼🏫 Learn a little science history to give you context on the origins of good experimental design (stories help you remember "why" behind things better) 📈 Gain confidence in statistics and understand its confusing terminology such as p-values (AHHHHH!), confidence intervals, alpha and beta, error types, sampling distributions, sample ratio mismatches (SRMs), etc. 👀 Identify good experimental design through analyzing and critiquing experiment data and documentation 🧪 Practice designing experiments that are high-quality and will give you good data 🛠️ Leave with a toolkit to make designing good experiments "easy as pie" (or cake, if that’s your thing) Not only that, but we will make sure there's plenty of time for us to answer your experimentation questions in a safe, friendly environment. But wait there's more! 🤓 Kelly Wortham, the founder of Test & Learn Community (TLC) has scholarships to get 50% of the course paid for. So even if your company gutted your learning budget, you can STILL get monetary support to attend. You also don't need to have a ton of foundational knowledge to join in and learn something useful. We'll start with the basics and build up to the more complicated things over the weeks. You can get more info and sign up here: https://lnkd.in/e7Kywzhv Hope to see you there! P.S. I included some screenshots of the slide deck we will use to cover all of the topics. Hopefully it gives you an idea of how we'll lean into visualizations and stories to help you more intuitively understand how the math behind experimentation works.

  • A hand-drawn paper that says "The Good Experimental Design Workshop".
  • To design your experiment you must: 

Get these: 
Base conversion rate
Average number of visitors to the test area
Business cycle

Then choose these: 
Minimum detectable effect (MDE)
Significance (alpha)
Power (beta)

To calculate these: 
Sample size
Run time
  • Fun fact: Confidence and p-values are basically the same.
  • A slide of illustrations showing parallel universes where you could have observed any possibility of numbers from the same population based on the sample you happened to grab.
  • An illustration of confidence intervals.
    +2
Erin Weigel

📚 Author of "Design for Impact" • Advisor at ABsmartly (Experimentation Platform)

2w

Thinking about who might have folks in their orgs that might benefit from the class and the scholarships: Alexa Kaminsky Vytas Butkus Kelly Chambers Pieter Boonstra Mauricio Wolff Toma Lulgjuraj are just a few folks that come to mind 🤗 In case any of you have any experiment-minded folk who want to learn more in the new year. 😄

Andra Baragan

Ecommerce Conversion Rate Optimization | Increasing profitability for ecom and DTC brands | Founder at Ontrack Digital

2w

This is going to be amazing for anyone who joins!

See more comments

To view or add a comment, sign in

Explore topics