Test & Learn Community (TLC)

Test & Learn Community (TLC)

Data Infrastructure and Analytics

A place for people to teach, learn, and converse about analytics & experimentation - no sales or solicitation allowed.

About us

The year was 2012. The view was of the Pacific. The venue: the xChange Conference hosted by Semphonic where I had been invited to attend as a huddle leader by Gary Angel. The conversation topic: what else? Experimentation. But, mid-conversation (mid-revelation, really), their time was up and they needed to move to the next “huddle.” An audible groan of disappointment arose. So I encouraged everyone to continue the conversation via email. From that email chain, we decided to have a monthly teleconference—I called it a “tele-huddle". Eventually, I decided to expand to include others and shifted to Zoom. Each month, we'd meet on Zoom to support each other with whatever topics we were working on in our respective jobs - sometimes with planned topics, sometimes just mentoring each other. Always with the purpose of teaching and learning. People dropped out and others joined along the way with the size of the community staying around 20-40 people for the first several years until we decided to start the Slack community and change the format to invite industry leaders to present and have live recorded panel discussions. (Shout out to our friends at measure.chat and the analyticshour.io for those inspirations.) The one thing that has always remained true to the original intention of the community - the TLC was designed as a place for people to teach, learn, and converse. And it remains so today. No sales or solicitation of members is ever allowed and all questions are welcome and encouraged. The environment should be welcoming and no one should ever feel worried that they'll get bullied for asking a "dumb question". That's not what the TLC is. Everyone here wants to help - and if anyone is not helpful, they'll be invited to leave. Because of the welcoming and encouraging atmosphere of sharing and learning, the TLC has grown to a community of well over 1,000 members and is continuing to grow. Members include industry leaders and those just getting started from research, an

Website
https://testandlearn.community/
Industry
Data Infrastructure and Analytics
Company size
1 employee
Type
Self-Employed
Founded
2012
Specialties
community, experimentation, research, analytics, and abtesting

Employees at Test & Learn Community (TLC)

Updates

  • Time to unwrap! https://lnkd.in/gE9DtYuM

    View organization page for Test & Learn Community (TLC), graphic

    792 followers

    You know that feeling when there's something really exciting just out of reach? Like a perfectly wrapped package filled with surprises you know you’ll love... but you have to wait just a tiny bit longer? That’s exactly what’s happening here. This isn’t just another newsletter—it’s a special delivery packed with gifts just for our readers (that means you!) And it goes out this Wednesday! Trust me, you won’t want to miss what’s inside. 🎁 Stay tuned! Link to post: https://lnkd.in/gE9DtYuM #giveback #scholarships #discounts #payitforward #holidaygiving #learning #thankyousponsors

    • No alternative text description for this image
  • You know that feeling when there's something really exciting just out of reach? Like a perfectly wrapped package filled with surprises you know you’ll love... but you have to wait just a tiny bit longer? That’s exactly what’s happening here. This isn’t just another newsletter—it’s a special delivery packed with gifts just for our readers (that means you!) And it goes out this Wednesday! Trust me, you won’t want to miss what’s inside. 🎁 Stay tuned! Link to post: https://lnkd.in/gE9DtYuM #giveback #scholarships #discounts #payitforward #holidaygiving #learning #thankyousponsors

    • No alternative text description for this image
  • TLC Conversation: "The Emperor Has No Clothes: Misleading Narratives on Cookies and Consent:" with Jenn Kunz Join me in welcoming back industry favorite Jenn Kunz of 33 Sticks! Jenn is back to talk cookies and consent - and why folks often have it wrong - confusing tracking with consent. See you this Friday, Dec. 13! 8 AM Pacific | 9 AM Mountain | 10 AM Central | 11 AM Eastern | 4 PM London Add to your calendar: https://lnkd.in/gty_ktXV Join the TLC: https://lnkd.in/gm9w4Ru9 #cookies #consent #analytics #testandlearncommunity #optimization #experimentation

    • No alternative text description for this image
  • Awe shucks.

    View organization page for Conversion Stash, graphic

    864 followers

    🎄 CRO Stars 2024 - 9th December 🎄 🌟 Today's CRO Star: Kelly Wortham 💡 Highlighted Resource: Test & Learn Community (TLC) (Slack) 🔗 Link to resource: https://lnkd.in/ejnd8h_G 1️⃣ Explore the full CRO Stars 2024 Advent Calendar and discover even more resources from top contributors: https://lnkd.in/e_mJR9z7 2️⃣ Feel free to follow today's CRO Star on LinkedIn for more great insights and contributions in CRO and Experimentation! 3️⃣ Follow us so you don't miss the remaining CRO Stars this year. #CRO #Experimentation #Growth #CROStars2024 #AdventCalendar

  • Test & Learn Community (TLC) reposted this

    View profile for Tim Wilson, graphic

    Experienced Analytics Leader, Thinker, and Doer

    The U.S. has been slow on the uptake on some conference formats that various European locations have pioneered. It took forever for Measurecamp unconferences to cross the Atlantic and get established in the U.S., but that's now happened. Next up, the concept of not-vendor-based, *short* formal presentations, lots of time for peer-to-peer knowledge sharing, at a very cool venue. That would be the Conversion Hotel format coming to the U.S. as Experimentation island: https://lnkd.in/gDPDtYS3. Kelly Wortham (with Ton Wesseling) are spearheading this particular import: February 26-28 on St. Simons Island in Georgia. Behavioral science? There's Lindsay Juarez Smart and useful thoughts on product design? See Erin Weigel Jaw-droppingly engaging, original, and useful thinking? Wil Reynolds will be speaking! And, if you get #mattgershoffed to the point that you *really* need a drink... Heather Greene can give you some tips on sniffing out the best option. It's too late for the Early Bird pricing, but it's not too late to get a discount! Reach out to me to learn more! I hope to see you there!

    Experimentation island, February 26-28, 2025

    Experimentation island, February 26-28, 2025

    experimentationisland.com

  • Test & Learn Community (TLC) reposted this

    View profile for Josh Silverbauer, graphic

    Singing and Dancing Analytics Guy | Head of Analytics & CRO at From the Future | GA4, Piwik Pro, Google Tag Manager, Microsoft Clarity | Philly-Based Entrepreneur | Musician, Songwriter & Producer | Rock & Roller

    Happy December! To kick off a month that is going to be full of creativity, we have the latest #Ei2025 speaker song - Rishi. Yes, that's right! This next song for Experimentation Island stars none other than Rishi Rawat, the Shopify product page guy. He probably has his hands pretty full on Cyber Monday, but what better day to release this song about optimizing product pages with better messaging? And what a perfect song choice with the band "Sixpence None the Richer" - which means don't spend time on stuff that offers no value. Rishi will tell you to make stronger messaging choices! Without further ado, presenting "Rishi," sung by the excellently talented Rachael Silverbauer (who happens to share a last name with me). And a reminder to get your tickets for Experimentation Island (if you need more info, talk to Kelly Wortham & Ton Wesseling!) (Link to event in comments)

  • Test & Learn Community (TLC) reposted this

    View profile for Kelly Wortham, graphic

    Founder, Test & Learn Community (TLC) & Organizer, Experimentation island (#Ei2025) | Founder, Forward Digital

    Next up: Come see Erin Weigel on the stage at Experimentation island, February 26-28, 2025! We will have to see if we can get another rainbow for ya... https://lnkd.in/ggae9XFT

    View profile for Erin Weigel, graphic

    📚 Author of "Design for Impact" • Advisor at ABsmartly (Experimentation Platform)

    Conversion Hotel was an ABSOLUTE DREAM. 🤩 Thanks so much to Ton Wesseling for having me as the back-up speaker. …and also for scaring me 2-3 times that he needed me on stage without warning. 😂 It was great to hang out with and learn from some of the most amazing folks in the experimentation industry! Pieter Boonstra thanks for trolling me IRL during the talks. Well played! Roderik Peeters I’m super excited to work with you on our super stealth project. 🤫 A connection that could only be made at Conversion Hotel. 🙌 Team Draco with Roderik, Cindy Croes, Bjarn Brunenberg, Jesper den Rooijen, Steffen Bath, Raghav Mohan, & Rick Melchers was an amazing combo! Well done for being awesome (and for winning the challenge). 🏆 Thanks to Lucia van den Brink ✨️ Alrik Burger and 🔎 Charles Meaden for the fun panel discussion on ethics. And like 100 other people I was so thrilled to get to see! Ton, what you do what that conference is pure magic (and experimentation and feedback and iteration). I still don’t know how you managed to arrange the rainbow outside of my hotel room window for my arrival though! 🤔 Thank you for sharing your magic with us. 🪄 #CH2024 #experimentation #growth

    • Ton Wesseling on stage at Conversion Hotel wearing a suit covered in stars.
    • Lucia, Erin, and Alrik sitting in front of microphones having a panel discussion.
    • A group of people playing Sani and Iqbal’s experimentation card game.
    • Melanie and Lukas hanging out and talking at a table.
    • Divya on stage sharing a slide about ecosystems.
      +3
  • Test & Learn Community (TLC) reposted this

    View profile for Erin Weigel, graphic

    📚 Author of "Design for Impact" • Advisor at ABsmartly (Experimentation Platform)

    Chances are, your learning budgets (if your company didn't gut them like most businesses did), will refresh in 2025. 💸 And if they do—then boyyyyy oh boy, do I have a learning opportunity for you! My pal, Lucas Bernardi, and I are teaching "The Good Experimental Design Workshop" online in January and February 2025. Lucas is the data science brain that made sure my book didn't anger PhDs around the world with how I explained A/B test statistics. (Some data science brains even had a little fun reading my book that the course is based on! 😲) Anyway, The Good Experimental Design Workshop is a four-week online course that will be held on these Mondays: • Jan 27 • Feb 3 • Feb 10 • Feb 17 Each class lasts for two hours between 5pm–7pm CET. In this workshop you will: 👩🏼🏫 Learn a little science history to give you context on the origins of good experimental design (stories help you remember "why" behind things better) 📈 Gain confidence in statistics and understand its confusing terminology such as p-values (AHHHHH!), confidence intervals, alpha and beta, error types, sampling distributions, sample ratio mismatches (SRMs), etc. 👀 Identify good experimental design through analyzing and critiquing experiment data and documentation 🧪 Practice designing experiments that are high-quality and will give you good data 🛠️ Leave with a toolkit to make designing good experiments "easy as pie" (or cake, if that’s your thing) Not only that, but we will make sure there's plenty of time for us to answer your experimentation questions in a safe, friendly environment. But wait there's more! 🤓 Kelly Wortham, the founder of Test & Learn Community (TLC) has scholarships to get 50% of the course paid for. So even if your company gutted your learning budget, you can STILL get monetary support to attend. You also don't need to have a ton of foundational knowledge to join in and learn something useful. We'll start with the basics and build up to the more complicated things over the weeks. You can get more info and sign up here: https://lnkd.in/e7Kywzhv Hope to see you there! P.S. I included some screenshots of the slide deck we will use to cover all of the topics. Hopefully it gives you an idea of how we'll lean into visualizations and stories to help you more intuitively understand how the math behind experimentation works.

    • A hand-drawn paper that says "The Good Experimental Design Workshop".
    • To design your experiment you must: 

Get these: 
Base conversion rate
Average number of visitors to the test area
Business cycle

Then choose these: 
Minimum detectable effect (MDE)
Significance (alpha)
Power (beta)

To calculate these: 
Sample size
Run time
    • Fun fact: Confidence and p-values are basically the same.
    • A slide of illustrations showing parallel universes where you could have observed any possibility of numbers from the same population based on the sample you happened to grab.
    • An illustration of confidence intervals.
      +2
  • Test & Learn Community (TLC) reposted this

    View profile for Shirley van Haalem, graphic

    CRO Manager bij Online Dialogue - Conversion & Experimentation specialist

    On January 10, I'lI get the opportunity to share my story 'A Call To Action for Digital Accessibility' in the Test & Learn Community (TLC)! 📢 Next year, the European Accessibility Act (EAA) comes into effect, which requires companies to make their digital products and services accessible. In this talk, I will offer a first-hand perspective on the importance of digital accessibility from someone with low vision. I will bust some common myths regarding accessibility and highlight why accessible digital spaces benefit all users and result in higher revenue. Will you join the conversation on January 10? Join +1900 members and register to the Test & Learn Community. If you're already a TLC member, you can directly add this event to your calendar. Links in the comments! #DigitalAccessibility #EAA #Experimentation #CRO

    • No alternative text description for this image
  • Test & Learn Community (TLC) reposted this

    View profile for Abdullah M., graphic

    Founder and CEO at Brillmark LLC | Conversion Rate Optimization | A/B Test Development | Shopify Development

    🎉 #Ei2025: The Ultimate Event for Experimenters! 🎉 🎟️ Special opportunity alert! I'm thrilled to announce that I'll be at Experimentation Island, and I’ve got a very limited number of exclusive discount tickets to share. Kelly Wortham and Ton Wesseling have entrusted me with this, but they’ve sworn me to secrecy on the details! 😅 Message me if you want the full story and to secure your spot before they’re gone. BrillMark is also a "community partner" for this exciting experience! Here’s why you should join: 🍽️ All-Inclusive Perks: Hotel? Covered. Meals (including TWO 3-course dinners!)? Covered. Fun activities? You bet! Just show up ready to learn and connect. 💡 Epic Content: Inspiring keynotes, unconference sessions where you can take the mic, and networking galore—it’s all about sharing and growing. 🌍 Built by the Community: Powered by the amazing Test & Learn Community (TLC) and hosted by the legendary Ton Wesseling, this event welcomes everyone passionate about experimentation. 🎉 Work Hard, Play Hard: Thought-provoking sessions by day, unforgettable parties by night—where the real magic happens. 🎟️ Message me for the deets and I’ve got access to exclusive discounts! #tlc #experimentation #community #EarlyBird

    • No alternative text description for this image

Similar pages