Why You Aren’t Learning As Much As You Could From Your Experiments
Explore how critical thinking can enhance your A/B testing strategies.
												Jan 12, 2016
							
												
													•
													12 min read
												
											
										
		
		
			
			
				-
			
		
	
	
		
			
				
				
					Intermediate
				
				
				
				
			
		
	
			Assumption Testing
		
		
		
	
		
		
		
		
		
		
		
			Deductive Reasoning
		
		
		
	
		
		
		
		
		
		
		
			Inductive Reasoning
		
		
		
	
		
		
		
		
		
		
		
			Innovation Frameworks
		
		
		
	
		
		
		
		
		
		
		
			Problem Analysis
		
		
			
				Show More
			
		
		
	
		
		
		
		
		
		
		
		
		
	
		
		
		
		
		
		
		
		
		
			
		
	
								Summary
										This article delves into the common pitfalls of A/B testing and emphasizes the importance of critical thinking in product management. Drawing from John Dewey's philosophy, it advocates for a systematic approach to experimentation, emphasizing inductive discovery and deductive testing. Product managers can enhance their testing strategies by applying these reflective thinking principles, leading to more meaningful insights and effective product development. Engage with this content to refine your experimentation skills.
									
								
								
								
								
									Takeaways
- Apply critical thinking principles to enhance product management and A/B testing.
- Avoid jumping to conclusions without thorough reflection and analysis.
- Start with inductive discovery to form a coherent theory before conducting experiments.
- Systematic inquiry and reflection lead to more meaningful and actionable insights.
- Use deductive testing to validate theories and generate new insights.
Suggested Resources
Common OKR mistakes when writing them
		
		
			
			
				-
			
		
	
	
		
			
				
				
					Intermediate
				
				
				
				
			
		
	
Is Compliance Killing Corporate Innovation?
		
		
			
			
				-
			
		
	
	
		
			
				
				
					Intermediate
				
				
				
				
			
		
	
The GO Product Roadmap
		
		
			
			
				-
			
		
	
	
		
			
				
				
					Intermediate
				
				
				
				
			
		
	
"As a user" needs to stop
		
		
			
			
				-
			
		
	
	
		
			
				
				
					Intermediate
				
				
				
				
			
		
	
10 Product Owner Questions
		
		
			
			
				-
			
		
	
	
		
			
				
				
					Intermediate
				
				
				
				
			
		
	
12 Types of Prototypes to Test Your Idea
		
		
			
			
				-
			
		
	
	
		
			
				
				
					Intermediate
				
				
				
				
			
		
	
20 Things I've Learned as a Systems (Over) Thinker
		
		
			
			
				-
			
		
	
	
		
			
				
				
					Intermediate