Why 90% of Data Science Fails—And How to Fix It
.png&w=828&q=75)
Eric Colson—former Chief Algorithms Officer at Stitch Fix and VP of Data Science and Machine Learning at Netflix—explains why most companies fail to fully leverage their data science teams. Drawing on his experience leading data functions at top tech companies, he shares how organizations can move beyond treating data science as a support function and instead empower data scientists to drive strategic impact through experimentation, iteration, and algorithmic decision-making.
Eric Colson—former Chief Algorithms Officer at Stitch Fix and VP of Data Science and Machine Learning at Netflix—explains why most companies fail to fully leverage their data science teams. Drawing on his experience leading data functions at top tech companies, he shares how organizations can move beyond treating data science as a support function and instead empower data scientists to drive strategic impact through experimentation, iteration, and algorithmic decision-making.
Guest
Eric Colson
Advisor of Data Science / Machine Learning. Former Chief Algorithms Officer Emeritus, Stitch Fix Former VP of Data Science & Engineering, Netflix at Activation Fund
Key Takeaways
- Why Treating Data Science as a Service Function Fails**
Many companies see data science as a support role, limiting it to answering business questions instead of driving strategic initiatives. The best organizations empower data scientists to generate ideas and shape decisions, not just execute predefined tasks.
2. The Hidden Value of Data Scientists: Cognitive Repertoires**
Data scientists bring unique ways of framing problems—drawing from machine learning, statistics, and classic models like Markov chains and the newsvendor problem. Recognizing the right framing often matters more than the specific tools used.
3. Scaling Experimentation, Not Just Models**
Most experiments fail—but that’s not a problem if you run enough of them. Organizations that embrace trial and error, rather than rigid planning, uncover the biggest wins. Data-driven companies don’t just analyze past results; they actively test their way to better decisions.
4. Decoupling Algorithms from Engineering Enables Impact**
When data teams depend on engineering to deploy models, iteration slows down. Separating algorithm development from infrastructure allows data scientists to experiment rapidly, test new ideas, and drive measurable business outcomes without waiting in line for resources.
5. From Cost Center to Revenue Driver**
Companies that structure data science as a core decision-making function—rather than a reporting layer—see direct business impact. The best data teams own their metrics, drive revenue, and operate autonomously, rather than waiting for permission to innovate.
You can read the full transcript here.
00:00 Data Scientist Value Left on the Table
00:28 Meet Eric Colson: DS/ML Advisor, ex-StitchFix, Netflix
01:34 The Evolving Role of Data Science
03:40 Unlocking the Potential of Data Scientists
04:10 Common Pitfalls in Data Science Utilization
07:59 The Importance of Cognitive Repertoires
09:54 Case Study: Stitch Fix's Algorithm Transformation
12:55 Leveraging Data Scientists' Unique Insights
21:30 Balancing Short-Term and Long-Term Goals
27:41 The Role of Experimentation in DS & ML
36:40 The Importance of Evidence in Data Science
37:59 Exploration and Trial Phases in DS & ML
38:29 Challenges in A/B Testing for Non-Algorithm Functions
39:36 Optionality in Data Science Experiments
45:13 Scaling Experimentation and Mitigating Risks
54:16 Organizational Changes for Data Science Impact
01:05:10 Final Thoughts and Takeaways
Ready to unleash your data?
Discover how Delphina can transform your data science.
