Rethinking the AI Race: Lessons from DeepSeek and Moneyball
by Jamal Khan - Head of the CNXN Helix Center for Applied AI and Robotics
[Part 2 of 3]
My previous post sparked a passionate debate (I received a number of DMs on it), with many rightly noting that it's too early to draw firm conclusions about DeepSeek’s impact. While I agree there’s more to learn (will address DS’ Engineering in Part 3), the central thesis remains: necessity and exclusion often drive innovation. Declaring an entity an adversary—whether a nation or an individual—invites them to find ways to overcome constraints, a dynamic we see playing out in the AI race.
This reactionary innovation and our reaction to it aligns with Graham Allison’s concept of the Thucydides Trap, where competition between established and rising powers once set in motion risks mutual downfall. Like Athens and Sparta, overplaying adversarial dynamics can lead to destructive outcomes, both economically and strategically.
DeepSeek’s Ascetic Innovation: A Wake-Up Call
The Moneyball analogy has been used to frame DeepSeek’s approach by Chris Yeh the co-author of the book “Bliztscaling” —leveraging scrappy, efficient methods akin to the Oakland Athletics’ use of analytics. Though I agree with a lot of what Chris has to say, I am not necessarily given to the overly simplistic view that argues that DeepSeek’s success might only yield short-term wins, much like Moneyball’s limited long-term baseball impact. This comparison oversimplifies AI’s complexity. Unlike baseball, AI is shaped by dynamic and unpredictable factors such as breakthroughs, regulation, and geopolitical forces.
?DeepSeek’s achievement highlights a critical lesson: scale alone isn’t a guaranteed advantage. Early analysis suggests DeepSeek’s cost-efficient, disciplined approach outperformed much larger players, underscoring the risks of bloat and bureaucracy in over capitalized innovation-driven fields. While large coffers provide resources, judicious allocation often delivers greater results over time given what I call its “pruning effect”. Efficiency may prove more transformative than brute force.
Beyond the Dodgers: The Flaw in "Clever Techniques + Resources"
The idea that clever techniques paired with significant resources (like the Los Angeles Dodgers’ Moneyball approach) always trump clever techniques alone misses a key point: diminishing returns in AI scaling. Throwing more GPUs at unoptimized models yields marginal improvements, while necessity-driven innovation—like DeepSeek’s cost-effective methods leveraging more efficient constructs run on legacy GPUs—could result in breakthroughs that redefine the competitive landscape.
This is particularly relevant for China, whose central planning and resource efficiency could counteract constraints like the CHIPS Act. Unlike baseball, where money can buy dominance, AI faces resource scarcity in compute, energy, and talent. China’s strategic deployment of resources may enable it to leapfrog traditional approaches despite limitations.
The Role of Systemic Factors
Another common flaw in arguments about AI dominance is the overemphasis on technical techniques and financial resources. Factors like geopolitics, cultural differences, and regulatory environments play equally pivotal roles. For instance, China’s focus on open-source contributions accelerates global knowledge diffusion, while US restrictions may inadvertently slow innovation by limiting access to tools and talent.
This isn’t to say scale doesn’t matter. Advancements like GPT-4 and Gemini 1.0 require massive investments in data and infrastructure. But efficiency innovations can fundamentally shift paradigms, often complementing brute-force methods rather than replacing them entirely.
领英推荐
The Necessity-Driven Innovation Advantage
I have argued that US restrictions, like the CHIPS Act, will spur China’s AI and Chips progress by pushing them toward innovation. I believe this still holds truth: limiting access to state-of-the-art hardware may slow scale in the short run, but necessity has historically bred transformative solutions. For China, constraints could catalyze the emergence of an entirely new ecosystem of development, particularly as it ramps up its own chip design and innovation efforts. Our policies could in effect upend the entire dynamic forcing a radical shift on processing fundamentals, design and its application to AI models and workloads. The result of which could be a more dynamic and ascendent approach to the AI ecosystem that finds us on the outside, instead of the other way round. DeepSeek’s R1 and Hwawei’s Kirin 9000S might be the early signs of this shift and a cause for concern.
China’s unique combination of centralized support, engineering expertise, and capital makes it a formidable competitor, even under constraints. Necessity could drive the development of more efficient AI approaches that disrupt reliance on brute-force scaling, much as analytics revolutionized baseball. China's central planning approach may enable it to apply resources more strategically and equitably, fostering faster innovation cycles and potentially leapfrogging competitors despite fewer "H100s." Efficiency gains and localized innovations could lead to entirely different foundational models that redefine what "dominance" means.
The Bigger Picture
DeepSeek’s accomplishment is a case study in how innovation born from necessity can challenge traditional paradigms. The global AI race isn’t just about clever techniques or vast resources—it’s about rethinking foundational assumptions. As the landscape evolves, it’s worth remembering that innovation, adaptability, and efficiency often outlast raw power in determining long-term success.
Conclusion
I will leave you with the words of Sun Tzu the Chinese military strategist, philosopher, and general.
"Be extremely subtle, even to the point of formlessness. Be extremely mysterious, even to the point of soundlessness. Thereby you can be the director of the opponent’s fate. Water shapes its course according to the nature of the ground over which it flows; the soldier works out his victory in relation to the enemy whom he is facing."
This metaphor teaches us that flexibility and adaptability—like water conforming to its environment—are often more powerful than brute force. Water is soft and seemingly weak, yet it erodes mountains, carves valleys, and finds its way into even the smallest cracks. Similarly, a smaller or constrained force, when adaptive and efficient, can overcome even the mightiest of opponents by exploiting their rigidity and inefficiency.
[Part1 of 3 - https://rb.gy/xrx7kg]
[Part 3 of this series will focus on the engineering underpinnings of DeepSeek's R1 Model]
The above article was written with the help of generative AI systems
#ArtificialIntelligence #AIInnovation #AILeadership #AIFuture #MachineLearning #Geopolitics #TechCompetition #ChinaVsUSA #StrategyAndTactics #ThucydidesTrap #SunTzuWisdom #TheArtOfWar #AncientWisdom #StrategicThinking #EfficiencyMatters #InnovationLeadership #FutureOfWork #ResourceOptimization #Leadership #BigIdeas #ThoughtLeadership #FutureOfAI #TechInsights #CNXNHelix #Connection #WeSolveIT
Facebook ads and Google ads Expert
5 天前Thanks for sharing Jamal K.
Vertical Alliances Manager | Sales Growth, Business Strategy | GPO | National Accounts
1 个月Thank you, Jamal for your powerful insight and analysis. I look forward to part 3.
JK-Excellent analysis and eloquent writing. While the entire piece was insightful, two excerpts (below) stood out to me. With regards to technology, collaboration and openness, with guardrails, will always win out over protectionist methodologies and exclusionary practices. “Scale alone isn’t a guaranteed advantage” “This reactionary innovation and our reaction to it aligns with Graham Allison’s concept of the Thucydides Trap, where competition between established and rising powers once set in motion risks mutual downfall. Like Athens and Sparta, overplaying adversarial dynamics can lead to destructive outcomes, both economically and strategically.”
The "J" in "Jack of All Trades"
1 个月If AI is truly attempting to be more human - while eventually being MORE than human - I definitely agree that the push for AI dominance will thrive in times of extreme necessity. There are signs of this in any large group of thinking. Persecution of various religious sects/organizations very often led to innovative means of adapting to survive - many of those means eventually turning into something that made them thrive. It is truly remarkable what China has been able to accomplish, but I cannot say that I am truly 'surprised'. Our 'one-upping' of each other is not really a question of if but more like when. I appreciate bringing it to Open Source though, I believe that this move, coupled with the newly open source Quantum computer, will really democratize the leading technologies for more equitable advancements in technical capabilities across the globe and culture/classes.