← Back to list

AlphaGo: The Algorithmic Revolution That Went From a Board Game to an Era

A complete record of development, architecture, every human match, and what it all means for the age of LLMs

BV6 · 2026-03-19 12:56 · 5 claps · 14.4 min read
#deepmind #machine-learning #artificial-intelligence #alphago #large-language-models
Open on Medium ↗
Wiki topics: LLM · Large Language Models ML · Machine Learning AI · AI · General EDU · Education & Learning 💻 · Programming 🏛️ · Architecture

AlphaGo: The Algorithmic Revolution That Went From a Board Game to an Era

A complete record of development, architecture, every human match, and what it all means for the age of LLMs

I. Why Go?

In the story of artificial intelligence, board games have always been the yardstick of machine intelligence. IBM’s Deep Blue defeated chess world champion Garry Kasparov in 1997 — a moment widely hailed as a milestone. Yet the complexity of Go dwarfs that of chess by orders of magnitude: the number of legal board configurations is approximately 10¹⁷⁰, exceeding the total number of atoms in the observable universe. Traditional AI methods — brute-force search and heuristic evaluation — were practically useless against Go. For decades, the strongest Go programs could only reach amateur level, and experts widely expected AI would need at least another decade before it could challenge top human players.

In March 2016, DeepMind’s AlphaGo defeated Lee Sedol 4–1, shattering that expectation. A decade has now passed. In those ten years, AlphaGo’s methodology spread from the game board to protein folding and won a Nobel Prize in Chemistry; its “intuition + search” dual-system architecture has been rediscovered at the heart of today’s LLM reasoning revolution; and the open-source blueprints it left behind have fundamentally rewritten how humans play Go. Looking back across this decade, the match was far more than a technical breakthrough — it redefined the boundary of what machines could do, and through its subsequent iterations (AlphaGo Zero, AlphaZero, MuZero) traced a clear evolutionary arc from domain-specific mastery to general intelligence.

II. Development History: From Concept to Transcendence

2.1 DeepMind and the Birth of AlphaGo

AlphaGo was developed by London-based DeepMind, founded in 2010 by Demis Hassabis, Shane Legg, and Mustafa Suleyman, and acquired by Google for approximately $500 million in 2014. David Silver led the algorithmic design of the entire AlphaGo family.

From the outset, the research goal was never simply to “build a better Go program.” It was to validate whether deep reinforcement learning could solve problems previously thought to require human intuition and creativity.

2.2 The Original AlphaGo (AlphaGo Fan, 2015)

The core architecture combined deep neural networks with Monte Carlo Tree Search (MCTS):

  • Policy Network: A 13-layer convolutional neural network trained via supervised learning on roughly 30 million move positions from human game records, learning to predict where a human expert would most likely play. It was then fine-tuned through self-play reinforcement learning.
  • Value Network: A separate convolutional neural network that evaluated the win probability of a given board position.
  • Monte Carlo Tree Search (MCTS): The policy network guided the direction of search (pruning irrelevant branches), while the value network and fast rollouts assessed leaf-node win rates, enabling efficient decision-making.

In October 2015, this version defeated European champion Fan Hui (professional 2-dan) 5–0 in a closed-door match. This was the first time AI had beaten a professional Go player on a full-sized 19×19 board without handicap. The corresponding paper was published in Nature in January 2016.

2.3 AlphaGo Lee (2016)

The version that faced Lee Sedol shared a similar architecture but featured deeper networks, more training data, and a more powerful hardware deployment — 1,920 CPUs and 280 GPUs running on Google’s cloud computing infrastructure.

2.4 AlphaGo Master (Late 2016–2017)

Between late 2016 and early 2017, a mysterious account appeared on the Tygem and Fox Go servers under the names “Master” and “Magister,” winning 60 consecutive blitz games against top professionals including Ke Jie, Park Junghwan, and 井山裕太 (Yuta Iyama). This was AlphaGo’s upgraded version.

In May 2017, at the Future of Go Summit in Wuzhen, China, AlphaGo Master played a three-game match against the world’s №1 ranked player, Ke Jie. Google DeepMind offered a $1.5 million winner’s prize. Master won all three games, and also won a team match against five top Chinese professionals and participated in a pair Go match. The Chinese Weiqi Association awarded AlphaGo a professional 9-dan ranking.

AlphaGo then announced its retirement from competitive play.

2.5 AlphaGo Zero (October 2017)

This was the true paradigm leap. AlphaGo Zero’s fundamental differences from all previous versions:

  • Zero human knowledge: No human game data whatsoever. Trained purely through self-play reinforcement learning, starting only from the rules of Go.
  • Single neural network: Merged the previously separate policy and value networks into a single “dual-headed” residual network (ResNet), sharing low-level feature extraction. One output head predicted move probabilities; the other predicted win probability.
  • No rollouts: Relied entirely on the neural network’s value output rather than fast random playouts.
  • Minimal input: Only the raw positions of black and white stones on the board — no hand-crafted features.

During training, AlphaGo Zero played approximately 4.9 million games against itself in three days. It independently rediscovered Go joseki (established opening patterns) that humans had accumulated over thousands of years, then developed entirely novel strategies beyond human understanding. It defeated AlphaGo Lee (the version that beat Lee Sedol) 100–0. Training used 64 GPU workers and 4 TPUs for inference, at a computational cost of approximately 3×10²³ FLOPs.

2.6 AlphaZero (December 2017)

Further generalization. AlphaZero extended AlphaGo Zero’s methods to chess and shogi, defeating the strongest specialized programs in all three domains (AlphaGo Zero in Go, Stockfish in chess, Elmo in shogi), with training times of just hours to a single day per domain. It demonstrated that a single algorithmic framework could be domain-agnostic.

2.7 MuZero (2019)

AlphaZero’s successor pushed further still — it didn’t even need to know the rules of the game in advance, instead learning a dynamic model of the environment during training. MuZero achieved superhuman performance in Go, chess, and shogi, and in testing across all 57 classic Atari 2600 games, outperformed prior state-of-the-art algorithms in the majority of them by substantial margins.

III. The Complete Human vs. Machine Match Record

3.1 AlphaGo vs. Fan Hui (October 2015, London)

Game Sides Result Game 1 AlphaGo (Black) AlphaGo wins by resignation Game 2 AlphaGo (White) AlphaGo wins Game 3 AlphaGo (Black) AlphaGo wins Game 4 AlphaGo (White) AlphaGo wins Game 5 AlphaGo (Black) AlphaGo wins

Final score: 5–0. Fan Hui was the European Go champion, professional 2-dan. The match was held behind closed doors; results were disclosed in January 2016 alongside the Nature paper. It should be noted that there is a vast skill gap between a professional 2-dan and a top 9-dan player.

3.2 AlphaGo vs. Lee Sedol (March 9–15, 2016, Four Seasons Hotel, Seoul)

This was the most-watched human-machine Go match in history. Lee Sedol, professional 9-dan, held 18 world championship titles and was widely regarded as the strongest player of the 2000s–2010s. The match used Chinese rules with 7.5-point komi; each side had 2 hours of thinking time plus three 60-second byoyomi periods. The winner would receive $1 million.

Game Date Sides Result Key Moment Game 1 Mar 9 AlphaGo (Black) AlphaGo wins (resignation) Lee expressed shock post-game Game 2 Mar 10 AlphaGo (White) AlphaGo wins (resignation) Move 37: A creative placement with 1-in-10,000 probability, overturning centuries of conventional wisdom. 9-dan Gu Li called it a “divine move” Game 3 Mar 12 AlphaGo (Black) AlphaGo wins (resignation) AlphaGo clinches the match at 3–0 Game 4 Mar 13 AlphaGo (White) Lee Sedol wins (resignation) Move 78: Lee’s “God’s Touch” — equally a 1-in-10,000 brilliancy. AlphaGo’s win-rate estimate plummeted from 70% after move 79, followed by a cascade of classic MCTS blind-spot errors (moves 87–101) Game 5 Mar 15 AlphaGo (Black) AlphaGo wins (resignation) An extremely close game throughout; Lee resigned after using all byoyomi

Final score: 4–1. Over 200 million people worldwide watched the live broadcast. Lee received $170,000 ($150,000 appearance fee + $20,000 game-win bonus). AlphaGo’s $1 million prize was donated by Google DeepMind to UNICEF and Go organizations. The Korea Baduk Association awarded AlphaGo an honorary 9-dan ranking.

Lee Sedol remains the only human to have ever defeated AlphaGo in any of its 74 official games. When he retired in 2019, he explicitly cited AI’s invincibility as one reason for leaving professional Go.

3.3 Master’s 60-Game Online Streak (December 2016–January 2017)

AlphaGo Master played under anonymous accounts on the Tygem and Fox Go servers, winning 60 consecutive blitz games. Opponents included Ke Jie (lost all three games), Park Junghwan, Yuta Iyama, Gu Li, Chang Hao, and Chen Yaoye — all among the world’s top-ranked professionals. Not a single loss.

3.4 AlphaGo vs. Ke Jie & the Future of Go Summit (May 23–27, 2017, Wuzhen, China)

Event Result Three-game match: AlphaGo vs. Ke Jie AlphaGo 3–0 Pair Go: AlphaGo + Lian Xiao vs. AlphaGo + Gu Li Lian Xiao’s side wins Team match: AlphaGo vs. five-player team (Shi Yue, Mi Yuting, Tang Weixing, Chen Yaoye, Zhou Ruiyang) AlphaGo wins

After the match, Ke Jie made his now-famous remark: “After humanity spent thousands of years improving our tactics, computers tell us that humans are completely wrong… I would go as far as to say not a single human has touched the edge of the truth of Go.”

AlphaGo officially retired. The Chinese Weiqi Association awarded it a professional 9-dan ranking.

3.5 Complete Match Summary

Version Opponent Format Score AlphaGo Fan Fan Hui 2p 5-game match 5–0 AlphaGo Lee Lee Sedol 9p 5-game match 4–1 AlphaGo Master Online professionals Blitz 60–0 AlphaGo Master Ke Jie 9p 3-game match 3–0 AlphaGo Master 5-player team Single game 1–0 AlphaGo Master Pair Go Single game —

Overall official record: 74 games, only 1 loss (Lee Sedol, Game 4).

3.6 After Retirement: AlphaGo’s Open-Source Offspring and the Transformation of Go

AlphaGo itself was permanently retired after the Wuzhen summit. Google never fully open-sourced its core code or commercialized it. However, its papers provided a complete theoretical blueprint that has thoroughly reshaped today’s Go ecosystem.

The dominant Go AI programs in use worldwide are now open-source implementations built on the AlphaGo Zero/AlphaZero architecture. The most influential is KataGo, which improved upon AlphaZero’s feature inputs and training objectives — for instance, adding precise territory-size prediction rather than win-rate alone — achieving faster convergence and stronger play with less compute. Leela Zero is another significant open-source replication project.

Professional Go training has been fundamentally transformed. The 3–3 point invasion, once considered a losing move by humans, became a standard modern joseki after AI’s win-rate analysis validated it. The strength of top players (such as current world №1 Shin Jinseo) is now largely evaluated by how well their first 50 moves align with AI recommendations — what the Go world calls “AI concordance rate.” AlphaGo changed not just how players play, but how they understand the game.

The flip side: since running KataGo on a consumer-grade GPU is sufficient to defeat any human 9-dan with a handicap, anti-cheating in Go tournaments has become a critical operational challenge. Banning electronic devices during matches and setting up signal-shielded zones are becoming standard practice — a textbook structural consequence of AI capability spillover into human competitive domains.

IV. Deep Dive into the Technical Architecture

4.1 The Original Dual-Network + MCTS Architecture

The core design can be decomposed into three layers:

Perception — Policy Network: Input is a multi-channel 19×19 representation of the board (stone positions, liberties, ladder status, etc.), output is a 19×19 probability distribution over move locations. First trained via supervised learning from human game records (SL Policy Network), then fine-tuned through self-play reinforcement learning (RL Policy Network).

Evaluation — Value Network: Same input, but outputs a single scalar predicting the current player’s win probability. This solved the fundamental challenge of positional evaluation in Go.

Decision — Monte Carlo Tree Search (MCTS): For each move decision, MCTS starts from the current position as the root node and repeatedly cycles through selection → expansion → evaluation → backpropagation. The policy network determines which branches to explore; the value network and rollouts jointly assess leaf-node quality. After extensive simulation, the move with the highest visit count is selected.

The elegance of this architecture lies in its duality: neural networks provide intuition (narrowing the search space), while MCTS provides reasoning (deep calculation within that narrowed space). Together, they gave AlphaGo both “board sense” and “reading ability.”

4.2 The Paradigm Shift of AlphaGo Zero

AlphaGo Zero’s advances were not incremental — they were categorical:

Unified dual-head network: Merged policy and value networks into a single residual network (ResNet, approximately 20 residual blocks). Shared low-level feature extraction enabled policy judgment and positional evaluation to mutually reinforce each other — the policy head tells search “where to go,” and the value head tells search “how good it is there.”

Self-play reinforcement learning loop: Neural network guides MCTS → MCTS search results generate better training data → training data updates the neural network → a stronger network guides better search. This is a self-reinforcing positive feedback loop, structurally similar to generative adversarial network (GAN) training logic, but more unified in direction.

De-humanization: All human game data and hand-crafted features were removed. Input was reduced to raw stone positions alone. This proved that human knowledge in certain domains is not just unnecessary — it may actually be a constraint.

4.3 From AlphaZero to MuZero: The Arc of Generalization

AlphaZero proved the same framework could apply across domains (Go, chess, shogi). MuZero went further: it didn’t need explicit rules at all, instead learning an internal model of the environment and conducting search and planning within that learned model. This extended the algorithm from “perfect-information games with known rules” to “open environments with unknown or partially observable dynamics.”

The evolutionary path is clear: AlphaGo (human knowledge + search) → AlphaGo Zero (self-learning + search) → AlphaZero (cross-domain self-learning + search) → MuZero (learned environment model + search). Each step stripped away another layer of prior-knowledge dependency while expanding the scope of applicability.

V. Lessons, Parallels, and Divergences for the Age of AI

5.1 What Transfers from AlphaGo’s Architecture to Today’s AI

The “intuition + reasoning” dual-system architecture. AlphaGo’s policy network ≈ fast intuition (System 1); MCTS ≈ slow reasoning (System 2). This structure has clear echoes in today’s large language model (LLM) era: the LLM itself resembles a giant policy network providing fast “intuitive responses,” while Chain-of-Thought, Tree-of-Thought, and various search-augmented reasoning methods layer MCTS-like reasoning on top. The emergence of OpenAI’s o1/o3, DeepSeek R1, and other “reasoning models” essentially replays AlphaGo’s dual-system logic. A caveat is necessary: AlphaGo’s policy network outputs a probability distribution over a discrete action space, while an LLM’s “intuition” operates as implicit reasoning in continuous semantic space — the computational substrates differ. This mapping is instructive at the structural level but should not be overextended to the mechanistic level.

Self-play and Reinforcement Learning from Human Feedback (RLHF). AlphaGo’s self-play mechanism — the closed loop of generating data, evaluating quality, and updating strategy — shares structural similarities with RLHF/DPO pipelines in today’s LLM training. The crucial difference: AlphaGo’s reward signal was objective (win/loss), while LLM reward signals derive from human preferences (subjective, ambiguous, manipulable), introducing alignment tax and value-lock risks.

The path from domain specialization to general capability. The trajectory from AlphaGo → AlphaZero → MuZero — first validating core algorithms in narrow domains, then progressively removing domain-specific assumptions — forms a dual mapping with LLM development. LLMs take the reverse route: first building general language understanding, then adapting to specific domains through fine-tuning and tool use. Whether these two paths will ultimately converge remains one of the central open questions in AI research.

5.2 Key Divergences: The AlphaGo Paradigm vs. the LLM Paradigm

Closed games vs. the open world. Go is a perfect-information game: rules are fixed, state is fully observable, win/loss is unambiguous. The real world possesses virtually none of these properties. AlphaGo’s search methods face state-space explosion, ambiguous reward signals, and broken long-range causal chains in open environments. MuZero partially addresses this by learning an environment model, but a vast gap remains between learned models and real-world complexity.

Explicit search vs. implicit reasoning. AlphaGo performs explicit tree search at every move (thousands of simulations). Current LLMs reason more “implicitly” — via forward passes through the network in latent space, without explicitly expanding a decision tree. This makes LLMs faster and more flexible, but also harder to explain and verify. Reasoning models (like o1) attempt to balance the two: using LLMs to generate search paths, and some evaluation mechanism to adjudicate path quality.

Compute efficiency and accessibility. AlphaGo used 1,920 CPUs and 280 GPUs against Lee Sedol. AlphaZero’s training required Google’s TPU clusters. This computational threshold means that while AlphaGo’s methods are algorithmically elegant, they are engineering-wise deeply dependent on compute monopolies. The open-source LLM ecosystem (LLaMA, Mistral, etc.) is lowering this barrier, but frontier reasoning capabilities remain concentrated among a handful of organizations with massive compute.

Interpretability and the “black box” problem. AlphaGo’s MCTS process is partially traceable — one can inspect the search tree expansion, visit counts, and value estimates at each node. But the neural network’s internal “board sense” (why it considers a position favorable) remains a black box. LLMs face the same problem at far greater scale. AlphaGo’s experience demonstrates that even when systems exhibit superhuman output-level performance, the interpretability of their internal mechanisms remains an unsolved challenge.

5.3 Insights and Forward-Looking Implications

The metaphor of Move 37 — the nature of machine creativity. AlphaGo’s Move 37 in Game 2 was judged by every professional Go player as “a move no human would play.” 9-dan Gu Li called it a “divine move,” placed at a position with a 1-in-10,000 probability. This move was not an imitation of human experience — it emerged from entirely novel understanding generated through self-play. It poses a profound question: when machines discover effective strategies outside the human knowledge system, should we reconsider the definitions of “knowledge” and “creativity”?

The warning of Move 78 — the exposure of AI brittleness. Lee Sedol’s Move 78 in Game 4 was equally a 1-in-10,000 brilliancy, but what matters more is AlphaGo’s reaction: its win-rate estimate plummeted from 70%, followed by a cascade of classic MCTS blind-spot errors (search-tree pruning that overlooked specific critical variation lines). This reveals a problem that still pervades AI systems today: under extreme conditions outside the training distribution, system behavior can degrade catastrophically. AlphaGo’s “brittle fracture” — overwhelmingly powerful in normal positions, yet shattered by a single outlier move — is a shared vulnerability across all deep learning systems.

Human knowledge as constraint rather than asset. AlphaGo Zero surpassed all human-data-trained versions using zero human data. Ke Jie put it bluntly: “Humans are completely wrong about Go.” Extrapolating: in certain structured problems, accumulated human experience and doctrine may not be an accelerator but a ceiling. This connects directly to current debates in AI development — are the human preferences injected through RLHF aligning AI, or constraining it?

Search as a universal reasoning amplifier. One of AlphaGo’s core insights: even a weak network, when augmented with sufficient search, can produce strong performance; a strong network plus search can produce superhuman performance. This principle is being rediscovered in the LLM space: test-time compute — investing additional computation during inference for search and verification — is emerging as a key lever for boosting LLM capability. In essence, AlphaGo validated this path as early as 2016.

The wisdom of retirement — knowing when to stop. AlphaGo retired from competitive play after proving its dominance. The business and research logic were both clear: the marginal value of continued play was zero, and a low-probability loss would cost reputation. But it also raised a question about AI deployment: a system that has proven superhuman derives its value not from continuing to beat humans, but from applying its methodology to more consequential domains. DeepMind’s subsequent work has extended this principle along at least three dimensions:

From perfect information to imperfect informationAlphaStar defeated professional players in StarCraft II, handling hidden information (fog of war), real-time micro-management, and long-horizon economic planning that don’t exist in Go, demonstrating algorithmic potential in multi-agent, imperfect-information settings.

From games to fundamental scienceAlphaFold transferred the ability to “find optimal solutions in vast state spaces” from the game board to protein folding. AlphaFold 2 accurately predicted the 3D structures of virtually all known proteins; AlphaFold 3 extended to protein–DNA/RNA interaction prediction, directly accelerating global drug discovery. In 2024, the Nobel Prize in Chemistry was awarded to DeepMind founder Demis Hassabis and researcher John Jumper — the most weighty external validation of AlphaGo’s methodology.

From intuitive decision-making to formal reasoningAlphaTensor discovered novel, more efficient matrix multiplication algorithms, breaking a human record that had stood for 50 years. AlphaGeometry and AlphaProof, combining neural language models with symbolic deduction engines, solved 4 of 6 problems at the 2024 International Mathematical Olympiad (IMO), scoring 28 points (out of 42) — one point short of the gold-medal threshold, performing at approximately silver-medal level. This marks AI’s crossing from “intuitive pattern matching” into “rigorous logical proof” — the ultimate extension of the original AlphaGo architecture’s “search + evaluation” logic.

VI. Conclusion: The Moves Beyond the Board

The story of AlphaGo is, on the surface, a story about Go. At its core, it is a story about learning how to learn. It proved three things:

First, the combination of deep learning and search can solve complex problems previously thought to require human intuition.

Second, in structured environments, knowledge generated through self-play can surpass the entirety of human accumulated understanding.

Third, algorithmic generality — the same set of methods can be transferred from Go to chess, shogi, protein folding, matrix computation, and mathematical proof, all the way to Nobel Prize-level scientific recognition.

For today’s AI practitioners and observers, AlphaGo’s deepest legacy is not how many games it won, but the path it demonstrated: abstracting general algorithms from domain knowledge, graduating from human demonstration into self-evolution, expanding from closed games to open problems. That path is still being walked today — only the board is larger, the moves more complex, and the stakes immeasurably higher.

Written March 2026 | Sources: DeepMind official materials, Nature papers, match records


메타데이터
post_id
c0257de48bb0
slug
alphago-the-algorithmic-revolution-that-went-from-a-board-game-to-an-era-c0257de48bb0
url
https://medium.com/@bv6/alphago-the-algorithmic-revolution-that-went-from-a-board-game-to-an-era-c0257de48bb0
canonical_url
https://medium.com/@bv6/alphago-the-algorithmic-revolution-that-went-from-a-board-game-to-an-era-c0257de48bb0
author_url
https://medium.com/@bv6
status
ok
fetched_at
2026-07-06 23:41:08