From Formal Limits to Silicon
Conclusion to Architecture of AI ProgressImage by AuthorThis concluding post brings together the four parts of the series and provides one place to access the full framework. The argument has unfolded...
View ArticleThe First Prompts
From Aristotle to ChatGPTPlato and Aristotle in The School of Athens, fresco, 1509–1511 (Stanza della Segnatura, Papal Palace, Vatican)Why Does AI Feel Different?We do not call it cheating to use a car...
View ArticleArchitecture of AI Progress: Part IV
How Scaling Laws Rechape the GPU-AI Silicon RaceImage by AuthorPart I argued that intelligence is an open-ended ascent across computational layers. Part II argued that practical progress can proceed...
View ArticleArchitecture of AI Progress: Part III
The Engine: Efficiency Doubling beneath Scaling LawsCover image by the author.Part I defined the outer boundary of what can be mechanized at all, and Part II defined the inner boundary of what can be...
View ArticleArchitecture of AI Progress: Part II
The Inner Boundary: Feasibility Is Not All-or-NothingCover image by the authorFrom the viewpoint of computability, Part I argued that intelligence is not a fixed mechanized closure but an open-ended...
View ArticleArchitecture of AI Progress: Introduction and Part I
The Outer Boundary: Intelligence Is Not a ClosureCover image by the author.How formal limits, practical feasibility, scaling laws, and hardware design fit into one unified pictureYou see the headlines...
View ArticleThe Race to Efficiency: A New Lens on AI Scaling
This chart shows how training loss decreases over time for various efficiency-doubling rates ( 𝛄 ), ranging from no improvement (𝛄 = 0 ) to rapid doubling every 6 months ( 𝛄 = 3 ). Faster doubling...
View ArticleRevisiting Ishiguro’s Klara and the Sun
Embodied AI from Fiction to RealityKlara and Josie. This image was generated using ChatGPT 4o.Spoiler Alert: The following review contains details that may reveal key plot points of Klara and the...
View ArticleKazuo Ishiguro’s Klara and the Sun
A Review in the Context of AI AdvancementKlara and Josie. This image was generated using ChatGPT 4o.Spoiler Alert: The following review contains details that may reveal key plot points of Klara and the...
View ArticleCan Machines Develop Morality?
A Causal-Theoretic PerspectiveThis is an extended excerpt from the main article, A Brief History of Causality from Homo Sapiens to AGI, which explores the evolution of causal reasoning from ancient...
View ArticleCan Machines ‘Understand’ Like Us?
A Computational-Complexity PerspectiveThis article is an extended excerpt from the larger work titled A Brief History of Causality from Homo Sapiens to AGI.This article is an extended excerpt from A...
View ArticleA Brief History of Causality from Homo Sapiens to AGI
Plato (left) and Aristotle, detail of The School of Athens by RaphaelIntroductionImagine a future where large language models (LLMs) evolve into Artificial General Intelligence (AGI), or ‘Strong AI.’...
View ArticleWill AGI Merit the Turing Award?
A Thought Experiment Exploring the Natures of Artificial and Human IntelligenceImage by the Author using ChatGPT-4The debate over Artificial General Intelligence (AGI) is intensifying, with discussions...
View ArticleWhen Authenticity Is Lost
Nostalgia and Obsession in A Generative AI Era‘Do Artificial Owls Hunt for Electric Toads?’ This image was created by the author using ChatGPT-4. Inspired by Philp K. Dick’s ‘Do Androids Dream of...
View ArticleSlow Is Fast, Fast Is Slow
AGI’s Forgotten Heritage in Classical Computational ComplexityIntroductionIn “Slow Is Fast, Fast Is Slow: AGI’s Forgotten Heritage in Classical Computational Complexity,” we explore the intricate...
View ArticleIn Our Image: The Cave and the Light of AGI
Photo by Jonatan Pie on UnsplashAbstractThis article offers fresh insights into the discussions of Artificial General Intelligence (AGI), drawing on Arthur Herman’s “The Cave and the Light.” It...
View ArticleReasoning and Knowledge
Photo by Michaela on UnsplashThe Unreasonable Effectiveness of Generative AI and Its ChallengesAbstractThe current landscape of Artificial Intelligence (AI) is undergoing a pivotal transformation with...
View ArticleFrom Self-Referential Paradoxes to Intelligence
Our Self-Exploratory Journey to Externalize Some of the Best in UsPhoto by marco balasso on UnsplashIntroductionAs Large Language Models (LLMs) like GPT-4 ascend to prominence, it’s fascinating to...
View ArticleBeyond the Bayesian vs. Frequentist Debate in the Advent of Large Language...
CP Lu, PhDPhoto by Juliana Malta on UnsplashIntroductionThere has long been a debate among statisticians about two different ways of thinking about probabilities: the Bayesian way and the frequentist...
View ArticleInfinite Dilemma 1: Not Enough Time
Photo by Francisco Jesús Navarro Hernández on UnsplashInfinite Dilemma 1Neo-Darwinistic Concept of Time Through the Lens of Computational ComplexityIf evolution is a computing problem, how has nature...
View Article