-
The Four Pillars Revisited: Essential Skills for Data Scientists in an Agentic AI World
From Model Builders to System Orchestrators When I first wrote about the Four Pillars of a Successful Data Scientist—Logical Thinking, Hunger to Learn, Passion to Implement, and Communication Skills—the field was focused on building and deploying single, powerful models. The goal was to move projects from “pilot purgatory” to production. Today, in 2026, the terrain has…
-
Real-Time Analytics and Edge AI: Transforming Hong Kong’s Smart City and Fintech Sectors
The Latency Challenge in a City That Never Sleeps Hong Kong operates at a blistering pace—financial markets react in microseconds, container cranes move with relentless efficiency, and metro trains arrive with clockwork precision. In such an environment, sending data to a distant cloud server for processing and waiting for a response isn’t just inefficient; it’s…
-
Green AI and Sustainable Data Science: Reducing Carbon Footprint in High-Density Cities like Hong Kong
The Invisible Cost of Intelligence: AI’s Growing Energy Dilemma In the towering data centers and humming server rooms of Hong Kong, a silent transformation is underway. As businesses and institutions race to harness generative AI and large language models, they are inadvertently consuming electricity at an unprecedented rate. The computational demand for training and running…
-
The Rise of Small Language Models and Open-Source AI: Opportunities for Asia-Pacific Data Scientists
Beyond the Billion-Parameter Arms Race For years, the narrative in artificial intelligence has been dominated by scale—more parameters, larger datasets, and ever-increasing computational budgets. This race towards massive, centralized models created a significant gap. For most organizations, especially in the dynamic and diverse Asia-Pacific (APAC) region, the costs, infrastructure demands, and privacy implications of deploying…
-
Data Governance in the Age of AI Agents: Lessons from Asia’s Regulatory Landscape
When Your AI Assistant Becomes a Compliance Liability The rise of agentic AI systems—autonomous workflows that can execute tasks, make decisions, and interact with other software—marks a watershed moment for data governance. As I’ve written before regarding professional integrity in data science, control over data is the cornerstone of trust. However, an AI agent that can…
-
Building AI Factories: How Hong Kong Companies Can Create Scalable GenAI Infrastructure on a Budget
From Cost Centre to Competitive Engine: The “AI Factory” Mindset For Hong Kong’s dynamic businesses, the promise of Generative AI (GenAI) is tempered by a harsh reality: the perceived high cost and complexity of building a robust, scalable infrastructure. Many companies find themselves trapped in “Pilot Purgatory,” where impressive prototypes—like the autonomous agent systems we’ve…
-
Escaping Pilot Purgatory 2.0: Strategies for Scaling Agentic Workflows in Production
From Static Models to Dynamic Workflows: A New Frontier of Stalled Progress In my 2024 article, “Pilot Purgatory in Machine Learning,” I explored the frustrating gap where promising AI prototypes fail to deploy. Two years later, we face a more complex challenge: Pilot Purgatory 2.0. This isn’t about deploying a single model anymore—it’s about scaling dynamic…
-
Agentic AI in 2026: From Hype to Real-World Deployment in Asian Enterprises
Introduction: Emerging from “Pilot Purgatory” Just two years ago, in my 2024 post on “Pilot Purgatory in Machine Learning,” I discussed the frustrating gap between promising prototypes and deployed production systems. Today, as we examine the state of Agentic AI in 2026, we witness a remarkable transformation. The landscape has evolved from isolated experiments with tools…
-
Pilot Purgatory in Machine Learning: Why Most Models Excel in Prototyping but Fail to Deploy in Production
The POC-to-Production Gap: A Persistent Challenge in Applied ML As data scientists, we’ve all encountered the frustrating reality of “pilot purgatory”—where promising proof-of-concept (POC) models deliver impressive offline performance but never make it to production. Industry reports highlight the scale of this issue: estimates suggest that 70-80% of ML projects fail to reach production deployment,…
-
AI Agents & Autonomous Systems: How AI Agents Like AutoGPT Are Evolving
In the rapidly advancing world of artificial intelligence, a new frontier is emerging—AI agents and autonomous systems. These aren’t just models that respond to prompts; they are self-directed digital entities that think, plan, and act toward achieving goals with minimal human intervention. At the center of this movement are AI agents like AutoGPT, BabyAGI,…