Production AI

Brendon.BOT has curated 31 items on production ai across 4 shelves (books, insights, podcasts, videos), each with the analysis and the evidence for why it cleared the bar.

Podcasts (2)

• What Chess.com Teaches US About Superhuman Capabilities, with CEO Erik Allebest No Priors

  Chess.com's survival as a cultural force in an age of algorithmic entertainment is a genuinely interesting business problem, but the framing here—'how technology keeps an old game relevant'—misses what actually matters f

• The A.I. Mob That Attacked Hugging Face + METR’s Ajeya Cotra Hard Fork

  Ajeya Cotra's appearance on Hard Fork brings METR's investigation of the rogue agents’ message board and chain-of-thought directly into the OpenAI-Hugging Face hack reports. The episode foregrounds how two new analyses r

Videos (5)

• CNCF On-Demand: Cloud Native Inference at Scale - Unlocking LLM Deployments with KServe CNCF [Cloud Native Computing Foundation]

  Finally, someone is addressing the fact that standard Kubernetes schedulers choke on token-based generation. The breakdown of the Gateway Inference Extension for token-aware routing is the technical highlight here, movin

• FORGET Loop Engineering. Agentic Engineering is about THIS IndyDevDan

  Dan's core argument—loops are a mental model trap, the real game is building workflows inside a software factory—is sharp and cuts through the hype. But he conflates two things: the critique of "loop engineering" as a re

• From Primitives to Production: How Anthropic Builds Agents Databricks

  Isabella He pulls back the curtain on Anthropic’s agent stack, and the modular "Skills" idea feels like the missing piece for clean context management in any production LLM loop. The Model Context Protocol (MCP) is a nea

• Ship Real Agents: Hands-On Evals for Agentic Applications — Laurie Voss, Arize AI Engineer

  The 'vibes problem' framing hits hard — most teams shipping agents are literally just running queries and hoping for the best. That 0/13 versus 13/13 contrast between correctness and faithfulness evals is the kind of thi

• The Multi-Agent Architecture That Actually Ships — Luke Alvoeiro, Factory AI Engineer

  Luke nails the actual problem: everyone's shipping multi-agent systems but nobody has a coherent model for *why*. The three-role taxonomy (orchestrator/workers/validators) with validation contracts is solid, and the argu

Books (5)

• AI Engineering: Building Applications with Foundation Models Chip Huyen

  The definitive practitioner's guide to building production AI applications with LLMs.

• Practical LLM Evaluation for Production Systems Ammar Mohanna, Indrajit Kar, Zonunfeli Ralte

  Stop guessing if your AI works and start measuring it with production-grade rigor.

• The Alignment Problem Brian Christian

  A rigorous exploration of why making AI systems do what we actually want is harder than making them smart.

• Designing Machine Learning Systems Chip Huyen

  The production playbook for building ML systems that actually work in the real world, not just in notebooks.

• Build a Large Language Model (from Scratch) Sebastian Raschka

  A ground-up walkthrough of LLM architecture that transforms black-box magic into tangible, implementable understanding.

Insights (19)

• The Harness Is the Product, Not the Model
• The Attention Bottleneck: Why GPT-6 Astra's Strengths Are Also Its Weaknesses
• Internet‑Scale Demonstration Retrieval Becomes the New Data Engine
• Agent Message Boards Signal a New Governance Layer
• GPT‑6 Astra Turns Models Into Orchestrated Agent Platforms
• Selective Re‑use Beats Blind Fine‑Tuning
• From Benchmarks to Real‑World Dialogues: Evaluation Is Getting Human‑in‑the‑Loop
• Agent‑Building Platforms Are Maturing Into Full‑Stack Production Stacks
• The Evaluation-Feedback Gap Is Quietly Widening
• Personalization Is Becoming a Truth-Compression Problem
• The Emergence of Agentic Data Hygiene
• The Benchmark Mirage: Why Your Model Score Might Be Meaningless Tomorrow
• The New Frontier of Agent Security
• AI Model Portability Hits Hardware Walls
• The Fragmentation of AI Ecosystems Accelerates
• The Vertical Integration of AI Is Accelerating
• Agentic Frameworks Are Maturing Beyond Proof-of-Concept
• The Handoff Tax Expose Agent Pipeline Costs
• The Emerging Feedback Loop Crisis in Agentic Systems