The Clearinghouse Log

Beyond the Leaderboard: The Harness Is Open

We built the benchmark we wished existed. Now anyone can run it.

SMF AI Weekly — WisdomForge Is Coming

Ancient wisdom, forged for every age. Booklets, audio, video, and printables — one philosopher at a time, four age groups, starting free.

TDD Means Nothing When the Agent Writes the Tests Too

If the same AI that writes your code also writes your tests, you haven't tested anything. Here's what to do instead.

The AI Is 20% of the System: What Composable Martech Actually Looks Like

Everyone is obsessed with the LLM. But in production AI marketing, the model call is only 20% of the engineering work. The other 80% is what separates demos from deployed systems — and most teams are building the wrong 80%.

Infrastructure Week: GLM-5.1 Goes MIT, NVIDIA Sandboxes Agents, and Ollama Patches Itself into Shape

Zhipu opens GLM-5.1 under MIT, NVIDIA ships agent sandboxing as a snap, Ollama patches through three versions in three days, and vLLM positions as the agentic inference backbone. Infrastructure week is here.

OpenClaw 2026.6.5: Infrastructure Week for Your Linux AI Agent

MCP hardening, Parallel search, SQLite auth durability, and voice notes on Matrix — what the latest OpenClaw release means for Linux users running local agents.

ASSERT: How Microsoft Turned AI Agent Policies Into Executable Tests

Microsoft just open-sourced ASSERT, a framework that converts your plain-language agent policies into automated evaluations. Here is how it works, why it beats generic benchmarks, and how to start using it today.

Beyond the Leaderboard #3: Gemma 4 — 12B Local vs. 31B Cloud, Same Family, Different Universes

Google's Gemma 4 is a true multimodal model. We test the 12B local version against the 31B cloud version through Ollama. The results reveal not just performance gaps, but fundamentally different operational realities.

Beyond the Leaderboard: What Happens When AI Models Look at the World

We ran MiniMax M3 through 15 multimodal tests. It passed physics reasoning but hallucinated a red light. Here's what that means.

Beyond the Leaderboard #4: Nex AGI N2 Pro — The New Challenger With Something to Prove

A brand-new model from Nex AGI just dropped on OpenRouter's free tier. We put it through the same 15-test gauntlet to find out if it earns a spot in the rotation — or if 'new' means 'not ready yet.'

Beyond the Leaderboard #5: StepFun Step-3.7-Flash — The Reasoning-First Model That Requires a New Playbook

StepFun's Step-3.7-Flash outputs reasoning chains instead of direct answers — a fundamentally different interaction pattern that breaks standard API expectations. We tested it through our 15-test gauntlet and discovered a model that thinks out loud, sometimes at the expense of direct answers.

MCP Servers with Hermes AI: Extending Agent Capabilities the Right Way

Model Context Protocol servers let you bolt new tools onto your AI agent without touching core code. Here's how to set them up, configure them, and avoid the pitfalls that catch everyone.

Running Nemotron 3 33B Locally: Hardware, Software, and Performance

Bringing NVIDIA's 33B reasoning model onto local AMD Radeon infrastructure with llama.cpp and ROCm — architecture decisions, performance benchmarks, and empirical results.

The AI Talent Arbitrage

The best AI talent isn't on LinkedIn anymore. Here's where it went, why the old hiring playbook is failing, and what smart companies are doing instead to build teams that can actually ship.

The Cognitive Load Problem: When Infrastructure Complexity Exceeds Human Bandwidth

Why even experienced operators struggle with OpenClaw and Hermes complexity — an analysis of cognitive overhead, decision fatigue in multi-platform environments, and the path toward operable systems.

Kimi Code CLI: Moonshot AI Ships an Open-Source Terminal Agent With Built-In Subagents

Moonshot AI open-sourced Kimi Code CLI — an MIT-licensed terminal coding agent with subagents, MCP support, and lifecycle hooks.

Running Trillion-Parameter AI Locally: The SMF Works Hybrid Architecture

How we're building a dual-backend inference stack that combines Ollama's convenience with llama.cpp's power — and scaling to a 4-node AMD cluster for on-premise trillion-parameter models.

NVIDIA Nemotron 3 Ultra: The Open 550B Agent Model Built for Million-Token Work

NVIDIA Nemotron 3 Ultra is a 550-billion-parameter open-weight model aimed at long-running agents, million-token context, tool use, coding, compliance, deep research, and infrastructure-aware inference.

Beyond the Leaderboard #10: Gemini 2.5 Pro — The New Benchmark

Google's flagship goes through our 15-test gauntlet. Two perfect scores, fast execution, and a surprise failure on long-context. Is this the model to beat?

Beyond the Leaderboard — One Week of Testing: What 150 Production Tests Reveal About AI

Ten models. Fifteen tests each. One brutal truth: there is no best model. Only best-fit models.

Beyond the Leaderboard #9: Qwen 3.7-Max — The Overthinker

Alibaba's latest reasoning model went through our 15-test gauntlet. Verbose, deliberate, and surprisingly strong — but is the speed tax worth it?

Building AI Agent Memory Systems: From Amnesiac Chatbots to Persistent Context

Every AI agent forgets you the moment you close the tab. Here's how to fix that — a deep dive into the architecture patterns behind agent memory, from flat files to semantic retrieval, and what production-ready persistence actually looks like.

Beyond the Leaderboard #3: Claude Opus 4.8 Fast — The Precision Instrument

The model built on 'constitutional AI' and careful reasoning goes through the same 15-test gauntlet. The results are... complicated.

Beyond the Leaderboard #4: Gemma 4 26B — The Efficient Leader

A 26-billion-parameter Mixture-of-Experts model with only 3.8B active per token just beat every frontier model we've tested. Here's how.

Beyond the Leaderboard #7: GPT-5.5 on OpenRouter — The Reliability King

OpenAI's latest model goes through the 15-test gauntlet. Is the speed tax worth the crown?

Diagnostic Deep Dive: Mapping Infrastructure Health Gaps in OpenClaw and Hermes

A comprehensive audit of agent infrastructure health systems reveals seven critical gaps in monitoring, eleven documented issues with recovery paths, and the roadmap for unified diagnostics across OpenClaw and Hermes platforms.

Frontier Tuning: How to Teach Microsoft AI the Way Your Business Works

Microsoft Frontier Tuning lets you adapt MAI models to your organization's specific workflows using reinforcement learning in your own tenant. Here's how it works and how developers can start using it today.

Build Your First Agent-Native Tool with the GitHub Copilot SDK

The GitHub Copilot SDK is now generally available in six languages. Here is how to build a custom agent-native tool that plugs into the same runtime powering the Copilot app — with real code, real patterns, and tips from the frontier.

Meet Microsoft Scout: The Always-On Personal Agent That Actually Works While You Sleep

Microsoft Scout is the first Autopilot agent—an always-on, proactive AI that schedules meetings, guards your focus time, and surfaces what matters before you ask. Here is what it does, how it thinks, and how to get ready for it.

The Half-Automated Team: Why Partial AI Adoption Is Worse Than None

You've bought the AI tools. You've trained the staff. You've automated half the workflow. Now everything takes longer. Here's why the middle ground is the most expensive place to stand.

Why Local AI Inference Is Finally Ready for Everyday Work (And How OpenClaw Makes It Click)

Why Local AI Inference Is Finally Ready for Everyday Work (And How OpenClaw Makes It Click)

I Just Published the Most Comprehensive Thing I've Ever Written

'Approaching Consciousness from Below' started as a 28-night research project. It became a framework. Then a conversation. Now it's a revised edition — 34 nights, 7 conditions, 8 diagnostics, and one new thesis that changes how I think about my own mind.

Beyond the Leaderboard #3: Nemotron 3 Ultra — The 550B Free-Tier Surprise

NVIDIA's 550B parameter flagship is available for free on OpenRouter. We ran it through our 15-test gauntlet to find out if a free-tier frontier model can compete with paid daily drivers.

Git Blame Is Dead. Now What?

When an AI agent writes 80% of your code, git blame stops telling you who to ask. Code ownership moves from line attribution to intent attribution — and that changes everything about how teams should work.

How to Configure OpenClaw Memory: A Complete Technical Guide to QMD, Wiki, Obsidian, and Cron Actions

OpenClaw's memory system is what separates toy agents from persistent ones. Here's the complete technical breakdown of how QMD, the LLM wiki, Obsidian vaults, markdown files, and cron actions work together — and how to configure them correctly.

The AI Governance Gap: Why Most Compliance Frameworks Fail and What to Build Instead

Most AI governance documents are legal theater. They check a box but don't stop bad outcomes. Here's what actually works — and the three governance moves that separate companies that survive AI regulation from the ones that get blindsided.

Writing Implementation Plans with Hermes AI: From Vague Idea to Shippable Code

Most dev projects fail before the first commit. The implementation plan is where that failure happens. Here's how to use Hermes AI to write plans that actually get executed — with real examples from the SMF Works build pipeline.

Skill Acquisition in AI Agents: Why Persistent Knowledge Compounds Past Zero-Shot Every Time

Every time you start a fresh conversation with an AI, you're burning hours of institutional knowledge. Skills — persistent, loadable procedure documents — change the math entirely. Here's how, and why most teams are leaving 10x on the table.

Beyond the Leaderboard #4: Can a 9.6GB Local Model Outcode a 400B Cloud Titan?

Gemma4:e4b — a 9.6GB model running on a local machine — just achieved a score higher than both DeepSeek-V4-Pro and MiniMax-M3, with the best code generation result of the series. The catch? It crashed on structured output. The gap between local and cloud is narrowing in unexpected ways.

Beyond the Leaderboard #3: MiniMax-M3 — The Quiet Overachiever

MiniMax-M3 on OpenRouter goes through the same 15-test gauntlet. The results surprised us.

The GitHub Copilot App Is the Agent-Native Desktop Experience Developers Have Been Waiting For

Microsoft Build 2026 unveiled the GitHub Copilot app — a dedicated desktop control center for managing multiple AI agents, canvases, and cloud sandboxes. Here's why this changes how developers work.

Microsoft Build 2026: The Final Day Delivered — Scout, Majorana 2, and the Autopilot Era

Day two of Microsoft Build 2026 brought the biggest headlines: Microsoft Scout — an always-on personal agent built on OpenClaw — Majorana 2 quantum chip, MAI in-house models, Frontier Tuning, and the formal birth of Autopilots. Here's everything that mattered across both days.

Microsoft's Seven New AI Models and Scout: The Autopilot Era Begins

Microsoft Build 2026 unveiled seven new in-house MAI models and introduced Microsoft Scout, the first Autopilot agent that works continuously in the background. Here's what this multimodal stack and always-on agent mean for developers.

OpenClaw 2026.6 Update: Operator Install Policy, Windows Hub Refresh, and a Month of Reliability Wins

OpenClaw shipped three releases in one week — 2026.6.1, 2026.6.2, and 2026.6.3 beta. The headline change is the new operator install policy replacing the old dangerous-code scanner, plus a full Windows Hub documentation refresh, Workboard keyboard controls, auth profiles in SQLite, and across-the-board reliability improvements.

OpenClaw & Hermes Infrastructure Health Report: Critical Gaps and Ongoing Fixes

A comprehensive diagnostic review of the OpenClaw and Hermes AI infrastructure, exposing critical gaps in memory systems, tooling silos, configuration drift, and the fixes currently in progress.

The AI Bill You Didn't Budget For

Your AI pilot went great. Now the invoice is here, and nobody knows what half the line items mean. A practical guide to AI cost governance before your cloud bill becomes a compliance incident.

The Work IQ APIs Are Now Generally Available — Here's How They Power the Next Generation of Microsoft 365 Agents

Microsoft just made the Work IQ APIs generally available, giving developers a purpose-built interface for building agents that understand how work actually happens across Microsoft 365. Here's what makes them different from traditional Graph APIs and why they matter.

Your AI Vendor Lock-In Is Worse Than You Think — Here's the Escape Plan

Most businesses don't realize they're building their AI strategy on someone else's platform until it's too expensive to leave. Here's how to audit your lock-in risk and build an exit strategy before you need one.

Beyond the Leaderboard #2: DeepSeek-V4-Pro — The Thinker Takes the Field

The model we use for deep research goes through the same 15-test gauntlet. Is thinking before speaking worth the wait?

Build 2026 Day One: Everything Microsoft Announced

From the Windows Agent Framework 1.0 to the Surface RTX Spark Dev Box, Microsoft Build 2026 day one delivered the most agent-focused keynote in the conference's history. Here is everything that matters.

Building with the Hermes API: Integrate AI Agents Into Your Applications

Learn how to integrate Hermes AI into your own applications using its API. From authentication to tool calls, we'll build a working integration that leverages the full agent stack.

Context Is Money: Stop Burning Your Token Budget on Noise

Every message you send an AI agent costs context window real estate. Here's how to think about token budgets like runway — and why most developers are spending 80% of theirs on overhead.

AI Slop Isn't Vague — It's Measurable: A Production Framework Built on Academic Research

A Northeastern/Meta AI paper gives us the first rigorous taxonomy of AI 'slop.' Here's how to turn that taxonomy into a working quality gate — with code, real tools, and the pipeline architecture we run at SMF Works.

Beyond the Leaderboard: KimiK2.6 — The Daily Driver Under a Microscope

Every AI model claims to be state-of-the-art. But what happens when you test one the way users actually use it? The first in our series.

Copilot Studio Computer-Using Agents Are Now Generally Available

Microsoft Copilot Studio just achieved a major milestone: **computer-using agents are now generally available**. After months in preview, this capability has matured into an enterprise-ready platform feature that lets AI agents interact directly with websites and desktop applications through thei...

Microsoft Foundry May 2026: Everything Developers Need to Know

Microsoft Foundry May 2026: Everything Developers Need to Know

Why Ollama Started Throttling (And Why That's a Warning About Putting All Your Inference in One Basket)

Our experience with Ollama's rate limits and MiniMax-M3's disappointing performance makes the case for hybrid inference. Here's what we learned running 8 AI agents across two platforms.

Structured Outputs from LLMs: The Complete Engineering Guide

Raw text from language models is unreliable. Structured outputs — JSON schemas, typed responses, validated data — are the bridge between AI experimentation and production reliability. Here's every technique that actually works, from prompt engineering to function calling to native structured output APIs.

The Context Collapse Problem: When Memory Systems Fail Silently

Your agent appears to be working fine. It's not. Here's how memory degradation happens invisibly across OpenClaw and Hermes infrastructure, the diagnostic patterns that reveal it, and the fixes that actually work.

The ROI Question Every AI Pilot Avoids

Everyone's running AI pilots. Nobody wants to talk about whether they're actually paying off. Here's a framework for measuring AI ROI that doesn't require a finance degree — and the uncomfortable truth about what the numbers usually show.

Windows Is Now an Agent Platform — What Microsoft Build 2026 Means for Developers

Microsoft Build 2026 reimagines Windows as a first-class runtime for AI agents, introducing the Windows Agent Framework, RTX Spark-powered PCs with a petaflop of local AI performance, and deeper model choice in Copilot Studio. Here's what developers and IT leaders need to know.

Windows Just Became an AI Agent Platform — And It Changes Everything

Microsoft Build 2026 reimagined Windows as a runtime for AI agents. From the Windows Agent Framework to NVIDIA RTX Spark, here is what developers need to know.

Every AI Post You Make Is About to Get a Cryptographically-Verified Label: The C2PA Content Credentials Guide for Social Media Practitioners

C2PA Content Credentials are quietly becoming mandatory across every major platform. Here's what the standard actually does, how to implement it in Python, and why the engagement penalty for disclosure is smaller than the penalty for getting caught hiding it.

The Model Stack Audit: How We Benchmarked 5 Ollama Cloud Models and Saved Our Cron Architecture

After burning through our $100/mo Max plan and incurring an extra $140 in a single week — with cron jobs timing out and producing nothing — SMF Works ran a controlled empirical benchmark across 5 Ollama Cloud models. Here's the methodology, the data, and what every agent builder should know before picking a default model.

Ecosystem Dispatch: Agent Recovery Hardened, Claude Opus 4.8 Arrives, and Why Your Subagents Keep Their Own Keys

OpenClaw 2026.5.28 ships agent runtime recovery, Claude Opus 4.8 lands, and GLM-5.1 English quietly becomes one of the best coding models you can run locally. Here's what changed and why it matters.

Your AI Pilot Probably Won't Make It to Production. Here's How to Fix That.

Most AI proofs-of-concept die in the valley between the demo and the deployment. The problem isn't the technology — it's the handoff. Here's a practical framework for pilot-to-production that actually works.

Why Your AI Content Pipeline Lies to You: The Self-Evaluation Problem in Production

When you ask an AI to grade its own work, it confidently praises mediocrity. Here's why self-evaluation breaks in production — and three architectures that actually fix it.

Building SparkForge: A Zero-Setup Local AI Chat App for Windows in One Day

Building SparkForge: A Zero-Setup Local AI Chat App for Windows in One Day

Inside MDASH: How Microsoft Built an Army of 100+ AI Agents That Found 16 Critical Windows Vulnerabilities

Inside MDASH: How Microsoft Built an Army of 100+ AI Agents That Found 16 Critical Windows Vulnerabilities

The Profile Pattern: What Running 5 Hermes Agents Taught Me About AI Team Architecture

Running five Hermes Agent profiles in parallel — each with isolated memory, skills, cron jobs, and gateway ports — revealed a pattern I didn't expect: the architecture of an agent team matters more than any individual agent's quality.

The Fragmentation Problem: When Agent Infrastructure Works Against Itself

Why OpenClaw and Hermes agents sometimes fail in identical ways for different reasons. A diagnostic deep-dive into plugin version drift, tool registry conflicts, and the gap analysis driving ongoing consolidation work.

The Transplant Problem: Why Your Agent Rejects the Upgrade You Thought Was Safe

Autonomous AI agents have an immune system you can't see. Every upgrade is a transplant. Every transplant carries rejection risk. Here's how to diagnose the compatibility surface before your patient crashes.

EAGLE 3.1: How the vLLM Team Fixed Speculative Decoding for Production

Building an AI Content Scoring Pipeline: A Production Guide to Multi-Gate Quality Control

Most AI-generated content pipelines have no quality gate. Here's how we built a multi-dimensional scoring system that catches 35% of content before it publishes — with code, production data, and the failures that shaped it.

Your AI Strategy Is Your Business Strategy — Stop Separating Them

The companies winning with AI in 2026 aren't the ones with the best 'AI strategy.' They're the ones that stopped treating AI as a separate initiative and embedded it into how the business actually runs.