Q3 2026 club · Wednesday, October 7, 2026 · LinkedIn, Sunnyvale, CA

Building Continuously Improving AI Systems

Name: Building Continuously Improving AI Systems
Start: 2026-10-07T17:30:00-07:00
End: 2026-10-07T21:00:00-07:00
Location: LinkedIn

Shipping an AI system is now table stakes. The teams pulling ahead built the machinery of improvement: the harness, the evals, the quality metrics, the feedback loops, and regression testing for systems that refuse to be deterministic.

130leaders in the room
5panelists
2sponsors

Read the Field Notes from this clubField Notes № 01: The Harness Is the ProductTen findings on building AI systems that keep getting better, from a closed room of five practitioners who could only say it with the logos off.

The theme

What the room took on

Harness designInstrumenting AI systems so improvement is measured rather than felt.
Evaluation frameworksEvals that survive contact with production.
Quality metrics beyond accuracyWhat leaders track when outputs are probabilistic.
Feedback loopsTurning user signal, human review and failures into an improvement flywheel.
Regression testingShipping with confidence when the same input can produce different outputs.

The highlight reel for this club is in production.

The breakout: Chips and Chaos: Build the Harness, an edition of the Perspective Pivot.

On stage