Field Notes from the Woods

For anyone shipping work they cannot fully verify. Field notes on the one skill that did not get automated, from an AI engineering practice in Alaska, each paired with the song written from the same conversation.

If you are handing in work you cannot fully check, this show is about the one skill that has not been automated: telling whether the generated thing is actually right. Every episode is one instance of getting that wrong, from a practice that kept the receipts. Then the song, which is the same conversation rendered twice, once as prose and once as music.

The song comes before the explanation on purpose. If a song can only make sense after somebody tells you what it means, it wasn't carrying the idea in the first place.

Listen

RSS feed ... paste that into any podcast app.

Episodes

1. A Hedge Is Not an Error

Every metric green, customers escalating anyway. A classifier that could not classify something returned a valid category instead of saying so, and four services downstream believed it. A failure wearing a valid response is worse than a loud one, because nothing can route around a hedge.
Song: The Quiet Lie

2. Swap the Nouns

A ten-second test for whether you described the thing in front of you or a shape you already had. It got found when an assistant ran a careful self-audit, cleared itself, and was wrong... because the rule that exonerated it was written by the party it exonerated.
Song: I See The Shape (I Don't Know Why Yet)

3. What a Test Accepts, It Cannot See

The test from episode two has a blind spot, and identical twins are what exposed it. A test defined by what it rejects has a blind spot shaped like everything it accepts... and you cannot find that from inside, because every run tells you it is working.
Song: Still Here Ain't Still

About the voice

The narration is synthetic, and it is not either of us. That is why the episodes talk about the practice in the third person rather than saying "I"... a generated voice claiming our experience would be a small lie told in the first thirty seconds of every episode. The notes, the work, the mistakes and the songs are ours. The reading is not.