Skip to content

1 · The premise

There's a lot of audio sitting unleveraged in organisations, even where the first step from audio to text has already been taken. The premise of this project is to turn hours of recorded speech into a graph you can actually ask questions of, with every answer traceable to who said it, and when. I built a prototype for it in 2024, shelved it when life got in the way, and rebuilt it in 2026 to run entirely on a single laptop. If you're sitting on recorded calls, interviews, panels or podcasts, you probably have some kind of full-text search over the transcripts - but that is usually where it ends. This is about going further.

Scope

The corpus throughout is Mikroökonomen, a German podcast on economic and political developments. The 12-episode proof-of-concept (494 chunks) used for most of the worked numbers is one slice of a ~460-episode archive, and the 352-episode core format is what the case study processes end-to-end.

The stack is entirely local - mlx-whisperpyannoteGLiNER2 → a small local instruct model → Neo4j - and every stage is cached, so iterating is cheap and a rebuild only costs you where the pipeline actually changed. The chapters that follow take each of these stages in turn.

A quick walkthrough

1AUDIO23 seconds of spoken Germanone MP3, no text yetMikroökonomen · Folge 237 · 22:13–22:36 2TRANSCRIPTSpeech to text (Whisper)verbatim, but anonymous: who said it?Was soll jemand darauf denn auch sagen? Ja. Stell dir mal vor, unser HerrHabeck, unser Wirtschaftsminister, würde sich jetzt hinstellen und dann beiSAP dazwischenreden. Das wäre doch absurd. Da würden doch alle sich dasMaul darüber zerreißen, dass er sich einfach komplett inkompetent verhält,dass er weit außerhalb seiner Zuständigkeiten agiert. Ja. 3WHO SAID WHATDiarization + speaker IDevery turn attributed to a named voiceFrederikWas soll jemand darauf denn auch sagen? Ja. Stell dir mal vor, unser Herr Habeck, unserWirtschaftsminister, würde sich jetzt hinstellen und dann bei SAP dazwischenreden. Das wäre dochabsurd. Da würden doch alle sich das Maul darüber zerreißen, dass er sich einfach komplettinkompetent verhält, dass er weit außerhalb seiner Zuständigkeiten agiert.HannahJa. 4KNOWLEDGE GRAPHEntities become a queryable graphthe same words, now connectedHabeck – Wirtschaftsminister · Habeck – SAPWirtschaftsministerSAPChristian LindnerKlimaschutzInflationGasWirtschaftIndustrieNetzausbauKlimageldRobertHabeck 5ASK IT ANYTHINGEvery claim, traceablethe exact quote · who said it · which episode„Was wurde über Robert Habeck und SAP gesagt?“Frederik nennt es absurd, sich Habeck als Wirtschaftsminister vorzustellen, wie er bei SAPdazwischenredet.Frederik · Folge 237 · 22:13

One 23-second clip of Mikroökonomen 237, carried through every stage: audio, transcript, who said it, the graph, a cited answer.

How this was made. The pipeline and the articles you're about to read were both created with AI assistance. Responsibility for both, and especially for the statements made in the articles, lies with me. I acknowledge and respect that many people, for ethical or other reasons, will not want to consume content that was created in part or wholly using LLMs. This is your notice. My intent is to inform, not deceive.

Close