2024-09-27

Readable Flake Memos for Skeptical Engineering Managers

By Marin Ilic

leadershipflaky testswriting
Illustration for Readable Flake Memos for Skeptical Engineering Managers

Managers rarely deny flake problems; they deny unreadable evidence. A flake memo should read like a briefing note: situation, blast radius, cost of ignoring, recommended cadence, owners.

Skip screenshots of raw logs unless annotated. Instead, attach histograms of reruns and customer-visible latency if available. If you lack metrics, say so plainly—credibility beats bluffing.

We encourage testers to co-author memos with one developer ally. Shared bylines signal partnership, not blame.

Cap memos at two pages. Anything longer should become a tracked issue with milestones, not an email attachment.

When requesting time, propose a trade: pause feature automation for one sprint in exchange for quarantining the worst ten tests. Specific swaps outperform vague cries for “more stability.”