Processes and Systems
"Process" is a dirty word to many engineers — it conjures bureaucracy, red tape, and forms in triplicate. But that's bad process. Good process is simply a repeatable way of doing something that used to require re-figuring-out every time, and it's how organizations stop relying on heroics and tribal knowledge. The real skill isn't avoiding process or worshipping it — it's knowing when a process earns its cost, and keeping it light enough to help rather than smother. This tension, between too little process and too much, is at the heart of operations.
Processes and systems turn ad-hoc work into repeatable, reliable ways of doing things — the core operational tool. This post covers what processes are and why they help, when to add process (and when not to), the danger of over-process (bureaucracy), and how to keep processes healthy. It builds on why operations matters at scale (processes are much of how you coordinate at scale) and addresses engineers’ common (often justified) aversion to process — by distinguishing good process from bad.
What processes are and why they help
A process is a defined, repeatable way of doing something — turning an ad-hoc activity into a consistent, reliable one. Its value:
- Processes make work repeatable and reliable. A process defines how a recurring task is done (the steps, who does what) — so it’s done consistently and reliably each time, rather than re-figured-out (differently, error-prone) every time. Processes turn ad-hoc work (improvised, inconsistent) into repeatable work (defined, consistent). Repeatability is the core value. Do it the same, reliable way each time.
- They reduce reliance on heroics and tribal knowledge. Without process, recurring work depends on individual heroics (someone figuring it out each time) and tribal knowledge (undocumented know-how in people’s heads) — fragile (breaks when people leave or are busy) and inconsistent. Processes capture how to do things (reducing dependence on specific individuals and undocumented knowledge), making the organization more robust. Processes replace fragile heroics with reliable repeatability. Less dependence on individuals.
- They enable coordination at scale. As the previous post noted, coordinating many people needs deliberate mechanisms — and processes are much of that (defined ways of working that let many people coordinate consistently, rather than everyone improvising). Processes are a key tool for functioning at scale. Processes enable coordinated work at scale. How many people work together consistently.
A process is a defined, repeatable way of doing something — turning ad-hoc, improvised work into consistent, reliable work — which reduces reliance on individual heroics and tribal knowledge and enables coordination at scale. That’s the value of good process. But process has costs, so when to add it matters.
When to add process (and when not to)
Process has costs (overhead, rigidity), so the skill is knowing when a process is worth it — adding it when it earns its cost, not by default:
- Process has real costs. A process isn’t free — it adds overhead (following steps, maintaining the process), rigidity (a defined way can be less flexible), and, if overdone, bureaucracy (below). So process is a tradeoff: the benefits (repeatability, coordination) against the costs (overhead, rigidity). Process must earn its cost. Process isn’t free — weigh it. Costs as well as benefits.
- Add process when the pain justifies it. The right time to add a process is when the pain of not having it (inconsistency, errors, coordination failures, reliance on heroics) exceeds the cost of the process. Often this means adding process reactively — when ad-hoc-ness starts hurting (things breaking, not scaling) — rather than preemptively. Let pain (real problems) signal when a process is worth adding. Add process when ad-hoc stops working. Pain justifies process.
- Don’t add process prematurely. Adding process too early (before the pain, “just in case,” or by default) imposes overhead and rigidity before they’re justified — slowing a small team that coordinated fine informally. Premature process is a common mistake (bureaucratic overhead with no benefit yet). Match process to actual need, not anticipated need. Don’t add process before it’s needed. Premature process is pure cost.
- The skill is judgment about when. There’s no formula — knowing when a process is worth adding (pain exceeds cost) is judgment. The operational skill is adding the right processes at the right time (when they earn their cost) and not adding unnecessary ones. Judgment about when to add process is the core skill. When does it earn its cost?
Process has real costs (overhead, rigidity), so add a process when the pain of not having it exceeds its cost (often reactively, when ad-hoc-ness starts hurting) — not prematurely (before the pain) or by default. Knowing when is judgment, and it’s the core operational skill. The danger on the other side is too much process — bureaucracy.
The danger of over-process: bureaucracy
The opposite failure of too little process is too much — bureaucracy — which smothers the organization, and it’s what engineers rightly fear:
- Bureaucracy is process gone bad. Bureaucracy is excessive, rigid process — too many rules, steps, approvals, and red tape that slow the organization and frustrate people without proportionate benefit. It’s process overdone — the costs (overhead, rigidity) dominating the benefits. Bureaucracy is what gives “process” its bad name. Too much process becomes bureaucracy. Process gone cancerous.
- It smothers effectiveness. Bureaucracy hampers the organization — slowing work, discouraging initiative, adding friction, and frustrating people (the “red tape” experience). Excessive process can cripple an organization as surely as too little (chaos) can. Both extremes — too little and too much process — are failures. Over-process smothers; under-process is chaos. Both extremes hurt.
- Engineers’ process aversion targets bureaucracy. Engineers’ common aversion to process is largely a (justified) reaction to bureaucracy (bad, excessive process they’ve suffered) — not to good process (light, valuable). The key distinction: good process (repeatability where it helps) vs bad process (bureaucratic overhead). Engineers rightly dislike bureaucracy; the answer isn’t no process but good, minimal process. Distinguish good process from bureaucracy. The aversion is to the bad kind.
- Process creep is a real risk. Organizations tend to accumulate process over time (adding rules after each problem, rarely removing them) — process creep toward bureaucracy. Guarding against this (periodically pruning process, keeping it minimal) is part of healthy operations. Process tends to grow; prune it. Watch for creeping bureaucracy.
Bureaucracy — excessive, rigid process — is the opposite failure to too-little process: it smothers effectiveness (slowing work, frustrating people, adding red tape) as surely as chaos does, and it’s what engineers rightly avert to (bad process, not good). Guarding against process creep toward bureaucracy is part of healthy operations. The goal is process that’s healthy — good, not bad.
Keeping processes healthy
The goal is good process — enough to help, not so much it smothers — and a few principles keep processes healthy:
- Keep processes minimal and lightweight. Good processes are as light as possible — the minimum needed to get the benefit (repeatability, coordination) without excess overhead. Prefer lightweight processes (simple, low-friction) over heavy ones. Minimal process (just enough) avoids bureaucracy while getting the value. Keep process light. As little as works.
- Processes should serve people, not the reverse. A healthy process serves the people and the work (making things easier, more reliable) — not the reverse (people serving the process, following rules that don’t help). If a process isn’t helping, it should be changed or removed. Process should help, not hinder. Serve the work, not the process. Process is a means, not an end.
- Prune and evolve processes. Because process creeps (accumulates), healthy operations prune (remove processes no longer worth their cost) and evolve processes (improve them as needs change). Treat processes as changeable (revised and removed), not permanent. Regularly question whether each process still earns its cost. Prune and evolve; don’t just accumulate. Kill dead process.
- Automate where you can. Often the best “process” is automation — encoding a repeatable process in software/tools (rather than manual steps), getting repeatability without the manual overhead. Automating processes (where feasible) gives the reliability of process with less friction (a theme engineers appreciate — the DevOps/platform-engineering series). Automate repeatable processes. Let software carry the process.
Keeping processes healthy means minimal, lightweight process (just enough, avoiding bureaucracy), processes that serve people (not the reverse), pruning and evolving them (against process creep), and automating where possible (repeatability without manual overhead). The goal is good process — enough to help, not so much it smothers. Processes and systems, done well, are how operations turns ad-hoc work into reliable, scalable functioning. Next: organizational structure — how companies are organized.
Key takeaways
- A process is a defined, repeatable way of doing something — turning ad-hoc, improvised, inconsistent work into consistent, reliable work — which reduces reliance on fragile individual heroics and undocumented tribal knowledge, and enables coordination at scale (much of how many people work together consistently).
- Process has real costs (overhead, rigidity), so add a process when the pain of not having it (inconsistency, errors, coordination failures) exceeds its cost — often reactively, when ad-hoc-ness starts hurting — not prematurely (before the pain, “just in case”) or by default; knowing when is judgment, the core operational skill.
- Bureaucracy — excessive, rigid process (too many rules/steps/approvals/red tape) — is the opposite failure: it smothers effectiveness (slowing work, frustrating people) as surely as too-little process causes chaos, and it’s what engineers rightly avert to (bad process, not good process).
- The key distinction is good process (light, valuable — repeatability where it helps) vs bad process (bureaucratic overhead) — engineers’ aversion targets bureaucracy, and the answer isn’t no process but good, minimal process; guard against process creep (organizations accumulate process and rarely prune it).
- Keep processes healthy: minimal and lightweight (just enough), serving people not the reverse (change/remove process that doesn’t help), pruned and evolved (against creep, treating process as changeable not permanent), and automated where feasible (repeatability without manual overhead — encoding process in software).
Further reading
- Business process (Wikipedia)
- Standard operating procedure (Wikipedia)
- What operations is (previous post)