A working system, not a reading list
The ones that do need the right one. Knowing that a weighted matrix exists is not the hard part. The hard parts are choosing a method for the decision in front of you, running it without fooling yourself, and finding out later whether your process was any good. This page does those three things.
Triage
The library
What am I actually deciding?
Establish what kind of problem this is before choosing a method for it. Most bad decisions are well-executed answers to the wrong question.
Is this the whole set of choices?
A choice between one option and nothing is not a choice. These methods widen the set before anything gets scored.
Which of these is best?
The options exist and the criteria are known. What remains is a comparison that does not quietly smuggle in the answer you started with.
What happens if I am wrong about the numbers?
Outcomes are probabilistic. These methods put the uncertainty in the arithmetic instead of leaving it in your stomach.
Can this kill the thing I am betting with?
A bad outcome and an unsurvivable one are different categories. Expected value is the wrong tool for the second.
How much process does this deserve?
Rigour costs time. These methods size the process to the decision, and sometimes the right size is none.
Must I decide all of it now?
Many decisions presented as one-shot are really a sequence. Deciding when to decide is often worth more than deciding well.
Who decides, and who is merely consulted?
Groups add information and subtract speed. These methods control which of the two you get.
Was my process any good?
Outcomes are noisy feedback on process. Without a record written before the result was known, you cannot tell skill from luck.
The workbench
Score defined options, then find out whether the total is actually deciding.
Criterion | Weight | ||
|---|---|---|---|
Total | 100 | 0.00 | 0.00 |
Totals
Weighted score, out of 10
How far a weight can move
Weight change, in percentage points, that reverses the leader
4 criteria cannot affect the result. Every option scores the same on Cost, Time, Quality, Risk, so it adds a constant to every total. Delete it — it is making the matrix look more thorough without changing anything.
Countermeasures
Limits
The tell
The analysis is commissioned after the decision is made.
A method applied to a settled question produces a document, not a decision. It is worse than no method, because the document transfers confidence to a choice that was never tested and gives everyone involved a reason not to object later. The tell is timing: if the conclusion was known before the work started, the work is documentation.
A probability carries two decimal places and no source.
Arithmetic does not improve its inputs. An expected value computed from invented probabilities has the authority of a calculation and the content of a guess, and the calculation makes the guess harder to question. Round every invented number to the nearest 5%, then check whether the conclusion survives. If it does not, the number was doing the deciding.
A decision that could be undone in a week has been open for a month.
Process costs time, and on a two-way door the time usually exceeds the mistake. The failure compounds because rigour looks responsible and speed looks careless, so nobody is punished for the third week of deliberation. Classify the door before choosing a method, and treat delay on a reversible decision as the error it is.
The analysis is unimpeachable and the result changes nothing.
A well-specified problem is pleasant to work on, which is why effort migrates toward it and away from the poorly specified one that actually matters. The frame is the cheapest thing to get wrong and the most expensive to discover late. Spend the first ten minutes on whether this is the right question, every time.
A method is abandoned after one bad result, or adopted after one good one.
In any domain with chance in it, a single outcome is weak evidence about the reasoning that produced it. Treating results as verdicts means good process gets discarded after bad luck and bad process gets entrenched after good luck — and the second is the more damaging, because it feels like success and nobody investigates it.