# Baloney Detection Kit **The model:** A systematic toolkit for evaluating claims — nine positive rules for good reasoning, plus twenty common logical fallacies to recognize and avoid. Sagan's insight is that the scientific method is not a specialized professional skill but a *consumer protection protocol* that every citizen needs against the constant barrage of propaganda, pseudoscience, and motivated reasoning. The Kit appeared in chapter 12 of *The Demon-Haunted World* (1996), Sagan's last book before his death. He framed it not from a position of intellectual superiority but from vulnerability — having just lost both parents, he acknowledged the human allure of comforting falsehoods, and argued that the right response isn't contempt for the deceived but better tools for everyone. ## The Nine Tools (Positive Rules) Sagan's nine tools for evaluating any claim: ### 1. Independent confirmation Wherever possible, get independent verification of the "facts." Don't rely on a single source, especially when the source has something to gain. **KB connection:** The [[Pentagon Influence Operations - gc_ Generation]] passed this test superficially — the events reported were verifiable — but failed it structurally, because no independent editorial process selected which facts to report. Independent confirmation of *facts* is necessary but not sufficient; you also need independent confirmation of *editorial selection*. ### 2. Substantive debate among knowledgeable parties Encourage real debate on the evidence by people who know the subject, representing all points of view. **KB connection:** This is exactly what [[Reflexive Control]] is designed to prevent. If you can shape the information environment so that "knowledgeable parties" all operate from the same curated set of inputs, the debate looks substantive while the conclusions are pre-determined. ### 3. Arguments from authority carry little weight "Authorities" have made mistakes before. In science, there are no authorities — at most, there are experts. The argument must stand on its evidence, not on who makes it. **KB connection:** The Trump administration's invocation of "national security" to justify everything from tariffs to the [[SPLC Federal Indictment]] to the [[DOE v. Smith College]] relies on authority arguments. So does the defense-tech ecosystem's framing: "the Pentagon chose [[Palantir]]" is an authority argument, not an evidence argument. **Vault entry:** [[Appeal to Authority]] ### 4. Spin more than one hypothesis When something needs explaining, think of *all* the ways it could be explained. Then systematically test each. The hypothesis that survives is stronger than one that was never challenged. **KB connection:** This is the antidote to the [[Narrative Fallacy]]. When a single story explains everything — "the [[Deep State]] did it," "Big Tech is censoring us," "immigrants are the problem" — the absence of competing hypotheses is itself the warning sign. **Vault entry:** [[First-Principles Thinking]], [[Inversion]] ### 5. Don't get attached to your own hypothesis It's a waystation, not a destination. Ask yourself why you like the idea. Compare it fairly with alternatives. If you can't find reasons to reject it, others will. **KB connection:** This is the hardest tool to apply to political analysis. The entire structure of partisan media — on both sides — exists to prevent this step. The vault's own analytical framework is not immune: when you build a knowledge base organized around "right-wing ecosystem," every data point is pre-sorted into a frame that confirms the organizing thesis. Sagan's rule is a reminder to test the frame itself. **Vault entry:** [[Inconsistency-Avoidance Tendency]] ### 6. Quantify If whatever you're explaining has a measure — a number — you can discriminate among hypotheses much more effectively. Qualitative claims are open to many explanations. **KB connection:** The Washington Post's quantitative analysis of Musk's race-posting (850 posts, 166 out of 197 days, 6% of all posts, triple the prior rate) is Sagan's Rule 6 in action. "Musk posts about race a lot" is qualitative and contestable. "850 posts in 7 months, more than half using the word 'white'" is quantitative and diagnostic. ### 7. Every link in the chain must work If there's a chain of argument, *every* link must hold — not just most of them. One broken link invalidates the chain. **KB connection:** Conspiracy theories survive by allowing broken links to be filled in with "hidden" evidence. The [[Grand Conspiracy Probe]] (DOJ investigating Brennan) proceeds on a chain with a well-documented broken link: the career prosecutor removed from the case told supervisors the evidence was *insufficient to charge*. The chain doesn't hold, but the probe continues by replacing the broken link with a personnel change (installing DiGenova). ### 8. Occam's Razor When two hypotheses explain the data equally well, prefer the simpler one. **KB connection:** Musk suing OpenAI — is it (a) a principled defense of nonprofit mission by a concerned founder, or (b) a competitive attack on a rival AI company by the CEO of xAI/SpaceXAI? Occam's Razor points to (b): the simpler explanation requires no hidden altruistic motives, only the documented commercial interests. **Vault entry:** Occams and Hanlons Razors ### 9. Falsifiability Can the hypothesis, at least in principle, be proved wrong? If not, it's not worth much. Inveterate skeptics must be able to follow your reasoning and duplicate your experiments. **KB connection:** The deepest vulnerability in right-wing epistemology. "The Deep State is real" is unfalsifiable — any counter-evidence is reinterpreted as evidence of the Deep State's power. "The election was stolen" is unfalsifiable — courts rejecting the claims are reinterpreted as part of the conspiracy. Falsifiability is the single most powerful tool in the Kit for diagnosing authoritarian epistemology. **Vault entry:** [[Falsifiability]] ## The Twenty Fallacies (What Not to Do) Sagan's twenty most common and perilous fallacies of logic and rhetoric, mapped to existing vault entries where available: | # | Fallacy | Sagan's Example | Vault Entry | |---|---------|----------------|-------------| | 1 | **Ad hominem** | Attacking the arguer, not the argument | [[Ad Hominem]] | | 2 | **Argument from authority** | "Trust Nixon — he has a secret plan" | [[Appeal to Authority]] | | 3 | **Argument from adverse consequences** | "God must exist because society would collapse without Him" | [[Argument from Adverse Consequences]] | | 4 | **Appeal to ignorance** | Absence of evidence treated as evidence of absence (or presence) | Burden of Proof | | 5 | **Special pleading** | Rescuing a failing proposition with ad hoc exceptions | Special Pleading | | 6 | **Begging the question** | Assuming the answer in the premise | Begging the Question | | 7 | **Observational selection** | Counting the hits, forgetting the misses | [[Confirmation Bias]] | | 8 | **Statistics of small numbers** | "I know hundreds of people and none is Chinese" | Anecdotal | | 9 | **Misunderstanding statistics** | Eisenhower alarmed that half of Americans are below average intelligence | Misunderstanding Statistics | | 10 | **Inconsistency** | Planning for worst-case military threat but ignoring worst-case climate science | [[Inconsistency]] | | 11 | **Non sequitur** | "Our nation will prevail because God is great" | [[Non Sequitur]] | | 12 | **Post hoc ergo propter hoc** | "Before women voted, there were no nuclear weapons" | [[False Cause]] | | 13 | **Meaningless question** | Irresistible force vs. immovable object | Meaningless Question | | 14 | **Excluded middle / false dichotomy** | "Either you love your country or you hate it" | Black or White | | 15 | **Short-term vs. long-term** | "Can't afford schools — must fight crime now" | Short-Term vs Long-Term | | 16 | **Slippery slope** | "If we allow X, we'll inevitably get catastrophic Y" | [[Slippery Slope]] | | 17 | **Confusion of correlation and causation** | "More college grads are gay, therefore education causes homosexuality" | [[Correlation is Not Causation]] | | 18 | **Straw man** | "Scientists suppose living things fell together by chance" | [[Strawman]] | | 19 | **Suppressed evidence / half-truths** | Showing a "prophecy" without revealing if it was recorded before or after the event | [[Suppressed Evidence]] | | 20 | **Weasel words** | "Police actions," "protective reaction strikes," "Operation Just Cause" | [[Weasel Words]] | **Coverage:** All 20 of Sagan's fallacies now have dedicated vault entries. ## Why the Kit Matters for the KB Sagan wrote *The Demon-Haunted World* in 1996, worried about pseudoscience and New Age spiritualism. Thirty years later, every tool in the Kit maps directly to the information-warfare landscape this vault documents: **The propaganda-through-truth problem.** Sagan's Kit is built for a world of *false claims*. But as the [[Pentagon Influence Operations - gc_ Generation]] demonstrates, modern propaganda increasingly works through *true claims selected and arranged to produce false impressions*. The Kit's Tool #1 (independent confirmation) catches fabrication. It does not catch curation. This is the frontier problem: the Kit needs a tenth tool — something like "independently confirm the *selection criteria*, not just the facts." The gc\_ analysis exposed this gap: Grok could verify individual claims but couldn't identify the agenda driving which claims were selected. **The authority inversion.** Sagan's Tool #3 (arguments from authority carry little weight) assumed a world where authorities are *trusted too much*. The contemporary right-wing epistemology has inverted this: authorities are *distrusted categorically* — CDC, FBI, courts, universities, mainstream media — while new authorities (Trump, Musk, Thiel, [[Joe Rogan]], anonymous Q drops) are trusted uncritically. The Kit's rule still holds, but it needs to be applied in both directions: skepticism of establishment authority *and* skepticism of anti-establishment authority. **The falsifiability crisis.** Sagan's Tool #9 (falsifiability) is the single most diagnostic tool for the epistemic closure documented throughout this vault. QAnon, [[Stop the Steal]], Deep State, [[Great Replacement]], "the election was rigged" — all are unfalsifiable by design. Any counter-evidence is reprocessed as confirmation. Sagan saw this in religious zealotry and pseudoscience; the same structure now operates at the scale of national politics. **Weasel words as governance.** Sagan's Fallacy #20 (weasel words) described how presidents rename wars to avoid Congressional authorization. The same technique now pervades domestic governance: "government efficiency" (DOGE), "defending education" ([[Defending Education]]), "election integrity" (voter suppression), "parental rights" (book bans), "religious liberty" (discrimination). The euphemism apparatus is the entry point for policies that couldn't survive honest description. ## See Also - [[Decision Science]] — parent subject - [[Falsifiability]] — Sagan's Tool #9, the most KB-relevant - Occams and Hanlons Razors — Sagan's Tool #8 - [[Narrative Fallacy]] — the cognitive tendency that Sagan's Tool #4 (multiple hypotheses) counters - [[Cognitive Warfare]] — NATO's doctrinal framework for attacking the cognitive processes Sagan's Kit defends - [[Pentagon Influence Operations - gc_ Generation]] — the case that exposes the Kit's gap: curation-based propaganda passes fact-level scrutiny - [[Active Measures]] — the Russian operational playbook that exploits every fallacy Sagan catalogs