Lies, Damned Lies, and Statistics: Difference between revisions

→‎top: Replaced redirects
(→‎Straight examples: Fixing|links to disambiguation pages)
(→‎top: Replaced redirects)
 
(4 intermediate revisions by one other user not shown)
Line 2:
[[File:piechart.gif|frame]]
 
{{quote|''"If enough data is collected, a board of inquiry can prove anything."''|'''Murphy's Law of Combat #75'''}}
|'''Murphy's Law of Combat #75'''}}
 
This well-known saying is part of a phrase attributed to [[Benjamin Disraeli]] and popularized in the U.S. by [[Mark Twain]]:
Line 18 ⟶ 19:
Also be aware of the Law of Very Large Numbers. Any fraction of a very large number is likely to be a large number, no matter how small the fraction is. It is estimated that 2,135,000 Americans have used cocaine (including crack) in the past month. But that's only 0.7% of the population! So, is this a lot of people, or not?
 
Then you can get the kind of statistical abuse in which you are careful to define the question to get you answer you want. What is the most popular book in the world? Depends if you mean most copies in existence (''Quotations from Chairman Mao''), most copies ever sold ([[The Bible]]) or fastest selling ever (''[[Harry Potter/Harry Potter and the Deathly Hallows (novel)|Harry Potter and the Deathly Hallows]]''{{verify}}<!-- MOD: Is this still true in 20212023?-->). Further, the number of copies is ''not'' the number of readers -- context is ''everything'', and obscuring the context can change the perceived import of a number.
 
Statistics are like studies: who made them and who paid them matters a lot. Want to "prove" that [[Murder Simulators|video games cause violence]]? Get a group of scientists that are already savvy to this and don't mind the lack of ethics. Have them draw from a very small pool of test subjects that are known to display violent behavior. Mental hospitals, prisons, schools for children with behavior disorders, what have you. Do some generic tests that are guaranteed to show up positive, come up with numbers, and presto, instant headline. "Recent test shows 77% of subjects become more violent after playing ''[[Mortal Kombat]]''." Most people won't bother with reading the article the whole way through and will just look at the headline. This works with anything from [[Comics Code|comic books]], and rock to watching ''[[Brokeback Mountain]]'' or voting for specific parties, basically anything.
Line 77 ⟶ 78:
* Many casinos like to advertise their slot machines with lines like "Up To 99% Payout!" to make it sound like the player has a good chance to win. First, "up to" means the payout could be 1% for all you know (although laws usually set a minimum). Secondly, even a 99% payout means that for every $100 you put in the machine, on average, you'll get $99 back, i.e. you still lose. That "99% payout" is also an average that is based on something like one million pulls (plays) on the machine. If you play 100 times in one slot machine, you're not getting a representative sample of that average. These machines work differently in the UK. UK Fun With Prizes are required by law to seek their set hold percentage within a certain number of spins (usually 10,000). To achieve this, they naturally [[The Computer Is a Cheating Bastard|cheat all the time]]. They also can be, and often are, programmed to go on a suck cycle and take in way more money then they need to, in order to save up for a large series of payouts later.
* A common problem encountered is Simpson's Paradox, best demonstrated by example: Suppose Hospitals 1 and 2 are nearby, but 1 is better equipped for treating people with severe injuries, so proportionally more of the people taken there are badly hurt. It does better at treating badly hurt people than hospital 2, and also does better at treating people who are not badly hurt. However, since people who're badly hurt are more likely to die than people who're not badly hurt whether or not they go to hospital 1 or hospital 2, hospital 1 may still have a higher overall death rate.
** Simpson's Paradox is when data shows one trend, but dividing it into categories shows the opposite trend. In the example above, hospital 1 has a higher death rate, but if the patients are split into categories based on severity of injury, it has a lower death rate in each category.
 
Simpson's Paradox is when data shows one trend, but dividing it into categories shows the opposite trend. In the example above, hospital 1 has a higher death rate, but if the patients are split into categories based on severity of injury, it has a lower death rate in each category.
** The same goes with good doctors and bad doctors, as told in the book [[Super Freakonomics]]. Good doctors are generally given tougher causes while bad doctors are given easier cases. However, if you look at death rates you see that some doctors have higher death rates, but these are usually the good doctors. Patients with serious cases are more likely to die, so good doctors lose a lot of their patients than, say the doctor who cures hiccups. The lesson is that you can be fairly certain that the doctor you receive at a hospital is competent enough to be assigned to you.
* When Russian Orthodox Church is up to banning some more fun stuff, it likes to self-impose the "voice of the populous" liability backed by the claim that according to surveys "70% of Russians are Orthodox Christians". Then some major religious occasion comes in and the attendance rate inevitably mounts to 2-3%. The surveys about the attendance of regular clerical services and general awareness in Orthodox lore yield similar results.
Line 104:
 
== Other examples ==
=== Anime and Manga ===
* [[The Onion]] does parody this from time to time.
* Shizuo in [[Durarara!!]] maintains that the series's troll, Izaya, is behind ''every '''single''' weird thing in the setting.'' Sure, Shizuo can get irrational when mad, and will even use statistics and percents to maintain points. [[Properly Paranoid|...Did we mention Izaya's a troll?]]
** An article was about a movement to shut down hospitals because "despite rapid advancement in medical technology, the world death rate remains at 100%."
 
** Another article said that children are universally opposed to children's health care, with responses to the question "Do you want to go to the doctor?" ranging from "NO!!!!" to "inconsolable crying," but no children in favor.
=== Comic Books ===
* An old ''[[Archie Comics|Archie]]'' story had one of the characters becoming a statistics-obsessed nut [[Negative Continuity|for the duration of the story]], only for Jughead to start citing statistics that horrified them and lead them to run away in fright, at which point [[Embarrassing Middle Name|Forsythe]] noted that some ridiculously high percentage of people who quote statistics "make 'em up on the spot!"
* [[Batman|The Penguin]] says this quote word-for-word in ''Detective Comics'' #684, at the same time pulling a [[You Have Failed Me...]] on a newly-acquired henchman who, through usage of statistics, "proved" that a broad daylight robbery had a 0% chance of being foiled by Batman.
 
=== Literature ===
* There is a semi-famous magazine article from 1958 called "The Dread Tomato Addiction" that correlates consumption of tomatoes with everything from death to communism. It can be found [https://web.archive.org/web/20090303181916/http://crystaloak.com/Gaijin/Essay/tomato_addiction.htm here]. There is a similar article about bread that can be seen [http://www.snopes.com/food/warnings/bread.asp here].
* Spoofed by ''[[The Daily Show|America: The Book]]'', which included a graph on "Growth of Misleading Charts". Two different bar heights represent the same number.
 
=== Live-Action TV ===
* ''[[Monty Python's Flying Circus]]'' parodied the use/abuse of meaningless statistics in the sketch "Spectrum":
{{quote|'''Man:''' This bar in this column represents seventeen percent of the population. This one represents twenty-eight percent of the population! And this one represents ''forty-three percent'' of the population!
Line 115 ⟶ 123:
That's only 90%.
Yeah, there was one guy who said the samples weren't big enough to be statistically significant. }}
* A commonly-cited factoid about the American Revolution is that roughly 1/3 of the residents of the Thirteen Colonies favored independence from Britain, 1/3 opposed it, and 1/3 were undecided or apathetic. The comedy series ''[[History Bites]]'' (based on the premise: what if TV had been around for 5,000 years) parodied Tom Paine as a spin-doctoring pundit:
* Spoofed by ''[[The Daily Show|America: The Book]]'', which included a graph on "Growth of Misleading Charts". Two different bar heights represent the same number.
* An old [[Archie Comics|Archie]] story had one of the characters becoming a statistics-obsessed nut [[Negative Continuity|for the duration of the story]], only for Jughead to start citing statistics that horrified them and lead them to run away in fright, at which point [[Embarrassing Middle Name|Forsythe]] noted that some ridiculously high percentage of people who quote statistics "make 'em up on the spot!"
* [[Batman|The Penguin]] says this quote word-for-word in ''Detective Comics'' #684, at the same time pulling a [[You Have Failed Me...]] on a newly-acquired henchman who, through usage of statistics, "proved" that a broad daylight robbery had a 0% chance of being foiled by Batman.
* A commonly-cited factoid about the American Revolution is that roughly 1/3 of the residents of the Thirteen Colonies favored independence from Britain, 1/3 opposed it, and 1/3 were undecided or apathetic. The comedy series ''History Bites'' (based on the premise: what if TV had been around for 5,000 years) parodied Tom Paine as a spin-doctoring pundit:
{{quote|TOM PAINE: Only 1/3 of the colonists are opposed to independence. Now, you can't let a minority opinion like that influence public policy!
INTERVIEWER: But the same number are in favor of independence.
TOM PAINE: But now we're talking half of ''decided voters'', which is essentially a majority. You can't ignore the wishes of half of decided voters! }}
** The original "statistic" doesn't come from any actual poll anyway... it was an estimation made by John Adams, and he admitted he'd not done any research on that, just that it was his feeling on the matter.
* ''[[Penn and& Teller: Bullshit!]]'' point it by having a man who makes pool research for the Republicans show he can make someone give two different answers to the same question by first asking: "Do you think the government expends too much in health care for immigrants?" The bystander answers "Yes". When he asks: "Would you deny an immigrant the right to treat himself? To give birth in a hospital? Etc..." and other medical services that go well beyond what the governments expends with immigrant health care, the answer now is: "No". Also, they make fun of the guy with his own mathematical wizardry by pointing out: "In this scene, ten cars pass by behind him. One guy from one of the cars shouts saying he sucks. This means that AT LEAST 10% of the American population believes he sucks".
 
* The Church Of The Flying Spaghetti Monster has semi-famously pointed out the obvious correlation between the [http://www.venganza.org/images/spreadword/pchart1.jpg decreasing number of pirates worldwide and Global Warming.]
=== Web Comics ===
* There's a billboard along a freeway in Michigan, advertising a dentist willing to do implants for only a couple hundred dollars. Next to it is a statement saying "Voted best dental office in Michigan". Just below that, in smaller text, is the disclaimer "by our dental staff".
* ''[[Saturday Morning Breakfast Cereal]]'' tells us [http://www.smbc-comics.com/index.php?db=comics&id=2275 how to make anything a victimless crime].
* ''[[Luke Surl]]'' expresses this via [[Visual Pun]] [http://www.lukesurl.com/archives/3105 here].
* ''[[xkcd]]'' uses this trope and a bit of bad math to justify staying indoors in the title text to [https://xkcd.com/2599/ this strip]:
{{quote|You say this daily walk will reduce my risk of death from cardiovascular disease by 30%, but also increase my risk of death by bear attack by 300%? That's a 280% increased! I'm not a sucker; I'm staying inside.}}
 
=== Web Original ===
* ''[[The Onion]]'' does parody this from time to time.
** An article was about a movement to shut down hospitals because "despite rapid advancement in medical technology, the world death rate remains at 100%."
** Another article said that children are universally opposed to children's health care, with responses to the question "Do you want to go to the doctor?" ranging from "NO!!!!" to "inconsolable crying," but no children in favor.
* ''[[Cracked.com]]'''s [http://www.cracked.com/article_20318_the-5-most-popular-ways-statistics-are-used-to-lie-to-you_p2.html The 5 Most Popular Ways Statistics Are Used to Lie to You] covers some fallacies commonly used to lie with statistics.
 
=== Western Animation ===
* One episode of ''[[The Boondocks]]'' had Uncle Ruckus, an [[Uncle Tom]] racist, declare about the (black) man who invented peanut butter and hundreds of other uses for peanuts: "George Washington Carver was the man responsible for more ''peanut allergy deaths'' than any man '''in history'''!"
* An episode of ''[[The Simpsons]]'' featured Homer forming a vigilante group to fight crime. At one point he recruits Jimbo (who calls the group "the drunken posse") on the basis that he can swing a sack full of doorknobs. Homer later gives an interview to the local news:
* [[Saturday Morning Breakfast Cereal]] tells us [http://www.smbc-comics.com/index.php?db=comics&id=2275 how to make anything a victimless crime].
* An episode of [[The Simpsons]] featured Homer forming a vigilante group to fight crime. At one point he recruits Jimbo (who calls the group "the drunken posse") on the basis that he can swing a sack full of doorknobs. Homer later gives an interview to the local news:
{{quote|'''Kent Brockman:''' Mr. Simpson, how do you respond to the charges that petty vandalism such as graffiti is down eighty percent, while heavy sack beatings are up a shocking ''nine hundred percent''?
'''Homer:''' Aw, people can come up with statistics to prove anything, Kent. ''Forfty'' percent of all people know that. }}
 
* ''Luke Surl'' expresses this via [[Visual Pun]] [http://www.lukesurl.com/archives/3105 here].
=== Other Media ===
* The Church Of The Flying Spaghetti Monster has semi-famously pointed out the obvious correlation between the [http://www.venganza.org/images/spreadword/pchart1.jpg decreasing number of pirates worldwide and Global Warming.]
* There's a billboard along a freeway in Michigan, advertising a dentist willing to do implants for only a couple hundred dollars. Next to it is a statement saying "Voted best dental office in Michigan". Just below that, in smaller text, is the disclaimer "by our dental staff".
 
=== Real Life ===
* Two sports teams each only play one game in a season, and that game is against each other. How does the losing team make themselves sound good and their opponents sound bad? {{spoiler|They say they only lost one game all season, and that their opponents only won one game all season.}}
* Shizuo in [[Durarara!!]] maintains that the series's troll, Izaya, is behind ''every '''single''' weird thing in the setting.'' Sure, Shizuo can get irrational when mad, and will even use statistics and percents to maintain points. [[Properly Paranoid|...Did we mention Izaya's a troll?]]
* ''[[Cracked.com]]'''s [http://www.cracked.com/article_20318_the-5-most-popular-ways-statistics-are-used-to-lie-to-you_p2.html The 5 Most Popular Ways Statistics Are Used to Lie to You] covers some fallacies commonly used to lie with statistics.
 
{{reflist}}
[[Category:Advertising Tropes{{PAGENAME}}]]
[[Category:Advertising Tropes]]
[[Category:Laws and Formulas]]
[[Category:Advertising Tropes]]
[[Category:Truth and Lies]]
[[Category:{{PAGENAME}}Examples Need Sorting]]