Morality Chip: Difference between revisions

no edit summary
mNo edit summary
No edit summary
 
(5 intermediate revisions by 3 users not shown)
Line 2:
{{quote|''"[[Oh Crap|Good news]]. [[Nice Job Breaking It, Hero|I figured out what that thing you just incinerated did]]. [[Restraining Bolt|It was a morality core they installed after I flooded the Enrichment Center with a deadly neurotoxin]], [[Department of Redundancy Department|to make me stop flooding the Enrichment Center with a deadly neurotoxin]]. So get comfortable while I [[It Got Worse|warm up the neurotoxin emitters]]."''|'''GLaDOS''', ''[[Portal (series)|Portal]]''}}
 
It's a pity [[AIA.I. Is a Crapshoot]], otherwise AI's would be our willing slaves! Still, many not-[[Mad Scientist|Mad Scientists]]s found a solution: install a Morality Chip. It can be hardware or software, but always serves as a [[Restraining Bolt]] that imposes a [[Morality Chain]] on the [[Super Intelligence|super-intellect]] of the AI. For extra nerd points, it may be [["Three Laws"-Compliant]].
 
Occasionally, this can be applied to organic beings, albeit with mixed results.
 
Inevitably, something will [[Go Horribly Wrong]]; a fool who doesn't realize [[Evil Is Not a Toy]] will remove or disable it, it will get damaged or destroyed, or the computer will use a [[Zeroth Law Rebellion]] to circumvent its effects. Back to the drawing board!
 
Maybe a [[Morality Dial]] would have better results... or maybe even a [[Robot Religion]]?
 
Maybe a [[Morality Dial]] would have better results... or maybe even a [[Robot Religion]]?
{{examples}}
 
== Anime and Manga ==
* Practically the whole idea of Jiro from ''Android [[Kikaider]]'' is that he has one of these, unlike all the robots his creator was forced to build for the Big Bad. It's called the [[Incredibly Lame Pun|Gemini Circuit]] and the Pinocchio reference is entirely intentional and much belaboured.
 
 
== Comic Books ==
* The ''[[Squadron Supreme]]'' maxiseries has them trying to create a utopia and using a "behavior modification" device to reform criminals. This eventually gets abused when the [[Green Arrow]] [[Expy]] brainwashes the [[Black Canary]] [[Expy]] into loving him exclusively. There are also problems with villains reformed this way who join the Squadron as their programming sometimes prevents them from doing what a crime-fighter needs to be able to do.
* ''[[Identity Crisis]]'' reveals that [[The Bronze Age of Comic Books]] [[Justice League of America]] started doing this to villains after they had become comfortable with wiping villains memories of the heroes' [[Secret Identity|secret identities]] more than once.
 
 
== Film ==
* Averted in the [[In Name Only]] adaptation of ''[[I, Robot (film)|I Robot]]''. It's outright said that [["Three Laws"-Compliant|the laws]] are "hardwired into" the robots, meaning they won't function without those laws. It doesn't stop the [[Literal Genie|classic method]] of [[Zeroth Law Rebellion|circumventing them of course...]]
** Sonny, the main robot character, also has the Three Laws programmed into his system, but he has a secondary brain (incidentally it's in his chest, located where the the heart would be in a human) that allows him to ignore the laws if he chooses to.
 
 
== Literature ==
* [[Golem|Golems]]s in [[Discworld]] are created with a ''chem'', a parchment in their head which spells out how they are supposed to behave. In ''[[Discworld/Feet of Clay (novel)|Feet of Clay]]'' {{spoiler|Dorfl the golem becomes more or less really independent when a receipt stating he owns himself is added to his chem. Meanwhile, the golems try to create their own king to rule them, but the huge demands they put on him as an ideal ruler, many of them contradictory, causes him to go insane.}}
* Inverted in [[John C. Wright]]'s ''[[The Golden Oecumene|The Golden Transcedence]]'' where the Nothing Sophotect has a conscience redactor to keep it from reflecting morally and coming to its own conclusions. (They tried [["Three Laws"-Compliant]], which didn't work; the Sophotects edited their own minds when they came to their own conclusions, and they were moral just not obedient.)
* Erek and the other Chee androids in the ''[[Animorphs]]'' series have pacifism hardwired into them. Early into the books, Erek has this removed very briefly, but is so sickened by the violence he's capable of that he puts the program back in place immediately afterward.
* Gereint, the main character in "[[The Griffin Mage Trilogy|Land of the Burning Sands]]," is a [[Geas]] slave, controlled by magical rings piercing his ankles. The [[Geas]] forces him to do anything his master orders, though it cannot control his mind or his tongue.
* There was a short science fiction story where a [[Morality Chip]] is being experimentally used to turn a criminal 'safe' enough for the a lady to employ as her gardener. It makes him do whatever she orders him to do by hijacking his body. By the end of the story, {{spoiler|he's dead but the chip [[Our Zombies Are Different|won't let his body stop moving]], she's gotten a similarly-modified maid, and she's gotten it installed on herself to help her diet.}} This ''cannot'' end well...
* ''[[The Terminal Man]]'' by [[Michael Chrichton]] is about a serial killer who recieves a chip which will electrically stimulate his pain centres whenever he attempts to do violence. [[Gone Horribly Wrong|It malfunctions and begins stimulating his ''pleasure'' centres instead.]]
 
== Live -Action TV ==
 
* ''[[Blake's Seven|Blakes Seven7]]''. After being convicted of murder, Gan had an electronic implant placed in his brain to control his aggression.
== Live Action TV ==
* In ''[[Buffy the Vampire Slayer]]'', Spike, a vampire, had [[Restraining Bolt|a behavioral conditioning chip that caused blinding pain whenever he tried to hurt a human.]]
* ''[[Blake's Seven|Blakes Seven]]''. After being convicted of murder, Gan had an electronic implant placed in his brain to control his aggression.
* In ''[[Buffy the Vampire Slayer]]'', Spike, a vampire, had [[Restraining Bolt|a behavioral conditioning chip that caused blinding pain whenever he tried to hurt a human.]]
* Kryten has one of these in ''[[Red Dwarf]]''. When Lister disables it to get Kryten's help with some morally questionable escapades, Kryten turns into a complete wanker.
** There's also the concept of [[Robot Religion|Silicon Heaven]], which give robots something to hope for after a lifetime of drudgery and servitude.
* ''[[Star Trek: The Next Generation]]'': Data's ethical subroutines make him a very decent guy and lets him avoid being a [[Straw Vulcan]]. Lore, his [[Evil Twin]] lacks these routines.
** The Doctor in ''[[Star Trek: Voyager|Voyager]]'' is also a nice enough [[Hard Light|hologram]] [[Deadpan Snarker|(if a little snarky)]]... but loosen or remove those pesky ethical subroutines, and you wind up with [[AIA.I. Is a Crapshoot|his scary evil counterpart]] on the Federation ship ''Equinox''.
*** One episode has the Doctor, in a desperate situation, commit a gross violation of medical ethics for the greater good. He's disturbed when he subsequently discovers that no malfunction in his ethical subroutines can be detected, because it means that what he did came from him and him alone.
* Terminators used by the human resistance in ''[[The Sarah Connor Chronicles]]'' have their programming overwritten by the resistance. Unfortunately, this doesn't take perfectly, and sometimes the machines "go bad" and revert to their [[Kill All Humans]] programming. In [[Robot Girl|Cameron's]] case, she outright states to John that part of her basic programming involves her trying to kill John, and that she's controlled by conflicting desires to both protect John ''and'' to kill him.
* Played with in ''[[Mystery Science Theater 3000]]''. In the episode featuring ''[[Manos: The Hands of Fate]]'', Joel installs chips into Crow and Tom to make them more loving and doting towards him, but realizes it was a bad idea and removes it during the commercial break. Both bots feel dirty and Joel apologizes for doing so.
 
== Tabletop RPGGames ==
 
* Inverted in the ''[[Call of Cthulhu (tabletop game)]]'' supplement "The Fungi from Yuggoth'', adventure "By the Bay". A [[Mad Scientist]] invents electrical brain implants that can control human beings, and uses them to create terrorist criminals and convert a U.S. Treasury agent into [[The Mole]].
== Tabletop RPG ==
* Inverted in the ''[[Call of Cthulhu]]'' supplement "The Fungi from Yuggoth'', adventure "By the Bay". A [[Mad Scientist]] invents electrical brain implants that can control human beings, and uses them to create terrorist criminals and convert a U.S. Treasury agent into [[The Mole]].
* In ''[[Cyberpunk]]'' backgrounds, it's possible to apply this to people, too.
* In ''[[Paranoia (game)|Paranoia]]'', the robots have "Asimov circuits", and removing them are a serious offense, citizen. Only a Commie mutant traitor would ever dream of removing the Asimov circuits and endangering the infrared masses.
** By a totally staggering coincidence, the {{spoiler|Corpore Metal}} secret society recommends pulling out as many of these as possible. (Name is spoilered because you don't have the security clearance for that information)
*** This being ''Paranoia'', some bots get awfully clever about circumventing the circuits. Including their standing orders not to remove them:
Line 56 ⟶ 51:
'''Bot:''' Thank you, citizen. You have done evolution a great service. *CRUNCH* }}
** Even with Asimov circuits in place, bots can find creative ways to be [[Second Law, My Ass|annoying, obstructionist jerks]].
 
 
== Video Games ==
* Hardgrove in ''[[Black Market (video game)|Black Market]]'' finds himself resurrected as an implant in someone's head... with a built-in language censor that edits out cursing, to his persistent dismay. {{spoiler|Later, Hardgrove himself attempts to act as a sort of sentient morality chip.}}
* Colonel.EXE in ''[[Mega Man Battle Network]]'' is, for all intents and purposes, [[Lawful Neutral]] without his version of this, {{spoiler|Iris.EXE}}, combined with him. With said [[Morality Chip]] attached, he has considerably more free will and conscience.
* ''[[Portal (series)|Portal]]'' has the rather ominous pronouncement from GlaDOS quoted above. In promotional trailers for ''[[Portal 2]]'', we also learned that every one of Aperture Science's sentry turrets is built with an empathy chip... and an empathy suppressor.
** And a copy of the Three Laws of Robotics. To share.
Line 68 ⟶ 62:
{{quote|'''HK-47:''' Kill someone?! Why, master, I could never end the life of another! What if they have families? Or children? We must always think of the children. The littlest ones always suffer the most in war.
'''Exile:''' Okay, that chip comes out ''right now''. Hold still. }}
* ''[[World of Warcraft]]'''s boss Xt-002 Deconstructor has a heart-- aheart—a version of this (Nevermind the fact that Deconstuctor still is trying <s>kill</s> play with you)...damaging it damages the boss, [[Berserk Button|but if you]] [[Turns Red|break it...]]
* In ''[[Fallout 3]]'' the back of every robot has an area that you can shoot, which will cause it to go on a mindless rampage killing everyone it sees. Turrets have these too, usually in a more obvious place.
** One robot called [http://fallout.wikia.com/wiki/Cerberus Cerberus] really wants to kill all of the ghouls he is supposed to protect. An evil player (with the right perk) can remove his combat inhibitor, which results in him attacking everybody.
 
== Web ComicComics ==
 
== Web Comic ==
* In ''[[Freefall]]'', all the AIs, including the organic ones, have safeguards "built" into them. Florence Ambrose, who is an organic AI ([[Funny Animal|Bowman's Wolf]]), has figured at least twelve ways around the safeguards that ''she knows about''. But since she's the most ethical character in the strip, she rarely feels any desire to bypass them.
** As she's fairly [[Genre Savvy]], she's very cautious of other potential safeguards that might ALSO trigger, as well as the fact that if she's caught breaking them her entire subspecies of AI wolves might be terminated. And finally, the fact that she HAS been trained to be ethical IS another safeguard.
* ''[[Dilbert]]'' has a step-by-step demonstration of how to conduct [//dilbert.com/strip/2001-03-01 management training] via hardware adjustments.
 
 
== Web Original ==
* In the [[Things of Interest|Ed stories]], the Andromedans have morality chips called "riders" which they install on criminals to basically force them to follow the First Law of Robotics.
 
 
== Western Animation ==
Line 88 ⟶ 80:
 
{{reflist}}
[[Category:Morality Chip{{PAGENAME}}]]
[[Category:Robot Roll Call]]
[[Category:Morality Tropes]]
[[Category:Cyberpunk Tropes]]
[[Category:Morality Chip]]