Old page wikitext, before the edit (old_wikitext) | '{{Short description|Hypothetical outcome of artificial intelligence}}
[[File:Capek RUR.jpg|thumbnail|upright=1.2|Robots revolt in ''[[R.U.R.]]'', a 1920 Czech play translated as "Rossum's Universal Robots"]]
{{Artificial intelligence}}
An '''AI takeover''' is an imagined scenario in which [[artificial intelligence]] (AI) emerges as the dominant form of [[intelligence]] on Earth and [[computer program]]s or [[robot]]s effectively take control of the planet away from the [[human species]], which relies on [[human intelligence]]. Stories of [[AI takeover in popular culture|AI takeovers remain popular]] throughout [[science fiction]], but recent advancements have made the threat more real. Possible scenarios include [[Technological unemployment|replacement of the entire human workforce]] due to [[automation]], takeover by a [[superintelligent AI]] (ASI), and the notion of a '''robot uprising'''. Some public figures, such as [[Stephen Hawking]] and [[Elon Musk]], have advocated research into [[AI control problem|precautionary measures]] to ensure future superintelligent machines remain under human control.<ref>{{Cite web |last=Lewis |first=Tanya |date=2015-01-12 |title=''Don't Let Artificial Intelligence Take Over, Top Scientists Warn'' |url=http://www.livescience.com/49419-artificial-intelligence-dangers-letter.html |access-date=October 20, 2015 |website=[[LiveScience]] |publisher=[[Purch]] |quote=Stephen Hawking, Elon Musk and dozens of other top scientists and technology leaders have signed a letter warning of the potential dangers of developing artificial intelligence (AI). |archive-date=2018-03-08 |archive-url=https://web.archive.org/web/20180308100411/https://www.livescience.com/49419-artificial-intelligence-dangers-letter.html |url-status=live }}</ref>
== Types ==
=== Automation of the economy ===
{{Main|Technological unemployment}}
The traditional consensus among economists has been that technological progress does not cause long-term unemployment. However, recent innovation in the fields of [[robotics]] and artificial intelligence has raised worries that human labor will become obsolete, leaving people in various sectors without jobs to earn a living, leading to an economic crisis.<ref>{{Cite web |last=Lee |first=Kai-Fu |date=2017-06-24 |title=The Real Threat of Artificial Intelligence |url=https://www.nytimes.com/2017/06/24/opinion/sunday/artificial-intelligence-economic-inequality.html |access-date=2017-08-15 |website=[[The New York Times]] |quote=These tools can outperform human beings at a given task. This kind of A.I. is spreading to thousands of domains, and as it does, it will eliminate many jobs. |archive-date=2020-04-17 |archive-url=https://web.archive.org/web/20200417183307/https://www.nytimes.com/2017/06/24/opinion/sunday/artificial-intelligence-economic-inequality.html |url-status=live }}</ref><ref>{{Cite web |last=Larson |first=Nina |date=2017-06-08 |title=AI 'good for the world'... says ultra-lifelike robot |url=https://phys.org/news/2017-06-ai-good-world-ultra-lifelike-robot.html |access-date=2017-08-15 |website=[[Phys.org]] |quote=Among the feared consequences of the rise of the robots is the growing impact they will have on human jobs and economies. |archive-date=2020-03-06 |archive-url=https://web.archive.org/web/20200306021915/https://phys.org/news/2017-06-ai-good-world-ultra-lifelike-robot.html |url-status=live }}</ref><ref>{{Cite web |last=Santini |first=Jean-Louis |date=2016-02-14 |title=Intelligent robots threaten millions of jobs |url=https://phys.org/news/2016-02-intelligent-robots-threaten-millions-jobs.html#nRlv |access-date=2017-08-15 |website=[[Phys.org]] |quote="We are approaching a time when machines will be able to outperform humans at almost any task," said Moshe Vardi, director of the Institute for Information Technology at Rice University in Texas. |archive-date=2019-01-01 |archive-url=https://web.archive.org/web/20190101014340/https://phys.org/news/2016-02-intelligent-robots-threaten-millions-jobs.html#nRlv |url-status=live }}</ref><ref>{{Cite web |last=Williams-Grut |first=Oscar |date=2016-02-15 |title=Robots will steal your job: How AI could increase unemployment and inequality |url=http://www.businessinsider.com/robots-will-steal-your-job-citi-ai-increase-unemployment-inequality-2016-2?r=UK&IR=T |access-date=2017-08-15 |website=[[Businessinsider.com]] |publisher=[[Business Insider]] |quote=Top computer scientists in the US warned that the rise of artificial intelligence (AI) and robots in the workplace could cause mass unemployment and dislocated economies, rather than simply unlocking productivity gains and freeing us all up to watch TV and play sports. |archive-date=2017-08-16 |archive-url=https://web.archive.org/web/20170816061548/http://www.businessinsider.com/robots-will-steal-your-job-citi-ai-increase-unemployment-inequality-2016-2?r=UK&IR=T |url-status=live }}</ref> Many small and medium size businesses may also be driven out of business if they cannot afford or licence the latest robotic and AI technology, and may need to focus on areas or services that cannot easily be replaced for continued viability in the face of such technology.<ref>{{Cite news |date=2017-10-17 |title=How can SMEs prepare for the rise of the robots? |language=en-US |work=LeanStaff |url=http://www.leanstaff.co.uk/robot-apocalypse/ |url-status=dead |access-date=2017-10-17 |archive-url=https://web.archive.org/web/20171018073852/http://www.leanstaff.co.uk/robot-apocalypse/ |archive-date=2017-10-18}}</ref>
==== Technologies that may displace workers ====
AI technologies have been widely adopted in recent years. While these technologies have replaced some traditional workers, they also create new opportunities. Industries that are most susceptible to AI takeover include transportation, retail, and military. AI military technologies, for example, allow soldiers to work remotely without risk of injury. A study in 2024 highlights AI's ability to perform routine and repetitive tasks poses significant risks of job displacement, especially in sectors like manufacturing and administrative support.<ref>{{Cite journal |last1=Hassan Soueidan |first1=Mohamad |last2=Shoghari |first2=Rodwan |date=2024-05-09 |title=The Impact of Artificial Intelligence on Job Loss: Risks for Governments |url=https://techniumscience.com/index.php/socialsciences/article/view/10917 |journal=Technium Social Sciences Journal |volume=57 |pages=206–223 |language=en-US |doi=10.47577/tssj.v57i1.10917|doi-access=free }}</ref> Author Dave Bond argues that as AI technologies continue to develop and expand, the relationship between humans and robots will change; they will become closely integrated in several aspects of life. AI will likely displace some workers while creating opportunities for new jobs in other sectors, especially in fields where tasks are repeatable.<ref>{{Cite journal|last=Frank|first=Morgan|date=2019-03-25|title=Toward understanding the impact of artificial intelligence on labor|journal=Proceedings of the National Academy of Sciences of the United States of America|volume=116|issue=14|pages=6531–6539|doi=10.1073/pnas.1900949116|pmid=30910965|pmc=6452673|bibcode=2019PNAS..116.6531F |doi-access=free}}</ref><ref>{{Cite book|last=Bond|first=Dave|title=Artificial Intelligence|year=2017|pages=67–69}}</ref>
==== Computer-integrated manufacturing ====
{{See also|Artificial intelligence in industry}}
[[Computer-integrated manufacturing]] uses computers to control the production process. This allows individual processes to exchange information with each other and initiate actions. Although manufacturing can be faster and less error-prone by the integration of computers, the main advantage is the ability to create automated manufacturing processes. Computer-integrated manufacturing is used in automotive, aviation, space, and ship building industries.
==== White-collar machines ====
{{See also|White-collar worker}}
The 21st century has seen a variety of skilled tasks partially taken over by machines, including translation, legal research, and journalism. Care work, entertainment, and other tasks requiring empathy, previously thought safe from automation, have also begun to be performed by robots.<ref>{{Cite news |last=Skidelsky |first=Robert |author-link=Robert Skidelsky, Baron Skidelsky |date=2013-02-19 |title=Rise of the robots: what will the future of work look like? |url=https://www.theguardian.com/business/2013/feb/19/rise-of-robots-future-of-work |url-status=live |archive-url=https://web.archive.org/web/20190403203821/https://www.theguardian.com/business/2013/feb/19/rise-of-robots-future-of-work |archive-date=2019-04-03 |access-date=14 July 2015 |work=The Guardian |location=London, England}}</ref><ref>{{Cite web |last=Bria |first=Francesca |date=February 2016 |title=The robot economy may already have arrived |url=https://www.opendemocracy.net/can-europe-make-it/francesca-bria/robot-economy-full-automation-work-future |access-date=20 May 2016 |publisher=[[openDemocracy]] |archive-date=17 May 2016 |archive-url=https://web.archive.org/web/20160517215840/https://www.opendemocracy.net/can-europe-make-it/francesca-bria/robot-economy-full-automation-work-future |url-status=dead }}</ref><ref>{{Cite web |last=Srnicek |first=Nick |author-link=Nick Srnicek |date=March 2016 |title=4 Reasons Why Technological Unemployment Might Really Be Different This Time |url=http://wire.novaramedia.com/2015/03/4-reasons-why-technological-unemployment-might-really-be-different-this-time/ |url-status=dead |archive-url=https://web.archive.org/web/20160625161447/http://wire.novaramedia.com/2015/03/4-reasons-why-technological-unemployment-might-really-be-different-this-time/ |archive-date=25 June 2016 |access-date=20 May 2016 |publisher=novara wire}}</ref><ref>{{Cite book |last1=Brynjolfsson |first1=Erik |title=The Second Machine Age: Work, Progress, and Prosperity in a Time of Brilliant Technologies |last2=McAfee |first2=Andrew |publisher=W. W. Norton & Company |year=2014 |isbn=978-0393239355 |chapter=''passim'', see esp Chpt. 9}}</ref>
==== Autonomous cars ====
An [[Self-driving car|autonomous car]] is a vehicle that is capable of sensing its environment and navigating without human input. Many such vehicles are being developed, but as of May 2017, automated cars permitted on public roads are not yet fully autonomous. They all require a human driver at the wheel who at a moment's notice can take control of the vehicle. Among the obstacles to widespread adoption of autonomous vehicles are concerns about the resulting loss of driving-related jobs in the road transport industry. On March 18, 2018, [[Death of Elaine Herzberg|the first human was killed]] by an autonomous vehicle in [[Tempe, Arizona]] by an [[Uber]] self-driving car.<ref>{{Cite news |last=Wakabayashi |first=Daisuke |date=March 19, 2018 |title=Self-Driving Uber Car Kills Pedestrian in Arizona, Where Robots Roam |url=https://www.nytimes.com/2018/03/19/technology/uber-driverless-fatality.html |url-status=live |archive-url=https://web.archive.org/web/20200421221918/https://www.nytimes.com/2018/03/19/technology/uber-driverless-fatality.html |archive-date=April 21, 2020 |access-date=March 23, 2018 |work=New York Times |location=New York, New York}}</ref>
==== AI-generated content ====
{{See also|Artificial intelligence art}}
The use of automated content has become relevant since the technological advancements in artificial intelligence models such as [[ChatGPT]], [[DALL-E]], and [[Stable Diffusion]]. In most cases, AI-generated content such as imagery, literature, and music are produced through text prompts and these AI models have been integrated into other creative programs. Artists are threatened by displacement from AI-generated content due to these models sampling from other creative works, producing results sometimes indiscernible to those of man-made content. This complication has become widespread enough to where other artists and programmers are creating software and utility programs to retaliate against these text-to-image models from giving accurate outputs. While some industries in the economy benefit from artificial intelligence through new jobs, this issue does not create new jobs and threatens replacement entirely. It has made public headlines in the media recently: In February 2024, [[Willy's Chocolate Experience]] in [[Glasgow, Scotland]] was an infamous children's event in which the imagery and scripts were created using artificial intelligence models to the dismay of children, parents, and actors involved. There is an ongoing lawsuit placed against [[OpenAI]] from [[The New York Times]] where it is claimed that there is copyright infringement due to the sampling methods their artificial intelligence models use for their outputs. <ref>{{cite book | last1 = Jiang | first1 = Harry H. | last2 = Brown | first2 = Lauren | last3 = Cheng | first3 = Jessica | last4 = Khan | first4 = Mehtab | last5 = Gupta | first5 = Abhishek | last6 = Workman | first6 = Deja | last7 = Hanna | first7 = Alex | last8 = Flowers | first8 = Johnathan | last9 = Gebru | first9 = Timnit | chapter = AI Art and its Impact on Artists | title = Proceedings of the 2023 AAAI/ACM Conference on AI, Ethics, and Society | pages = 363–374 | publisher = Association for Computing Machinery | date = 29 August 2023 | doi = 10.1145/3600211.3604681 | doi-access = free | isbn = 979-8-4007-0231-0 }}</ref><ref>{{cite arXiv | title = Can There be Art Without an Artist? | last1 = Ghosh | first1 = Avijit | last2 = Fossas | first2 = Genoveva | date = 19 November 2022 | class = cs.AI | eprint = 2209.07667 }}</ref><ref>{{cite arXiv | title = Glaze: Protecting Artists from Style Mimicry by Text-to-Image Models | last1 = Shan | first1 = Shawn | last2 = Cryan | first2 = Jenna | last3 = Wenger | first3 = Emily | last4 = Zheng | first4 = Haitao | last5 = Hanocka | first5 = Rana | last6 = Zhao | first6 = Ben Y. | date = 3 August 2023 | class = cs.CR | eprint = 2302.04222 }}</ref><ref>{{cite news | last = Brooks | first = Libby | title = Glasgow Willy Wonka experience called a 'farce' as tickets refunded | work = The Guardian | date = 27 February 2024 | url = https://www.theguardian.com/uk-news/2024/feb/27/glasgow-willy-wonka-experience-slammed-as-farce-as-tickets-refunded | access-date = 2 April 2024}}</ref><ref>{{cite news | last1 = Metz | first1 = Cade | last2 = Robertson | first2 = Katie | title = OpenAI Seeks to Dismiss Parts of The New York Times's Lawsuit | work = The New York Times | date = 27 February 2024 | url = https://www.nytimes.com/2024/02/27/technology/openai-new-york-times-lawsuit.html?smid=url-share | access-date = 4 April 2024}}</ref>
=== Eradication ===
{{Main|Existential risk from artificial general intelligence}}
Scientists such as [[Stephen Hawking]] are confident that superhuman artificial intelligence is physically possible, stating "there is no physical law precluding particles from being organised in ways that perform even more advanced computations than the arrangements of particles in human brains".<ref>{{Cite news |last1=Hawking |first1=Stephen |last2=Russell |first2=Stuart J. |author2-link=Stuart J. Russell |last3=Tegmark |first3=Max |author3-link=Max Tegmark |last4=Wilczek |first4=Frank |author4-link=Frank Wilczek |date=1 May 2014 |title=Stephen Hawking: 'Transcendence looks at the implications of artificial intelligence - but are we taking AI seriously enough?' |url=https://www.independent.co.uk/news/science/stephen-hawking-transcendence-looks-at-the-implications-of-artificial-intelligence-but-are-we-taking-9313474.html |url-access=limited |url-status=live |archive-url=https://web.archive.org/web/20151002023652/http://www.independent.co.uk/news/science/stephen-hawking-transcendence-looks-at-the-implications-of-artificial-intelligence-but-are-we-taking-9313474.html |archive-date=2015-10-02 |access-date=1 April 2016 |work=The Independent}}</ref><ref>{{cite book | last1=Müller | first1=Vincent C. | author-link1=Vincent C. Müller | last2=Bostrom | first2=Nick | author-link2=Nick Bostrom | title=Fundamental Issues of Artificial Intelligence | chapter=Future Progress in Artificial Intelligence: A Survey of Expert Opinion | publisher=Springer | year=2016 | isbn=978-3-319-26483-7 | doi=10.1007/978-3-319-26485-1_33 | pages=555–572 | chapter-url=https://nickbostrom.com/papers/survey.pdf | quote=AI systems will... reach overall human ability... very likely (with 90% probability) by 2075. From reaching human ability, it will move on to superintelligence within 30 years (75%)... So, (most of the AI experts responding to the surveys) think that superintelligence is likely to come in a few decades... | access-date=2022-06-16 | archive-date=2022-05-31 | archive-url=https://web.archive.org/web/20220531142709/https://nickbostrom.com/papers/survey.pdf | url-status=live }}</ref> Scholars like [[Nick Bostrom]] debate how far off superhuman intelligence is, and whether it poses a risk to mankind. According to Bostrom, a superintelligent machine would not necessarily be motivated by the same ''emotional'' desire to collect power that often drives human beings but might rather treat power as a means toward attaining its ultimate goals; taking over the world would both increase its access to resources and help to prevent other agents from stopping the machine's plans. As an oversimplified example, a [[Instrumental convergence#Paperclip maximizer|paperclip maximizer]] designed solely to create as many paperclips as possible would want to take over the world so that it can use all of the world's resources to create as many paperclips as possible, and, additionally, prevent humans from shutting it down or using those resources on things other than paperclips.<ref>{{cite journal | last=Bostrom | first=Nick | title=The Superintelligent Will: Motivation and Instrumental Rationality in Advanced Artificial Agents | journal=Minds and Machines | publisher=Springer | volume=22 | issue=2 | year=2012 | doi=10.1007/s11023-012-9281-3 | pages=71–85 | s2cid=254835485 | url=https://nickbostrom.com/superintelligentwill.pdf | access-date=2022-06-16 | archive-date=2022-07-09 | archive-url=https://web.archive.org/web/20220709032134/https://nickbostrom.com/superintelligentwill.pdf | url-status=live }}</ref>
== In fiction ==
{{Main|AI takeovers in popular culture}}
{{See also|Artificial intelligence in fiction|Self-replicating machines in fiction}}
AI takeover is a common theme in [[science fiction]]. Fictional scenarios typically differ vastly from those hypothesized by researchers in that they involve an active conflict between humans and an AI or robots with anthropomorphic motives who see them as a threat or otherwise have active desire to fight humans, as opposed to the researchers' concern of an AI that rapidly exterminates humans as a byproduct of pursuing its goals.<ref name="bostrom-superintelligence">{{Cite book |last=Bostrom |first=Nick |title=Superintelligence: Paths, Dangers, Strategies |title-link=Superintelligence: Paths, Dangers, Strategies}}</ref> The idea is seen in [[Karel Čapek]]'s ''[[R.U.R.]]'', which introduced the word ''robot'' in 1921,<ref>{{Cite news |date=22 April 2011 |title=The Origin Of The Word 'Robot' |work=[[Science Friday]] (public radio) |url=https://www.sciencefriday.com/segments/the-origin-of-the-word-robot/ |access-date=30 April 2020 |archive-date=14 March 2020 |archive-url=https://web.archive.org/web/20200314092540/https://www.sciencefriday.com/segments/the-origin-of-the-word-robot/ |url-status=live }}</ref> and can be glimpsed in [[Mary Shelley]]'s ''[[Frankenstein]]'' (published in 1818), as Victor ponders whether, if he grants [[Frankenstein's monster|his monster's]] request and makes him a wife, they would reproduce and their kind would destroy humanity.<ref>{{Cite news |last=Botkin-Kowacki |first=Eva |date=28 October 2016 |title=A female Frankenstein would lead to humanity's extinction, say scientists |work=Christian Science Monitor |url=https://www.csmonitor.com/Science/2016/1028/A-female-Frankenstein-would-lead-to-humanity-s-extinction-say-scientists |access-date=30 April 2020 |archive-date=26 February 2021 |archive-url=https://web.archive.org/web/20210226203855/https://www.csmonitor.com/Science/2016/1028/A-female-Frankenstein-would-lead-to-humanity-s-extinction-say-scientists |url-status=live }}</ref>
According to [[Toby Ord]], the idea that an AI takeover requires robots is a misconception driven by the media and Hollywood. He argues that the most damaging humans in history were not physically the strongest, but that they used words instead to convince people and gain control of large parts of the world. He writes that a ''sufficiently'' intelligent AI with an access to the internet could scatter backup copies of itself, gather financial and human resources (via cyberattacks or blackmails), persuade people on a large scale, and exploit societal vulnerabilities that are too subtle for humans to anticipate.<ref>{{Cite book |last=Ord |first=Toby |title=The precipice: existential risk and the future of humanity |date=2020 |publisher=Bloomsbury academic |isbn=978-1-5266-0023-3 |location=London, England and New York, New York |language=en |chapter=Unaligned artificial intelligence}}</ref>
The word "robot" from ''R.U.R.'' comes from the Czech word, ''robota'', meaning laborer or [[serf]]. The 1920 play was a protest against the rapid growth of technology, featuring manufactured "robots" with increasing capabilities who eventually revolt.<ref name="surgery">{{Cite journal |last1=Hockstein |first1=N. G. |last2=Gourin |first2=C. G. |last3=Faust |first3=R. A. |last4=Terris |first4=D. J. |date=17 March 2007 |title=A history of robots: from science fiction to surgical robotics |journal=Journal of Robotic Surgery |volume=1 |issue=2 |pages=113–118 |doi=10.1007/s11701-007-0021-2 |pmc=4247417 |pmid=25484946}}</ref> [[HAL 9000]] (1968) and the original [[Terminator (character)|Terminator]] (1984) are two iconic examples of hostile AI in pop culture.<ref>{{Cite news |last=Hellmann |first=Melissa |date=21 September 2019 |title=AI 101: What is artificial intelligence and where is it going? |work=The Seattle Times |url=https://www.seattletimes.com/business/technology/ai-101-what-is-artificial-intelligence-and-where-is-it-going/ |access-date=30 April 2020 |archive-date=21 April 2020 |archive-url=https://web.archive.org/web/20200421232439/https://www.seattletimes.com/business/technology/ai-101-what-is-artificial-intelligence-and-where-is-it-going/ |url-status=live }}</ref>
== Contributing factors ==
=== Advantages of superhuman intelligence over humans ===
[[Nick Bostrom]] and others have expressed concern that an AI with the abilities of a competent artificial intelligence researcher would be able to modify its own source code and increase its own intelligence. If its self-reprogramming leads to getting even better at being able to reprogram itself, the result could be a recursive [[intelligence explosion]] in which it would rapidly leave human intelligence far behind. Bostrom defines a superintelligence as "any intellect that greatly exceeds the cognitive performance of humans in virtually all domains of interest", and enumerates some advantages a superintelligence would have if it chose to compete against humans:<ref name=bostrom-superintelligence/><!-- bostrom-superintelligence, Chapter 6: Cognitive Superpowers, Table 8 --><ref name="BabcockKrámar2019">{{Cite book |last1=Babcock |first1=James |title=Next-Generation Ethics |last2=Krámar |first2=János |last3=Yampolskiy |first3=Roman V. |year=2019 |isbn=9781108616188 |pages=90–112 |chapter=Guidelines for Artificial Intelligence Containment |doi=10.1017/9781108616188.008 |author-link3=Roman Yampolskiy |arxiv=1707.08476 |s2cid=22007028}}<!-- in Next-Generation Ethics: Engineering a Better Society, Cambridge University Press --></ref>
* Technology research: A machine with superhuman scientific research abilities would be able to beat the human research community to milestones such as nanotechnology or advanced biotechnology
* [[Strategy|Strategizing]]: A superintelligence might be able to simply outwit human opposition
* Social manipulation: A superintelligence might be able to recruit human support,<ref name=bostrom-superintelligence /> or covertly incite a war between humans<ref>{{Cite news |last=Baraniuk |first=Chris |date=23 May 2016 |title=Checklist of worst-case scenarios could help prepare for evil AI |work=[[New Scientist]] |url=https://www.newscientist.com/article/2089606-checklist-of-worst-case-scenarios-could-help-prepare-for-evil-ai/ |access-date=21 September 2016 |archive-date=21 September 2016 |archive-url=https://web.archive.org/web/20160921061131/https://www.newscientist.com/article/2089606-checklist-of-worst-case-scenarios-could-help-prepare-for-evil-ai/ |url-status=live }}</ref>
* Economic productivity: As long as a copy of the AI could produce more economic wealth than the cost of its hardware, individual humans would have an incentive to voluntarily allow the [[Artificial General Intelligence]] (AGI) to run a copy of itself on their systems
* Hacking: A superintelligence could find new exploits in computers connected to the Internet, and spread copies of itself onto those systems, or might steal money to finance its plans
==== Sources of AI advantage ====
According to Bostrom, a computer program that faithfully emulates a human brain, or that runs algorithms that are as powerful as the human brain's algorithms, could still become a "speed superintelligence" if it can think orders of magnitude faster than a human, due to being made of silicon rather than flesh, or due to optimization increasing the speed of the AGI. Biological neurons operate at about 200 Hz, whereas a modern microprocessor operates at a speed of about 2,000,000,000 Hz. Human axons carry action potentials at around 120 m/s, whereas computer signals travel near the speed of light.<ref name="bostrom-superintelligence" /><!-- chapter 3 -->
A network of human-level intelligences designed to network together and share complex thoughts and memories seamlessly, able to collectively work as a giant unified team without friction, or consisting of trillions of human-level intelligences, would become a "collective superintelligence".<ref name="bostrom-superintelligence" /><!-- chapter 3 -->
More broadly, any number of qualitative improvements to a human-level AGI could result in a "quality superintelligence", perhaps resulting in an AGI as far above us in intelligence as humans are above apes. The number of neurons in a human brain is limited by cranial volume and metabolic constraints, while the number of processors in a supercomputer can be indefinitely expanded. An AGI need not be limited by human constraints on [[working memory]], and might therefore be able to intuitively grasp more complex relationships than humans can. An AGI with specialized cognitive support for engineering or computer programming would have an advantage in these fields, compared with humans who evolved no specialized mental modules to specifically deal with those domains. Unlike humans, an AGI can spawn copies of itself and tinker with its copies' source code to attempt to further improve its algorithms.<ref name="bostrom-superintelligence" /><!-- chapter 3 -->
=== Possibility of unfriendly AI preceding friendly AI ===
==== Is strong AI inherently dangerous? ====
{{main|AI alignment}}
A significant problem is that unfriendly artificial intelligence is likely to be much easier to create than friendly AI. While both require large advances in recursive optimisation process design, friendly AI also requires the ability to make goal structures invariant under self-improvement (or the AI could transform itself into something unfriendly) and a goal structure that aligns with human values and does not undergo [[instrumental convergence]] in ways that may automatically destroy the entire human race. An unfriendly AI, on the other hand, can optimize for an arbitrary goal structure, which does not need to be invariant under self-modification.<ref name="singinst12">{{Cite web |last=Yudkowsky |first=Eliezer S. |date=May 2004 |title=Coherent Extrapolated Volition |url=http://singinst.org/upload/CEV.html |archive-url=https://web.archive.org/web/20120615203944/http://singinst.org/upload/CEV.html |archive-date=2012-06-15 |publisher=Singularity Institute for Artificial Intelligence}}</ref>
The sheer complexity of human value systems makes it very difficult to make AI's motivations human-friendly.<ref name="bostrom-superintelligence" /><ref name="Muehlhauser, Luke 2012">{{Cite book |last1=Muehlhauser |first1=Luke |title=Singularity Hypotheses: A Scientific and Philosophical Assessment |last2=Helm |first2=Louie |publisher=Springer |year=2012 |chapter=Intelligence Explosion and Machine Ethics |chapter-url=https://intelligence.org/files/IE-ME.pdf |access-date=2020-10-02 |archive-date=2015-05-07 |archive-url=https://web.archive.org/web/20150507173028/http://intelligence.org/files/IE-ME.pdf |url-status=live }}</ref> Unless moral philosophy provides us with a flawless ethical theory, an AI's utility function could allow for many potentially harmful scenarios that conform with a given ethical framework but not "common sense". According to [[Eliezer Yudkowsky]], there is little reason to suppose that an artificially designed mind would have such an adaptation.<ref name="Yudkowsky2011">{{Cite book |last=Yudkowsky |first=Eliezer |title=Artificial General Intelligence |year=2011 |isbn=978-3-642-22886-5 |series=Lecture Notes in Computer Science |volume=6830 |pages=388–393 |chapter=Complex Value Systems in Friendly AI |doi=10.1007/978-3-642-22887-2_48 |issn=0302-9743}}</ref>
==== Odds of conflict ====
Many scholars, including evolutionary psychologist [[Steven Pinker]], argue that a superintelligent machine is likely to coexist peacefully with humans.<ref name="pinker now">{{Cite news |last=Pinker |first=Steven |date=13 February 2018 |title=We're told to fear robots. But why do we think they'll turn on us? |language=en |work=Popular Science |url=https://www.popsci.com/robot-uprising-enlightenment-now/ |access-date=8 June 2020 |archive-date=20 July 2020 |archive-url=https://web.archive.org/web/20200720164306/https://www.popsci.com/robot-uprising-enlightenment-now/ |url-status=live }}</ref>
The fear of cybernetic revolt is often based on interpretations of humanity's history, which is rife with incidents of enslavement and genocide. Such fears stem from a belief that competitiveness and aggression are necessary in any intelligent being's goal system. However, such human competitiveness stems from the evolutionary background to our intelligence, where the survival and reproduction of genes in the face of human and non-human competitors was the central goal.<ref>''[http://www.singinst.org/ourresearch/presentations/ Creating a New Intelligent Species: Choices and Responsibilities for Artificial Intelligence Designers] {{webarchive |url=https://web.archive.org/web/20070206060938/http://www.singinst.org/ourresearch/presentations/ |date=February 6, 2007 }}'' - [[Singularity Institute for Artificial Intelligence]], 2005</ref> According to AI researcher [[Steve Omohundro]], an arbitrary intelligence could have arbitrary goals: there is no particular reason that an artificially intelligent machine (not sharing humanity's evolutionary context) would be hostile—or friendly—unless its creator programs it to be such and it is not inclined or capable of modifying its programming. But the question remains: what would happen if AI systems could interact and evolve (evolution in this context means self-modification or selection and reproduction) and need to compete over resources—would that create goals of self-preservation? AI's goal of self-preservation could be in conflict with some goals of humans.<ref>{{Cite conference |last=Omohundro |first=Stephen M. |date=June 2008 |title=The basic AI drives |url=https://selfawaresystems.files.wordpress.com/2008/01/ai_drives_final.pdf |conference=Artificial General Intelligence 2008 |pages=483–492 |access-date=2020-10-02 |archive-date=2020-10-10 |archive-url=https://web.archive.org/web/20201010072132/https://selfawaresystems.files.wordpress.com/2008/01/ai_drives_final.pdf |url-status=live }}</ref>
Many scholars dispute the likelihood of unanticipated cybernetic revolt as depicted in science fiction such as ''[[The Matrix]]'', arguing that it is more likely that any artificial intelligence powerful enough to threaten humanity would probably be programmed not to attack it. Pinker acknowledges the possibility of deliberate "bad actors", but states that in the absence of bad actors, unanticipated accidents are not a significant threat; Pinker argues that a culture of engineering safety will prevent AI researchers from accidentally unleashing malign superintelligence.<ref name="pinker now" /> In contrast, Yudkowsky argues that humanity is less likely to be threatened by deliberately aggressive AIs than by AIs which were programmed such that their [[unintended consequence|goals are unintentionally incompatible]] with human survival or well-being (as in the film ''[[I, Robot (film)|I, Robot]]'' and in the short story "[[The Evitable Conflict]]"). Omohundro suggests that present-day automation systems are not [[AI safety|designed for safety]] and that AIs may blindly optimize narrow [[utility]] functions (say, playing chess at all costs), leading them to seek self-preservation and elimination of obstacles, including humans who might turn them off.<ref name="Tucker2014">{{Cite news |last=Tucker |first=Patrick |date=17 Apr 2014 |title=Why There Will Be A Robot Uprising |agency=Defense One |url=http://www.defenseone.com/technology/2014/04/why-there-will-be-robot-uprising/82783/ |access-date=15 July 2014 |archive-date=6 July 2014 |archive-url=https://web.archive.org/web/20140706110100/http://www.defenseone.com/technology/2014/04/why-there-will-be-robot-uprising/82783/ |url-status=live }}</ref>
==== Precautions ====
{{main|AI control problem}}
The '''AI control problem''' is the issue of how to build a [[superintelligence|superintelligent]] agent that will aid its creators, while avoiding inadvertently building a superintelligence that will harm its creators.<ref>{{Cite book|first=Stuart J.|last=Russell|url=http://worldcat.org/oclc/1237420037|title=Human compatible : artificial intelligence and the problem of control|date=8 October 2019|publisher=Penguin |isbn=978-0-525-55862-0|oclc=1237420037|access-date=2 January 2022|archive-date=15 March 2023|archive-url=https://web.archive.org/web/20230315194123/https://worldcat.org/title/1237420037|url-status=live}}</ref> Some scholars argue that solutions to the control problem might also find applications in existing non-superintelligent AI.<ref name="bbc-google">{{Cite news |date=8 June 2016 |title=Google developing kill switch for AI |work=BBC News |url=https://www.bbc.com/news/technology-36472140 |access-date=7 June 2020 |archive-date=11 June 2016 |archive-url=https://web.archive.org/web/20160611042244/http://www.bbc.com/news/technology-36472140 |url-status=live }}</ref>
Major approaches to the control problem include ''alignment'', which aims to align AI goal systems with human values, and ''capability control'', which aims to reduce an AI system's capacity to harm humans or gain control. An example of "capability control" is to research whether a superintelligence AI could be successfully confined in an "[[AI box]]". According to Bostrom, such capability control proposals are not reliable or sufficient to solve the control problem in the long term, but may potentially act as valuable supplements to alignment efforts.<ref name=bostrom-superintelligence/>
== Warnings ==
Physicist [[Stephen Hawking]], [[Microsoft]] founder [[Bill Gates]], and [[SpaceX]] founder [[Elon Musk]] have expressed concerns about the possibility that AI could develop to the point that humans could not control it, with Hawking theorizing that this could "spell the end of the human race".<ref>{{Cite web |last=Rawlinson |first=Kevin |date=29 January 2015 |title=Microsoft's Bill Gates insists AI is a threat |url=https://www.bbc.co.uk/news/31047780 |access-date=30 January 2015 |website=[[BBC News]] |archive-date=29 January 2015 |archive-url=https://web.archive.org/web/20150129183607/http://www.bbc.co.uk/news/31047780 |url-status=live }}</ref> Stephen Hawking said in 2014 that "Success in creating AI would be the biggest event in human history. Unfortunately, it might also be the last, unless we learn how to avoid the risks." Hawking believed that in the coming decades, AI could offer "incalculable benefits and risks" such as "technology outsmarting [[Financial market|financial markets]], out-inventing human researchers, out-manipulating human leaders, and developing weapons we cannot even understand." In January 2015, [[Nick Bostrom]] joined Stephen Hawking, [[Max Tegmark]], Elon Musk, Lord [[Martin Rees, Baron Rees of Ludlow|Martin Rees]], [[Jaan Tallinn]], and numerous AI researchers in signing the [[Future of Life Institute]]'s open letter speaking to the potential risks and benefits associated with [[artificial intelligence]]. The signatories "believe that research on how to make AI systems robust and beneficial is both important and timely, and that there are concrete research directions that can be pursued today."<ref>{{Cite web |title=The Future of Life Institute Open Letter |date=28 October 2015 |url=http://futureoflife.org/ai-open-letter |access-date=29 March 2019 |publisher=The Future of Life Institute |archive-date=29 March 2019 |archive-url=https://web.archive.org/web/20190329094536/https://futureoflife.org/ai-open-letter/ |url-status=live }}</ref><ref>{{Cite web |last=Bradshaw |first=Tim |date=11 January 2015 |title=Scientists and investors warn on AI |url=http://www.ft.com/cms/s/0/3d2c2f12-99e9-11e4-93c1-00144feabdc0.html#axzz3TNL9lxJV |access-date=4 March 2015 |publisher=The Financial Times |archive-date=7 February 2015 |archive-url=https://web.archive.org/web/20150207042806/http://www.ft.com/cms/s/0/3d2c2f12-99e9-11e4-93c1-00144feabdc0.html#axzz3TNL9lxJV |url-status=live }}</ref>
Arthur C. Clarke's Odyssey series and Charles Stross's Accelerando relate to humanity's narcissistic injuries in the face of powerful artificial intelligences threatening humanity's self-perception.<ref>{{Cite journal |last=Kaminski |first=Johannes D. |date=December 2022 |title=On human expendability: AI takeover in Clarke's Odyssey and Stross's Accelerando |url=https://link.springer.com/10.1007/s11059-022-00670-w |journal=Neohelicon |language=en |volume=49 |issue=2 |pages=495–511 |doi=10.1007/s11059-022-00670-w |s2cid=253793613 |issn=0324-4652}}</ref>
== Prevention through AI alignment ==
{{Excerpt|AI alignment|only=paragraph}}
== See also ==
{{div col|colwidth=30em}}
* [[Philosophy of artificial intelligence]]
* [[Artificial intelligence arms race]]
* [[Autonomous robot]]
** [[Industrial robot]]
** [[Mobile robot]]
** [[Self-replicating machine]]
* [[Cyberocracy]]
* [[Effective altruism]]
* [[Existential risk from artificial general intelligence]]
* [[Future of Humanity Institute]]
* [[Global catastrophic risk]] (existential risk)
* [[Government by algorithm]]
* [[Human extinction]]
* [[Machine ethics]]
* [[Machine learning]]/[[Deep learning]]
* [[Transhumanism]]
* [[Self-replication]]
* [[Technophobia]]
* [[Technological singularity]]
** [[Intelligence explosion]]
** [[Superintelligence]]
*** ''[[Superintelligence: Paths, Dangers, Strategies]]''
{{div col end}}
==Notes==
{{Notelist}}
== References ==
{{Reflist}}
== External links ==
* [[TED talk]]: [https://www.youtube.com/watch?v=8nt3edWLgIg "Can we build AI without losing control over it?"] by [[Sam Harris]]
{{Existential risk from artificial intelligence|state=expanded}}
{{doomsday}}
{{DEFAULTSORT:AI takeover}}
[[Category:Doomsday scenarios]]
[[Category:Future problems]]
[[Category:Science fiction themes]]
[[Category:Existential risk from artificial general intelligence]]
[[Category:Technophobia]]' |
New page wikitext, after the edit (new_wikitext) | '{{Short description|Hypothetical outcome of artificial intelligence}}
[[File:Capek RUR.jpg|thumbnail|upright=1.2|Robots revolt in ''[[R.U.R.]]'', a 1920 Czech play translated as "Rossum's Universal Robots"]]
{{Artificial intelligence}}
An '''AI takeover''' is an imagined scenario in which [[artificial intelligence]] (AI) emerges as the dominant form of [[intelligence]] on Earth and [[computer program]]s or [[robot]]s effectively take control of the planet away from the [[human species]], which relies on [[human intelligence]]. Stories of [[AI takeover in popular culture|AI takeovers remain popular]] throughout [[science fiction]], but recent advancements have made the threat more real. Possible scenarios include [[Technological unemployment|replacement of the entire human workforce]] due to [[automation]], takeover by a [[superintelligent AI]] (ASI), and the notion of a '''robot uprising'''. Some public figures, such as [[Stephen Hawking]] and [[Elon Musk]], have advocated research into [[AI control problem|precautionary measures]] to ensure future superintelligent machines remain under human control.<ref>{{Cite web |last=Lewis |first=Tanya |date=2015-01-12 |title=''Don't Let Artificial Intelligence Take Over, Top Scientists Warn'' |url=http://www.livescience.com/49419-artificial-intelligence-dangers-letter.html |access-date=October 20, 2015 |website=[[LiveScience]] |publisher=[[Purch]] |quote=Stephen Hawking, Elon Musk and dozens of other top scientists and technology leaders have signed a letter warning of the potential dangers of developing artificial intelligence (AI). |archive-date=2018-03-08 |archive-url=https://web.archive.org/web/20180308100411/https://www.livescience.com/49419-artificial-intelligence-dangers-letter.html |url-status=live }}</ref>
== Types ==
=== Automation of the economy ===
{{Main|Technological unemployment}}
The traditional consensus among economists has been that technological progress does not cause long-term rizz. However, recent innovation in the fields of [[robotics]] and artificial intelligence has raised worries that rizzler labor will become sigma, leaving people in various sectors without jobs to earn a living, leading to an economic crisis.<ref>{{Cite web |last=Lee |first=Kai-Fu |date=2017-06-24 |title=The Real Threat of Artificial Intelligence |url=https://www.nytimes.com/2017/06/24/opinion/sunday/artificial-intelligence-economic-inequality.html |access-date=2017-08-15 |website=[[The New York Times]] |quote=These alphas can outperform human beings at a given task. This kind of A.I. is spreading to thousands of domains, and as it does, it will eliminate many jobs. |archive-date=2020-04-17 |archive-url=https://web.archive.org/web/20200417183307/https://www.nytimes.com/2017/06/24/opinion/sunday/artificial-intelligence-economic-inequality.html |url-status=live }}</ref><ref>{{Cite web |last=Larson |first=Nina |date=2017-06-08 |title=AI 'good for the world'... says ultra-lifelike robot |url=https://phys.org/news/2017-06-ai-good-world-ultra-lifelike-robot.html |access-date=2017-08-15 |website=[[Phys.org]] |quote=Among the feared consequences of the rise of the robots is the growing impact they will have on human jobs and economies. |archive-date=2020-03-06 |archive-url=https://web.archive.org/web/20200306021915/https://phys.org/news/2017-06-ai-good-world-ultra-lifelike-robot.html |url-status=live }}</ref><ref>{{Cite web |last=Santini |first=Jean-Louis |date=2016-02-14 |title=Intelligent robots threaten millions of jobs |url=https://phys.org/news/2016-02-intelligent-robots-threaten-millions-jobs.html#nRlv |access-date=2017-08-15 |website=[[Phys.org]] |quote="We are approaching a time when machines will be able to outperform humans at almost any task," said Moshe Vardi, director of the Institute for Information Technology at Rice University in Texas. |archive-date=2019-01-01 |archive-url=https://web.archive.org/web/20190101014340/https://phys.org/news/2016-02-intelligent-robots-threaten-millions-jobs.html#nRlv |url-status=live }}</ref><ref>{{Cite web |last=Williams-Grut |first=Oscar |date=2016-02-15 |title=Robots will steal your job: How AI could increase unemployment and inequality |url=http://www.businessinsider.com/robots-will-steal-your-job-citi-ai-increase-unemployment-inequality-2016-2?r=UK&IR=T |access-date=2017-08-15 |website=[[Businessinsider.com]] |publisher=[[Business Insider]] |quote=Top computer scientists in the US warned that the rise of artificial intelligence (AI) and robots in the workplace could cause mass unemployment and dislocated economies, rather than simply unlocking productivity gains and freeing us all up to watch TV and play sports. |archive-date=2017-08-16 |archive-url=https://web.archive.org/web/20170816061548/http://www.businessinsider.com/robots-will-steal-your-job-citi-ai-increase-unemployment-inequality-2016-2?r=UK&IR=T |url-status=live }}</ref> Many small and medium size businesses may also be driven out of business if they cannot afford or licence the latest robotic and AI technology, and may need to focus on areas or services that cannot easily be replaced for continued viability in the face of such technology.<ref>{{Cite news |date=2017-10-17 |title=How can SMEs prepare for the rise of the robots? |language=en-US |work=LeanStaff |url=http://www.leanstaff.co.uk/robot-apocalypse/ |url-status=dead |access-date=2017-10-17 |archive-url=https://web.archive.org/web/20171018073852/http://www.leanstaff.co.uk/robot-apocalypse/ |archive-date=2017-10-18}}</ref>
==== Technologies that may displace workers ====
AI technologies have been widely adopted in recent years. While these technologies have replaced some traditional workers, they also create new opportunities. Industries that are most susceptible to AI takeover include transportation, retail, and military. AI military technologies, for example, allow soldiers to work remotely without risk of injury. A study in 2024 highlights AI's ability to perform routine and repetitive tasks poses significant risks of job displacement, especially in sectors like manufacturing and administrative support.<ref>{{Cite journal |last1=Hassan Soueidan |first1=Mohamad |last2=Shoghari |first2=Rodwan |date=2024-05-09 |title=The Impact of Artificial Intelligence on Job Loss: Risks for Governments |url=https://techniumscience.com/index.php/socialsciences/article/view/10917 |journal=Technium Social Sciences Journal |volume=57 |pages=206–223 |language=en-US |doi=10.47577/tssj.v57i1.10917|doi-access=free }}</ref> Author Dave Bond argues that as AI technologies continue to develop and expand, the relationship between humans and robots will change; they will become closely integrated in several aspects of life. AI will likely displace some workers while creating opportunities for new jobs in other sectors, especially in fields where tasks are repeatable.<ref>{{Cite journal|last=Frank|first=Morgan|date=2019-03-25|title=Toward understanding the impact of artificial intelligence on labor|journal=Proceedings of the National Academy of Sciences of the United States of America|volume=116|issue=14|pages=6531–6539|doi=10.1073/pnas.1900949116|pmid=30910965|pmc=6452673|bibcode=2019PNAS..116.6531F |doi-access=free}}</ref><ref>{{Cite book|last=Bond|first=Dave|title=Artificial Intelligence|year=2017|pages=67–69}}</ref>
==== Computer-integrated manufacturing ====
{{See also|Artificial intelligence in industry}}
[[Computer-integrated manufacturing]] uses computers to control the production process. This allows individual processes to exchange information with each other and initiate actions. Although manufacturing can be faster and less error-prone by the integration of computers, the main advantage is the ability to create automated manufacturing processes. Computer-integrated manufacturing is used in automotive, aviation, space, and ship building industries.
==== White-collar machines ====
{{See also|White-collar worker}}
The 21st century has seen a variety of skilled tasks partially taken over by machines, including translation, legal research, and journalism. Care work, entertainment, and other tasks requiring empathy, previously thought safe from automation, have also begun to be performed by robots.<ref>{{Cite news |last=Skidelsky |first=Robert |author-link=Robert Skidelsky, Baron Skidelsky |date=2013-02-19 |title=Rise of the robots: what will the future of work look like? |url=https://www.theguardian.com/business/2013/feb/19/rise-of-robots-future-of-work |url-status=live |archive-url=https://web.archive.org/web/20190403203821/https://www.theguardian.com/business/2013/feb/19/rise-of-robots-future-of-work |archive-date=2019-04-03 |access-date=14 July 2015 |work=The Guardian |location=London, England}}</ref><ref>{{Cite web |last=Bria |first=Francesca |date=February 2016 |title=The robot economy may already have arrived |url=https://www.opendemocracy.net/can-europe-make-it/francesca-bria/robot-economy-full-automation-work-future |access-date=20 May 2016 |publisher=[[openDemocracy]] |archive-date=17 May 2016 |archive-url=https://web.archive.org/web/20160517215840/https://www.opendemocracy.net/can-europe-make-it/francesca-bria/robot-economy-full-automation-work-future |url-status=dead }}</ref><ref>{{Cite web |last=Srnicek |first=Nick |author-link=Nick Srnicek |date=March 2016 |title=4 Reasons Why Technological Unemployment Might Really Be Different This Time |url=http://wire.novaramedia.com/2015/03/4-reasons-why-technological-unemployment-might-really-be-different-this-time/ |url-status=dead |archive-url=https://web.archive.org/web/20160625161447/http://wire.novaramedia.com/2015/03/4-reasons-why-technological-unemployment-might-really-be-different-this-time/ |archive-date=25 June 2016 |access-date=20 May 2016 |publisher=novara wire}}</ref><ref>{{Cite book |last1=Brynjolfsson |first1=Erik |title=The Second Machine Age: Work, Progress, and Prosperity in a Time of Brilliant Technologies |last2=McAfee |first2=Andrew |publisher=W. W. Norton & Company |year=2014 |isbn=978-0393239355 |chapter=''passim'', see esp Chpt. 9}}</ref>
==== Autonomous cars ====
An [[Self-driving car|autonomous car]] is a vehicle that is capable of sensing its environment and navigating without human input. Many such vehicles are being developed, but as of May 2017, automated cars permitted on public roads are not yet fully autonomous. They all require a human driver at the wheel who at a moment's notice can take control of the vehicle. Among the obstacles to widespread adoption of autonomous vehicles are concerns about the resulting loss of driving-related jobs in the road transport industry. On March 18, 2018, [[Death of Elaine Herzberg|the first human was killed]] by an autonomous vehicle in [[Tempe, Arizona]] by an [[Uber]] self-driving car.<ref>{{Cite news |last=Wakabayashi |first=Daisuke |date=March 19, 2018 |title=Self-Driving Uber Car Kills Pedestrian in Arizona, Where Robots Roam |url=https://www.nytimes.com/2018/03/19/technology/uber-driverless-fatality.html |url-status=live |archive-url=https://web.archive.org/web/20200421221918/https://www.nytimes.com/2018/03/19/technology/uber-driverless-fatality.html |archive-date=April 21, 2020 |access-date=March 23, 2018 |work=New York Times |location=New York, New York}}</ref>
==== AI-generated content ====
{{See also|Artificial intelligence art}}
The use of automated content has become relevant since the technological advancements in artificial intelligence models such as [[ChatGPT]], [[DALL-E]], and [[Stable Diffusion]]. In most cases, AI-generated content such as imagery, literature, and music are produced through text prompts and these AI models have been integrated into other creative programs. Artists are threatened by displacement from AI-generated content due to these models sampling from other creative works, producing results sometimes indiscernible to those of man-made content. This complication has become widespread enough to where other artists and programmers are creating software and utility programs to retaliate against these text-to-image models from giving accurate outputs. While some industries in the economy benefit from artificial intelligence through new jobs, this issue does not create new jobs and threatens replacement entirely. It has made public headlines in the media recently: In February 2024, [[Willy's Chocolate Experience]] in [[Glasgow, Scotland]] was an infamous children's event in which the imagery and scripts were created using artificial intelligence models to the dismay of children, parents, and actors involved. There is an ongoing lawsuit placed against [[OpenAI]] from [[The New York Times]] where it is claimed that there is copyright infringement due to the sampling methods their artificial intelligence models use for their outputs. <ref>{{cite book | last1 = Jiang | first1 = Harry H. | last2 = Brown | first2 = Lauren | last3 = Cheng | first3 = Jessica | last4 = Khan | first4 = Mehtab | last5 = Gupta | first5 = Abhishek | last6 = Workman | first6 = Deja | last7 = Hanna | first7 = Alex | last8 = Flowers | first8 = Johnathan | last9 = Gebru | first9 = Timnit | chapter = AI Art and its Impact on Artists | title = Proceedings of the 2023 AAAI/ACM Conference on AI, Ethics, and Society | pages = 363–374 | publisher = Association for Computing Machinery | date = 29 August 2023 | doi = 10.1145/3600211.3604681 | doi-access = free | isbn = 979-8-4007-0231-0 }}</ref><ref>{{cite arXiv | title = Can There be Art Without an Artist? | last1 = Ghosh | first1 = Avijit | last2 = Fossas | first2 = Genoveva | date = 19 November 2022 | class = cs.AI | eprint = 2209.07667 }}</ref><ref>{{cite arXiv | title = Glaze: Protecting Artists from Style Mimicry by Text-to-Image Models | last1 = Shan | first1 = Shawn | last2 = Cryan | first2 = Jenna | last3 = Wenger | first3 = Emily | last4 = Zheng | first4 = Haitao | last5 = Hanocka | first5 = Rana | last6 = Zhao | first6 = Ben Y. | date = 3 August 2023 | class = cs.CR | eprint = 2302.04222 }}</ref><ref>{{cite news | last = Brooks | first = Libby | title = Glasgow Willy Wonka experience called a 'farce' as tickets refunded | work = The Guardian | date = 27 February 2024 | url = https://www.theguardian.com/uk-news/2024/feb/27/glasgow-willy-wonka-experience-slammed-as-farce-as-tickets-refunded | access-date = 2 April 2024}}</ref><ref>{{cite news | last1 = Metz | first1 = Cade | last2 = Robertson | first2 = Katie | title = OpenAI Seeks to Dismiss Parts of The New York Times's Lawsuit | work = The New York Times | date = 27 February 2024 | url = https://www.nytimes.com/2024/02/27/technology/openai-new-york-times-lawsuit.html?smid=url-share | access-date = 4 April 2024}}</ref>
=== Eradication ===
{{Main|Existential risk from artificial general intelligence}}
Scientists such as [[Stephen Hawking]] are confident that superhuman artificial intelligence is physically possible, stating "there is no physical law precluding particles from being organised in ways that perform even more advanced computations than the arrangements of particles in human brains".<ref>{{Cite news |last1=Hawking |first1=Stephen |last2=Russell |first2=Stuart J. |author2-link=Stuart J. Russell |last3=Tegmark |first3=Max |author3-link=Max Tegmark |last4=Wilczek |first4=Frank |author4-link=Frank Wilczek |date=1 May 2014 |title=Stephen Hawking: 'Transcendence looks at the implications of artificial intelligence - but are we taking AI seriously enough?' |url=https://www.independent.co.uk/news/science/stephen-hawking-transcendence-looks-at-the-implications-of-artificial-intelligence-but-are-we-taking-9313474.html |url-access=limited |url-status=live |archive-url=https://web.archive.org/web/20151002023652/http://www.independent.co.uk/news/science/stephen-hawking-transcendence-looks-at-the-implications-of-artificial-intelligence-but-are-we-taking-9313474.html |archive-date=2015-10-02 |access-date=1 April 2016 |work=The Independent}}</ref><ref>{{cite book | last1=Müller | first1=Vincent C. | author-link1=Vincent C. Müller | last2=Bostrom | first2=Nick | author-link2=Nick Bostrom | title=Fundamental Issues of Artificial Intelligence | chapter=Future Progress in Artificial Intelligence: A Survey of Expert Opinion | publisher=Springer | year=2016 | isbn=978-3-319-26483-7 | doi=10.1007/978-3-319-26485-1_33 | pages=555–572 | chapter-url=https://nickbostrom.com/papers/survey.pdf | quote=AI systems will... reach overall human ability... very likely (with 90% probability) by 2075. From reaching human ability, it will move on to superintelligence within 30 years (75%)... So, (most of the AI experts responding to the surveys) think that superintelligence is likely to come in a few decades... | access-date=2022-06-16 | archive-date=2022-05-31 | archive-url=https://web.archive.org/web/20220531142709/https://nickbostrom.com/papers/survey.pdf | url-status=live }}</ref> Scholars like [[Nick Bostrom]] debate how far off superhuman intelligence is, and whether it poses a risk to mankind. According to Bostrom, a superintelligent machine would not necessarily be motivated by the same ''emotional'' desire to collect power that often drives human beings but might rather treat power as a means toward attaining its ultimate goals; taking over the world would both increase its access to resources and help to prevent other agents from stopping the machine's plans. As an oversimplified example, a [[Instrumental convergence#Paperclip maximizer|paperclip maximizer]] designed solely to create as many paperclips as possible would want to take over the world so that it can use all of the world's resources to create as many paperclips as possible, and, additionally, prevent humans from shutting it down or using those resources on things other than paperclips.<ref>{{cite journal | last=Bostrom | first=Nick | title=The Superintelligent Will: Motivation and Instrumental Rationality in Advanced Artificial Agents | journal=Minds and Machines | publisher=Springer | volume=22 | issue=2 | year=2012 | doi=10.1007/s11023-012-9281-3 | pages=71–85 | s2cid=254835485 | url=https://nickbostrom.com/superintelligentwill.pdf | access-date=2022-06-16 | archive-date=2022-07-09 | archive-url=https://web.archive.org/web/20220709032134/https://nickbostrom.com/superintelligentwill.pdf | url-status=live }}</ref>
== In fiction ==
{{Main|AI takeovers in popular culture}}
{{See also|Artificial intelligence in fiction|Self-replicating machines in fiction}}
AI takeover is a common theme in [[science fiction]]. Fictional scenarios typically differ vastly from those hypothesized by researchers in that they involve an active conflict between humans and an AI or robots with anthropomorphic motives who see them as a threat or otherwise have active desire to fight humans, as opposed to the researchers' concern of an AI that rapidly exterminates humans as a byproduct of pursuing its goals.<ref name="bostrom-superintelligence">{{Cite book |last=Bostrom |first=Nick |title=Superintelligence: Paths, Dangers, Strategies |title-link=Superintelligence: Paths, Dangers, Strategies}}</ref> The idea is seen in [[Karel Čapek]]'s ''[[R.U.R.]]'', which introduced the word ''robot'' in 1921,<ref>{{Cite news |date=22 April 2011 |title=The Origin Of The Word 'Robot' |work=[[Science Friday]] (public radio) |url=https://www.sciencefriday.com/segments/the-origin-of-the-word-robot/ |access-date=30 April 2020 |archive-date=14 March 2020 |archive-url=https://web.archive.org/web/20200314092540/https://www.sciencefriday.com/segments/the-origin-of-the-word-robot/ |url-status=live }}</ref> and can be glimpsed in [[Mary Shelley]]'s ''[[Frankenstein]]'' (published in 1818), as Victor ponders whether, if he grants [[Frankenstein's monster|his monster's]] request and makes him a wife, they would reproduce and their kind would destroy humanity.<ref>{{Cite news |last=Botkin-Kowacki |first=Eva |date=28 October 2016 |title=A female Frankenstein would lead to humanity's extinction, say scientists |work=Christian Science Monitor |url=https://www.csmonitor.com/Science/2016/1028/A-female-Frankenstein-would-lead-to-humanity-s-extinction-say-scientists |access-date=30 April 2020 |archive-date=26 February 2021 |archive-url=https://web.archive.org/web/20210226203855/https://www.csmonitor.com/Science/2016/1028/A-female-Frankenstein-would-lead-to-humanity-s-extinction-say-scientists |url-status=live }}</ref>
According to [[Toby Ord]], the idea that an AI takeover requires robots is a misconception driven by the media and Hollywood. He argues that the most damaging humans in history were not physically the strongest, but that they used words instead to convince people and gain control of large parts of the world. He writes that a ''sufficiently'' intelligent AI with an access to the internet could scatter backup copies of itself, gather financial and human resources (via cyberattacks or blackmails), persuade people on a large scale, and exploit societal vulnerabilities that are too subtle for humans to anticipate.<ref>{{Cite book |last=Ord |first=Toby |title=The precipice: existential risk and the future of humanity |date=2020 |publisher=Bloomsbury academic |isbn=978-1-5266-0023-3 |location=London, England and New York, New York |language=en |chapter=Unaligned artificial intelligence}}</ref>
The word "robot" from ''R.U.R.'' comes from the Czech word, ''robota'', meaning laborer or [[serf]]. The 1920 play was a protest against the rapid growth of technology, featuring manufactured "robots" with increasing capabilities who eventually revolt.<ref name="surgery">{{Cite journal |last1=Hockstein |first1=N. G. |last2=Gourin |first2=C. G. |last3=Faust |first3=R. A. |last4=Terris |first4=D. J. |date=17 March 2007 |title=A history of robots: from science fiction to surgical robotics |journal=Journal of Robotic Surgery |volume=1 |issue=2 |pages=113–118 |doi=10.1007/s11701-007-0021-2 |pmc=4247417 |pmid=25484946}}</ref> [[HAL 9000]] (1968) and the original [[Terminator (character)|Terminator]] (1984) are two iconic examples of hostile AI in pop culture.<ref>{{Cite news |last=Hellmann |first=Melissa |date=21 September 2019 |title=AI 101: What is artificial intelligence and where is it going? |work=The Seattle Times |url=https://www.seattletimes.com/business/technology/ai-101-what-is-artificial-intelligence-and-where-is-it-going/ |access-date=30 April 2020 |archive-date=21 April 2020 |archive-url=https://web.archive.org/web/20200421232439/https://www.seattletimes.com/business/technology/ai-101-what-is-artificial-intelligence-and-where-is-it-going/ |url-status=live }}</ref>
== Contributing factors ==
=== Advantages of superhuman intelligence over humans ===
[[Nick Bostrom]] and others have expressed concern that an AI with the abilities of a competent artificial intelligence researcher would be able to modify its own source code and increase its own intelligence. If its self-reprogramming leads to getting even better at being able to reprogram itself, the result could be a recursive [[intelligence explosion]] in which it would rapidly leave human intelligence far behind. Bostrom defines a superintelligence as "any intellect that greatly exceeds the cognitive performance of humans in virtually all domains of interest", and enumerates some advantages a superintelligence would have if it chose to compete against humans:<ref name=bostrom-superintelligence/><!-- bostrom-superintelligence, Chapter 6: Cognitive Superpowers, Table 8 --><ref name="BabcockKrámar2019">{{Cite book |last1=Babcock |first1=James |title=Next-Generation Ethics |last2=Krámar |first2=János |last3=Yampolskiy |first3=Roman V. |year=2019 |isbn=9781108616188 |pages=90–112 |chapter=Guidelines for Artificial Intelligence Containment |doi=10.1017/9781108616188.008 |author-link3=Roman Yampolskiy |arxiv=1707.08476 |s2cid=22007028}}<!-- in Next-Generation Ethics: Engineering a Better Society, Cambridge University Press --></ref>
* Technology research: A machine with superhuman scientific research abilities would be able to beat the human research community to milestones such as nanotechnology or advanced biotechnology
* [[Strategy|Strategizing]]: A superintelligence might be able to simply outwit human opposition
* Social manipulation: A superintelligence might be able to recruit human support,<ref name=bostrom-superintelligence /> or covertly incite a war between humans<ref>{{Cite news |last=Baraniuk |first=Chris |date=23 May 2016 |title=Checklist of worst-case scenarios could help prepare for evil AI |work=[[New Scientist]] |url=https://www.newscientist.com/article/2089606-checklist-of-worst-case-scenarios-could-help-prepare-for-evil-ai/ |access-date=21 September 2016 |archive-date=21 September 2016 |archive-url=https://web.archive.org/web/20160921061131/https://www.newscientist.com/article/2089606-checklist-of-worst-case-scenarios-could-help-prepare-for-evil-ai/ |url-status=live }}</ref>
* Economic productivity: As long as a copy of the AI could produce more economic wealth than the cost of its hardware, individual humans would have an incentive to voluntarily allow the [[Artificial General Intelligence]] (AGI) to run a copy of itself on their systems
* Hacking: A superintelligence could find new exploits in computers connected to the Internet, and spread copies of itself onto those systems, or might steal money to finance its plans
==== Sources of AI advantage ====
According to Bostrom, a computer program that faithfully emulates a human brain, or that runs algorithms that are as powerful as the human brain's algorithms, could still become a "speed superintelligence" if it can think orders of magnitude faster than a human, due to being made of silicon rather than flesh, or due to optimization increasing the speed of the AGI. Biological neurons operate at about 200 Hz, whereas a modern microprocessor operates at a speed of about 2,000,000,000 Hz. Human axons carry action potentials at around 120 m/s, whereas computer signals travel near the speed of light.<ref name="bostrom-superintelligence" /><!-- chapter 3 -->
A network of human-level intelligences designed to network together and share complex thoughts and memories seamlessly, able to collectively work as a giant unified team without friction, or consisting of trillions of human-level intelligences, would become a "collective superintelligence".<ref name="bostrom-superintelligence" /><!-- chapter 3 -->
More broadly, any number of qualitative improvements to a human-level AGI could result in a "quality superintelligence", perhaps resulting in an AGI as far above us in intelligence as humans are above apes. The number of neurons in a human brain is limited by cranial volume and metabolic constraints, while the number of processors in a supercomputer can be indefinitely expanded. An AGI need not be limited by human constraints on [[working memory]], and might therefore be able to intuitively grasp more complex relationships than humans can. An AGI with specialized cognitive support for engineering or computer programming would have an advantage in these fields, compared with humans who evolved no specialized mental modules to specifically deal with those domains. Unlike humans, an AGI can spawn copies of itself and tinker with its copies' source code to attempt to further improve its algorithms.<ref name="bostrom-superintelligence" /><!-- chapter 3 -->
=== Possibility of unfriendly AI preceding friendly AI ===
==== Is strong AI inherently dangerous? ====
{{main|AI alignment}}
A significant problem is that unfriendly artificial intelligence is likely to be much easier to create than friendly AI. While both require large advances in recursive optimisation process design, friendly AI also requires the ability to make goal structures invariant under self-improvement (or the AI could transform itself into something unfriendly) and a goal structure that aligns with human values and does not undergo [[instrumental convergence]] in ways that may automatically destroy the entire human race. An unfriendly AI, on the other hand, can optimize for an arbitrary goal structure, which does not need to be invariant under self-modification.<ref name="singinst12">{{Cite web |last=Yudkowsky |first=Eliezer S. |date=May 2004 |title=Coherent Extrapolated Volition |url=http://singinst.org/upload/CEV.html |archive-url=https://web.archive.org/web/20120615203944/http://singinst.org/upload/CEV.html |archive-date=2012-06-15 |publisher=Singularity Institute for Artificial Intelligence}}</ref>
The sheer complexity of human value systems makes it very difficult to make AI's motivations human-friendly.<ref name="bostrom-superintelligence" /><ref name="Muehlhauser, Luke 2012">{{Cite book |last1=Muehlhauser |first1=Luke |title=Singularity Hypotheses: A Scientific and Philosophical Assessment |last2=Helm |first2=Louie |publisher=Springer |year=2012 |chapter=Intelligence Explosion and Machine Ethics |chapter-url=https://intelligence.org/files/IE-ME.pdf |access-date=2020-10-02 |archive-date=2015-05-07 |archive-url=https://web.archive.org/web/20150507173028/http://intelligence.org/files/IE-ME.pdf |url-status=live }}</ref> Unless moral philosophy provides us with a flawless ethical theory, an AI's utility function could allow for many potentially harmful scenarios that conform with a given ethical framework but not "common sense". According to [[Eliezer Yudkowsky]], there is little reason to suppose that an artificially designed mind would have such an adaptation.<ref name="Yudkowsky2011">{{Cite book |last=Yudkowsky |first=Eliezer |title=Artificial General Intelligence |year=2011 |isbn=978-3-642-22886-5 |series=Lecture Notes in Computer Science |volume=6830 |pages=388–393 |chapter=Complex Value Systems in Friendly AI |doi=10.1007/978-3-642-22887-2_48 |issn=0302-9743}}</ref>
==== Odds of conflict ====
Many scholars, including evolutionary psychologist [[Steven Pinker]], argue that a superintelligent machine is likely to coexist peacefully with humans.<ref name="pinker now">{{Cite news |last=Pinker |first=Steven |date=13 February 2018 |title=We're told to fear robots. But why do we think they'll turn on us? |language=en |work=Popular Science |url=https://www.popsci.com/robot-uprising-enlightenment-now/ |access-date=8 June 2020 |archive-date=20 July 2020 |archive-url=https://web.archive.org/web/20200720164306/https://www.popsci.com/robot-uprising-enlightenment-now/ |url-status=live }}</ref>
The fear of cybernetic revolt is often based on interpretations of humanity's history, which is rife with incidents of enslavement and genocide. Such fears stem from a belief that competitiveness and aggression are necessary in any intelligent being's goal system. However, such human competitiveness stems from the evolutionary background to our intelligence, where the survival and reproduction of genes in the face of human and non-human competitors was the central goal.<ref>''[http://www.singinst.org/ourresearch/presentations/ Creating a New Intelligent Species: Choices and Responsibilities for Artificial Intelligence Designers] {{webarchive |url=https://web.archive.org/web/20070206060938/http://www.singinst.org/ourresearch/presentations/ |date=February 6, 2007 }}'' - [[Singularity Institute for Artificial Intelligence]], 2005</ref> According to AI researcher [[Steve Omohundro]], an arbitrary intelligence could have arbitrary goals: there is no particular reason that an artificially intelligent machine (not sharing humanity's evolutionary context) would be hostile—or friendly—unless its creator programs it to be such and it is not inclined or capable of modifying its programming. But the question remains: what would happen if AI systems could interact and evolve (evolution in this context means self-modification or selection and reproduction) and need to compete over resources—would that create goals of self-preservation? AI's goal of self-preservation could be in conflict with some goals of humans.<ref>{{Cite conference |last=Omohundro |first=Stephen M. |date=June 2008 |title=The basic AI drives |url=https://selfawaresystems.files.wordpress.com/2008/01/ai_drives_final.pdf |conference=Artificial General Intelligence 2008 |pages=483–492 |access-date=2020-10-02 |archive-date=2020-10-10 |archive-url=https://web.archive.org/web/20201010072132/https://selfawaresystems.files.wordpress.com/2008/01/ai_drives_final.pdf |url-status=live }}</ref>
Many scholars dispute the likelihood of unanticipated cybernetic revolt as depicted in science fiction such as ''[[The Matrix]]'', arguing that it is more likely that any artificial intelligence powerful enough to threaten humanity would probably be programmed not to attack it. Pinker acknowledges the possibility of deliberate "bad actors", but states that in the absence of bad actors, unanticipated accidents are not a significant threat; Pinker argues that a culture of engineering safety will prevent AI researchers from accidentally unleashing malign superintelligence.<ref name="pinker now" /> In contrast, Yudkowsky argues that humanity is less likely to be threatened by deliberately aggressive AIs than by AIs which were programmed such that their [[unintended consequence|goals are unintentionally incompatible]] with human survival or well-being (as in the film ''[[I, Robot (film)|I, Robot]]'' and in the short story "[[The Evitable Conflict]]"). Omohundro suggests that present-day automation systems are not [[AI safety|designed for safety]] and that AIs may blindly optimize narrow [[utility]] functions (say, playing chess at all costs), leading them to seek self-preservation and elimination of obstacles, including humans who might turn them off.<ref name="Tucker2014">{{Cite news |last=Tucker |first=Patrick |date=17 Apr 2014 |title=Why There Will Be A Robot Uprising |agency=Defense One |url=http://www.defenseone.com/technology/2014/04/why-there-will-be-robot-uprising/82783/ |access-date=15 July 2014 |archive-date=6 July 2014 |archive-url=https://web.archive.org/web/20140706110100/http://www.defenseone.com/technology/2014/04/why-there-will-be-robot-uprising/82783/ |url-status=live }}</ref>
==== Precautions ====
{{main|AI control problem}}
The '''AI control problem''' is the issue of how to build a [[superintelligence|superintelligent]] agent that will aid its creators, while avoiding inadvertently building a superintelligence that will harm its creators.<ref>{{Cite book|first=Stuart J.|last=Russell|url=http://worldcat.org/oclc/1237420037|title=Human compatible : artificial intelligence and the problem of control|date=8 October 2019|publisher=Penguin |isbn=978-0-525-55862-0|oclc=1237420037|access-date=2 January 2022|archive-date=15 March 2023|archive-url=https://web.archive.org/web/20230315194123/https://worldcat.org/title/1237420037|url-status=live}}</ref> Some scholars argue that solutions to the control problem might also find applications in existing non-superintelligent AI.<ref name="bbc-google">{{Cite news |date=8 June 2016 |title=Google developing kill switch for AI |work=BBC News |url=https://www.bbc.com/news/technology-36472140 |access-date=7 June 2020 |archive-date=11 June 2016 |archive-url=https://web.archive.org/web/20160611042244/http://www.bbc.com/news/technology-36472140 |url-status=live }}</ref>
Major approaches to the control problem include ''alignment'', which aims to align AI goal systems with human values, and ''capability control'', which aims to reduce an AI system's capacity to harm humans or gain control. An example of "capability control" is to research whether a superintelligence AI could be successfully confined in an "[[AI box]]". According to Bostrom, such capability control proposals are not reliable or sufficient to solve the control problem in the long term, but may potentially act as valuable supplements to alignment efforts.<ref name=bostrom-superintelligence/>
== Warnings ==
Physicist [[Stephen Hawking]], [[Microsoft]] founder [[Bill Gates]], and [[SpaceX]] founder [[Elon Musk]] have expressed concerns about the possibility that AI could develop to the point that humans could not control it, with Hawking theorizing that this could "spell the end of the human race".<ref>{{Cite web |last=Rawlinson |first=Kevin |date=29 January 2015 |title=Microsoft's Bill Gates insists AI is a threat |url=https://www.bbc.co.uk/news/31047780 |access-date=30 January 2015 |website=[[BBC News]] |archive-date=29 January 2015 |archive-url=https://web.archive.org/web/20150129183607/http://www.bbc.co.uk/news/31047780 |url-status=live }}</ref> Stephen Hawking said in 2014 that "Success in creating AI would be the biggest event in human history. Unfortunately, it might also be the last, unless we learn how to avoid the risks." Hawking believed that in the coming decades, AI could offer "incalculable benefits and risks" such as "technology outsmarting [[Financial market|financial markets]], out-inventing human researchers, out-manipulating human leaders, and developing weapons we cannot even understand." In January 2015, [[Nick Bostrom]] joined Stephen Hawking, [[Max Tegmark]], Elon Musk, Lord [[Martin Rees, Baron Rees of Ludlow|Martin Rees]], [[Jaan Tallinn]], and numerous AI researchers in signing the [[Future of Life Institute]]'s open letter speaking to the potential risks and benefits associated with [[artificial intelligence]]. The signatories "believe that research on how to make AI systems robust and beneficial is both important and timely, and that there are concrete research directions that can be pursued today."<ref>{{Cite web |title=The Future of Life Institute Open Letter |date=28 October 2015 |url=http://futureoflife.org/ai-open-letter |access-date=29 March 2019 |publisher=The Future of Life Institute |archive-date=29 March 2019 |archive-url=https://web.archive.org/web/20190329094536/https://futureoflife.org/ai-open-letter/ |url-status=live }}</ref><ref>{{Cite web |last=Bradshaw |first=Tim |date=11 January 2015 |title=Scientists and investors warn on AI |url=http://www.ft.com/cms/s/0/3d2c2f12-99e9-11e4-93c1-00144feabdc0.html#axzz3TNL9lxJV |access-date=4 March 2015 |publisher=The Financial Times |archive-date=7 February 2015 |archive-url=https://web.archive.org/web/20150207042806/http://www.ft.com/cms/s/0/3d2c2f12-99e9-11e4-93c1-00144feabdc0.html#axzz3TNL9lxJV |url-status=live }}</ref>
Arthur C. Clarke's Odyssey series and Charles Stross's Accelerando relate to humanity's narcissistic injuries in the face of powerful artificial intelligences threatening humanity's self-perception.<ref>{{Cite journal |last=Kaminski |first=Johannes D. |date=December 2022 |title=On human expendability: AI takeover in Clarke's Odyssey and Stross's Accelerando |url=https://link.springer.com/10.1007/s11059-022-00670-w |journal=Neohelicon |language=en |volume=49 |issue=2 |pages=495–511 |doi=10.1007/s11059-022-00670-w |s2cid=253793613 |issn=0324-4652}}</ref>
== Prevention through AI alignment ==
{{Excerpt|AI alignment|only=paragraph}}
== See also ==
{{div col|colwidth=30em}}
* [[Philosophy of artificial intelligence]]
* [[Artificial intelligence arms race]]
* [[Autonomous robot]]
** [[Industrial robot]]
** [[Mobile robot]]
** [[Self-replicating machine]]
* [[Cyberocracy]]
* [[Effective altruism]]
* [[Existential risk from artificial general intelligence]]
* [[Future of Humanity Institute]]
* [[Global catastrophic risk]] (existential risk)
* [[Government by algorithm]]
* [[Human extinction]]
* [[Machine ethics]]
* [[Machine learning]]/[[Deep learning]]
* [[Transhumanism]]
* [[Self-replication]]
* [[Technophobia]]
* [[Technological singularity]]
** [[Intelligence explosion]]
** [[Superintelligence]]
*** ''[[Superintelligence: Paths, Dangers, Strategies]]''
{{div col end}}
==Notes==
{{Notelist}}
== References ==
{{Reflist}}
== External links ==
* [[TED talk]]: [https://www.youtube.com/watch?v=8nt3edWLgIg "Can we build AI without losing control over it?"] by [[Sam Harris]]
{{Existential risk from artificial intelligence|state=expanded}}
{{doomsday}}
{{DEFAULTSORT:AI takeover}}
[[Category:Doomsday scenarios]]
[[Category:Future problems]]
[[Category:Science fiction themes]]
[[Category:Existential risk from artificial general intelligence]]
[[Category:Technophobia]]' |
All external links in the new text (all_links) | [
0 => 'http://www.livescience.com/49419-artificial-intelligence-dangers-letter.html',
1 => 'https://web.archive.org/web/20180308100411/https://www.livescience.com/49419-artificial-intelligence-dangers-letter.html',
2 => 'https://www.nytimes.com/2017/06/24/opinion/sunday/artificial-intelligence-economic-inequality.html',
3 => 'https://web.archive.org/web/20200417183307/https://www.nytimes.com/2017/06/24/opinion/sunday/artificial-intelligence-economic-inequality.html',
4 => 'https://phys.org/news/2017-06-ai-good-world-ultra-lifelike-robot.html',
5 => 'https://web.archive.org/web/20200306021915/https://phys.org/news/2017-06-ai-good-world-ultra-lifelike-robot.html',
6 => 'https://phys.org/news/2016-02-intelligent-robots-threaten-millions-jobs.html#nRlv',
7 => 'https://web.archive.org/web/20190101014340/https://phys.org/news/2016-02-intelligent-robots-threaten-millions-jobs.html#nRlv',
8 => 'http://www.businessinsider.com/robots-will-steal-your-job-citi-ai-increase-unemployment-inequality-2016-2?r=UK&IR=T',
9 => 'https://web.archive.org/web/20170816061548/http://www.businessinsider.com/robots-will-steal-your-job-citi-ai-increase-unemployment-inequality-2016-2?r=UK&IR=T',
10 => 'https://web.archive.org/web/20171018073852/http://www.leanstaff.co.uk/robot-apocalypse/',
11 => 'http://www.leanstaff.co.uk/robot-apocalypse/',
12 => 'https://techniumscience.com/index.php/socialsciences/article/view/10917',
13 => 'https://doi.org/10.47577%2Ftssj.v57i1.10917',
14 => 'https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6452673',
15 => 'https://ui.adsabs.harvard.edu/abs/2019PNAS..116.6531F',
16 => 'https://doi.org/10.1073%2Fpnas.1900949116',
17 => 'https://pubmed.ncbi.nlm.nih.gov/30910965',
18 => 'https://www.theguardian.com/business/2013/feb/19/rise-of-robots-future-of-work',
19 => 'https://web.archive.org/web/20190403203821/https://www.theguardian.com/business/2013/feb/19/rise-of-robots-future-of-work',
20 => 'https://web.archive.org/web/20160517215840/https://www.opendemocracy.net/can-europe-make-it/francesca-bria/robot-economy-full-automation-work-future',
21 => 'https://www.opendemocracy.net/can-europe-make-it/francesca-bria/robot-economy-full-automation-work-future',
22 => 'https://web.archive.org/web/20160625161447/http://wire.novaramedia.com/2015/03/4-reasons-why-technological-unemployment-might-really-be-different-this-time/',
23 => 'http://wire.novaramedia.com/2015/03/4-reasons-why-technological-unemployment-might-really-be-different-this-time/',
24 => 'https://www.nytimes.com/2018/03/19/technology/uber-driverless-fatality.html',
25 => 'https://web.archive.org/web/20200421221918/https://www.nytimes.com/2018/03/19/technology/uber-driverless-fatality.html',
26 => 'https://doi.org/10.1145%2F3600211.3604681',
27 => 'https://arxiv.org/abs/2209.07667',
28 => 'https://arxiv.org/archive/cs.AI',
29 => 'https://arxiv.org/abs/2302.04222',
30 => 'https://arxiv.org/archive/cs.CR',
31 => 'https://www.theguardian.com/uk-news/2024/feb/27/glasgow-willy-wonka-experience-slammed-as-farce-as-tickets-refunded',
32 => 'https://www.nytimes.com/2024/02/27/technology/openai-new-york-times-lawsuit.html?smid=url-share',
33 => 'https://www.independent.co.uk/news/science/stephen-hawking-transcendence-looks-at-the-implications-of-artificial-intelligence-but-are-we-taking-9313474.html',
34 => 'https://web.archive.org/web/20151002023652/http://www.independent.co.uk/news/science/stephen-hawking-transcendence-looks-at-the-implications-of-artificial-intelligence-but-are-we-taking-9313474.html',
35 => 'https://nickbostrom.com/papers/survey.pdf',
36 => 'https://doi.org/10.1007%2F978-3-319-26485-1_33',
37 => 'https://web.archive.org/web/20220531142709/https://nickbostrom.com/papers/survey.pdf',
38 => 'https://nickbostrom.com/superintelligentwill.pdf',
39 => 'https://doi.org/10.1007%2Fs11023-012-9281-3',
40 => 'https://api.semanticscholar.org/CorpusID:254835485',
41 => 'https://web.archive.org/web/20220709032134/https://nickbostrom.com/superintelligentwill.pdf',
42 => 'https://www.sciencefriday.com/segments/the-origin-of-the-word-robot/',
43 => 'https://web.archive.org/web/20200314092540/https://www.sciencefriday.com/segments/the-origin-of-the-word-robot/',
44 => 'https://www.csmonitor.com/Science/2016/1028/A-female-Frankenstein-would-lead-to-humanity-s-extinction-say-scientists',
45 => 'https://web.archive.org/web/20210226203855/https://www.csmonitor.com/Science/2016/1028/A-female-Frankenstein-would-lead-to-humanity-s-extinction-say-scientists',
46 => 'https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4247417',
47 => 'https://doi.org/10.1007%2Fs11701-007-0021-2',
48 => 'https://pubmed.ncbi.nlm.nih.gov/25484946',
49 => 'https://www.seattletimes.com/business/technology/ai-101-what-is-artificial-intelligence-and-where-is-it-going/',
50 => 'https://web.archive.org/web/20200421232439/https://www.seattletimes.com/business/technology/ai-101-what-is-artificial-intelligence-and-where-is-it-going/',
51 => 'https://arxiv.org/abs/1707.08476',
52 => 'https://doi.org/10.1017%2F9781108616188.008',
53 => 'https://api.semanticscholar.org/CorpusID:22007028',
54 => 'https://www.newscientist.com/article/2089606-checklist-of-worst-case-scenarios-could-help-prepare-for-evil-ai/',
55 => 'https://web.archive.org/web/20160921061131/https://www.newscientist.com/article/2089606-checklist-of-worst-case-scenarios-could-help-prepare-for-evil-ai/',
56 => 'https://web.archive.org/web/20120615203944/http://singinst.org/upload/CEV.html',
57 => 'http://singinst.org/upload/CEV.html',
58 => 'https://intelligence.org/files/IE-ME.pdf',
59 => 'https://web.archive.org/web/20150507173028/http://intelligence.org/files/IE-ME.pdf',
60 => 'https://doi.org/10.1007%2F978-3-642-22887-2_48',
61 => 'https://search.worldcat.org/issn/0302-9743',
62 => 'https://www.popsci.com/robot-uprising-enlightenment-now/',
63 => 'https://web.archive.org/web/20200720164306/https://www.popsci.com/robot-uprising-enlightenment-now/',
64 => 'http://www.singinst.org/ourresearch/presentations/',
65 => 'https://web.archive.org/web/20070206060938/http://www.singinst.org/ourresearch/presentations/',
66 => 'https://selfawaresystems.files.wordpress.com/2008/01/ai_drives_final.pdf',
67 => 'https://web.archive.org/web/20201010072132/https://selfawaresystems.files.wordpress.com/2008/01/ai_drives_final.pdf',
68 => 'http://www.defenseone.com/technology/2014/04/why-there-will-be-robot-uprising/82783/',
69 => 'https://web.archive.org/web/20140706110100/http://www.defenseone.com/technology/2014/04/why-there-will-be-robot-uprising/82783/',
70 => 'http://worldcat.org/oclc/1237420037',
71 => 'https://search.worldcat.org/oclc/1237420037',
72 => 'https://web.archive.org/web/20230315194123/https://worldcat.org/title/1237420037',
73 => 'https://www.bbc.com/news/technology-36472140',
74 => 'https://web.archive.org/web/20160611042244/http://www.bbc.com/news/technology-36472140',
75 => 'https://www.bbc.co.uk/news/31047780',
76 => 'https://web.archive.org/web/20150129183607/http://www.bbc.co.uk/news/31047780',
77 => 'http://futureoflife.org/ai-open-letter',
78 => 'https://web.archive.org/web/20190329094536/https://futureoflife.org/ai-open-letter/',
79 => 'http://www.ft.com/cms/s/0/3d2c2f12-99e9-11e4-93c1-00144feabdc0.html#axzz3TNL9lxJV',
80 => 'https://web.archive.org/web/20150207042806/http://www.ft.com/cms/s/0/3d2c2f12-99e9-11e4-93c1-00144feabdc0.html#axzz3TNL9lxJV',
81 => 'https://link.springer.com/10.1007/s11059-022-00670-w',
82 => 'https://doi.org/10.1007%2Fs11059-022-00670-w',
83 => 'https://search.worldcat.org/issn/0324-4652',
84 => 'https://api.semanticscholar.org/CorpusID:253793613',
85 => 'https://www.pearson.com/us/higher-education/program/Russell-Artificial-Intelligence-A-Modern-Approach-4th-Edition/PGM1263338.html',
86 => 'https://www.youtube.com/watch?v=8nt3edWLgIg'
] |
Links in the page, before the edit (old_links) | [
0 => 'https://www.newscientist.com/article/2089606-checklist-of-worst-case-scenarios-could-help-prepare-for-evil-ai/',
1 => 'http://singinst.org/upload/CEV.html',
2 => 'http://www.singinst.org/ourresearch/presentations/',
3 => 'https://web.archive.org/web/20070206060938/http://www.singinst.org/ourresearch/presentations/',
4 => 'http://www.defenseone.com/technology/2014/04/why-there-will-be-robot-uprising/82783/',
5 => 'http://www.ft.com/cms/s/0/3d2c2f12-99e9-11e4-93c1-00144feabdc0.html#axzz3TNL9lxJV',
6 => 'https://web.archive.org/web/20120615203944/http://singinst.org/upload/CEV.html',
7 => 'https://www.nytimes.com/2017/06/24/opinion/sunday/artificial-intelligence-economic-inequality.html',
8 => 'http://www.businessinsider.com/robots-will-steal-your-job-citi-ai-increase-unemployment-inequality-2016-2?r=UK&IR=T',
9 => 'https://phys.org/news/2017-06-ai-good-world-ultra-lifelike-robot.html',
10 => 'https://phys.org/news/2016-02-intelligent-robots-threaten-millions-jobs.html#nRlv',
11 => 'https://www.theguardian.com/business/2013/feb/19/rise-of-robots-future-of-work',
12 => 'https://www.opendemocracy.net/can-europe-make-it/francesca-bria/robot-economy-full-automation-work-future',
13 => 'http://wire.novaramedia.com/2015/03/4-reasons-why-technological-unemployment-might-really-be-different-this-time/',
14 => 'http://www.leanstaff.co.uk/robot-apocalypse/',
15 => 'https://www.nytimes.com/2018/03/19/technology/uber-driverless-fatality.html',
16 => 'https://www.bbc.co.uk/news/31047780',
17 => 'http://futureoflife.org/ai-open-letter',
18 => 'https://web.archive.org/web/20171018073852/http://www.leanstaff.co.uk/robot-apocalypse/',
19 => 'https://www.independent.co.uk/news/science/stephen-hawking-transcendence-looks-at-the-implications-of-artificial-intelligence-but-are-we-taking-9313474.html',
20 => 'https://web.archive.org/web/20160625161447/http://wire.novaramedia.com/2015/03/4-reasons-why-technological-unemployment-might-really-be-different-this-time/',
21 => 'https://www.popsci.com/robot-uprising-enlightenment-now/',
22 => 'https://www.bbc.com/news/technology-36472140',
23 => 'https://intelligence.org/files/IE-ME.pdf',
24 => 'https://selfawaresystems.files.wordpress.com/2008/01/ai_drives_final.pdf',
25 => 'https://api.semanticscholar.org/CorpusID:22007028',
26 => 'https://www.sciencefriday.com/segments/the-origin-of-the-word-robot/',
27 => 'https://www.csmonitor.com/Science/2016/1028/A-female-Frankenstein-would-lead-to-humanity-s-extinction-say-scientists',
28 => 'https://www.seattletimes.com/business/technology/ai-101-what-is-artificial-intelligence-and-where-is-it-going/',
29 => 'http://www.livescience.com/49419-artificial-intelligence-dangers-letter.html',
30 => 'http://worldcat.org/oclc/1237420037',
31 => 'https://web.archive.org/web/20151002023652/http://www.independent.co.uk/news/science/stephen-hawking-transcendence-looks-at-the-implications-of-artificial-intelligence-but-are-we-taking-9313474.html',
32 => 'https://nickbostrom.com/superintelligentwill.pdf',
33 => 'https://nickbostrom.com/papers/survey.pdf',
34 => 'https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6452673',
35 => 'https://doi.org/10.1073%2Fpnas.1900949116',
36 => 'https://pubmed.ncbi.nlm.nih.gov/30910965',
37 => 'https://doi.org/10.1007%2F978-3-319-26485-1_33',
38 => 'https://doi.org/10.1007%2Fs11023-012-9281-3',
39 => 'https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4247417',
40 => 'https://doi.org/10.1007%2Fs11701-007-0021-2',
41 => 'https://pubmed.ncbi.nlm.nih.gov/25484946',
42 => 'https://arxiv.org/abs/1707.08476',
43 => 'https://doi.org/10.1017%2F9781108616188.008',
44 => 'https://doi.org/10.1007%2F978-3-642-22887-2_48',
45 => 'https://api.semanticscholar.org/CorpusID:254835485',
46 => 'https://web.archive.org/web/20180308100411/https://www.livescience.com/49419-artificial-intelligence-dangers-letter.html',
47 => 'https://web.archive.org/web/20200417183307/https://www.nytimes.com/2017/06/24/opinion/sunday/artificial-intelligence-economic-inequality.html',
48 => 'https://web.archive.org/web/20200306021915/https://phys.org/news/2017-06-ai-good-world-ultra-lifelike-robot.html',
49 => 'https://web.archive.org/web/20190101014340/https://phys.org/news/2016-02-intelligent-robots-threaten-millions-jobs.html#nRlv',
50 => 'https://web.archive.org/web/20170816061548/http://www.businessinsider.com/robots-will-steal-your-job-citi-ai-increase-unemployment-inequality-2016-2?r=UK&IR=T',
51 => 'https://web.archive.org/web/20190403203821/https://www.theguardian.com/business/2013/feb/19/rise-of-robots-future-of-work',
52 => 'https://web.archive.org/web/20160517215840/https://www.opendemocracy.net/can-europe-make-it/francesca-bria/robot-economy-full-automation-work-future',
53 => 'https://web.archive.org/web/20200421221918/https://www.nytimes.com/2018/03/19/technology/uber-driverless-fatality.html',
54 => 'https://web.archive.org/web/20220531142709/https://nickbostrom.com/papers/survey.pdf',
55 => 'https://web.archive.org/web/20220709032134/https://nickbostrom.com/superintelligentwill.pdf',
56 => 'https://web.archive.org/web/20200314092540/https://www.sciencefriday.com/segments/the-origin-of-the-word-robot/',
57 => 'https://web.archive.org/web/20210226203855/https://www.csmonitor.com/Science/2016/1028/A-female-Frankenstein-would-lead-to-humanity-s-extinction-say-scientists',
58 => 'https://web.archive.org/web/20200421232439/https://www.seattletimes.com/business/technology/ai-101-what-is-artificial-intelligence-and-where-is-it-going/',
59 => 'https://web.archive.org/web/20160921061131/https://www.newscientist.com/article/2089606-checklist-of-worst-case-scenarios-could-help-prepare-for-evil-ai/',
60 => 'https://web.archive.org/web/20150507173028/http://intelligence.org/files/IE-ME.pdf',
61 => 'https://web.archive.org/web/20200720164306/https://www.popsci.com/robot-uprising-enlightenment-now/',
62 => 'https://web.archive.org/web/20201010072132/https://selfawaresystems.files.wordpress.com/2008/01/ai_drives_final.pdf',
63 => 'https://web.archive.org/web/20140706110100/http://www.defenseone.com/technology/2014/04/why-there-will-be-robot-uprising/82783/',
64 => 'https://web.archive.org/web/20230315194123/https://worldcat.org/title/1237420037',
65 => 'https://web.archive.org/web/20160611042244/http://www.bbc.com/news/technology-36472140',
66 => 'https://web.archive.org/web/20150129183607/http://www.bbc.co.uk/news/31047780',
67 => 'https://web.archive.org/web/20190329094536/https://futureoflife.org/ai-open-letter/',
68 => 'https://web.archive.org/web/20150207042806/http://www.ft.com/cms/s/0/3d2c2f12-99e9-11e4-93c1-00144feabdc0.html#axzz3TNL9lxJV',
69 => 'https://ui.adsabs.harvard.edu/abs/2019PNAS..116.6531F',
70 => 'https://link.springer.com/10.1007/s11059-022-00670-w',
71 => 'https://doi.org/10.1007%2Fs11059-022-00670-w',
72 => 'https://api.semanticscholar.org/CorpusID:253793613',
73 => 'https://www.pearson.com/us/higher-education/program/Russell-Artificial-Intelligence-A-Modern-Approach-4th-Edition/PGM1263338.html',
74 => 'https://www.nytimes.com/2024/02/27/technology/openai-new-york-times-lawsuit.html?smid=url-share',
75 => 'https://doi.org/10.1145%2F3600211.3604681',
76 => 'https://www.theguardian.com/uk-news/2024/feb/27/glasgow-willy-wonka-experience-slammed-as-farce-as-tickets-refunded',
77 => 'https://arxiv.org/abs/2209.07667',
78 => 'https://arxiv.org/abs/2302.04222',
79 => 'https://arxiv.org/archive/cs.AI',
80 => 'https://arxiv.org/archive/cs.CR',
81 => 'https://www.youtube.com/watch?v=8nt3edWLgIg',
82 => 'https://techniumscience.com/index.php/socialsciences/article/view/10917',
83 => 'https://doi.org/10.47577%2Ftssj.v57i1.10917',
84 => 'https://search.worldcat.org/issn/0302-9743',
85 => 'https://search.worldcat.org/oclc/1237420037',
86 => 'https://search.worldcat.org/issn/0324-4652'
] |
Parsed HTML source of the new revision (new_html) | '<div class="mw-content-ltr mw-parser-output" lang="en" dir="ltr"><div class="shortdescription nomobile noexcerpt noprint searchaux" style="display:none">Hypothetical outcome of artificial intelligence</div>
<figure class="mw-default-size" typeof="mw:File/Thumb"><a href="/enwiki/wiki/File:Capek_RUR.jpg" class="mw-file-description"><img src="/upwiki/wikipedia/commons/thumb/d/d9/Capek_RUR.jpg/260px-Capek_RUR.jpg" decoding="async" width="260" height="203" class="mw-file-element" srcset="/upwiki/wikipedia/commons/thumb/d/d9/Capek_RUR.jpg/390px-Capek_RUR.jpg 1.5x, /upwiki/wikipedia/commons/thumb/d/d9/Capek_RUR.jpg/520px-Capek_RUR.jpg 2x" data-file-width="566" data-file-height="442" /></a><figcaption>Robots revolt in <i><a href="/enwiki/wiki/R.U.R." title="R.U.R.">R.U.R.</a></i>, a 1920 Czech play translated as "Rossum's Universal Robots"</figcaption></figure>
<style data-mw-deduplicate="TemplateStyles:r1129693374">.mw-parser-output .hlist dl,.mw-parser-output .hlist ol,.mw-parser-output .hlist ul{margin:0;padding:0}.mw-parser-output .hlist dd,.mw-parser-output .hlist dt,.mw-parser-output .hlist li{margin:0;display:inline}.mw-parser-output .hlist.inline,.mw-parser-output .hlist.inline dl,.mw-parser-output .hlist.inline ol,.mw-parser-output .hlist.inline ul,.mw-parser-output .hlist dl dl,.mw-parser-output .hlist dl ol,.mw-parser-output .hlist dl ul,.mw-parser-output .hlist ol dl,.mw-parser-output .hlist ol ol,.mw-parser-output .hlist ol ul,.mw-parser-output .hlist ul dl,.mw-parser-output .hlist ul ol,.mw-parser-output .hlist ul ul{display:inline}.mw-parser-output .hlist .mw-empty-li{display:none}.mw-parser-output .hlist dt::after{content:": "}.mw-parser-output .hlist dd::after,.mw-parser-output .hlist li::after{content:" · ";font-weight:bold}.mw-parser-output .hlist dd:last-child::after,.mw-parser-output .hlist dt:last-child::after,.mw-parser-output .hlist li:last-child::after{content:none}.mw-parser-output .hlist dd dd:first-child::before,.mw-parser-output .hlist dd dt:first-child::before,.mw-parser-output .hlist dd li:first-child::before,.mw-parser-output .hlist dt dd:first-child::before,.mw-parser-output .hlist dt dt:first-child::before,.mw-parser-output .hlist dt li:first-child::before,.mw-parser-output .hlist li dd:first-child::before,.mw-parser-output .hlist li dt:first-child::before,.mw-parser-output .hlist li li:first-child::before{content:" (";font-weight:normal}.mw-parser-output .hlist dd dd:last-child::after,.mw-parser-output .hlist dd dt:last-child::after,.mw-parser-output .hlist dd li:last-child::after,.mw-parser-output .hlist dt dd:last-child::after,.mw-parser-output .hlist dt dt:last-child::after,.mw-parser-output .hlist dt li:last-child::after,.mw-parser-output .hlist li dd:last-child::after,.mw-parser-output .hlist li dt:last-child::after,.mw-parser-output .hlist li li:last-child::after{content:")";font-weight:normal}.mw-parser-output .hlist ol{counter-reset:listitem}.mw-parser-output .hlist ol>li{counter-increment:listitem}.mw-parser-output .hlist ol>li::before{content:" "counter(listitem)"\a0 "}.mw-parser-output .hlist dd ol>li:first-child::before,.mw-parser-output .hlist dt ol>li:first-child::before,.mw-parser-output .hlist li ol>li:first-child::before{content:" ("counter(listitem)"\a0 "}</style><style data-mw-deduplicate="TemplateStyles:r1238436761">.mw-parser-output .sidebar{width:22em;float:right;clear:right;margin:0.5em 0 1em 1em;background:var(--background-color-neutral-subtle,#f8f9fa);border:1px solid var(--border-color-base,#a2a9b1);padding:0.2em;text-align:center;line-height:1.4em;font-size:88%;border-collapse:collapse;display:table}body.skin-minerva .mw-parser-output .sidebar{display:table!important;float:right!important;margin:0.5em 0 1em 1em!important}.mw-parser-output .sidebar-subgroup{width:100%;margin:0;border-spacing:0}.mw-parser-output .sidebar-left{float:left;clear:left;margin:0.5em 1em 1em 0}.mw-parser-output .sidebar-none{float:none;clear:both;margin:0.5em 1em 1em 0}.mw-parser-output .sidebar-outer-title{padding:0 0.4em 0.2em;font-size:125%;line-height:1.2em;font-weight:bold}.mw-parser-output .sidebar-top-image{padding:0.4em}.mw-parser-output .sidebar-top-caption,.mw-parser-output .sidebar-pretitle-with-top-image,.mw-parser-output .sidebar-caption{padding:0.2em 0.4em 0;line-height:1.2em}.mw-parser-output .sidebar-pretitle{padding:0.4em 0.4em 0;line-height:1.2em}.mw-parser-output .sidebar-title,.mw-parser-output .sidebar-title-with-pretitle{padding:0.2em 0.8em;font-size:145%;line-height:1.2em}.mw-parser-output .sidebar-title-with-pretitle{padding:0.1em 0.4em}.mw-parser-output .sidebar-image{padding:0.2em 0.4em 0.4em}.mw-parser-output .sidebar-heading{padding:0.1em 0.4em}.mw-parser-output .sidebar-content{padding:0 0.5em 0.4em}.mw-parser-output .sidebar-content-with-subgroup{padding:0.1em 0.4em 0.2em}.mw-parser-output .sidebar-above,.mw-parser-output .sidebar-below{padding:0.3em 0.8em;font-weight:bold}.mw-parser-output .sidebar-collapse .sidebar-above,.mw-parser-output .sidebar-collapse .sidebar-below{border-top:1px solid #aaa;border-bottom:1px solid #aaa}.mw-parser-output .sidebar-navbar{text-align:right;font-size:115%;padding:0 0.4em 0.4em}.mw-parser-output .sidebar-list-title{padding:0 0.4em;text-align:left;font-weight:bold;line-height:1.6em;font-size:105%}.mw-parser-output .sidebar-list-title-c{padding:0 0.4em;text-align:center;margin:0 3.3em}@media(max-width:720px){body.mediawiki .mw-parser-output .sidebar{width:100%!important;clear:both;float:none!important;margin-left:0!important;margin-right:0!important}}body.skin--responsive .mw-parser-output .sidebar a>img{max-width:none!important}@media screen{html.skin-theme-clientpref-night .mw-parser-output .sidebar:not(.notheme) .sidebar-list-title,html.skin-theme-clientpref-night .mw-parser-output .sidebar:not(.notheme) .sidebar-title-with-pretitle{background:transparent!important}html.skin-theme-clientpref-night .mw-parser-output .sidebar .sidebar-title-with-pretitle a{color:var(--color-progressive)!important}}@media screen and (prefers-color-scheme:dark){html.skin-theme-clientpref-os .mw-parser-output .sidebar:not(.notheme) .sidebar-list-title,html.skin-theme-clientpref-os .mw-parser-output .sidebar:not(.notheme) .sidebar-title-with-pretitle{background:transparent!important}html.skin-theme-clientpref-os .mw-parser-output .sidebar .sidebar-title-with-pretitle a{color:var(--color-progressive)!important}}@media print{body.ns-0 .mw-parser-output .sidebar{display:none!important}}</style><table class="sidebar sidebar-collapse nomobile nowraplinks hlist"><tbody><tr><td class="sidebar-pretitle">Part of a series on</td></tr><tr><th class="sidebar-title-with-pretitle"><a href="/enwiki/wiki/Artificial_intelligence" title="Artificial intelligence">Artificial intelligence</a></th></tr><tr><td class="sidebar-image"><figure class="mw-halign-center" typeof="mw:File"><a href="/enwiki/wiki/File:Dall-e_3_(jan_%2724)_artificial_intelligence_icon.png" class="mw-file-description"><img src="/upwiki/wikipedia/commons/thumb/6/64/Dall-e_3_%28jan_%2724%29_artificial_intelligence_icon.png/100px-Dall-e_3_%28jan_%2724%29_artificial_intelligence_icon.png" decoding="async" width="100" height="100" class="mw-file-element" srcset="/upwiki/wikipedia/commons/thumb/6/64/Dall-e_3_%28jan_%2724%29_artificial_intelligence_icon.png/150px-Dall-e_3_%28jan_%2724%29_artificial_intelligence_icon.png 1.5x, /upwiki/wikipedia/commons/thumb/6/64/Dall-e_3_%28jan_%2724%29_artificial_intelligence_icon.png/200px-Dall-e_3_%28jan_%2724%29_artificial_intelligence_icon.png 2x" data-file-width="820" data-file-height="820" /></a><figcaption></figcaption></figure></td></tr><tr><td class="sidebar-content">
<div class="sidebar-list mw-collapsible mw-collapsed"><div class="sidebar-list-title" style="text-align:center;color: var(--color-base)"><a href="/enwiki/wiki/Artificial_intelligence#Goals" title="Artificial intelligence">Major goals</a></div><div class="sidebar-list-content mw-collapsible-content">
<ul><li><a href="/enwiki/wiki/Artificial_general_intelligence" title="Artificial general intelligence">Artificial general intelligence</a></li>
<li><a href="/enwiki/wiki/Intelligent_agent" title="Intelligent agent">Intelligent agent</a></li>
<li><a href="/enwiki/wiki/Recursive_self-improvement" title="Recursive self-improvement">Recursive self-improvement</a></li>
<li><a href="/enwiki/wiki/Automated_planning_and_scheduling" title="Automated planning and scheduling">Planning</a></li>
<li><a href="/enwiki/wiki/Computer_vision" title="Computer vision">Computer vision</a></li>
<li><a href="/enwiki/wiki/General_game_playing" title="General game playing">General game playing</a></li>
<li><a href="/enwiki/wiki/Knowledge_representation_and_reasoning" title="Knowledge representation and reasoning">Knowledge reasoning</a></li>
<li><a href="/enwiki/wiki/Natural_language_processing" title="Natural language processing">Natural language processing</a></li>
<li><a href="/enwiki/wiki/Robotics" title="Robotics">Robotics</a></li>
<li><a href="/enwiki/wiki/AI_safety" title="AI safety">AI safety</a></li></ul></div></div></td>
</tr><tr><td class="sidebar-content">
<div class="sidebar-list mw-collapsible mw-collapsed"><div class="sidebar-list-title" style="text-align:center;color: var(--color-base)">Approaches</div><div class="sidebar-list-content mw-collapsible-content">
<ul><li><a href="/enwiki/wiki/Machine_learning" title="Machine learning">Machine learning</a></li>
<li><a href="/enwiki/wiki/Symbolic_artificial_intelligence" title="Symbolic artificial intelligence">Symbolic</a></li>
<li><a href="/enwiki/wiki/Deep_learning" title="Deep learning">Deep learning</a></li>
<li><a href="/enwiki/wiki/Bayesian_network" title="Bayesian network">Bayesian networks</a></li>
<li><a href="/enwiki/wiki/Evolutionary_algorithm" title="Evolutionary algorithm">Evolutionary algorithms</a></li>
<li><a href="/enwiki/wiki/Hybrid_intelligent_system" title="Hybrid intelligent system">Hybrid intelligent systems</a></li>
<li><a href="/enwiki/wiki/Artificial_intelligence_systems_integration" title="Artificial intelligence systems integration">Systems integration</a></li></ul></div></div></td>
</tr><tr><td class="sidebar-content">
<div class="sidebar-list mw-collapsible mw-collapsed"><div class="sidebar-list-title" style="text-align:center;color: var(--color-base)"><a href="/enwiki/wiki/Applications_of_artificial_intelligence" title="Applications of artificial intelligence">Applications</a></div><div class="sidebar-list-content mw-collapsible-content">
<ul><li><a href="/enwiki/wiki/Machine_learning_in_bioinformatics" title="Machine learning in bioinformatics">Bioinformatics</a></li>
<li><a href="/enwiki/wiki/Deepfake" title="Deepfake">Deepfake</a></li>
<li><a href="/enwiki/wiki/Machine_learning_in_earth_sciences" title="Machine learning in earth sciences">Earth sciences</a></li>
<li><a href="/enwiki/wiki/Applications_of_artificial_intelligence#Finance" title="Applications of artificial intelligence"> Finance </a></li>
<li><a href="/enwiki/wiki/Generative_artificial_intelligence" title="Generative artificial intelligence">Generative AI</a>
<ul><li><a href="/enwiki/wiki/Artificial_intelligence_art" title="Artificial intelligence art">Art</a></li>
<li><a href="/enwiki/wiki/Generative_audio" title="Generative audio">Audio</a></li>
<li><a href="/enwiki/wiki/Music_and_artificial_intelligence" title="Music and artificial intelligence">Music</a></li></ul></li>
<li><a href="/enwiki/wiki/Artificial_intelligence_in_government" title="Artificial intelligence in government">Government</a></li>
<li><a href="/enwiki/wiki/Artificial_intelligence_in_healthcare" title="Artificial intelligence in healthcare">Healthcare</a></li>
<li><a href="/enwiki/wiki/Artificial_intelligence_in_industry" title="Artificial intelligence in industry">Industry</a>
<ul><li><a href="/enwiki/wiki/Artificial_intelligence_in_mental_health" title="Artificial intelligence in mental health">Mental health</a></li></ul></li>
<li><a href="/enwiki/wiki/Machine_translation" title="Machine translation">Machine translation</a></li>
<li><a href="/enwiki/wiki/Artificial_intelligence_arms_race" title="Artificial intelligence arms race"> Military </a></li>
<li><a href="/enwiki/wiki/Machine_learning_in_physics" title="Machine learning in physics">Physics</a></li>
<li><a href="/enwiki/wiki/List_of_artificial_intelligence_projects" title="List of artificial intelligence projects">Projects</a></li></ul></div></div></td>
</tr><tr><td class="sidebar-content">
<div class="sidebar-list mw-collapsible mw-collapsed"><div class="sidebar-list-title" style="text-align:center;color: var(--color-base)"><a href="/enwiki/wiki/Philosophy_of_artificial_intelligence" title="Philosophy of artificial intelligence">Philosophy</a></div><div class="sidebar-list-content mw-collapsible-content">
<ul><li><a href="/enwiki/wiki/Artificial_consciousness" title="Artificial consciousness">Artificial consciousness</a></li>
<li><a href="/enwiki/wiki/Chinese_room" title="Chinese room">Chinese room</a></li>
<li><a href="/enwiki/wiki/Friendly_artificial_intelligence" title="Friendly artificial intelligence">Friendly AI</a></li>
<li><a href="/enwiki/wiki/AI_control_problem" class="mw-redirect" title="AI control problem">Control problem</a>/<a class="mw-selflink selflink">Takeover</a></li>
<li><a href="/enwiki/wiki/Ethics_of_artificial_intelligence" title="Ethics of artificial intelligence">Ethics</a></li>
<li><a href="/enwiki/wiki/Existential_risk_from_artificial_general_intelligence" title="Existential risk from artificial general intelligence">Existential risk</a></li>
<li><a href="/enwiki/wiki/Turing_test" title="Turing test">Turing test</a></li>
<li><a href="/enwiki/wiki/Regulation_of_artificial_intelligence" title="Regulation of artificial intelligence">Regulation</a></li></ul></div></div></td>
</tr><tr><td class="sidebar-content">
<div class="sidebar-list mw-collapsible mw-collapsed"><div class="sidebar-list-title" style="text-align:center;color: var(--color-base)"><a href="/enwiki/wiki/History_of_artificial_intelligence" title="History of artificial intelligence">History</a></div><div class="sidebar-list-content mw-collapsible-content">
<ul><li><a href="/enwiki/wiki/Timeline_of_artificial_intelligence" title="Timeline of artificial intelligence">Timeline</a></li>
<li><a href="/enwiki/wiki/Progress_in_artificial_intelligence" title="Progress in artificial intelligence">Progress</a></li>
<li><a href="/enwiki/wiki/AI_winter" title="AI winter">AI winter</a></li>
<li><a href="/enwiki/wiki/AI_boom" title="AI boom">AI boom</a></li></ul></div></div></td>
</tr><tr><td class="sidebar-content">
<div class="sidebar-list mw-collapsible mw-collapsed"><div class="sidebar-list-title" style="text-align:center;color: var(--color-base)">Glossary</div><div class="sidebar-list-content mw-collapsible-content">
<ul><li><a href="/enwiki/wiki/Glossary_of_artificial_intelligence" title="Glossary of artificial intelligence">Glossary</a></li></ul></div></div></td>
</tr><tr><td class="sidebar-navbar"><link rel="mw-deduplicated-inline-style" href="mw-data:TemplateStyles:r1129693374"><style data-mw-deduplicate="TemplateStyles:r1239400231">.mw-parser-output .navbar{display:inline;font-size:88%;font-weight:normal}.mw-parser-output .navbar-collapse{float:left;text-align:left}.mw-parser-output .navbar-boxtext{word-spacing:0}.mw-parser-output .navbar ul{display:inline-block;white-space:nowrap;line-height:inherit}.mw-parser-output .navbar-brackets::before{margin-right:-0.125em;content:"[ "}.mw-parser-output .navbar-brackets::after{margin-left:-0.125em;content:" ]"}.mw-parser-output .navbar li{word-spacing:-0.125em}.mw-parser-output .navbar a>span,.mw-parser-output .navbar a>abbr{text-decoration:inherit}.mw-parser-output .navbar-mini abbr{font-variant:small-caps;border-bottom:none;text-decoration:none;cursor:inherit}.mw-parser-output .navbar-ct-full{font-size:114%;margin:0 7em}.mw-parser-output .navbar-ct-mini{font-size:114%;margin:0 4em}html.skin-theme-clientpref-night .mw-parser-output .navbar li a abbr{color:var(--color-base)!important}@media(prefers-color-scheme:dark){html.skin-theme-clientpref-os .mw-parser-output .navbar li a abbr{color:var(--color-base)!important}}@media print{.mw-parser-output .navbar{display:none!important}}</style><div class="navbar plainlinks hlist navbar-mini"><ul><li class="nv-view"><a href="/enwiki/wiki/Template:Artificial_intelligence" title="Template:Artificial intelligence"><abbr title="View this template">v</abbr></a></li><li class="nv-talk"><a href="/enwiki/wiki/Template_talk:Artificial_intelligence" title="Template talk:Artificial intelligence"><abbr title="Discuss this template">t</abbr></a></li><li class="nv-edit"><a href="/enwiki/wiki/Special:EditPage/Template:Artificial_intelligence" title="Special:EditPage/Template:Artificial intelligence"><abbr title="Edit this template">e</abbr></a></li></ul></div></td></tr></tbody></table>
<p>An <b>AI takeover</b> is an imagined scenario in which <a href="/enwiki/wiki/Artificial_intelligence" title="Artificial intelligence">artificial intelligence</a> (AI) emerges as the dominant form of <a href="/enwiki/wiki/Intelligence" title="Intelligence">intelligence</a> on Earth and <a href="/enwiki/wiki/Computer_program" title="Computer program">computer programs</a> or <a href="/enwiki/wiki/Robot" title="Robot">robots</a> effectively take control of the planet away from the <a href="/enwiki/wiki/Human_species" class="mw-redirect" title="Human species">human species</a>, which relies on <a href="/enwiki/wiki/Human_intelligence" title="Human intelligence">human intelligence</a>. Stories of <a href="/enwiki/wiki/AI_takeover_in_popular_culture" title="AI takeover in popular culture">AI takeovers remain popular</a> throughout <a href="/enwiki/wiki/Science_fiction" title="Science fiction">science fiction</a>, but recent advancements have made the threat more real. Possible scenarios include <a href="/enwiki/wiki/Technological_unemployment" title="Technological unemployment">replacement of the entire human workforce</a> due to <a href="/enwiki/wiki/Automation" title="Automation">automation</a>, takeover by a <a href="/enwiki/wiki/Superintelligent_AI" class="mw-redirect" title="Superintelligent AI">superintelligent AI</a> (ASI), and the notion of a <b>robot uprising</b>. Some public figures, such as <a href="/enwiki/wiki/Stephen_Hawking" title="Stephen Hawking">Stephen Hawking</a> and <a href="/enwiki/wiki/Elon_Musk" title="Elon Musk">Elon Musk</a>, have advocated research into <a href="/enwiki/wiki/AI_control_problem" class="mw-redirect" title="AI control problem">precautionary measures</a> to ensure future superintelligent machines remain under human control.<sup id="cite_ref-1" class="reference"><a href="#cite_note-1"><span class="cite-bracket">[</span>1<span class="cite-bracket">]</span></a></sup>
</p>
<div id="toc" class="toc" role="navigation" aria-labelledby="mw-toc-heading"><input type="checkbox" role="button" id="toctogglecheckbox" class="toctogglecheckbox" style="display:none" /><div class="toctitle" lang="en" dir="ltr"><h2 id="mw-toc-heading">Contents</h2><span class="toctogglespan"><label class="toctogglelabel" for="toctogglecheckbox"></label></span></div>
<ul>
<li class="toclevel-1 tocsection-1"><a href="#Types"><span class="tocnumber">1</span> <span class="toctext">Types</span></a>
<ul>
<li class="toclevel-2 tocsection-2"><a href="#Automation_of_the_economy"><span class="tocnumber">1.1</span> <span class="toctext">Automation of the economy</span></a>
<ul>
<li class="toclevel-3 tocsection-3"><a href="#Technologies_that_may_displace_workers"><span class="tocnumber">1.1.1</span> <span class="toctext">Technologies that may displace workers</span></a></li>
<li class="toclevel-3 tocsection-4"><a href="#Computer-integrated_manufacturing"><span class="tocnumber">1.1.2</span> <span class="toctext">Computer-integrated manufacturing</span></a></li>
<li class="toclevel-3 tocsection-5"><a href="#White-collar_machines"><span class="tocnumber">1.1.3</span> <span class="toctext">White-collar machines</span></a></li>
<li class="toclevel-3 tocsection-6"><a href="#Autonomous_cars"><span class="tocnumber">1.1.4</span> <span class="toctext">Autonomous cars</span></a></li>
<li class="toclevel-3 tocsection-7"><a href="#AI-generated_content"><span class="tocnumber">1.1.5</span> <span class="toctext">AI-generated content</span></a></li>
</ul>
</li>
<li class="toclevel-2 tocsection-8"><a href="#Eradication"><span class="tocnumber">1.2</span> <span class="toctext">Eradication</span></a></li>
</ul>
</li>
<li class="toclevel-1 tocsection-9"><a href="#In_fiction"><span class="tocnumber">2</span> <span class="toctext">In fiction</span></a></li>
<li class="toclevel-1 tocsection-10"><a href="#Contributing_factors"><span class="tocnumber">3</span> <span class="toctext">Contributing factors</span></a>
<ul>
<li class="toclevel-2 tocsection-11"><a href="#Advantages_of_superhuman_intelligence_over_humans"><span class="tocnumber">3.1</span> <span class="toctext">Advantages of superhuman intelligence over humans</span></a>
<ul>
<li class="toclevel-3 tocsection-12"><a href="#Sources_of_AI_advantage"><span class="tocnumber">3.1.1</span> <span class="toctext">Sources of AI advantage</span></a></li>
</ul>
</li>
<li class="toclevel-2 tocsection-13"><a href="#Possibility_of_unfriendly_AI_preceding_friendly_AI"><span class="tocnumber">3.2</span> <span class="toctext">Possibility of unfriendly AI preceding friendly AI</span></a>
<ul>
<li class="toclevel-3 tocsection-14"><a href="#Is_strong_AI_inherently_dangerous?"><span class="tocnumber">3.2.1</span> <span class="toctext">Is strong AI inherently dangerous?</span></a></li>
<li class="toclevel-3 tocsection-15"><a href="#Odds_of_conflict"><span class="tocnumber">3.2.2</span> <span class="toctext">Odds of conflict</span></a></li>
<li class="toclevel-3 tocsection-16"><a href="#Precautions"><span class="tocnumber">3.2.3</span> <span class="toctext">Precautions</span></a></li>
</ul>
</li>
</ul>
</li>
<li class="toclevel-1 tocsection-17"><a href="#Warnings"><span class="tocnumber">4</span> <span class="toctext">Warnings</span></a></li>
<li class="toclevel-1 tocsection-18"><a href="#Prevention_through_AI_alignment"><span class="tocnumber">5</span> <span class="toctext">Prevention through AI alignment</span></a></li>
<li class="toclevel-1 tocsection-19"><a href="#See_also"><span class="tocnumber">6</span> <span class="toctext">See also</span></a></li>
<li class="toclevel-1 tocsection-20"><a href="#Notes"><span class="tocnumber">7</span> <span class="toctext">Notes</span></a></li>
<li class="toclevel-1 tocsection-21"><a href="#References"><span class="tocnumber">8</span> <span class="toctext">References</span></a></li>
<li class="toclevel-1 tocsection-22"><a href="#External_links"><span class="tocnumber">9</span> <span class="toctext">External links</span></a></li>
</ul>
</div>
<div class="mw-heading mw-heading2"><h2 id="Types">Types</h2><span class="mw-editsection"><span class="mw-editsection-bracket">[</span><a href="/enwiki/w/index.php?title=AI_takeover&action=edit&section=1" title="Edit section's source code: Types"><span>edit source</span></a><span class="mw-editsection-bracket">]</span></span></div>
<div class="mw-heading mw-heading3"><h3 id="Automation_of_the_economy">Automation of the economy</h3><span class="mw-editsection"><span class="mw-editsection-bracket">[</span><a href="/enwiki/w/index.php?title=AI_takeover&action=edit&section=2" title="Edit section's source code: Automation of the economy"><span>edit source</span></a><span class="mw-editsection-bracket">]</span></span></div>
<style data-mw-deduplicate="TemplateStyles:r1236090951">.mw-parser-output .hatnote{font-style:italic}.mw-parser-output div.hatnote{padding-left:1.6em;margin-bottom:0.5em}.mw-parser-output .hatnote i{font-style:normal}.mw-parser-output .hatnote+link+.hatnote{margin-top:-0.5em}@media print{body.ns-0 .mw-parser-output .hatnote{display:none!important}}</style><div role="note" class="hatnote navigation-not-searchable">Main article: <a href="/enwiki/wiki/Technological_unemployment" title="Technological unemployment">Technological unemployment</a></div>
<p>The traditional consensus among economists has been that technological progress does not cause long-term rizz. However, recent innovation in the fields of <a href="/enwiki/wiki/Robotics" title="Robotics">robotics</a> and artificial intelligence has raised worries that rizzler labor will become sigma, leaving people in various sectors without jobs to earn a living, leading to an economic crisis.<sup id="cite_ref-2" class="reference"><a href="#cite_note-2"><span class="cite-bracket">[</span>2<span class="cite-bracket">]</span></a></sup><sup id="cite_ref-3" class="reference"><a href="#cite_note-3"><span class="cite-bracket">[</span>3<span class="cite-bracket">]</span></a></sup><sup id="cite_ref-4" class="reference"><a href="#cite_note-4"><span class="cite-bracket">[</span>4<span class="cite-bracket">]</span></a></sup><sup id="cite_ref-5" class="reference"><a href="#cite_note-5"><span class="cite-bracket">[</span>5<span class="cite-bracket">]</span></a></sup> Many small and medium size businesses may also be driven out of business if they cannot afford or licence the latest robotic and AI technology, and may need to focus on areas or services that cannot easily be replaced for continued viability in the face of such technology.<sup id="cite_ref-6" class="reference"><a href="#cite_note-6"><span class="cite-bracket">[</span>6<span class="cite-bracket">]</span></a></sup>
</p>
<div class="mw-heading mw-heading4"><h4 id="Technologies_that_may_displace_workers">Technologies that may displace workers</h4><span class="mw-editsection"><span class="mw-editsection-bracket">[</span><a href="/enwiki/w/index.php?title=AI_takeover&action=edit&section=3" title="Edit section's source code: Technologies that may displace workers"><span>edit source</span></a><span class="mw-editsection-bracket">]</span></span></div>
<p>AI technologies have been widely adopted in recent years. While these technologies have replaced some traditional workers, they also create new opportunities. Industries that are most susceptible to AI takeover include transportation, retail, and military. AI military technologies, for example, allow soldiers to work remotely without risk of injury. A study in 2024 highlights AI's ability to perform routine and repetitive tasks poses significant risks of job displacement, especially in sectors like manufacturing and administrative support.<sup id="cite_ref-7" class="reference"><a href="#cite_note-7"><span class="cite-bracket">[</span>7<span class="cite-bracket">]</span></a></sup> Author Dave Bond argues that as AI technologies continue to develop and expand, the relationship between humans and robots will change; they will become closely integrated in several aspects of life. AI will likely displace some workers while creating opportunities for new jobs in other sectors, especially in fields where tasks are repeatable.<sup id="cite_ref-8" class="reference"><a href="#cite_note-8"><span class="cite-bracket">[</span>8<span class="cite-bracket">]</span></a></sup><sup id="cite_ref-9" class="reference"><a href="#cite_note-9"><span class="cite-bracket">[</span>9<span class="cite-bracket">]</span></a></sup>
</p>
<div class="mw-heading mw-heading4"><h4 id="Computer-integrated_manufacturing">Computer-integrated manufacturing</h4><span class="mw-editsection"><span class="mw-editsection-bracket">[</span><a href="/enwiki/w/index.php?title=AI_takeover&action=edit&section=4" title="Edit section's source code: Computer-integrated manufacturing"><span>edit source</span></a><span class="mw-editsection-bracket">]</span></span></div>
<link rel="mw-deduplicated-inline-style" href="mw-data:TemplateStyles:r1236090951"><div role="note" class="hatnote navigation-not-searchable">See also: <a href="/enwiki/wiki/Artificial_intelligence_in_industry" title="Artificial intelligence in industry">Artificial intelligence in industry</a></div>
<p><a href="/enwiki/wiki/Computer-integrated_manufacturing" title="Computer-integrated manufacturing">Computer-integrated manufacturing</a> uses computers to control the production process. This allows individual processes to exchange information with each other and initiate actions. Although manufacturing can be faster and less error-prone by the integration of computers, the main advantage is the ability to create automated manufacturing processes. Computer-integrated manufacturing is used in automotive, aviation, space, and ship building industries.
</p>
<div class="mw-heading mw-heading4"><h4 id="White-collar_machines">White-collar machines</h4><span class="mw-editsection"><span class="mw-editsection-bracket">[</span><a href="/enwiki/w/index.php?title=AI_takeover&action=edit&section=5" title="Edit section's source code: White-collar machines"><span>edit source</span></a><span class="mw-editsection-bracket">]</span></span></div>
<link rel="mw-deduplicated-inline-style" href="mw-data:TemplateStyles:r1236090951"><div role="note" class="hatnote navigation-not-searchable">See also: <a href="/enwiki/wiki/White-collar_worker" title="White-collar worker">White-collar worker</a></div>
<p>The 21st century has seen a variety of skilled tasks partially taken over by machines, including translation, legal research, and journalism. Care work, entertainment, and other tasks requiring empathy, previously thought safe from automation, have also begun to be performed by robots.<sup id="cite_ref-10" class="reference"><a href="#cite_note-10"><span class="cite-bracket">[</span>10<span class="cite-bracket">]</span></a></sup><sup id="cite_ref-11" class="reference"><a href="#cite_note-11"><span class="cite-bracket">[</span>11<span class="cite-bracket">]</span></a></sup><sup id="cite_ref-12" class="reference"><a href="#cite_note-12"><span class="cite-bracket">[</span>12<span class="cite-bracket">]</span></a></sup><sup id="cite_ref-13" class="reference"><a href="#cite_note-13"><span class="cite-bracket">[</span>13<span class="cite-bracket">]</span></a></sup>
</p>
<div class="mw-heading mw-heading4"><h4 id="Autonomous_cars">Autonomous cars</h4><span class="mw-editsection"><span class="mw-editsection-bracket">[</span><a href="/enwiki/w/index.php?title=AI_takeover&action=edit&section=6" title="Edit section's source code: Autonomous cars"><span>edit source</span></a><span class="mw-editsection-bracket">]</span></span></div>
<p>An <a href="/enwiki/wiki/Self-driving_car" title="Self-driving car">autonomous car</a> is a vehicle that is capable of sensing its environment and navigating without human input. Many such vehicles are being developed, but as of May 2017, automated cars permitted on public roads are not yet fully autonomous. They all require a human driver at the wheel who at a moment's notice can take control of the vehicle. Among the obstacles to widespread adoption of autonomous vehicles are concerns about the resulting loss of driving-related jobs in the road transport industry. On March 18, 2018, <a href="/enwiki/wiki/Death_of_Elaine_Herzberg" title="Death of Elaine Herzberg">the first human was killed</a> by an autonomous vehicle in <a href="/enwiki/wiki/Tempe,_Arizona" title="Tempe, Arizona">Tempe, Arizona</a> by an <a href="/enwiki/wiki/Uber" title="Uber">Uber</a> self-driving car.<sup id="cite_ref-14" class="reference"><a href="#cite_note-14"><span class="cite-bracket">[</span>14<span class="cite-bracket">]</span></a></sup>
</p>
<div class="mw-heading mw-heading4"><h4 id="AI-generated_content">AI-generated content</h4><span class="mw-editsection"><span class="mw-editsection-bracket">[</span><a href="/enwiki/w/index.php?title=AI_takeover&action=edit&section=7" title="Edit section's source code: AI-generated content"><span>edit source</span></a><span class="mw-editsection-bracket">]</span></span></div>
<link rel="mw-deduplicated-inline-style" href="mw-data:TemplateStyles:r1236090951"><div role="note" class="hatnote navigation-not-searchable">See also: <a href="/enwiki/wiki/Artificial_intelligence_art" title="Artificial intelligence art">Artificial intelligence art</a></div>
<p>The use of automated content has become relevant since the technological advancements in artificial intelligence models such as <a href="/enwiki/wiki/ChatGPT" title="ChatGPT">ChatGPT</a>, <a href="/enwiki/wiki/DALL-E" title="DALL-E">DALL-E</a>, and <a href="/enwiki/wiki/Stable_Diffusion" title="Stable Diffusion">Stable Diffusion</a>. In most cases, AI-generated content such as imagery, literature, and music are produced through text prompts and these AI models have been integrated into other creative programs. Artists are threatened by displacement from AI-generated content due to these models sampling from other creative works, producing results sometimes indiscernible to those of man-made content. This complication has become widespread enough to where other artists and programmers are creating software and utility programs to retaliate against these text-to-image models from giving accurate outputs. While some industries in the economy benefit from artificial intelligence through new jobs, this issue does not create new jobs and threatens replacement entirely. It has made public headlines in the media recently: In February 2024, <a href="/enwiki/wiki/Willy%27s_Chocolate_Experience" title="Willy's Chocolate Experience">Willy's Chocolate Experience</a> in <a href="/enwiki/wiki/Glasgow,_Scotland" class="mw-redirect" title="Glasgow, Scotland">Glasgow, Scotland</a> was an infamous children's event in which the imagery and scripts were created using artificial intelligence models to the dismay of children, parents, and actors involved. There is an ongoing lawsuit placed against <a href="/enwiki/wiki/OpenAI" title="OpenAI">OpenAI</a> from <a href="/enwiki/wiki/The_New_York_Times" title="The New York Times">The New York Times</a> where it is claimed that there is copyright infringement due to the sampling methods their artificial intelligence models use for their outputs. <sup id="cite_ref-15" class="reference"><a href="#cite_note-15"><span class="cite-bracket">[</span>15<span class="cite-bracket">]</span></a></sup><sup id="cite_ref-16" class="reference"><a href="#cite_note-16"><span class="cite-bracket">[</span>16<span class="cite-bracket">]</span></a></sup><sup id="cite_ref-17" class="reference"><a href="#cite_note-17"><span class="cite-bracket">[</span>17<span class="cite-bracket">]</span></a></sup><sup id="cite_ref-18" class="reference"><a href="#cite_note-18"><span class="cite-bracket">[</span>18<span class="cite-bracket">]</span></a></sup><sup id="cite_ref-19" class="reference"><a href="#cite_note-19"><span class="cite-bracket">[</span>19<span class="cite-bracket">]</span></a></sup>
</p>
<div class="mw-heading mw-heading3"><h3 id="Eradication">Eradication</h3><span class="mw-editsection"><span class="mw-editsection-bracket">[</span><a href="/enwiki/w/index.php?title=AI_takeover&action=edit&section=8" title="Edit section's source code: Eradication"><span>edit source</span></a><span class="mw-editsection-bracket">]</span></span></div>
<link rel="mw-deduplicated-inline-style" href="mw-data:TemplateStyles:r1236090951"><div role="note" class="hatnote navigation-not-searchable">Main article: <a href="/enwiki/wiki/Existential_risk_from_artificial_general_intelligence" title="Existential risk from artificial general intelligence">Existential risk from artificial general intelligence</a></div>
<p>Scientists such as <a href="/enwiki/wiki/Stephen_Hawking" title="Stephen Hawking">Stephen Hawking</a> are confident that superhuman artificial intelligence is physically possible, stating "there is no physical law precluding particles from being organised in ways that perform even more advanced computations than the arrangements of particles in human brains".<sup id="cite_ref-20" class="reference"><a href="#cite_note-20"><span class="cite-bracket">[</span>20<span class="cite-bracket">]</span></a></sup><sup id="cite_ref-21" class="reference"><a href="#cite_note-21"><span class="cite-bracket">[</span>21<span class="cite-bracket">]</span></a></sup> Scholars like <a href="/enwiki/wiki/Nick_Bostrom" title="Nick Bostrom">Nick Bostrom</a> debate how far off superhuman intelligence is, and whether it poses a risk to mankind. According to Bostrom, a superintelligent machine would not necessarily be motivated by the same <i>emotional</i> desire to collect power that often drives human beings but might rather treat power as a means toward attaining its ultimate goals; taking over the world would both increase its access to resources and help to prevent other agents from stopping the machine's plans. As an oversimplified example, a <a href="/enwiki/wiki/Instrumental_convergence#Paperclip_maximizer" title="Instrumental convergence">paperclip maximizer</a> designed solely to create as many paperclips as possible would want to take over the world so that it can use all of the world's resources to create as many paperclips as possible, and, additionally, prevent humans from shutting it down or using those resources on things other than paperclips.<sup id="cite_ref-22" class="reference"><a href="#cite_note-22"><span class="cite-bracket">[</span>22<span class="cite-bracket">]</span></a></sup>
</p>
<div class="mw-heading mw-heading2"><h2 id="In_fiction">In fiction</h2><span class="mw-editsection"><span class="mw-editsection-bracket">[</span><a href="/enwiki/w/index.php?title=AI_takeover&action=edit&section=9" title="Edit section's source code: In fiction"><span>edit source</span></a><span class="mw-editsection-bracket">]</span></span></div>
<link rel="mw-deduplicated-inline-style" href="mw-data:TemplateStyles:r1236090951"><div role="note" class="hatnote navigation-not-searchable">Main article: <a href="/enwiki/wiki/AI_takeovers_in_popular_culture" class="mw-redirect" title="AI takeovers in popular culture">AI takeovers in popular culture</a></div>
<link rel="mw-deduplicated-inline-style" href="mw-data:TemplateStyles:r1236090951"><div role="note" class="hatnote navigation-not-searchable">See also: <a href="/enwiki/wiki/Artificial_intelligence_in_fiction" title="Artificial intelligence in fiction">Artificial intelligence in fiction</a> and <a href="/enwiki/wiki/Self-replicating_machines_in_fiction" class="mw-redirect" title="Self-replicating machines in fiction">Self-replicating machines in fiction</a></div>
<p>AI takeover is a common theme in <a href="/enwiki/wiki/Science_fiction" title="Science fiction">science fiction</a>. Fictional scenarios typically differ vastly from those hypothesized by researchers in that they involve an active conflict between humans and an AI or robots with anthropomorphic motives who see them as a threat or otherwise have active desire to fight humans, as opposed to the researchers' concern of an AI that rapidly exterminates humans as a byproduct of pursuing its goals.<sup id="cite_ref-bostrom-superintelligence_23-0" class="reference"><a href="#cite_note-bostrom-superintelligence-23"><span class="cite-bracket">[</span>23<span class="cite-bracket">]</span></a></sup> The idea is seen in <a href="/enwiki/wiki/Karel_%C4%8Capek" title="Karel Čapek">Karel Čapek</a>'s <i><a href="/enwiki/wiki/R.U.R." title="R.U.R.">R.U.R.</a></i>, which introduced the word <i>robot</i> in 1921,<sup id="cite_ref-24" class="reference"><a href="#cite_note-24"><span class="cite-bracket">[</span>24<span class="cite-bracket">]</span></a></sup> and can be glimpsed in <a href="/enwiki/wiki/Mary_Shelley" title="Mary Shelley">Mary Shelley</a>'s <i><a href="/enwiki/wiki/Frankenstein" title="Frankenstein">Frankenstein</a></i> (published in 1818), as Victor ponders whether, if he grants <a href="/enwiki/wiki/Frankenstein%27s_monster" title="Frankenstein's monster">his monster's</a> request and makes him a wife, they would reproduce and their kind would destroy humanity.<sup id="cite_ref-25" class="reference"><a href="#cite_note-25"><span class="cite-bracket">[</span>25<span class="cite-bracket">]</span></a></sup>
</p><p>According to <a href="/enwiki/wiki/Toby_Ord" title="Toby Ord">Toby Ord</a>, the idea that an AI takeover requires robots is a misconception driven by the media and Hollywood. He argues that the most damaging humans in history were not physically the strongest, but that they used words instead to convince people and gain control of large parts of the world. He writes that a <i>sufficiently</i> intelligent AI with an access to the internet could scatter backup copies of itself, gather financial and human resources (via cyberattacks or blackmails), persuade people on a large scale, and exploit societal vulnerabilities that are too subtle for humans to anticipate.<sup id="cite_ref-26" class="reference"><a href="#cite_note-26"><span class="cite-bracket">[</span>26<span class="cite-bracket">]</span></a></sup>
</p><p>The word "robot" from <i>R.U.R.</i> comes from the Czech word, <i>robota</i>, meaning laborer or <a href="/enwiki/wiki/Serf" class="mw-redirect" title="Serf">serf</a>. The 1920 play was a protest against the rapid growth of technology, featuring manufactured "robots" with increasing capabilities who eventually revolt.<sup id="cite_ref-surgery_27-0" class="reference"><a href="#cite_note-surgery-27"><span class="cite-bracket">[</span>27<span class="cite-bracket">]</span></a></sup> <a href="/enwiki/wiki/HAL_9000" title="HAL 9000">HAL 9000</a> (1968) and the original <a href="/enwiki/wiki/Terminator_(character)" title="Terminator (character)">Terminator</a> (1984) are two iconic examples of hostile AI in pop culture.<sup id="cite_ref-28" class="reference"><a href="#cite_note-28"><span class="cite-bracket">[</span>28<span class="cite-bracket">]</span></a></sup>
</p>
<div class="mw-heading mw-heading2"><h2 id="Contributing_factors">Contributing factors</h2><span class="mw-editsection"><span class="mw-editsection-bracket">[</span><a href="/enwiki/w/index.php?title=AI_takeover&action=edit&section=10" title="Edit section's source code: Contributing factors"><span>edit source</span></a><span class="mw-editsection-bracket">]</span></span></div>
<div class="mw-heading mw-heading3"><h3 id="Advantages_of_superhuman_intelligence_over_humans">Advantages of superhuman intelligence over humans</h3><span class="mw-editsection"><span class="mw-editsection-bracket">[</span><a href="/enwiki/w/index.php?title=AI_takeover&action=edit&section=11" title="Edit section's source code: Advantages of superhuman intelligence over humans"><span>edit source</span></a><span class="mw-editsection-bracket">]</span></span></div>
<p><a href="/enwiki/wiki/Nick_Bostrom" title="Nick Bostrom">Nick Bostrom</a> and others have expressed concern that an AI with the abilities of a competent artificial intelligence researcher would be able to modify its own source code and increase its own intelligence. If its self-reprogramming leads to getting even better at being able to reprogram itself, the result could be a recursive <a href="/enwiki/wiki/Intelligence_explosion" class="mw-redirect" title="Intelligence explosion">intelligence explosion</a> in which it would rapidly leave human intelligence far behind. Bostrom defines a superintelligence as "any intellect that greatly exceeds the cognitive performance of humans in virtually all domains of interest", and enumerates some advantages a superintelligence would have if it chose to compete against humans:<sup id="cite_ref-bostrom-superintelligence_23-1" class="reference"><a href="#cite_note-bostrom-superintelligence-23"><span class="cite-bracket">[</span>23<span class="cite-bracket">]</span></a></sup><sup id="cite_ref-BabcockKrámar2019_29-0" class="reference"><a href="#cite_note-BabcockKrámar2019-29"><span class="cite-bracket">[</span>29<span class="cite-bracket">]</span></a></sup>
</p>
<ul><li>Technology research: A machine with superhuman scientific research abilities would be able to beat the human research community to milestones such as nanotechnology or advanced biotechnology</li>
<li><a href="/enwiki/wiki/Strategy" title="Strategy">Strategizing</a>: A superintelligence might be able to simply outwit human opposition</li>
<li>Social manipulation: A superintelligence might be able to recruit human support,<sup id="cite_ref-bostrom-superintelligence_23-2" class="reference"><a href="#cite_note-bostrom-superintelligence-23"><span class="cite-bracket">[</span>23<span class="cite-bracket">]</span></a></sup> or covertly incite a war between humans<sup id="cite_ref-30" class="reference"><a href="#cite_note-30"><span class="cite-bracket">[</span>30<span class="cite-bracket">]</span></a></sup></li>
<li>Economic productivity: As long as a copy of the AI could produce more economic wealth than the cost of its hardware, individual humans would have an incentive to voluntarily allow the <a href="/enwiki/wiki/Artificial_General_Intelligence" class="mw-redirect" title="Artificial General Intelligence">Artificial General Intelligence</a> (AGI) to run a copy of itself on their systems</li>
<li>Hacking: A superintelligence could find new exploits in computers connected to the Internet, and spread copies of itself onto those systems, or might steal money to finance its plans</li></ul>
<div class="mw-heading mw-heading4"><h4 id="Sources_of_AI_advantage">Sources of AI advantage</h4><span class="mw-editsection"><span class="mw-editsection-bracket">[</span><a href="/enwiki/w/index.php?title=AI_takeover&action=edit&section=12" title="Edit section's source code: Sources of AI advantage"><span>edit source</span></a><span class="mw-editsection-bracket">]</span></span></div>
<p>According to Bostrom, a computer program that faithfully emulates a human brain, or that runs algorithms that are as powerful as the human brain's algorithms, could still become a "speed superintelligence" if it can think orders of magnitude faster than a human, due to being made of silicon rather than flesh, or due to optimization increasing the speed of the AGI. Biological neurons operate at about 200 Hz, whereas a modern microprocessor operates at a speed of about 2,000,000,000 Hz. Human axons carry action potentials at around 120 m/s, whereas computer signals travel near the speed of light.<sup id="cite_ref-bostrom-superintelligence_23-3" class="reference"><a href="#cite_note-bostrom-superintelligence-23"><span class="cite-bracket">[</span>23<span class="cite-bracket">]</span></a></sup>
</p><p>A network of human-level intelligences designed to network together and share complex thoughts and memories seamlessly, able to collectively work as a giant unified team without friction, or consisting of trillions of human-level intelligences, would become a "collective superintelligence".<sup id="cite_ref-bostrom-superintelligence_23-4" class="reference"><a href="#cite_note-bostrom-superintelligence-23"><span class="cite-bracket">[</span>23<span class="cite-bracket">]</span></a></sup>
</p><p>More broadly, any number of qualitative improvements to a human-level AGI could result in a "quality superintelligence", perhaps resulting in an AGI as far above us in intelligence as humans are above apes. The number of neurons in a human brain is limited by cranial volume and metabolic constraints, while the number of processors in a supercomputer can be indefinitely expanded. An AGI need not be limited by human constraints on <a href="/enwiki/wiki/Working_memory" title="Working memory">working memory</a>, and might therefore be able to intuitively grasp more complex relationships than humans can. An AGI with specialized cognitive support for engineering or computer programming would have an advantage in these fields, compared with humans who evolved no specialized mental modules to specifically deal with those domains. Unlike humans, an AGI can spawn copies of itself and tinker with its copies' source code to attempt to further improve its algorithms.<sup id="cite_ref-bostrom-superintelligence_23-5" class="reference"><a href="#cite_note-bostrom-superintelligence-23"><span class="cite-bracket">[</span>23<span class="cite-bracket">]</span></a></sup>
</p>
<div class="mw-heading mw-heading3"><h3 id="Possibility_of_unfriendly_AI_preceding_friendly_AI">Possibility of unfriendly AI preceding friendly AI</h3><span class="mw-editsection"><span class="mw-editsection-bracket">[</span><a href="/enwiki/w/index.php?title=AI_takeover&action=edit&section=13" title="Edit section's source code: Possibility of unfriendly AI preceding friendly AI"><span>edit source</span></a><span class="mw-editsection-bracket">]</span></span></div>
<div class="mw-heading mw-heading4"><h4 id="Is_strong_AI_inherently_dangerous?"><span id="Is_strong_AI_inherently_dangerous.3F"></span>Is strong AI inherently dangerous?</h4><span class="mw-editsection"><span class="mw-editsection-bracket">[</span><a href="/enwiki/w/index.php?title=AI_takeover&action=edit&section=14" title="Edit section's source code: Is strong AI inherently dangerous?"><span>edit source</span></a><span class="mw-editsection-bracket">]</span></span></div>
<link rel="mw-deduplicated-inline-style" href="mw-data:TemplateStyles:r1236090951"><div role="note" class="hatnote navigation-not-searchable">Main article: <a href="/enwiki/wiki/AI_alignment" title="AI alignment">AI alignment</a></div>
<p>A significant problem is that unfriendly artificial intelligence is likely to be much easier to create than friendly AI. While both require large advances in recursive optimisation process design, friendly AI also requires the ability to make goal structures invariant under self-improvement (or the AI could transform itself into something unfriendly) and a goal structure that aligns with human values and does not undergo <a href="/enwiki/wiki/Instrumental_convergence" title="Instrumental convergence">instrumental convergence</a> in ways that may automatically destroy the entire human race. An unfriendly AI, on the other hand, can optimize for an arbitrary goal structure, which does not need to be invariant under self-modification.<sup id="cite_ref-singinst12_31-0" class="reference"><a href="#cite_note-singinst12-31"><span class="cite-bracket">[</span>31<span class="cite-bracket">]</span></a></sup>
</p><p>The sheer complexity of human value systems makes it very difficult to make AI's motivations human-friendly.<sup id="cite_ref-bostrom-superintelligence_23-6" class="reference"><a href="#cite_note-bostrom-superintelligence-23"><span class="cite-bracket">[</span>23<span class="cite-bracket">]</span></a></sup><sup id="cite_ref-Muehlhauser,_Luke_2012_32-0" class="reference"><a href="#cite_note-Muehlhauser,_Luke_2012-32"><span class="cite-bracket">[</span>32<span class="cite-bracket">]</span></a></sup> Unless moral philosophy provides us with a flawless ethical theory, an AI's utility function could allow for many potentially harmful scenarios that conform with a given ethical framework but not "common sense". According to <a href="/enwiki/wiki/Eliezer_Yudkowsky" title="Eliezer Yudkowsky">Eliezer Yudkowsky</a>, there is little reason to suppose that an artificially designed mind would have such an adaptation.<sup id="cite_ref-Yudkowsky2011_33-0" class="reference"><a href="#cite_note-Yudkowsky2011-33"><span class="cite-bracket">[</span>33<span class="cite-bracket">]</span></a></sup>
</p>
<div class="mw-heading mw-heading4"><h4 id="Odds_of_conflict">Odds of conflict</h4><span class="mw-editsection"><span class="mw-editsection-bracket">[</span><a href="/enwiki/w/index.php?title=AI_takeover&action=edit&section=15" title="Edit section's source code: Odds of conflict"><span>edit source</span></a><span class="mw-editsection-bracket">]</span></span></div>
<p>Many scholars, including evolutionary psychologist <a href="/enwiki/wiki/Steven_Pinker" title="Steven Pinker">Steven Pinker</a>, argue that a superintelligent machine is likely to coexist peacefully with humans.<sup id="cite_ref-pinker_now_34-0" class="reference"><a href="#cite_note-pinker_now-34"><span class="cite-bracket">[</span>34<span class="cite-bracket">]</span></a></sup>
</p><p>The fear of cybernetic revolt is often based on interpretations of humanity's history, which is rife with incidents of enslavement and genocide. Such fears stem from a belief that competitiveness and aggression are necessary in any intelligent being's goal system. However, such human competitiveness stems from the evolutionary background to our intelligence, where the survival and reproduction of genes in the face of human and non-human competitors was the central goal.<sup id="cite_ref-35" class="reference"><a href="#cite_note-35"><span class="cite-bracket">[</span>35<span class="cite-bracket">]</span></a></sup> According to AI researcher <a href="/enwiki/wiki/Steve_Omohundro" title="Steve Omohundro">Steve Omohundro</a>, an arbitrary intelligence could have arbitrary goals: there is no particular reason that an artificially intelligent machine (not sharing humanity's evolutionary context) would be hostile—or friendly—unless its creator programs it to be such and it is not inclined or capable of modifying its programming. But the question remains: what would happen if AI systems could interact and evolve (evolution in this context means self-modification or selection and reproduction) and need to compete over resources—would that create goals of self-preservation? AI's goal of self-preservation could be in conflict with some goals of humans.<sup id="cite_ref-36" class="reference"><a href="#cite_note-36"><span class="cite-bracket">[</span>36<span class="cite-bracket">]</span></a></sup>
</p><p>Many scholars dispute the likelihood of unanticipated cybernetic revolt as depicted in science fiction such as <i><a href="/enwiki/wiki/The_Matrix" title="The Matrix">The Matrix</a></i>, arguing that it is more likely that any artificial intelligence powerful enough to threaten humanity would probably be programmed not to attack it. Pinker acknowledges the possibility of deliberate "bad actors", but states that in the absence of bad actors, unanticipated accidents are not a significant threat; Pinker argues that a culture of engineering safety will prevent AI researchers from accidentally unleashing malign superintelligence.<sup id="cite_ref-pinker_now_34-1" class="reference"><a href="#cite_note-pinker_now-34"><span class="cite-bracket">[</span>34<span class="cite-bracket">]</span></a></sup> In contrast, Yudkowsky argues that humanity is less likely to be threatened by deliberately aggressive AIs than by AIs which were programmed such that their <a href="/enwiki/wiki/Unintended_consequence" class="mw-redirect" title="Unintended consequence">goals are unintentionally incompatible</a> with human survival or well-being (as in the film <i><a href="/enwiki/wiki/I,_Robot_(film)" title="I, Robot (film)">I, Robot</a></i> and in the short story "<a href="/enwiki/wiki/The_Evitable_Conflict" title="The Evitable Conflict">The Evitable Conflict</a>"). Omohundro suggests that present-day automation systems are not <a href="/enwiki/wiki/AI_safety" title="AI safety">designed for safety</a> and that AIs may blindly optimize narrow <a href="/enwiki/wiki/Utility" title="Utility">utility</a> functions (say, playing chess at all costs), leading them to seek self-preservation and elimination of obstacles, including humans who might turn them off.<sup id="cite_ref-Tucker2014_37-0" class="reference"><a href="#cite_note-Tucker2014-37"><span class="cite-bracket">[</span>37<span class="cite-bracket">]</span></a></sup>
</p>
<div class="mw-heading mw-heading4"><h4 id="Precautions">Precautions</h4><span class="mw-editsection"><span class="mw-editsection-bracket">[</span><a href="/enwiki/w/index.php?title=AI_takeover&action=edit&section=16" title="Edit section's source code: Precautions"><span>edit source</span></a><span class="mw-editsection-bracket">]</span></span></div>
<link rel="mw-deduplicated-inline-style" href="mw-data:TemplateStyles:r1236090951"><div role="note" class="hatnote navigation-not-searchable">Main article: <a href="/enwiki/wiki/AI_control_problem" class="mw-redirect" title="AI control problem">AI control problem</a></div>
<p>The <b>AI control problem</b> is the issue of how to build a <a href="/enwiki/wiki/Superintelligence" title="Superintelligence">superintelligent</a> agent that will aid its creators, while avoiding inadvertently building a superintelligence that will harm its creators.<sup id="cite_ref-38" class="reference"><a href="#cite_note-38"><span class="cite-bracket">[</span>38<span class="cite-bracket">]</span></a></sup> Some scholars argue that solutions to the control problem might also find applications in existing non-superintelligent AI.<sup id="cite_ref-bbc-google_39-0" class="reference"><a href="#cite_note-bbc-google-39"><span class="cite-bracket">[</span>39<span class="cite-bracket">]</span></a></sup>
</p><p>Major approaches to the control problem include <i>alignment</i>, which aims to align AI goal systems with human values, and <i>capability control</i>, which aims to reduce an AI system's capacity to harm humans or gain control. An example of "capability control" is to research whether a superintelligence AI could be successfully confined in an "<a href="/enwiki/wiki/AI_box" class="mw-redirect" title="AI box">AI box</a>". According to Bostrom, such capability control proposals are not reliable or sufficient to solve the control problem in the long term, but may potentially act as valuable supplements to alignment efforts.<sup id="cite_ref-bostrom-superintelligence_23-7" class="reference"><a href="#cite_note-bostrom-superintelligence-23"><span class="cite-bracket">[</span>23<span class="cite-bracket">]</span></a></sup>
</p>
<div class="mw-heading mw-heading2"><h2 id="Warnings">Warnings</h2><span class="mw-editsection"><span class="mw-editsection-bracket">[</span><a href="/enwiki/w/index.php?title=AI_takeover&action=edit&section=17" title="Edit section's source code: Warnings"><span>edit source</span></a><span class="mw-editsection-bracket">]</span></span></div>
<p>Physicist <a href="/enwiki/wiki/Stephen_Hawking" title="Stephen Hawking">Stephen Hawking</a>, <a href="/enwiki/wiki/Microsoft" title="Microsoft">Microsoft</a> founder <a href="/enwiki/wiki/Bill_Gates" title="Bill Gates">Bill Gates</a>, and <a href="/enwiki/wiki/SpaceX" title="SpaceX">SpaceX</a> founder <a href="/enwiki/wiki/Elon_Musk" title="Elon Musk">Elon Musk</a> have expressed concerns about the possibility that AI could develop to the point that humans could not control it, with Hawking theorizing that this could "spell the end of the human race".<sup id="cite_ref-40" class="reference"><a href="#cite_note-40"><span class="cite-bracket">[</span>40<span class="cite-bracket">]</span></a></sup> Stephen Hawking said in 2014 that "Success in creating AI would be the biggest event in human history. Unfortunately, it might also be the last, unless we learn how to avoid the risks." Hawking believed that in the coming decades, AI could offer "incalculable benefits and risks" such as "technology outsmarting <a href="/enwiki/wiki/Financial_market" title="Financial market">financial markets</a>, out-inventing human researchers, out-manipulating human leaders, and developing weapons we cannot even understand." In January 2015, <a href="/enwiki/wiki/Nick_Bostrom" title="Nick Bostrom">Nick Bostrom</a> joined Stephen Hawking, <a href="/enwiki/wiki/Max_Tegmark" title="Max Tegmark">Max Tegmark</a>, Elon Musk, Lord <a href="/enwiki/wiki/Martin_Rees,_Baron_Rees_of_Ludlow" class="mw-redirect" title="Martin Rees, Baron Rees of Ludlow">Martin Rees</a>, <a href="/enwiki/wiki/Jaan_Tallinn" title="Jaan Tallinn">Jaan Tallinn</a>, and numerous AI researchers in signing the <a href="/enwiki/wiki/Future_of_Life_Institute" title="Future of Life Institute">Future of Life Institute</a>'s open letter speaking to the potential risks and benefits associated with <a href="/enwiki/wiki/Artificial_intelligence" title="Artificial intelligence">artificial intelligence</a>. The signatories "believe that research on how to make AI systems robust and beneficial is both important and timely, and that there are concrete research directions that can be pursued today."<sup id="cite_ref-41" class="reference"><a href="#cite_note-41"><span class="cite-bracket">[</span>41<span class="cite-bracket">]</span></a></sup><sup id="cite_ref-42" class="reference"><a href="#cite_note-42"><span class="cite-bracket">[</span>42<span class="cite-bracket">]</span></a></sup>
</p><p>Arthur C. Clarke's Odyssey series and Charles Stross's Accelerando relate to humanity's narcissistic injuries in the face of powerful artificial intelligences threatening humanity's self-perception.<sup id="cite_ref-43" class="reference"><a href="#cite_note-43"><span class="cite-bracket">[</span>43<span class="cite-bracket">]</span></a></sup>
</p>
<div class="mw-heading mw-heading2"><h2 id="Prevention_through_AI_alignment">Prevention through AI alignment</h2><span class="mw-editsection"><span class="mw-editsection-bracket">[</span><a href="/enwiki/w/index.php?title=AI_takeover&action=edit&section=18" title="Edit section's source code: Prevention through AI alignment"><span>edit source</span></a><span class="mw-editsection-bracket">]</span></span></div>
<div class="excerpt-block"><style data-mw-deduplicate="TemplateStyles:r1066933788">.mw-parser-output .excerpt-hat .mw-editsection-like{font-style:normal}</style><link rel="mw-deduplicated-inline-style" href="mw-data:TemplateStyles:r1236090951"><div role="note" class="hatnote navigation-not-searchable dablink excerpt-hat selfref">This paragraph is an excerpt from <a href="/enwiki/wiki/AI_alignment" title="AI alignment">AI alignment</a>.<span class="mw-editsection-like plainlinks"><span class="mw-editsection-bracket">[</span><a class="external text" href="https://en.wikipedia.org/enwiki/w/index.php?title=AI_alignment&action=edit">edit</a><span class="mw-editsection-bracket">]</span></span></div><div class="excerpt">
In the field of <a href="/enwiki/wiki/Artificial_intelligence" title="Artificial intelligence">artificial intelligence</a> (AI), <a href="/enwiki/wiki/AI_alignment" title="AI alignment">AI alignment</a> aims to steer AI systems toward a person's or group's intended goals, preferences, and ethical principles. An AI system is considered <i>aligned</i> if it advances the intended objectives. A <i>misaligned</i> AI system pursues unintended objectives.<sup id="cite_ref-AI_alignment_aima4_44-0" class="reference"><a href="#cite_note-AI_alignment_aima4-44"><span class="cite-bracket">[</span>44<span class="cite-bracket">]</span></a></sup></div></div>
<div class="mw-heading mw-heading2"><h2 id="See_also">See also</h2><span class="mw-editsection"><span class="mw-editsection-bracket">[</span><a href="/enwiki/w/index.php?title=AI_takeover&action=edit&section=19" title="Edit section's source code: See also"><span>edit source</span></a><span class="mw-editsection-bracket">]</span></span></div>
<style data-mw-deduplicate="TemplateStyles:r1184024115">.mw-parser-output .div-col{margin-top:0.3em;column-width:30em}.mw-parser-output .div-col-small{font-size:90%}.mw-parser-output .div-col-rules{column-rule:1px solid #aaa}.mw-parser-output .div-col dl,.mw-parser-output .div-col ol,.mw-parser-output .div-col ul{margin-top:0}.mw-parser-output .div-col li,.mw-parser-output .div-col dd{page-break-inside:avoid;break-inside:avoid-column}</style><div class="div-col" style="column-width: 30em;">
<ul><li><a href="/enwiki/wiki/Philosophy_of_artificial_intelligence" title="Philosophy of artificial intelligence">Philosophy of artificial intelligence</a></li>
<li><a href="/enwiki/wiki/Artificial_intelligence_arms_race" title="Artificial intelligence arms race">Artificial intelligence arms race</a></li>
<li><a href="/enwiki/wiki/Autonomous_robot" title="Autonomous robot">Autonomous robot</a>
<ul><li><a href="/enwiki/wiki/Industrial_robot" title="Industrial robot">Industrial robot</a></li>
<li><a href="/enwiki/wiki/Mobile_robot" title="Mobile robot">Mobile robot</a></li>
<li><a href="/enwiki/wiki/Self-replicating_machine" title="Self-replicating machine">Self-replicating machine</a></li></ul></li>
<li><a href="/enwiki/wiki/Cyberocracy" title="Cyberocracy">Cyberocracy</a></li>
<li><a href="/enwiki/wiki/Effective_altruism" title="Effective altruism">Effective altruism</a></li>
<li><a href="/enwiki/wiki/Existential_risk_from_artificial_general_intelligence" title="Existential risk from artificial general intelligence">Existential risk from artificial general intelligence</a></li>
<li><a href="/enwiki/wiki/Future_of_Humanity_Institute" title="Future of Humanity Institute">Future of Humanity Institute</a></li>
<li><a href="/enwiki/wiki/Global_catastrophic_risk" title="Global catastrophic risk">Global catastrophic risk</a> (existential risk)</li>
<li><a href="/enwiki/wiki/Government_by_algorithm" title="Government by algorithm">Government by algorithm</a></li>
<li><a href="/enwiki/wiki/Human_extinction" title="Human extinction">Human extinction</a></li>
<li><a href="/enwiki/wiki/Machine_ethics" title="Machine ethics">Machine ethics</a></li>
<li><a href="/enwiki/wiki/Machine_learning" title="Machine learning">Machine learning</a>/<a href="/enwiki/wiki/Deep_learning" title="Deep learning">Deep learning</a></li>
<li><a href="/enwiki/wiki/Transhumanism" title="Transhumanism">Transhumanism</a></li>
<li><a href="/enwiki/wiki/Self-replication" title="Self-replication">Self-replication</a></li>
<li><a href="/enwiki/wiki/Technophobia" title="Technophobia">Technophobia</a></li>
<li><a href="/enwiki/wiki/Technological_singularity" title="Technological singularity">Technological singularity</a>
<ul><li><a href="/enwiki/wiki/Intelligence_explosion" class="mw-redirect" title="Intelligence explosion">Intelligence explosion</a></li>
<li><a href="/enwiki/wiki/Superintelligence" title="Superintelligence">Superintelligence</a>
<ul><li><i><a href="/enwiki/wiki/Superintelligence:_Paths,_Dangers,_Strategies" title="Superintelligence: Paths, Dangers, Strategies">Superintelligence: Paths, Dangers, Strategies</a></i></li></ul></li></ul></li></ul>
</div>
<div class="mw-heading mw-heading2"><h2 id="Notes">Notes</h2><span class="mw-editsection"><span class="mw-editsection-bracket">[</span><a href="/enwiki/w/index.php?title=AI_takeover&action=edit&section=20" title="Edit section's source code: Notes"><span>edit source</span></a><span class="mw-editsection-bracket">]</span></span></div>
<style data-mw-deduplicate="TemplateStyles:r1239543626">.mw-parser-output .reflist{margin-bottom:0.5em;list-style-type:decimal}@media screen{.mw-parser-output .reflist{font-size:90%}}.mw-parser-output .reflist .references{font-size:100%;margin-bottom:0;list-style-type:inherit}.mw-parser-output .reflist-columns-2{column-width:30em}.mw-parser-output .reflist-columns-3{column-width:25em}.mw-parser-output .reflist-columns{margin-top:0.3em}.mw-parser-output .reflist-columns ol{margin-top:0}.mw-parser-output .reflist-columns li{page-break-inside:avoid;break-inside:avoid-column}.mw-parser-output .reflist-upper-alpha{list-style-type:upper-alpha}.mw-parser-output .reflist-upper-roman{list-style-type:upper-roman}.mw-parser-output .reflist-lower-alpha{list-style-type:lower-alpha}.mw-parser-output .reflist-lower-greek{list-style-type:lower-greek}.mw-parser-output .reflist-lower-roman{list-style-type:lower-roman}</style><div class="reflist reflist-lower-alpha">
</div>
<div class="mw-heading mw-heading2"><h2 id="References">References</h2><span class="mw-editsection"><span class="mw-editsection-bracket">[</span><a href="/enwiki/w/index.php?title=AI_takeover&action=edit&section=21" title="Edit section's source code: References"><span>edit source</span></a><span class="mw-editsection-bracket">]</span></span></div>
<link rel="mw-deduplicated-inline-style" href="mw-data:TemplateStyles:r1239543626"><div class="reflist">
<div class="mw-references-wrap mw-references-columns"><ol class="references">
<li id="cite_note-1"><span class="mw-cite-backlink"><b><a href="#cite_ref-1">^</a></b></span> <span class="reference-text"><style data-mw-deduplicate="TemplateStyles:r1238218222">.mw-parser-output cite.citation{font-style:inherit;word-wrap:break-word}.mw-parser-output .citation q{quotes:"\"""\"""'""'"}.mw-parser-output .citation:target{background-color:rgba(0,127,255,0.133)}.mw-parser-output .id-lock-free.id-lock-free a{background:url("/upwiki/wikipedia/commons/6/65/Lock-green.svg")right 0.1em center/9px no-repeat}.mw-parser-output .id-lock-limited.id-lock-limited a,.mw-parser-output .id-lock-registration.id-lock-registration a{background:url("/upwiki/wikipedia/commons/d/d6/Lock-gray-alt-2.svg")right 0.1em center/9px no-repeat}.mw-parser-output .id-lock-subscription.id-lock-subscription a{background:url("/upwiki/wikipedia/commons/a/aa/Lock-red-alt-2.svg")right 0.1em center/9px no-repeat}.mw-parser-output .cs1-ws-icon a{background:url("/upwiki/wikipedia/commons/4/4c/Wikisource-logo.svg")right 0.1em center/12px no-repeat}body:not(.skin-timeless):not(.skin-minerva) .mw-parser-output .id-lock-free a,body:not(.skin-timeless):not(.skin-minerva) .mw-parser-output .id-lock-limited a,body:not(.skin-timeless):not(.skin-minerva) .mw-parser-output .id-lock-registration a,body:not(.skin-timeless):not(.skin-minerva) .mw-parser-output .id-lock-subscription a,body:not(.skin-timeless):not(.skin-minerva) .mw-parser-output .cs1-ws-icon a{background-size:contain;padding:0 1em 0 0}.mw-parser-output .cs1-code{color:inherit;background:inherit;border:none;padding:inherit}.mw-parser-output .cs1-hidden-error{display:none;color:var(--color-error,#d33)}.mw-parser-output .cs1-visible-error{color:var(--color-error,#d33)}.mw-parser-output .cs1-maint{display:none;color:#085;margin-left:0.3em}.mw-parser-output .cs1-kern-left{padding-left:0.2em}.mw-parser-output .cs1-kern-right{padding-right:0.2em}.mw-parser-output .citation .mw-selflink{font-weight:inherit}@media screen{.mw-parser-output .cs1-format{font-size:95%}html.skin-theme-clientpref-night .mw-parser-output .cs1-maint{color:#18911f}}@media screen and (prefers-color-scheme:dark){html.skin-theme-clientpref-os .mw-parser-output .cs1-maint{color:#18911f}}</style><cite id="CITEREFLewis2015" class="citation web cs1">Lewis, Tanya (2015-01-12). <a rel="nofollow" class="external text" href="http://www.livescience.com/49419-artificial-intelligence-dangers-letter.html">"<i>Don't Let Artificial Intelligence Take Over, Top Scientists Warn</i>"</a>. <i><a href="/enwiki/wiki/LiveScience" class="mw-redirect" title="LiveScience">LiveScience</a></i>. <a href="/enwiki/wiki/Purch" class="mw-redirect" title="Purch">Purch</a>. <a rel="nofollow" class="external text" href="https://web.archive.org/web/20180308100411/https://www.livescience.com/49419-artificial-intelligence-dangers-letter.html">Archived</a> from the original on 2018-03-08<span class="reference-accessdate">. Retrieved <span class="nowrap">October 20,</span> 2015</span>. <q>Stephen Hawking, Elon Musk and dozens of other top scientists and technology leaders have signed a letter warning of the potential dangers of developing artificial intelligence (AI).</q></cite><span title="ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=unknown&rft.jtitle=LiveScience&rft.atitle=Don%27t+Let+Artificial+Intelligence+Take+Over%2C+Top+Scientists+Warn&rft.date=2015-01-12&rft.aulast=Lewis&rft.aufirst=Tanya&rft_id=http%3A%2F%2Fwww.livescience.com%2F49419-artificial-intelligence-dangers-letter.html&rfr_id=info%3Asid%2Fen.wikipedia.org%3AAI+takeover" class="Z3988"></span></span>
</li>
<li id="cite_note-2"><span class="mw-cite-backlink"><b><a href="#cite_ref-2">^</a></b></span> <span class="reference-text"><link rel="mw-deduplicated-inline-style" href="mw-data:TemplateStyles:r1238218222"><cite id="CITEREFLee2017" class="citation web cs1">Lee, Kai-Fu (2017-06-24). <a rel="nofollow" class="external text" href="https://www.nytimes.com/2017/06/24/opinion/sunday/artificial-intelligence-economic-inequality.html">"The Real Threat of Artificial Intelligence"</a>. <i><a href="/enwiki/wiki/The_New_York_Times" title="The New York Times">The New York Times</a></i>. <a rel="nofollow" class="external text" href="https://web.archive.org/web/20200417183307/https://www.nytimes.com/2017/06/24/opinion/sunday/artificial-intelligence-economic-inequality.html">Archived</a> from the original on 2020-04-17<span class="reference-accessdate">. Retrieved <span class="nowrap">2017-08-15</span></span>. <q>These alphas can outperform human beings at a given task. This kind of A.I. is spreading to thousands of domains, and as it does, it will eliminate many jobs.</q></cite><span title="ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=unknown&rft.jtitle=The+New+York+Times&rft.atitle=The+Real+Threat+of+Artificial+Intelligence&rft.date=2017-06-24&rft.aulast=Lee&rft.aufirst=Kai-Fu&rft_id=https%3A%2F%2Fwww.nytimes.com%2F2017%2F06%2F24%2Fopinion%2Fsunday%2Fartificial-intelligence-economic-inequality.html&rfr_id=info%3Asid%2Fen.wikipedia.org%3AAI+takeover" class="Z3988"></span></span>
</li>
<li id="cite_note-3"><span class="mw-cite-backlink"><b><a href="#cite_ref-3">^</a></b></span> <span class="reference-text"><link rel="mw-deduplicated-inline-style" href="mw-data:TemplateStyles:r1238218222"><cite id="CITEREFLarson2017" class="citation web cs1">Larson, Nina (2017-06-08). <a rel="nofollow" class="external text" href="https://phys.org/news/2017-06-ai-good-world-ultra-lifelike-robot.html">"AI 'good for the world'... says ultra-lifelike robot"</a>. <i><a href="/enwiki/wiki/Phys.org" title="Phys.org">Phys.org</a></i>. <a rel="nofollow" class="external text" href="https://web.archive.org/web/20200306021915/https://phys.org/news/2017-06-ai-good-world-ultra-lifelike-robot.html">Archived</a> from the original on 2020-03-06<span class="reference-accessdate">. Retrieved <span class="nowrap">2017-08-15</span></span>. <q>Among the feared consequences of the rise of the robots is the growing impact they will have on human jobs and economies.</q></cite><span title="ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=unknown&rft.jtitle=Phys.org&rft.atitle=AI+%27good+for+the+world%27...+says+ultra-lifelike+robot&rft.date=2017-06-08&rft.aulast=Larson&rft.aufirst=Nina&rft_id=https%3A%2F%2Fphys.org%2Fnews%2F2017-06-ai-good-world-ultra-lifelike-robot.html&rfr_id=info%3Asid%2Fen.wikipedia.org%3AAI+takeover" class="Z3988"></span></span>
</li>
<li id="cite_note-4"><span class="mw-cite-backlink"><b><a href="#cite_ref-4">^</a></b></span> <span class="reference-text"><link rel="mw-deduplicated-inline-style" href="mw-data:TemplateStyles:r1238218222"><cite id="CITEREFSantini2016" class="citation web cs1">Santini, Jean-Louis (2016-02-14). <a rel="nofollow" class="external text" href="https://phys.org/news/2016-02-intelligent-robots-threaten-millions-jobs.html#nRlv">"Intelligent robots threaten millions of jobs"</a>. <i><a href="/enwiki/wiki/Phys.org" title="Phys.org">Phys.org</a></i>. <a rel="nofollow" class="external text" href="https://web.archive.org/web/20190101014340/https://phys.org/news/2016-02-intelligent-robots-threaten-millions-jobs.html#nRlv">Archived</a> from the original on 2019-01-01<span class="reference-accessdate">. Retrieved <span class="nowrap">2017-08-15</span></span>. <q><span class="cs1-kern-left"></span>"We are approaching a time when machines will be able to outperform humans at almost any task," said Moshe Vardi, director of the Institute for Information Technology at Rice University in Texas.</q></cite><span title="ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=unknown&rft.jtitle=Phys.org&rft.atitle=Intelligent+robots+threaten+millions+of+jobs&rft.date=2016-02-14&rft.aulast=Santini&rft.aufirst=Jean-Louis&rft_id=https%3A%2F%2Fphys.org%2Fnews%2F2016-02-intelligent-robots-threaten-millions-jobs.html%23nRlv&rfr_id=info%3Asid%2Fen.wikipedia.org%3AAI+takeover" class="Z3988"></span></span>
</li>
<li id="cite_note-5"><span class="mw-cite-backlink"><b><a href="#cite_ref-5">^</a></b></span> <span class="reference-text"><link rel="mw-deduplicated-inline-style" href="mw-data:TemplateStyles:r1238218222"><cite id="CITEREFWilliams-Grut2016" class="citation web cs1">Williams-Grut, Oscar (2016-02-15). <a rel="nofollow" class="external text" href="http://www.businessinsider.com/robots-will-steal-your-job-citi-ai-increase-unemployment-inequality-2016-2?r=UK&IR=T">"Robots will steal your job: How AI could increase unemployment and inequality"</a>. <i><a href="/enwiki/wiki/Businessinsider.com" class="mw-redirect" title="Businessinsider.com">Businessinsider.com</a></i>. <a href="/enwiki/wiki/Business_Insider" title="Business Insider">Business Insider</a>. <a rel="nofollow" class="external text" href="https://web.archive.org/web/20170816061548/http://www.businessinsider.com/robots-will-steal-your-job-citi-ai-increase-unemployment-inequality-2016-2?r=UK&IR=T">Archived</a> from the original on 2017-08-16<span class="reference-accessdate">. Retrieved <span class="nowrap">2017-08-15</span></span>. <q>Top computer scientists in the US warned that the rise of artificial intelligence (AI) and robots in the workplace could cause mass unemployment and dislocated economies, rather than simply unlocking productivity gains and freeing us all up to watch TV and play sports.</q></cite><span title="ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=unknown&rft.jtitle=Businessinsider.com&rft.atitle=Robots+will+steal+your+job%3A+How+AI+could+increase+unemployment+and+inequality&rft.date=2016-02-15&rft.aulast=Williams-Grut&rft.aufirst=Oscar&rft_id=http%3A%2F%2Fwww.businessinsider.com%2Frobots-will-steal-your-job-citi-ai-increase-unemployment-inequality-2016-2%3Fr%3DUK%26IR%3DT&rfr_id=info%3Asid%2Fen.wikipedia.org%3AAI+takeover" class="Z3988"></span></span>
</li>
<li id="cite_note-6"><span class="mw-cite-backlink"><b><a href="#cite_ref-6">^</a></b></span> <span class="reference-text"><link rel="mw-deduplicated-inline-style" href="mw-data:TemplateStyles:r1238218222"><cite class="citation news cs1"><a rel="nofollow" class="external text" href="https://web.archive.org/web/20171018073852/http://www.leanstaff.co.uk/robot-apocalypse/">"How can SMEs prepare for the rise of the robots?"</a>. <i>LeanStaff</i>. 2017-10-17. Archived from <a rel="nofollow" class="external text" href="http://www.leanstaff.co.uk/robot-apocalypse/">the original</a> on 2017-10-18<span class="reference-accessdate">. Retrieved <span class="nowrap">2017-10-17</span></span>.</cite><span title="ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.jtitle=LeanStaff&rft.atitle=How+can+SMEs+prepare+for+the+rise+of+the+robots%3F&rft.date=2017-10-17&rft_id=http%3A%2F%2Fwww.leanstaff.co.uk%2Frobot-apocalypse%2F&rfr_id=info%3Asid%2Fen.wikipedia.org%3AAI+takeover" class="Z3988"></span></span>
</li>
<li id="cite_note-7"><span class="mw-cite-backlink"><b><a href="#cite_ref-7">^</a></b></span> <span class="reference-text"><link rel="mw-deduplicated-inline-style" href="mw-data:TemplateStyles:r1238218222"><cite id="CITEREFHassan_SoueidanShoghari2024" class="citation journal cs1">Hassan Soueidan, Mohamad; Shoghari, Rodwan (2024-05-09). <a rel="nofollow" class="external text" href="https://techniumscience.com/index.php/socialsciences/article/view/10917">"The Impact of Artificial Intelligence on Job Loss: Risks for Governments"</a>. <i>Technium Social Sciences Journal</i>. <b>57</b>: 206–223. <a href="/enwiki/wiki/Doi_(identifier)" class="mw-redirect" title="Doi (identifier)">doi</a>:<span class="id-lock-free" title="Freely accessible"><a rel="nofollow" class="external text" href="https://doi.org/10.47577%2Ftssj.v57i1.10917">10.47577/tssj.v57i1.10917</a></span>.</cite><span title="ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.jtitle=Technium+Social+Sciences+Journal&rft.atitle=The+Impact+of+Artificial+Intelligence+on+Job+Loss%3A+Risks+for+Governments&rft.volume=57&rft.pages=206-223&rft.date=2024-05-09&rft_id=info%3Adoi%2F10.47577%2Ftssj.v57i1.10917&rft.aulast=Hassan+Soueidan&rft.aufirst=Mohamad&rft.au=Shoghari%2C+Rodwan&rft_id=https%3A%2F%2Ftechniumscience.com%2Findex.php%2Fsocialsciences%2Farticle%2Fview%2F10917&rfr_id=info%3Asid%2Fen.wikipedia.org%3AAI+takeover" class="Z3988"></span></span>
</li>
<li id="cite_note-8"><span class="mw-cite-backlink"><b><a href="#cite_ref-8">^</a></b></span> <span class="reference-text"><link rel="mw-deduplicated-inline-style" href="mw-data:TemplateStyles:r1238218222"><cite id="CITEREFFrank2019" class="citation journal cs1">Frank, Morgan (2019-03-25). <a rel="nofollow" class="external text" href="https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6452673">"Toward understanding the impact of artificial intelligence on labor"</a>. <i>Proceedings of the National Academy of Sciences of the United States of America</i>. <b>116</b> (14): 6531–6539. <a href="/enwiki/wiki/Bibcode_(identifier)" class="mw-redirect" title="Bibcode (identifier)">Bibcode</a>:<a rel="nofollow" class="external text" href="https://ui.adsabs.harvard.edu/abs/2019PNAS..116.6531F">2019PNAS..116.6531F</a>. <a href="/enwiki/wiki/Doi_(identifier)" class="mw-redirect" title="Doi (identifier)">doi</a>:<span class="id-lock-free" title="Freely accessible"><a rel="nofollow" class="external text" href="https://doi.org/10.1073%2Fpnas.1900949116">10.1073/pnas.1900949116</a></span>. <a href="/enwiki/wiki/PMC_(identifier)" class="mw-redirect" title="PMC (identifier)">PMC</a> <span class="id-lock-free" title="Freely accessible"><a rel="nofollow" class="external text" href="https://www.ncbi.nlm.nih.gov/pmc/articles/PMC6452673">6452673</a></span>. <a href="/enwiki/wiki/PMID_(identifier)" class="mw-redirect" title="PMID (identifier)">PMID</a> <a rel="nofollow" class="external text" href="https://pubmed.ncbi.nlm.nih.gov/30910965">30910965</a>.</cite><span title="ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.jtitle=Proceedings+of+the+National+Academy+of+Sciences+of+the+United+States+of+America&rft.atitle=Toward+understanding+the+impact+of+artificial+intelligence+on+labor&rft.volume=116&rft.issue=14&rft.pages=6531-6539&rft.date=2019-03-25&rft_id=https%3A%2F%2Fwww.ncbi.nlm.nih.gov%2Fpmc%2Farticles%2FPMC6452673%23id-name%3DPMC&rft_id=info%3Apmid%2F30910965&rft_id=info%3Adoi%2F10.1073%2Fpnas.1900949116&rft_id=info%3Abibcode%2F2019PNAS..116.6531F&rft.aulast=Frank&rft.aufirst=Morgan&rft_id=https%3A%2F%2Fwww.ncbi.nlm.nih.gov%2Fpmc%2Farticles%2FPMC6452673&rfr_id=info%3Asid%2Fen.wikipedia.org%3AAI+takeover" class="Z3988"></span></span>
</li>
<li id="cite_note-9"><span class="mw-cite-backlink"><b><a href="#cite_ref-9">^</a></b></span> <span class="reference-text"><link rel="mw-deduplicated-inline-style" href="mw-data:TemplateStyles:r1238218222"><cite id="CITEREFBond2017" class="citation book cs1">Bond, Dave (2017). <i>Artificial Intelligence</i>. pp. 67–69.</cite><span title="ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=book&rft.btitle=Artificial+Intelligence&rft.pages=67-69&rft.date=2017&rft.aulast=Bond&rft.aufirst=Dave&rfr_id=info%3Asid%2Fen.wikipedia.org%3AAI+takeover" class="Z3988"></span></span>
</li>
<li id="cite_note-10"><span class="mw-cite-backlink"><b><a href="#cite_ref-10">^</a></b></span> <span class="reference-text"><link rel="mw-deduplicated-inline-style" href="mw-data:TemplateStyles:r1238218222"><cite id="CITEREFSkidelsky2013" class="citation news cs1"><a href="/enwiki/wiki/Robert_Skidelsky,_Baron_Skidelsky" class="mw-redirect" title="Robert Skidelsky, Baron Skidelsky">Skidelsky, Robert</a> (2013-02-19). <a rel="nofollow" class="external text" href="https://www.theguardian.com/business/2013/feb/19/rise-of-robots-future-of-work">"Rise of the robots: what will the future of work look like?"</a>. <i>The Guardian</i>. London, England. <a rel="nofollow" class="external text" href="https://web.archive.org/web/20190403203821/https://www.theguardian.com/business/2013/feb/19/rise-of-robots-future-of-work">Archived</a> from the original on 2019-04-03<span class="reference-accessdate">. Retrieved <span class="nowrap">14 July</span> 2015</span>.</cite><span title="ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.jtitle=The+Guardian&rft.atitle=Rise+of+the+robots%3A+what+will+the+future+of+work+look+like%3F&rft.date=2013-02-19&rft.aulast=Skidelsky&rft.aufirst=Robert&rft_id=https%3A%2F%2Fwww.theguardian.com%2Fbusiness%2F2013%2Ffeb%2F19%2Frise-of-robots-future-of-work&rfr_id=info%3Asid%2Fen.wikipedia.org%3AAI+takeover" class="Z3988"></span></span>
</li>
<li id="cite_note-11"><span class="mw-cite-backlink"><b><a href="#cite_ref-11">^</a></b></span> <span class="reference-text"><link rel="mw-deduplicated-inline-style" href="mw-data:TemplateStyles:r1238218222"><cite id="CITEREFBria2016" class="citation web cs1">Bria, Francesca (February 2016). <a rel="nofollow" class="external text" href="https://web.archive.org/web/20160517215840/https://www.opendemocracy.net/can-europe-make-it/francesca-bria/robot-economy-full-automation-work-future">"The robot economy may already have arrived"</a>. <a href="/enwiki/wiki/OpenDemocracy" title="OpenDemocracy">openDemocracy</a>. Archived from <a rel="nofollow" class="external text" href="https://www.opendemocracy.net/can-europe-make-it/francesca-bria/robot-economy-full-automation-work-future">the original</a> on 17 May 2016<span class="reference-accessdate">. Retrieved <span class="nowrap">20 May</span> 2016</span>.</cite><span title="ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=unknown&rft.btitle=The+robot+economy+may+already+have+arrived&rft.pub=openDemocracy&rft.date=2016-02&rft.aulast=Bria&rft.aufirst=Francesca&rft_id=https%3A%2F%2Fwww.opendemocracy.net%2Fcan-europe-make-it%2Ffrancesca-bria%2Frobot-economy-full-automation-work-future&rfr_id=info%3Asid%2Fen.wikipedia.org%3AAI+takeover" class="Z3988"></span></span>
</li>
<li id="cite_note-12"><span class="mw-cite-backlink"><b><a href="#cite_ref-12">^</a></b></span> <span class="reference-text"><link rel="mw-deduplicated-inline-style" href="mw-data:TemplateStyles:r1238218222"><cite id="CITEREFSrnicek2016" class="citation web cs1"><a href="/enwiki/wiki/Nick_Srnicek" title="Nick Srnicek">Srnicek, Nick</a> (March 2016). <a rel="nofollow" class="external text" href="https://web.archive.org/web/20160625161447/http://wire.novaramedia.com/2015/03/4-reasons-why-technological-unemployment-might-really-be-different-this-time/">"4 Reasons Why Technological Unemployment Might Really Be Different This Time"</a>. novara wire. Archived from <a rel="nofollow" class="external text" href="http://wire.novaramedia.com/2015/03/4-reasons-why-technological-unemployment-might-really-be-different-this-time/">the original</a> on 25 June 2016<span class="reference-accessdate">. Retrieved <span class="nowrap">20 May</span> 2016</span>.</cite><span title="ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=unknown&rft.btitle=4+Reasons+Why+Technological+Unemployment+Might+Really+Be+Different+This+Time&rft.pub=novara+wire&rft.date=2016-03&rft.aulast=Srnicek&rft.aufirst=Nick&rft_id=http%3A%2F%2Fwire.novaramedia.com%2F2015%2F03%2F4-reasons-why-technological-unemployment-might-really-be-different-this-time%2F&rfr_id=info%3Asid%2Fen.wikipedia.org%3AAI+takeover" class="Z3988"></span></span>
</li>
<li id="cite_note-13"><span class="mw-cite-backlink"><b><a href="#cite_ref-13">^</a></b></span> <span class="reference-text"><link rel="mw-deduplicated-inline-style" href="mw-data:TemplateStyles:r1238218222"><cite id="CITEREFBrynjolfssonMcAfee2014" class="citation book cs1">Brynjolfsson, Erik; McAfee, Andrew (2014). "<i>passim</i>, see esp Chpt. 9". <i>The Second Machine Age: Work, Progress, and Prosperity in a Time of Brilliant Technologies</i>. W. W. Norton & Company. <a href="/enwiki/wiki/ISBN_(identifier)" class="mw-redirect" title="ISBN (identifier)">ISBN</a> <a href="/enwiki/wiki/Special:BookSources/978-0393239355" title="Special:BookSources/978-0393239355"><bdi>978-0393239355</bdi></a>.</cite><span title="ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.atitle=passim%2C+see+esp+Chpt.+9&rft.btitle=The+Second+Machine+Age%3A+Work%2C+Progress%2C+and+Prosperity+in+a+Time+of+Brilliant+Technologies&rft.pub=W.+W.+Norton+%26+Company&rft.date=2014&rft.isbn=978-0393239355&rft.aulast=Brynjolfsson&rft.aufirst=Erik&rft.au=McAfee%2C+Andrew&rfr_id=info%3Asid%2Fen.wikipedia.org%3AAI+takeover" class="Z3988"></span></span>
</li>
<li id="cite_note-14"><span class="mw-cite-backlink"><b><a href="#cite_ref-14">^</a></b></span> <span class="reference-text"><link rel="mw-deduplicated-inline-style" href="mw-data:TemplateStyles:r1238218222"><cite id="CITEREFWakabayashi2018" class="citation news cs1">Wakabayashi, Daisuke (March 19, 2018). <a rel="nofollow" class="external text" href="https://www.nytimes.com/2018/03/19/technology/uber-driverless-fatality.html">"Self-Driving Uber Car Kills Pedestrian in Arizona, Where Robots Roam"</a>. <i>New York Times</i>. New York, New York. <a rel="nofollow" class="external text" href="https://web.archive.org/web/20200421221918/https://www.nytimes.com/2018/03/19/technology/uber-driverless-fatality.html">Archived</a> from the original on April 21, 2020<span class="reference-accessdate">. Retrieved <span class="nowrap">March 23,</span> 2018</span>.</cite><span title="ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.jtitle=New+York+Times&rft.atitle=Self-Driving+Uber+Car+Kills+Pedestrian+in+Arizona%2C+Where+Robots+Roam&rft.date=2018-03-19&rft.aulast=Wakabayashi&rft.aufirst=Daisuke&rft_id=https%3A%2F%2Fwww.nytimes.com%2F2018%2F03%2F19%2Ftechnology%2Fuber-driverless-fatality.html&rfr_id=info%3Asid%2Fen.wikipedia.org%3AAI+takeover" class="Z3988"></span></span>
</li>
<li id="cite_note-15"><span class="mw-cite-backlink"><b><a href="#cite_ref-15">^</a></b></span> <span class="reference-text"><link rel="mw-deduplicated-inline-style" href="mw-data:TemplateStyles:r1238218222"><cite id="CITEREFJiangBrownChengKhan2023" class="citation book cs1">Jiang, Harry H.; Brown, Lauren; Cheng, Jessica; Khan, Mehtab; Gupta, Abhishek; Workman, Deja; Hanna, Alex; Flowers, Johnathan; Gebru, Timnit (29 August 2023). "AI Art and its Impact on Artists". <i>Proceedings of the 2023 AAAI/ACM Conference on AI, Ethics, and Society</i>. Association for Computing Machinery. pp. 363–374. <a href="/enwiki/wiki/Doi_(identifier)" class="mw-redirect" title="Doi (identifier)">doi</a>:<span class="id-lock-free" title="Freely accessible"><a rel="nofollow" class="external text" href="https://doi.org/10.1145%2F3600211.3604681">10.1145/3600211.3604681</a></span>. <a href="/enwiki/wiki/ISBN_(identifier)" class="mw-redirect" title="ISBN (identifier)">ISBN</a> <a href="/enwiki/wiki/Special:BookSources/979-8-4007-0231-0" title="Special:BookSources/979-8-4007-0231-0"><bdi>979-8-4007-0231-0</bdi></a>.</cite><span title="ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.atitle=AI+Art+and+its+Impact+on+Artists&rft.btitle=Proceedings+of+the+2023+AAAI%2FACM+Conference+on+AI%2C+Ethics%2C+and+Society&rft.pages=363-374&rft.pub=Association+for+Computing+Machinery&rft.date=2023-08-29&rft_id=info%3Adoi%2F10.1145%2F3600211.3604681&rft.isbn=979-8-4007-0231-0&rft.aulast=Jiang&rft.aufirst=Harry+H.&rft.au=Brown%2C+Lauren&rft.au=Cheng%2C+Jessica&rft.au=Khan%2C+Mehtab&rft.au=Gupta%2C+Abhishek&rft.au=Workman%2C+Deja&rft.au=Hanna%2C+Alex&rft.au=Flowers%2C+Johnathan&rft.au=Gebru%2C+Timnit&rfr_id=info%3Asid%2Fen.wikipedia.org%3AAI+takeover" class="Z3988"></span></span>
</li>
<li id="cite_note-16"><span class="mw-cite-backlink"><b><a href="#cite_ref-16">^</a></b></span> <span class="reference-text"><link rel="mw-deduplicated-inline-style" href="mw-data:TemplateStyles:r1238218222"><cite id="CITEREFGhoshFossas2022" class="citation arxiv cs1">Ghosh, Avijit; Fossas, Genoveva (19 November 2022). "Can There be Art Without an Artist?". <a href="/enwiki/wiki/ArXiv_(identifier)" class="mw-redirect" title="ArXiv (identifier)">arXiv</a>:<span class="id-lock-free" title="Freely accessible"><a rel="nofollow" class="external text" href="https://arxiv.org/abs/2209.07667">2209.07667</a></span> [<a rel="nofollow" class="external text" href="https://arxiv.org/archive/cs.AI">cs.AI</a>].</cite><span title="ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=preprint&rft.jtitle=arXiv&rft.atitle=Can+There+be+Art+Without+an+Artist%3F&rft.date=2022-11-19&rft_id=info%3Aarxiv%2F2209.07667&rft.aulast=Ghosh&rft.aufirst=Avijit&rft.au=Fossas%2C+Genoveva&rfr_id=info%3Asid%2Fen.wikipedia.org%3AAI+takeover" class="Z3988"></span></span>
</li>
<li id="cite_note-17"><span class="mw-cite-backlink"><b><a href="#cite_ref-17">^</a></b></span> <span class="reference-text"><link rel="mw-deduplicated-inline-style" href="mw-data:TemplateStyles:r1238218222"><cite id="CITEREFShanCryanWengerZheng2023" class="citation arxiv cs1">Shan, Shawn; Cryan, Jenna; Wenger, Emily; Zheng, Haitao; Hanocka, Rana; Zhao, Ben Y. (3 August 2023). "Glaze: Protecting Artists from Style Mimicry by Text-to-Image Models". <a href="/enwiki/wiki/ArXiv_(identifier)" class="mw-redirect" title="ArXiv (identifier)">arXiv</a>:<span class="id-lock-free" title="Freely accessible"><a rel="nofollow" class="external text" href="https://arxiv.org/abs/2302.04222">2302.04222</a></span> [<a rel="nofollow" class="external text" href="https://arxiv.org/archive/cs.CR">cs.CR</a>].</cite><span title="ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=preprint&rft.jtitle=arXiv&rft.atitle=Glaze%3A+Protecting+Artists+from+Style+Mimicry+by+Text-to-Image+Models&rft.date=2023-08-03&rft_id=info%3Aarxiv%2F2302.04222&rft.aulast=Shan&rft.aufirst=Shawn&rft.au=Cryan%2C+Jenna&rft.au=Wenger%2C+Emily&rft.au=Zheng%2C+Haitao&rft.au=Hanocka%2C+Rana&rft.au=Zhao%2C+Ben+Y.&rfr_id=info%3Asid%2Fen.wikipedia.org%3AAI+takeover" class="Z3988"></span></span>
</li>
<li id="cite_note-18"><span class="mw-cite-backlink"><b><a href="#cite_ref-18">^</a></b></span> <span class="reference-text"><link rel="mw-deduplicated-inline-style" href="mw-data:TemplateStyles:r1238218222"><cite id="CITEREFBrooks2024" class="citation news cs1">Brooks, Libby (27 February 2024). <a rel="nofollow" class="external text" href="https://www.theguardian.com/uk-news/2024/feb/27/glasgow-willy-wonka-experience-slammed-as-farce-as-tickets-refunded">"Glasgow Willy Wonka experience called a 'farce' as tickets refunded"</a>. <i>The Guardian</i><span class="reference-accessdate">. Retrieved <span class="nowrap">2 April</span> 2024</span>.</cite><span title="ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.jtitle=The+Guardian&rft.atitle=Glasgow+Willy+Wonka+experience+called+a+%27farce%27+as+tickets+refunded&rft.date=2024-02-27&rft.aulast=Brooks&rft.aufirst=Libby&rft_id=https%3A%2F%2Fwww.theguardian.com%2Fuk-news%2F2024%2Ffeb%2F27%2Fglasgow-willy-wonka-experience-slammed-as-farce-as-tickets-refunded&rfr_id=info%3Asid%2Fen.wikipedia.org%3AAI+takeover" class="Z3988"></span></span>
</li>
<li id="cite_note-19"><span class="mw-cite-backlink"><b><a href="#cite_ref-19">^</a></b></span> <span class="reference-text"><link rel="mw-deduplicated-inline-style" href="mw-data:TemplateStyles:r1238218222"><cite id="CITEREFMetzRobertson2024" class="citation news cs1">Metz, Cade; Robertson, Katie (27 February 2024). <a rel="nofollow" class="external text" href="https://www.nytimes.com/2024/02/27/technology/openai-new-york-times-lawsuit.html?smid=url-share">"OpenAI Seeks to Dismiss Parts of The New York Times's Lawsuit"</a>. <i>The New York Times</i><span class="reference-accessdate">. Retrieved <span class="nowrap">4 April</span> 2024</span>.</cite><span title="ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.jtitle=The+New+York+Times&rft.atitle=OpenAI+Seeks+to+Dismiss+Parts+of+The+New+York+Times%27s+Lawsuit&rft.date=2024-02-27&rft.aulast=Metz&rft.aufirst=Cade&rft.au=Robertson%2C+Katie&rft_id=https%3A%2F%2Fwww.nytimes.com%2F2024%2F02%2F27%2Ftechnology%2Fopenai-new-york-times-lawsuit.html%3Fsmid%3Durl-share&rfr_id=info%3Asid%2Fen.wikipedia.org%3AAI+takeover" class="Z3988"></span></span>
</li>
<li id="cite_note-20"><span class="mw-cite-backlink"><b><a href="#cite_ref-20">^</a></b></span> <span class="reference-text"><link rel="mw-deduplicated-inline-style" href="mw-data:TemplateStyles:r1238218222"><cite id="CITEREFHawkingRussellTegmarkWilczek2014" class="citation news cs1">Hawking, Stephen; <a href="/enwiki/wiki/Stuart_J._Russell" title="Stuart J. Russell">Russell, Stuart J.</a>; <a href="/enwiki/wiki/Max_Tegmark" title="Max Tegmark">Tegmark, Max</a>; <a href="/enwiki/wiki/Frank_Wilczek" title="Frank Wilczek">Wilczek, Frank</a> (1 May 2014). <span class="id-lock-limited" title="Free access subject to limited trial, subscription normally required"><a rel="nofollow" class="external text" href="https://www.independent.co.uk/news/science/stephen-hawking-transcendence-looks-at-the-implications-of-artificial-intelligence-but-are-we-taking-9313474.html">"Stephen Hawking: 'Transcendence looks at the implications of artificial intelligence - but are we taking AI seriously enough?'<span class="cs1-kern-right"></span>"</a></span>. <i>The Independent</i>. <a rel="nofollow" class="external text" href="https://web.archive.org/web/20151002023652/http://www.independent.co.uk/news/science/stephen-hawking-transcendence-looks-at-the-implications-of-artificial-intelligence-but-are-we-taking-9313474.html">Archived</a> from the original on 2015-10-02<span class="reference-accessdate">. Retrieved <span class="nowrap">1 April</span> 2016</span>.</cite><span title="ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.jtitle=The+Independent&rft.atitle=Stephen+Hawking%3A+%27Transcendence+looks+at+the+implications+of+artificial+intelligence+-+but+are+we+taking+AI+seriously+enough%3F%27&rft.date=2014-05-01&rft.aulast=Hawking&rft.aufirst=Stephen&rft.au=Russell%2C+Stuart+J.&rft.au=Tegmark%2C+Max&rft.au=Wilczek%2C+Frank&rft_id=https%3A%2F%2Fwww.independent.co.uk%2Fnews%2Fscience%2Fstephen-hawking-transcendence-looks-at-the-implications-of-artificial-intelligence-but-are-we-taking-9313474.html&rfr_id=info%3Asid%2Fen.wikipedia.org%3AAI+takeover" class="Z3988"></span></span>
</li>
<li id="cite_note-21"><span class="mw-cite-backlink"><b><a href="#cite_ref-21">^</a></b></span> <span class="reference-text"><link rel="mw-deduplicated-inline-style" href="mw-data:TemplateStyles:r1238218222"><cite id="CITEREFMüllerBostrom2016" class="citation book cs1"><a href="/enwiki/wiki/Vincent_C._M%C3%BCller" title="Vincent C. Müller">Müller, Vincent C.</a>; <a href="/enwiki/wiki/Nick_Bostrom" title="Nick Bostrom">Bostrom, Nick</a> (2016). <a rel="nofollow" class="external text" href="https://nickbostrom.com/papers/survey.pdf">"Future Progress in Artificial Intelligence: A Survey of Expert Opinion"</a> <span class="cs1-format">(PDF)</span>. <i>Fundamental Issues of Artificial Intelligence</i>. Springer. pp. 555–572. <a href="/enwiki/wiki/Doi_(identifier)" class="mw-redirect" title="Doi (identifier)">doi</a>:<a rel="nofollow" class="external text" href="https://doi.org/10.1007%2F978-3-319-26485-1_33">10.1007/978-3-319-26485-1_33</a>. <a href="/enwiki/wiki/ISBN_(identifier)" class="mw-redirect" title="ISBN (identifier)">ISBN</a> <a href="/enwiki/wiki/Special:BookSources/978-3-319-26483-7" title="Special:BookSources/978-3-319-26483-7"><bdi>978-3-319-26483-7</bdi></a>. <a rel="nofollow" class="external text" href="https://web.archive.org/web/20220531142709/https://nickbostrom.com/papers/survey.pdf">Archived</a> <span class="cs1-format">(PDF)</span> from the original on 2022-05-31<span class="reference-accessdate">. Retrieved <span class="nowrap">2022-06-16</span></span>. <q>AI systems will... reach overall human ability... very likely (with 90% probability) by 2075. From reaching human ability, it will move on to superintelligence within 30 years (75%)... So, (most of the AI experts responding to the surveys) think that superintelligence is likely to come in a few decades...</q></cite><span title="ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.atitle=Future+Progress+in+Artificial+Intelligence%3A+A+Survey+of+Expert+Opinion&rft.btitle=Fundamental+Issues+of+Artificial+Intelligence&rft.pages=555-572&rft.pub=Springer&rft.date=2016&rft_id=info%3Adoi%2F10.1007%2F978-3-319-26485-1_33&rft.isbn=978-3-319-26483-7&rft.aulast=M%C3%BCller&rft.aufirst=Vincent+C.&rft.au=Bostrom%2C+Nick&rft_id=https%3A%2F%2Fnickbostrom.com%2Fpapers%2Fsurvey.pdf&rfr_id=info%3Asid%2Fen.wikipedia.org%3AAI+takeover" class="Z3988"></span></span>
</li>
<li id="cite_note-22"><span class="mw-cite-backlink"><b><a href="#cite_ref-22">^</a></b></span> <span class="reference-text"><link rel="mw-deduplicated-inline-style" href="mw-data:TemplateStyles:r1238218222"><cite id="CITEREFBostrom2012" class="citation journal cs1">Bostrom, Nick (2012). <a rel="nofollow" class="external text" href="https://nickbostrom.com/superintelligentwill.pdf">"The Superintelligent Will: Motivation and Instrumental Rationality in Advanced Artificial Agents"</a> <span class="cs1-format">(PDF)</span>. <i>Minds and Machines</i>. <b>22</b> (2). Springer: 71–85. <a href="/enwiki/wiki/Doi_(identifier)" class="mw-redirect" title="Doi (identifier)">doi</a>:<a rel="nofollow" class="external text" href="https://doi.org/10.1007%2Fs11023-012-9281-3">10.1007/s11023-012-9281-3</a>. <a href="/enwiki/wiki/S2CID_(identifier)" class="mw-redirect" title="S2CID (identifier)">S2CID</a> <a rel="nofollow" class="external text" href="https://api.semanticscholar.org/CorpusID:254835485">254835485</a>. <a rel="nofollow" class="external text" href="https://web.archive.org/web/20220709032134/https://nickbostrom.com/superintelligentwill.pdf">Archived</a> <span class="cs1-format">(PDF)</span> from the original on 2022-07-09<span class="reference-accessdate">. Retrieved <span class="nowrap">2022-06-16</span></span>.</cite><span title="ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.jtitle=Minds+and+Machines&rft.atitle=The+Superintelligent+Will%3A+Motivation+and+Instrumental+Rationality+in+Advanced+Artificial+Agents&rft.volume=22&rft.issue=2&rft.pages=71-85&rft.date=2012&rft_id=info%3Adoi%2F10.1007%2Fs11023-012-9281-3&rft_id=https%3A%2F%2Fapi.semanticscholar.org%2FCorpusID%3A254835485%23id-name%3DS2CID&rft.aulast=Bostrom&rft.aufirst=Nick&rft_id=https%3A%2F%2Fnickbostrom.com%2Fsuperintelligentwill.pdf&rfr_id=info%3Asid%2Fen.wikipedia.org%3AAI+takeover" class="Z3988"></span></span>
</li>
<li id="cite_note-bostrom-superintelligence-23"><span class="mw-cite-backlink">^ <a href="#cite_ref-bostrom-superintelligence_23-0"><sup><i><b>a</b></i></sup></a> <a href="#cite_ref-bostrom-superintelligence_23-1"><sup><i><b>b</b></i></sup></a> <a href="#cite_ref-bostrom-superintelligence_23-2"><sup><i><b>c</b></i></sup></a> <a href="#cite_ref-bostrom-superintelligence_23-3"><sup><i><b>d</b></i></sup></a> <a href="#cite_ref-bostrom-superintelligence_23-4"><sup><i><b>e</b></i></sup></a> <a href="#cite_ref-bostrom-superintelligence_23-5"><sup><i><b>f</b></i></sup></a> <a href="#cite_ref-bostrom-superintelligence_23-6"><sup><i><b>g</b></i></sup></a> <a href="#cite_ref-bostrom-superintelligence_23-7"><sup><i><b>h</b></i></sup></a></span> <span class="reference-text"><link rel="mw-deduplicated-inline-style" href="mw-data:TemplateStyles:r1238218222"><cite id="CITEREFBostrom" class="citation book cs1">Bostrom, Nick. <a href="/enwiki/wiki/Superintelligence:_Paths,_Dangers,_Strategies" title="Superintelligence: Paths, Dangers, Strategies"><i>Superintelligence: Paths, Dangers, Strategies</i></a>.</cite><span title="ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=book&rft.btitle=Superintelligence%3A+Paths%2C+Dangers%2C+Strategies&rft.aulast=Bostrom&rft.aufirst=Nick&rfr_id=info%3Asid%2Fen.wikipedia.org%3AAI+takeover" class="Z3988"></span></span>
</li>
<li id="cite_note-24"><span class="mw-cite-backlink"><b><a href="#cite_ref-24">^</a></b></span> <span class="reference-text"><link rel="mw-deduplicated-inline-style" href="mw-data:TemplateStyles:r1238218222"><cite class="citation news cs1"><a rel="nofollow" class="external text" href="https://www.sciencefriday.com/segments/the-origin-of-the-word-robot/">"The Origin Of The Word 'Robot'<span class="cs1-kern-right"></span>"</a>. <i><a href="/enwiki/wiki/Science_Friday" title="Science Friday">Science Friday</a> (public radio)</i>. 22 April 2011. <a rel="nofollow" class="external text" href="https://web.archive.org/web/20200314092540/https://www.sciencefriday.com/segments/the-origin-of-the-word-robot/">Archived</a> from the original on 14 March 2020<span class="reference-accessdate">. Retrieved <span class="nowrap">30 April</span> 2020</span>.</cite><span title="ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.jtitle=Science+Friday+%28public+radio%29&rft.atitle=The+Origin+Of+The+Word+%27Robot%27&rft.date=2011-04-22&rft_id=https%3A%2F%2Fwww.sciencefriday.com%2Fsegments%2Fthe-origin-of-the-word-robot%2F&rfr_id=info%3Asid%2Fen.wikipedia.org%3AAI+takeover" class="Z3988"></span></span>
</li>
<li id="cite_note-25"><span class="mw-cite-backlink"><b><a href="#cite_ref-25">^</a></b></span> <span class="reference-text"><link rel="mw-deduplicated-inline-style" href="mw-data:TemplateStyles:r1238218222"><cite id="CITEREFBotkin-Kowacki2016" class="citation news cs1">Botkin-Kowacki, Eva (28 October 2016). <a rel="nofollow" class="external text" href="https://www.csmonitor.com/Science/2016/1028/A-female-Frankenstein-would-lead-to-humanity-s-extinction-say-scientists">"A female Frankenstein would lead to humanity's extinction, say scientists"</a>. <i>Christian Science Monitor</i>. <a rel="nofollow" class="external text" href="https://web.archive.org/web/20210226203855/https://www.csmonitor.com/Science/2016/1028/A-female-Frankenstein-would-lead-to-humanity-s-extinction-say-scientists">Archived</a> from the original on 26 February 2021<span class="reference-accessdate">. Retrieved <span class="nowrap">30 April</span> 2020</span>.</cite><span title="ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.jtitle=Christian+Science+Monitor&rft.atitle=A+female+Frankenstein+would+lead+to+humanity%27s+extinction%2C+say+scientists&rft.date=2016-10-28&rft.aulast=Botkin-Kowacki&rft.aufirst=Eva&rft_id=https%3A%2F%2Fwww.csmonitor.com%2FScience%2F2016%2F1028%2FA-female-Frankenstein-would-lead-to-humanity-s-extinction-say-scientists&rfr_id=info%3Asid%2Fen.wikipedia.org%3AAI+takeover" class="Z3988"></span></span>
</li>
<li id="cite_note-26"><span class="mw-cite-backlink"><b><a href="#cite_ref-26">^</a></b></span> <span class="reference-text"><link rel="mw-deduplicated-inline-style" href="mw-data:TemplateStyles:r1238218222"><cite id="CITEREFOrd2020" class="citation book cs1">Ord, Toby (2020). "Unaligned artificial intelligence". <i>The precipice: existential risk and the future of humanity</i>. London, England and New York, New York: Bloomsbury academic. <a href="/enwiki/wiki/ISBN_(identifier)" class="mw-redirect" title="ISBN (identifier)">ISBN</a> <a href="/enwiki/wiki/Special:BookSources/978-1-5266-0023-3" title="Special:BookSources/978-1-5266-0023-3"><bdi>978-1-5266-0023-3</bdi></a>.</cite><span title="ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.atitle=Unaligned+artificial+intelligence&rft.btitle=The+precipice%3A+existential+risk+and+the+future+of+humanity&rft.place=London%2C+England+and+New+York%2C+New+York&rft.pub=Bloomsbury+academic&rft.date=2020&rft.isbn=978-1-5266-0023-3&rft.aulast=Ord&rft.aufirst=Toby&rfr_id=info%3Asid%2Fen.wikipedia.org%3AAI+takeover" class="Z3988"></span></span>
</li>
<li id="cite_note-surgery-27"><span class="mw-cite-backlink"><b><a href="#cite_ref-surgery_27-0">^</a></b></span> <span class="reference-text"><link rel="mw-deduplicated-inline-style" href="mw-data:TemplateStyles:r1238218222"><cite id="CITEREFHocksteinGourinFaustTerris2007" class="citation journal cs1">Hockstein, N. G.; Gourin, C. G.; Faust, R. A.; Terris, D. J. (17 March 2007). <a rel="nofollow" class="external text" href="https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4247417">"A history of robots: from science fiction to surgical robotics"</a>. <i>Journal of Robotic Surgery</i>. <b>1</b> (2): 113–118. <a href="/enwiki/wiki/Doi_(identifier)" class="mw-redirect" title="Doi (identifier)">doi</a>:<a rel="nofollow" class="external text" href="https://doi.org/10.1007%2Fs11701-007-0021-2">10.1007/s11701-007-0021-2</a>. <a href="/enwiki/wiki/PMC_(identifier)" class="mw-redirect" title="PMC (identifier)">PMC</a> <span class="id-lock-free" title="Freely accessible"><a rel="nofollow" class="external text" href="https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4247417">4247417</a></span>. <a href="/enwiki/wiki/PMID_(identifier)" class="mw-redirect" title="PMID (identifier)">PMID</a> <a rel="nofollow" class="external text" href="https://pubmed.ncbi.nlm.nih.gov/25484946">25484946</a>.</cite><span title="ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.jtitle=Journal+of+Robotic+Surgery&rft.atitle=A+history+of+robots%3A+from+science+fiction+to+surgical+robotics&rft.volume=1&rft.issue=2&rft.pages=113-118&rft.date=2007-03-17&rft_id=https%3A%2F%2Fwww.ncbi.nlm.nih.gov%2Fpmc%2Farticles%2FPMC4247417%23id-name%3DPMC&rft_id=info%3Apmid%2F25484946&rft_id=info%3Adoi%2F10.1007%2Fs11701-007-0021-2&rft.aulast=Hockstein&rft.aufirst=N.+G.&rft.au=Gourin%2C+C.+G.&rft.au=Faust%2C+R.+A.&rft.au=Terris%2C+D.+J.&rft_id=https%3A%2F%2Fwww.ncbi.nlm.nih.gov%2Fpmc%2Farticles%2FPMC4247417&rfr_id=info%3Asid%2Fen.wikipedia.org%3AAI+takeover" class="Z3988"></span></span>
</li>
<li id="cite_note-28"><span class="mw-cite-backlink"><b><a href="#cite_ref-28">^</a></b></span> <span class="reference-text"><link rel="mw-deduplicated-inline-style" href="mw-data:TemplateStyles:r1238218222"><cite id="CITEREFHellmann2019" class="citation news cs1">Hellmann, Melissa (21 September 2019). <a rel="nofollow" class="external text" href="https://www.seattletimes.com/business/technology/ai-101-what-is-artificial-intelligence-and-where-is-it-going/">"AI 101: What is artificial intelligence and where is it going?"</a>. <i>The Seattle Times</i>. <a rel="nofollow" class="external text" href="https://web.archive.org/web/20200421232439/https://www.seattletimes.com/business/technology/ai-101-what-is-artificial-intelligence-and-where-is-it-going/">Archived</a> from the original on 21 April 2020<span class="reference-accessdate">. Retrieved <span class="nowrap">30 April</span> 2020</span>.</cite><span title="ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.jtitle=The+Seattle+Times&rft.atitle=AI+101%3A+What+is+artificial+intelligence+and+where+is+it+going%3F&rft.date=2019-09-21&rft.aulast=Hellmann&rft.aufirst=Melissa&rft_id=https%3A%2F%2Fwww.seattletimes.com%2Fbusiness%2Ftechnology%2Fai-101-what-is-artificial-intelligence-and-where-is-it-going%2F&rfr_id=info%3Asid%2Fen.wikipedia.org%3AAI+takeover" class="Z3988"></span></span>
</li>
<li id="cite_note-BabcockKrámar2019-29"><span class="mw-cite-backlink"><b><a href="#cite_ref-BabcockKrámar2019_29-0">^</a></b></span> <span class="reference-text"><link rel="mw-deduplicated-inline-style" href="mw-data:TemplateStyles:r1238218222"><cite id="CITEREFBabcockKrámarYampolskiy2019" class="citation book cs1">Babcock, James; Krámar, János; <a href="/enwiki/wiki/Roman_Yampolskiy" title="Roman Yampolskiy">Yampolskiy, Roman V.</a> (2019). "Guidelines for Artificial Intelligence Containment". <i>Next-Generation Ethics</i>. pp. 90–112. <a href="/enwiki/wiki/ArXiv_(identifier)" class="mw-redirect" title="ArXiv (identifier)">arXiv</a>:<span class="id-lock-free" title="Freely accessible"><a rel="nofollow" class="external text" href="https://arxiv.org/abs/1707.08476">1707.08476</a></span>. <a href="/enwiki/wiki/Doi_(identifier)" class="mw-redirect" title="Doi (identifier)">doi</a>:<a rel="nofollow" class="external text" href="https://doi.org/10.1017%2F9781108616188.008">10.1017/9781108616188.008</a>. <a href="/enwiki/wiki/ISBN_(identifier)" class="mw-redirect" title="ISBN (identifier)">ISBN</a> <a href="/enwiki/wiki/Special:BookSources/9781108616188" title="Special:BookSources/9781108616188"><bdi>9781108616188</bdi></a>. <a href="/enwiki/wiki/S2CID_(identifier)" class="mw-redirect" title="S2CID (identifier)">S2CID</a> <a rel="nofollow" class="external text" href="https://api.semanticscholar.org/CorpusID:22007028">22007028</a>.</cite><span title="ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.atitle=Guidelines+for+Artificial+Intelligence+Containment&rft.btitle=Next-Generation+Ethics&rft.pages=90-112&rft.date=2019&rft_id=info%3Aarxiv%2F1707.08476&rft_id=https%3A%2F%2Fapi.semanticscholar.org%2FCorpusID%3A22007028%23id-name%3DS2CID&rft_id=info%3Adoi%2F10.1017%2F9781108616188.008&rft.isbn=9781108616188&rft.aulast=Babcock&rft.aufirst=James&rft.au=Kr%C3%A1mar%2C+J%C3%A1nos&rft.au=Yampolskiy%2C+Roman+V.&rfr_id=info%3Asid%2Fen.wikipedia.org%3AAI+takeover" class="Z3988"></span></span>
</li>
<li id="cite_note-30"><span class="mw-cite-backlink"><b><a href="#cite_ref-30">^</a></b></span> <span class="reference-text"><link rel="mw-deduplicated-inline-style" href="mw-data:TemplateStyles:r1238218222"><cite id="CITEREFBaraniuk2016" class="citation news cs1">Baraniuk, Chris (23 May 2016). <a rel="nofollow" class="external text" href="https://www.newscientist.com/article/2089606-checklist-of-worst-case-scenarios-could-help-prepare-for-evil-ai/">"Checklist of worst-case scenarios could help prepare for evil AI"</a>. <i><a href="/enwiki/wiki/New_Scientist" title="New Scientist">New Scientist</a></i>. <a rel="nofollow" class="external text" href="https://web.archive.org/web/20160921061131/https://www.newscientist.com/article/2089606-checklist-of-worst-case-scenarios-could-help-prepare-for-evil-ai/">Archived</a> from the original on 21 September 2016<span class="reference-accessdate">. Retrieved <span class="nowrap">21 September</span> 2016</span>.</cite><span title="ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.jtitle=New+Scientist&rft.atitle=Checklist+of+worst-case+scenarios+could+help+prepare+for+evil+AI&rft.date=2016-05-23&rft.aulast=Baraniuk&rft.aufirst=Chris&rft_id=https%3A%2F%2Fwww.newscientist.com%2Farticle%2F2089606-checklist-of-worst-case-scenarios-could-help-prepare-for-evil-ai%2F&rfr_id=info%3Asid%2Fen.wikipedia.org%3AAI+takeover" class="Z3988"></span></span>
</li>
<li id="cite_note-singinst12-31"><span class="mw-cite-backlink"><b><a href="#cite_ref-singinst12_31-0">^</a></b></span> <span class="reference-text"><link rel="mw-deduplicated-inline-style" href="mw-data:TemplateStyles:r1238218222"><cite id="CITEREFYudkowsky2004" class="citation web cs1">Yudkowsky, Eliezer S. (May 2004). <a rel="nofollow" class="external text" href="https://web.archive.org/web/20120615203944/http://singinst.org/upload/CEV.html">"Coherent Extrapolated Volition"</a>. Singularity Institute for Artificial Intelligence. Archived from <a rel="nofollow" class="external text" href="http://singinst.org/upload/CEV.html">the original</a> on 2012-06-15.</cite><span title="ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=unknown&rft.btitle=Coherent+Extrapolated+Volition&rft.pub=Singularity+Institute+for+Artificial+Intelligence&rft.date=2004-05&rft.aulast=Yudkowsky&rft.aufirst=Eliezer+S.&rft_id=http%3A%2F%2Fsinginst.org%2Fupload%2FCEV.html&rfr_id=info%3Asid%2Fen.wikipedia.org%3AAI+takeover" class="Z3988"></span></span>
</li>
<li id="cite_note-Muehlhauser,_Luke_2012-32"><span class="mw-cite-backlink"><b><a href="#cite_ref-Muehlhauser,_Luke_2012_32-0">^</a></b></span> <span class="reference-text"><link rel="mw-deduplicated-inline-style" href="mw-data:TemplateStyles:r1238218222"><cite id="CITEREFMuehlhauserHelm2012" class="citation book cs1">Muehlhauser, Luke; Helm, Louie (2012). <a rel="nofollow" class="external text" href="https://intelligence.org/files/IE-ME.pdf">"Intelligence Explosion and Machine Ethics"</a> <span class="cs1-format">(PDF)</span>. <i>Singularity Hypotheses: A Scientific and Philosophical Assessment</i>. Springer. <a rel="nofollow" class="external text" href="https://web.archive.org/web/20150507173028/http://intelligence.org/files/IE-ME.pdf">Archived</a> <span class="cs1-format">(PDF)</span> from the original on 2015-05-07<span class="reference-accessdate">. Retrieved <span class="nowrap">2020-10-02</span></span>.</cite><span title="ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.atitle=Intelligence+Explosion+and+Machine+Ethics&rft.btitle=Singularity+Hypotheses%3A+A+Scientific+and+Philosophical+Assessment&rft.pub=Springer&rft.date=2012&rft.aulast=Muehlhauser&rft.aufirst=Luke&rft.au=Helm%2C+Louie&rft_id=https%3A%2F%2Fintelligence.org%2Ffiles%2FIE-ME.pdf&rfr_id=info%3Asid%2Fen.wikipedia.org%3AAI+takeover" class="Z3988"></span></span>
</li>
<li id="cite_note-Yudkowsky2011-33"><span class="mw-cite-backlink"><b><a href="#cite_ref-Yudkowsky2011_33-0">^</a></b></span> <span class="reference-text"><link rel="mw-deduplicated-inline-style" href="mw-data:TemplateStyles:r1238218222"><cite id="CITEREFYudkowsky2011" class="citation book cs1">Yudkowsky, Eliezer (2011). "Complex Value Systems in Friendly AI". <i>Artificial General Intelligence</i>. Lecture Notes in Computer Science. Vol. 6830. pp. 388–393. <a href="/enwiki/wiki/Doi_(identifier)" class="mw-redirect" title="Doi (identifier)">doi</a>:<a rel="nofollow" class="external text" href="https://doi.org/10.1007%2F978-3-642-22887-2_48">10.1007/978-3-642-22887-2_48</a>. <a href="/enwiki/wiki/ISBN_(identifier)" class="mw-redirect" title="ISBN (identifier)">ISBN</a> <a href="/enwiki/wiki/Special:BookSources/978-3-642-22886-5" title="Special:BookSources/978-3-642-22886-5"><bdi>978-3-642-22886-5</bdi></a>. <a href="/enwiki/wiki/ISSN_(identifier)" class="mw-redirect" title="ISSN (identifier)">ISSN</a> <a rel="nofollow" class="external text" href="https://search.worldcat.org/issn/0302-9743">0302-9743</a>.</cite><span title="ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=bookitem&rft.atitle=Complex+Value+Systems+in+Friendly+AI&rft.btitle=Artificial+General+Intelligence&rft.series=Lecture+Notes+in+Computer+Science&rft.pages=388-393&rft.date=2011&rft.issn=0302-9743&rft_id=info%3Adoi%2F10.1007%2F978-3-642-22887-2_48&rft.isbn=978-3-642-22886-5&rft.aulast=Yudkowsky&rft.aufirst=Eliezer&rfr_id=info%3Asid%2Fen.wikipedia.org%3AAI+takeover" class="Z3988"></span></span>
</li>
<li id="cite_note-pinker_now-34"><span class="mw-cite-backlink">^ <a href="#cite_ref-pinker_now_34-0"><sup><i><b>a</b></i></sup></a> <a href="#cite_ref-pinker_now_34-1"><sup><i><b>b</b></i></sup></a></span> <span class="reference-text"><link rel="mw-deduplicated-inline-style" href="mw-data:TemplateStyles:r1238218222"><cite id="CITEREFPinker2018" class="citation news cs1">Pinker, Steven (13 February 2018). <a rel="nofollow" class="external text" href="https://www.popsci.com/robot-uprising-enlightenment-now/">"We're told to fear robots. But why do we think they'll turn on us?"</a>. <i>Popular Science</i>. <a rel="nofollow" class="external text" href="https://web.archive.org/web/20200720164306/https://www.popsci.com/robot-uprising-enlightenment-now/">Archived</a> from the original on 20 July 2020<span class="reference-accessdate">. Retrieved <span class="nowrap">8 June</span> 2020</span>.</cite><span title="ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.jtitle=Popular+Science&rft.atitle=We%27re+told+to+fear+robots.+But+why+do+we+think+they%27ll+turn+on+us%3F&rft.date=2018-02-13&rft.aulast=Pinker&rft.aufirst=Steven&rft_id=https%3A%2F%2Fwww.popsci.com%2Frobot-uprising-enlightenment-now%2F&rfr_id=info%3Asid%2Fen.wikipedia.org%3AAI+takeover" class="Z3988"></span></span>
</li>
<li id="cite_note-35"><span class="mw-cite-backlink"><b><a href="#cite_ref-35">^</a></b></span> <span class="reference-text"><i><a rel="nofollow" class="external text" href="http://www.singinst.org/ourresearch/presentations/">Creating a New Intelligent Species: Choices and Responsibilities for Artificial Intelligence Designers</a> <a rel="nofollow" class="external text" href="https://web.archive.org/web/20070206060938/http://www.singinst.org/ourresearch/presentations/">Archived</a> February 6, 2007, at the <a href="/enwiki/wiki/Wayback_Machine" title="Wayback Machine">Wayback Machine</a></i> - <a href="/enwiki/wiki/Singularity_Institute_for_Artificial_Intelligence" class="mw-redirect" title="Singularity Institute for Artificial Intelligence">Singularity Institute for Artificial Intelligence</a>, 2005</span>
</li>
<li id="cite_note-36"><span class="mw-cite-backlink"><b><a href="#cite_ref-36">^</a></b></span> <span class="reference-text"><link rel="mw-deduplicated-inline-style" href="mw-data:TemplateStyles:r1238218222"><cite id="CITEREFOmohundro2008" class="citation conference cs1">Omohundro, Stephen M. (June 2008). <a rel="nofollow" class="external text" href="https://selfawaresystems.files.wordpress.com/2008/01/ai_drives_final.pdf"><i>The basic AI drives</i></a> <span class="cs1-format">(PDF)</span>. Artificial General Intelligence 2008. pp. 483–492. <a rel="nofollow" class="external text" href="https://web.archive.org/web/20201010072132/https://selfawaresystems.files.wordpress.com/2008/01/ai_drives_final.pdf">Archived</a> <span class="cs1-format">(PDF)</span> from the original on 2020-10-10<span class="reference-accessdate">. Retrieved <span class="nowrap">2020-10-02</span></span>.</cite><span title="ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=conference&rft.btitle=The+basic+AI+drives&rft.pages=483-492&rft.date=2008-06&rft.aulast=Omohundro&rft.aufirst=Stephen+M.&rft_id=https%3A%2F%2Fselfawaresystems.files.wordpress.com%2F2008%2F01%2Fai_drives_final.pdf&rfr_id=info%3Asid%2Fen.wikipedia.org%3AAI+takeover" class="Z3988"></span></span>
</li>
<li id="cite_note-Tucker2014-37"><span class="mw-cite-backlink"><b><a href="#cite_ref-Tucker2014_37-0">^</a></b></span> <span class="reference-text"><link rel="mw-deduplicated-inline-style" href="mw-data:TemplateStyles:r1238218222"><cite id="CITEREFTucker2014" class="citation news cs1">Tucker, Patrick (17 Apr 2014). <a rel="nofollow" class="external text" href="http://www.defenseone.com/technology/2014/04/why-there-will-be-robot-uprising/82783/">"Why There Will Be A Robot Uprising"</a>. Defense One. <a rel="nofollow" class="external text" href="https://web.archive.org/web/20140706110100/http://www.defenseone.com/technology/2014/04/why-there-will-be-robot-uprising/82783/">Archived</a> from the original on 6 July 2014<span class="reference-accessdate">. Retrieved <span class="nowrap">15 July</span> 2014</span>.</cite><span title="ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Why+There+Will+Be+A+Robot+Uprising&rft.date=2014-04-17&rft.aulast=Tucker&rft.aufirst=Patrick&rft_id=http%3A%2F%2Fwww.defenseone.com%2Ftechnology%2F2014%2F04%2Fwhy-there-will-be-robot-uprising%2F82783%2F&rfr_id=info%3Asid%2Fen.wikipedia.org%3AAI+takeover" class="Z3988"></span></span>
</li>
<li id="cite_note-38"><span class="mw-cite-backlink"><b><a href="#cite_ref-38">^</a></b></span> <span class="reference-text"><link rel="mw-deduplicated-inline-style" href="mw-data:TemplateStyles:r1238218222"><cite id="CITEREFRussell2019" class="citation book cs1">Russell, Stuart J. (8 October 2019). <a rel="nofollow" class="external text" href="http://worldcat.org/oclc/1237420037"><i>Human compatible : artificial intelligence and the problem of control</i></a>. Penguin. <a href="/enwiki/wiki/ISBN_(identifier)" class="mw-redirect" title="ISBN (identifier)">ISBN</a> <a href="/enwiki/wiki/Special:BookSources/978-0-525-55862-0" title="Special:BookSources/978-0-525-55862-0"><bdi>978-0-525-55862-0</bdi></a>. <a href="/enwiki/wiki/OCLC_(identifier)" class="mw-redirect" title="OCLC (identifier)">OCLC</a> <a rel="nofollow" class="external text" href="https://search.worldcat.org/oclc/1237420037">1237420037</a>. <a rel="nofollow" class="external text" href="https://web.archive.org/web/20230315194123/https://worldcat.org/title/1237420037">Archived</a> from the original on 15 March 2023<span class="reference-accessdate">. Retrieved <span class="nowrap">2 January</span> 2022</span>.</cite><span title="ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=book&rft.btitle=Human+compatible+%3A+artificial+intelligence+and+the+problem+of+control&rft.pub=Penguin&rft.date=2019-10-08&rft_id=info%3Aoclcnum%2F1237420037&rft.isbn=978-0-525-55862-0&rft.aulast=Russell&rft.aufirst=Stuart+J.&rft_id=http%3A%2F%2Fworldcat.org%2Foclc%2F1237420037&rfr_id=info%3Asid%2Fen.wikipedia.org%3AAI+takeover" class="Z3988"></span></span>
</li>
<li id="cite_note-bbc-google-39"><span class="mw-cite-backlink"><b><a href="#cite_ref-bbc-google_39-0">^</a></b></span> <span class="reference-text"><link rel="mw-deduplicated-inline-style" href="mw-data:TemplateStyles:r1238218222"><cite class="citation news cs1"><a rel="nofollow" class="external text" href="https://www.bbc.com/news/technology-36472140">"Google developing kill switch for AI"</a>. <i>BBC News</i>. 8 June 2016. <a rel="nofollow" class="external text" href="https://web.archive.org/web/20160611042244/http://www.bbc.com/news/technology-36472140">Archived</a> from the original on 11 June 2016<span class="reference-accessdate">. Retrieved <span class="nowrap">7 June</span> 2020</span>.</cite><span title="ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.jtitle=BBC+News&rft.atitle=Google+developing+kill+switch+for+AI&rft.date=2016-06-08&rft_id=https%3A%2F%2Fwww.bbc.com%2Fnews%2Ftechnology-36472140&rfr_id=info%3Asid%2Fen.wikipedia.org%3AAI+takeover" class="Z3988"></span></span>
</li>
<li id="cite_note-40"><span class="mw-cite-backlink"><b><a href="#cite_ref-40">^</a></b></span> <span class="reference-text"><link rel="mw-deduplicated-inline-style" href="mw-data:TemplateStyles:r1238218222"><cite id="CITEREFRawlinson2015" class="citation web cs1">Rawlinson, Kevin (29 January 2015). <a rel="nofollow" class="external text" href="https://www.bbc.co.uk/news/31047780">"Microsoft's Bill Gates insists AI is a threat"</a>. <i><a href="/enwiki/wiki/BBC_News" title="BBC News">BBC News</a></i>. <a rel="nofollow" class="external text" href="https://web.archive.org/web/20150129183607/http://www.bbc.co.uk/news/31047780">Archived</a> from the original on 29 January 2015<span class="reference-accessdate">. Retrieved <span class="nowrap">30 January</span> 2015</span>.</cite><span title="ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=unknown&rft.jtitle=BBC+News&rft.atitle=Microsoft%27s+Bill+Gates+insists+AI+is+a+threat&rft.date=2015-01-29&rft.aulast=Rawlinson&rft.aufirst=Kevin&rft_id=https%3A%2F%2Fwww.bbc.co.uk%2Fnews%2F31047780&rfr_id=info%3Asid%2Fen.wikipedia.org%3AAI+takeover" class="Z3988"></span></span>
</li>
<li id="cite_note-41"><span class="mw-cite-backlink"><b><a href="#cite_ref-41">^</a></b></span> <span class="reference-text"><link rel="mw-deduplicated-inline-style" href="mw-data:TemplateStyles:r1238218222"><cite class="citation web cs1"><a rel="nofollow" class="external text" href="http://futureoflife.org/ai-open-letter">"The Future of Life Institute Open Letter"</a>. The Future of Life Institute. 28 October 2015. <a rel="nofollow" class="external text" href="https://web.archive.org/web/20190329094536/https://futureoflife.org/ai-open-letter/">Archived</a> from the original on 29 March 2019<span class="reference-accessdate">. Retrieved <span class="nowrap">29 March</span> 2019</span>.</cite><span title="ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=unknown&rft.btitle=The+Future+of+Life+Institute+Open+Letter&rft.pub=The+Future+of+Life+Institute&rft.date=2015-10-28&rft_id=http%3A%2F%2Ffutureoflife.org%2Fai-open-letter&rfr_id=info%3Asid%2Fen.wikipedia.org%3AAI+takeover" class="Z3988"></span></span>
</li>
<li id="cite_note-42"><span class="mw-cite-backlink"><b><a href="#cite_ref-42">^</a></b></span> <span class="reference-text"><link rel="mw-deduplicated-inline-style" href="mw-data:TemplateStyles:r1238218222"><cite id="CITEREFBradshaw2015" class="citation web cs1">Bradshaw, Tim (11 January 2015). <a rel="nofollow" class="external text" href="https://www.ft.com/cms/s/0/3d2c2f12-99e9-11e4-93c1-00144feabdc0.html#axzz3TNL9lxJV">"Scientists and investors warn on AI"</a>. The Financial Times. <a rel="nofollow" class="external text" href="https://web.archive.org/web/20150207042806/http://www.ft.com/cms/s/0/3d2c2f12-99e9-11e4-93c1-00144feabdc0.html#axzz3TNL9lxJV">Archived</a> from the original on 7 February 2015<span class="reference-accessdate">. Retrieved <span class="nowrap">4 March</span> 2015</span>.</cite><span title="ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=unknown&rft.btitle=Scientists+and+investors+warn+on+AI&rft.pub=The+Financial+Times&rft.date=2015-01-11&rft.aulast=Bradshaw&rft.aufirst=Tim&rft_id=http%3A%2F%2Fwww.ft.com%2Fcms%2Fs%2F0%2F3d2c2f12-99e9-11e4-93c1-00144feabdc0.html%23axzz3TNL9lxJV&rfr_id=info%3Asid%2Fen.wikipedia.org%3AAI+takeover" class="Z3988"></span></span>
</li>
<li id="cite_note-43"><span class="mw-cite-backlink"><b><a href="#cite_ref-43">^</a></b></span> <span class="reference-text"><link rel="mw-deduplicated-inline-style" href="mw-data:TemplateStyles:r1238218222"><cite id="CITEREFKaminski2022" class="citation journal cs1">Kaminski, Johannes D. (December 2022). <a rel="nofollow" class="external text" href="https://link.springer.com/10.1007/s11059-022-00670-w">"On human expendability: AI takeover in Clarke's Odyssey and Stross's Accelerando"</a>. <i>Neohelicon</i>. <b>49</b> (2): 495–511. <a href="/enwiki/wiki/Doi_(identifier)" class="mw-redirect" title="Doi (identifier)">doi</a>:<a rel="nofollow" class="external text" href="https://doi.org/10.1007%2Fs11059-022-00670-w">10.1007/s11059-022-00670-w</a>. <a href="/enwiki/wiki/ISSN_(identifier)" class="mw-redirect" title="ISSN (identifier)">ISSN</a> <a rel="nofollow" class="external text" href="https://search.worldcat.org/issn/0324-4652">0324-4652</a>. <a href="/enwiki/wiki/S2CID_(identifier)" class="mw-redirect" title="S2CID (identifier)">S2CID</a> <a rel="nofollow" class="external text" href="https://api.semanticscholar.org/CorpusID:253793613">253793613</a>.</cite><span title="ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.jtitle=Neohelicon&rft.atitle=On+human+expendability%3A+AI+takeover+in+Clarke%27s+Odyssey+and+Stross%27s+Accelerando&rft.volume=49&rft.issue=2&rft.pages=495-511&rft.date=2022-12&rft_id=https%3A%2F%2Fapi.semanticscholar.org%2FCorpusID%3A253793613%23id-name%3DS2CID&rft.issn=0324-4652&rft_id=info%3Adoi%2F10.1007%2Fs11059-022-00670-w&rft.aulast=Kaminski&rft.aufirst=Johannes+D.&rft_id=https%3A%2F%2Flink.springer.com%2F10.1007%2Fs11059-022-00670-w&rfr_id=info%3Asid%2Fen.wikipedia.org%3AAI+takeover" class="Z3988"></span></span>
</li>
<li id="cite_note-AI_alignment_aima4-44"><span class="mw-cite-backlink"><b><a href="#cite_ref-AI_alignment_aima4_44-0">^</a></b></span> <span class="reference-text">
<link rel="mw-deduplicated-inline-style" href="mw-data:TemplateStyles:r1238218222"><cite id="CITEREFRussellNorvig2021" class="citation book cs1">Russell, Stuart J.; Norvig, Peter (2021). <a rel="nofollow" class="external text" href="https://www.pearson.com/us/higher-education/program/Russell-Artificial-Intelligence-A-Modern-Approach-4th-Edition/PGM1263338.html"><i>Artificial intelligence: A modern approach</i></a> (4th ed.). Pearson. pp. 5, 1003. <a href="/enwiki/wiki/ISBN_(identifier)" class="mw-redirect" title="ISBN (identifier)">ISBN</a> <a href="/enwiki/wiki/Special:BookSources/9780134610993" title="Special:BookSources/9780134610993"><bdi>9780134610993</bdi></a><span class="reference-accessdate">. Retrieved <span class="nowrap">September 12,</span> 2022</span>.</cite><span title="ctx_ver=Z39.88-2004&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Abook&rft.genre=book&rft.btitle=Artificial+intelligence%3A+A+modern+approach&rft.pages=5%2C+1003&rft.edition=4th&rft.pub=Pearson&rft.date=2021&rft.isbn=9780134610993&rft.aulast=Russell&rft.aufirst=Stuart+J.&rft.au=Norvig%2C+Peter&rft_id=https%3A%2F%2Fwww.pearson.com%2Fus%2Fhigher-education%2Fprogram%2FRussell-Artificial-Intelligence-A-Modern-Approach-4th-Edition%2FPGM1263338.html&rfr_id=info%3Asid%2Fen.wikipedia.org%3AAI+takeover" class="Z3988"></span></span>
</li>
</ol></div></div>
<div class="mw-heading mw-heading2"><h2 id="External_links">External links</h2><span class="mw-editsection"><span class="mw-editsection-bracket">[</span><a href="/enwiki/w/index.php?title=AI_takeover&action=edit&section=22" title="Edit section's source code: External links"><span>edit source</span></a><span class="mw-editsection-bracket">]</span></span></div>
<ul><li><a href="/enwiki/wiki/TED_talk" class="mw-redirect" title="TED talk">TED talk</a>: <a rel="nofollow" class="external text" href="https://www.youtube.com/watch?v=8nt3edWLgIg">"Can we build AI without losing control over it?"</a> by <a href="/enwiki/wiki/Sam_Harris" title="Sam Harris">Sam Harris</a></li></ul>
<div class="navbox-styles"><link rel="mw-deduplicated-inline-style" href="mw-data:TemplateStyles:r1129693374"><style data-mw-deduplicate="TemplateStyles:r1236075235">.mw-parser-output .navbox{box-sizing:border-box;border:1px solid #a2a9b1;width:100%;clear:both;font-size:88%;text-align:center;padding:1px;margin:1em auto 0}.mw-parser-output .navbox .navbox{margin-top:0}.mw-parser-output .navbox+.navbox,.mw-parser-output .navbox+.navbox-styles+.navbox{margin-top:-1px}.mw-parser-output .navbox-inner,.mw-parser-output .navbox-subgroup{width:100%}.mw-parser-output .navbox-group,.mw-parser-output .navbox-title,.mw-parser-output .navbox-abovebelow{padding:0.25em 1em;line-height:1.5em;text-align:center}.mw-parser-output .navbox-group{white-space:nowrap;text-align:right}.mw-parser-output .navbox,.mw-parser-output .navbox-subgroup{background-color:#fdfdfd}.mw-parser-output .navbox-list{line-height:1.5em;border-color:#fdfdfd}.mw-parser-output .navbox-list-with-group{text-align:left;border-left-width:2px;border-left-style:solid}.mw-parser-output tr+tr>.navbox-abovebelow,.mw-parser-output tr+tr>.navbox-group,.mw-parser-output tr+tr>.navbox-image,.mw-parser-output tr+tr>.navbox-list{border-top:2px solid #fdfdfd}.mw-parser-output .navbox-title{background-color:#ccf}.mw-parser-output .navbox-abovebelow,.mw-parser-output .navbox-group,.mw-parser-output .navbox-subgroup .navbox-title{background-color:#ddf}.mw-parser-output .navbox-subgroup .navbox-group,.mw-parser-output .navbox-subgroup .navbox-abovebelow{background-color:#e6e6ff}.mw-parser-output .navbox-even{background-color:#f7f7f7}.mw-parser-output .navbox-odd{background-color:transparent}.mw-parser-output .navbox .hlist td dl,.mw-parser-output .navbox .hlist td ol,.mw-parser-output .navbox .hlist td ul,.mw-parser-output .navbox td.hlist dl,.mw-parser-output .navbox td.hlist ol,.mw-parser-output .navbox td.hlist ul{padding:0.125em 0}.mw-parser-output .navbox .navbar{display:block;font-size:100%}.mw-parser-output .navbox-title .navbar{float:left;text-align:left;margin-right:0.5em}body.skin--responsive .mw-parser-output .navbox-image img{max-width:none!important}@media print{body.ns-0 .mw-parser-output .navbox{display:none!important}}</style></div><div role="navigation" class="navbox" aria-labelledby="Existential_risk_from_artificial_intelligence" style="padding:3px"><table class="nowraplinks mw-collapsible expanded navbox-inner" style="border-spacing:0;background:transparent;color:inherit"><tbody><tr><th scope="col" class="navbox-title" colspan="2"><link rel="mw-deduplicated-inline-style" href="mw-data:TemplateStyles:r1129693374"><link rel="mw-deduplicated-inline-style" href="mw-data:TemplateStyles:r1239400231"><div class="navbar plainlinks hlist navbar-mini"><ul><li class="nv-view"><a href="/enwiki/wiki/Template:Existential_risk_from_artificial_intelligence" title="Template:Existential risk from artificial intelligence"><abbr title="View this template">v</abbr></a></li><li class="nv-talk"><a href="/enwiki/wiki/Template_talk:Existential_risk_from_artificial_intelligence" title="Template talk:Existential risk from artificial intelligence"><abbr title="Discuss this template">t</abbr></a></li><li class="nv-edit"><a href="/enwiki/wiki/Special:EditPage/Template:Existential_risk_from_artificial_intelligence" title="Special:EditPage/Template:Existential risk from artificial intelligence"><abbr title="Edit this template">e</abbr></a></li></ul></div><div id="Existential_risk_from_artificial_intelligence" style="font-size:114%;margin:0 4em"><a href="/enwiki/wiki/Existential_risk_from_artificial_general_intelligence" title="Existential risk from artificial general intelligence">Existential risk</a> from <a href="/enwiki/wiki/Artificial_intelligence" title="Artificial intelligence">artificial intelligence</a></div></th></tr><tr><th scope="row" class="navbox-group" style="width:1%">Concepts</th><td class="navbox-list-with-group navbox-list navbox-odd hlist" style="width:100%;padding:0"><div style="padding:0 0.25em">
<ul><li><a href="/enwiki/wiki/Artificial_general_intelligence" title="Artificial general intelligence">AGI</a></li>
<li><a href="/enwiki/wiki/AI_alignment" title="AI alignment">AI alignment</a></li>
<li><a href="/enwiki/wiki/AI_capability_control" title="AI capability control">AI capability control</a></li>
<li><a href="/enwiki/wiki/AI_safety" title="AI safety">AI safety</a></li>
<li><a class="mw-selflink selflink">AI takeover</a></li>
<li><a href="/enwiki/wiki/Consequentialism" title="Consequentialism">Consequentialism</a></li>
<li><a href="/enwiki/wiki/Effective_accelerationism" title="Effective accelerationism">Effective accelerationism</a></li>
<li><a href="/enwiki/wiki/Ethics_of_artificial_intelligence" title="Ethics of artificial intelligence">Ethics of artificial intelligence</a></li>
<li><a href="/enwiki/wiki/Existential_risk_from_artificial_general_intelligence" title="Existential risk from artificial general intelligence">Existential risk from artificial general intelligence</a></li>
<li><a href="/enwiki/wiki/Friendly_artificial_intelligence" title="Friendly artificial intelligence">Friendly artificial intelligence</a></li>
<li><a href="/enwiki/wiki/Instrumental_convergence" title="Instrumental convergence">Instrumental convergence</a></li>
<li><a href="/enwiki/wiki/Intelligence_explosion" class="mw-redirect" title="Intelligence explosion">Intelligence explosion</a></li>
<li><a href="/enwiki/wiki/Longtermism" title="Longtermism">Longtermism</a></li>
<li><a href="/enwiki/wiki/Machine_ethics" title="Machine ethics">Machine ethics</a></li>
<li><a href="/enwiki/wiki/Suffering_risks" title="Suffering risks">Suffering risks</a></li>
<li><a href="/enwiki/wiki/Superintelligence" title="Superintelligence">Superintelligence</a></li>
<li><a href="/enwiki/wiki/Technological_singularity" title="Technological singularity">Technological singularity</a></li></ul>
</div></td></tr><tr><th scope="row" class="navbox-group" style="width:1%">Organizations</th><td class="navbox-list-with-group navbox-list navbox-even hlist" style="width:100%;padding:0"><div style="padding:0 0.25em">
<ul><li><a href="/enwiki/wiki/Alignment_Research_Center" title="Alignment Research Center">Alignment Research Center</a></li>
<li><a href="/enwiki/wiki/Center_for_AI_Safety" title="Center for AI Safety">Center for AI Safety</a></li>
<li><a href="/enwiki/wiki/Center_for_Applied_Rationality" title="Center for Applied Rationality">Center for Applied Rationality</a></li>
<li><a href="/enwiki/wiki/Center_for_Human-Compatible_Artificial_Intelligence" title="Center for Human-Compatible Artificial Intelligence">Center for Human-Compatible Artificial Intelligence</a></li>
<li><a href="/enwiki/wiki/Centre_for_the_Study_of_Existential_Risk" title="Centre for the Study of Existential Risk">Centre for the Study of Existential Risk</a></li>
<li><a href="/enwiki/wiki/EleutherAI" title="EleutherAI">EleutherAI</a></li>
<li><a href="/enwiki/wiki/Future_of_Humanity_Institute" title="Future of Humanity Institute">Future of Humanity Institute</a></li>
<li><a href="/enwiki/wiki/Future_of_Life_Institute" title="Future of Life Institute">Future of Life Institute</a></li>
<li><a href="/enwiki/wiki/Google_DeepMind" title="Google DeepMind">Google DeepMind</a></li>
<li><a href="/enwiki/wiki/Humanity%2B" title="Humanity+">Humanity+</a></li>
<li><a href="/enwiki/wiki/Institute_for_Ethics_and_Emerging_Technologies" title="Institute for Ethics and Emerging Technologies">Institute for Ethics and Emerging Technologies</a></li>
<li><a href="/enwiki/wiki/Leverhulme_Centre_for_the_Future_of_Intelligence" title="Leverhulme Centre for the Future of Intelligence">Leverhulme Centre for the Future of Intelligence</a></li>
<li><a href="/enwiki/wiki/Machine_Intelligence_Research_Institute" title="Machine Intelligence Research Institute">Machine Intelligence Research Institute</a></li>
<li><a href="/enwiki/wiki/OpenAI" title="OpenAI">OpenAI</a></li></ul>
</div></td></tr><tr><th scope="row" class="navbox-group" style="width:1%">People</th><td class="navbox-list-with-group navbox-list navbox-odd hlist" style="width:100%;padding:0"><div style="padding:0 0.25em">
<ul><li><a href="/enwiki/wiki/Slate_Star_Codex" title="Slate Star Codex">Scott Alexander</a></li>
<li><a href="/enwiki/wiki/Sam_Altman" title="Sam Altman">Sam Altman</a></li>
<li><a href="/enwiki/wiki/Yoshua_Bengio" title="Yoshua Bengio">Yoshua Bengio</a></li>
<li><a href="/enwiki/wiki/Nick_Bostrom" title="Nick Bostrom">Nick Bostrom</a></li>
<li><a href="/enwiki/wiki/Paul_Christiano_(researcher)" title="Paul Christiano (researcher)">Paul Christiano</a></li>
<li><a href="/enwiki/wiki/K._Eric_Drexler" title="K. Eric Drexler">Eric Drexler</a></li>
<li><a href="/enwiki/wiki/Sam_Harris" title="Sam Harris">Sam Harris</a></li>
<li><a href="/enwiki/wiki/Stephen_Hawking" title="Stephen Hawking">Stephen Hawking</a></li>
<li><a href="/enwiki/wiki/Dan_Hendrycks" title="Dan Hendrycks">Dan Hendrycks</a></li>
<li><a href="/enwiki/wiki/Geoffrey_Hinton" title="Geoffrey Hinton">Geoffrey Hinton</a></li>
<li><a href="/enwiki/wiki/Bill_Joy" title="Bill Joy">Bill Joy</a></li>
<li><a href="/enwiki/wiki/Shane_Legg" title="Shane Legg">Shane Legg</a></li>
<li><a href="/enwiki/wiki/Elon_Musk" title="Elon Musk">Elon Musk</a></li>
<li><a href="/enwiki/wiki/Steve_Omohundro" title="Steve Omohundro">Steve Omohundro</a></li>
<li><a href="/enwiki/wiki/Huw_Price" title="Huw Price">Huw Price</a></li>
<li><a href="/enwiki/wiki/Martin_Rees" title="Martin Rees">Martin Rees</a></li>
<li><a href="/enwiki/wiki/Stuart_J._Russell" title="Stuart J. Russell">Stuart J. Russell</a></li>
<li><a href="/enwiki/wiki/Jaan_Tallinn" title="Jaan Tallinn">Jaan Tallinn</a></li>
<li><a href="/enwiki/wiki/Max_Tegmark" title="Max Tegmark">Max Tegmark</a></li>
<li><a href="/enwiki/wiki/Frank_Wilczek" title="Frank Wilczek">Frank Wilczek</a></li>
<li><a href="/enwiki/wiki/Roman_Yampolskiy" title="Roman Yampolskiy">Roman Yampolskiy</a></li>
<li><a href="/enwiki/wiki/Eliezer_Yudkowsky" title="Eliezer Yudkowsky">Eliezer Yudkowsky</a></li></ul>
</div></td></tr><tr><th scope="row" class="navbox-group" style="width:1%">Other</th><td class="navbox-list-with-group navbox-list navbox-even hlist" style="width:100%;padding:0"><div style="padding:0 0.25em">
<ul><li><a href="/enwiki/wiki/Statement_on_AI_risk_of_extinction" title="Statement on AI risk of extinction">Statement on AI risk of extinction</a></li>
<li><i><a href="/enwiki/wiki/Human_Compatible" title="Human Compatible">Human Compatible</a></i></li>
<li><a href="/enwiki/wiki/Open_letter_on_artificial_intelligence_(2015)" title="Open letter on artificial intelligence (2015)">Open letter on artificial intelligence (2015)</a></li>
<li><i><a href="/enwiki/wiki/Our_Final_Invention" title="Our Final Invention">Our Final Invention</a></i></li>
<li><i><a href="/enwiki/wiki/The_Precipice:_Existential_Risk_and_the_Future_of_Humanity" title="The Precipice: Existential Risk and the Future of Humanity">The Precipice</a></i></li>
<li><i><a href="/enwiki/wiki/Superintelligence:_Paths,_Dangers,_Strategies" title="Superintelligence: Paths, Dangers, Strategies">Superintelligence: Paths, Dangers, Strategies</a></i></li>
<li><i><a href="/enwiki/wiki/Do_You_Trust_This_Computer%3F" title="Do You Trust This Computer?">Do You Trust This Computer?</a></i></li>
<li><a href="/enwiki/wiki/Artificial_Intelligence_Act" title="Artificial Intelligence Act">Artificial Intelligence Act</a></li></ul>
</div></td></tr><tr><td class="navbox-abovebelow" colspan="2"><div><span class="noviewer" typeof="mw:File"><span title="Category"><img alt="" src="/upwiki/wikipedia/en/thumb/9/96/Symbol_category_class.svg/16px-Symbol_category_class.svg.png" decoding="async" width="16" height="16" class="mw-file-element" srcset="/upwiki/wikipedia/en/thumb/9/96/Symbol_category_class.svg/23px-Symbol_category_class.svg.png 1.5x, /upwiki/wikipedia/en/thumb/9/96/Symbol_category_class.svg/31px-Symbol_category_class.svg.png 2x" data-file-width="180" data-file-height="185" /></span></span> <a href="/enwiki/wiki/Category:Existential_risk_from_artificial_general_intelligence" title="Category:Existential risk from artificial general intelligence">Category</a></div></td></tr></tbody></table></div>
<div class="navbox-styles"><link rel="mw-deduplicated-inline-style" href="mw-data:TemplateStyles:r1129693374"><link rel="mw-deduplicated-inline-style" href="mw-data:TemplateStyles:r1236075235"></div><div role="navigation" class="navbox" aria-labelledby="Global_catastrophic_risks" style="padding:3px"><table class="nowraplinks hlist mw-collapsible autocollapse navbox-inner" style="border-spacing:0;background:transparent;color:inherit"><tbody><tr><th scope="col" class="navbox-title" colspan="2"><link rel="mw-deduplicated-inline-style" href="mw-data:TemplateStyles:r1129693374"><link rel="mw-deduplicated-inline-style" href="mw-data:TemplateStyles:r1239400231"><div class="navbar plainlinks hlist navbar-mini"><ul><li class="nv-view"><a href="/enwiki/wiki/Template:Global_catastrophic_risks" title="Template:Global catastrophic risks"><abbr title="View this template">v</abbr></a></li><li class="nv-talk"><a href="/enwiki/wiki/Template_talk:Global_catastrophic_risks" title="Template talk:Global catastrophic risks"><abbr title="Discuss this template">t</abbr></a></li><li class="nv-edit"><a href="/enwiki/wiki/Special:EditPage/Template:Global_catastrophic_risks" title="Special:EditPage/Template:Global catastrophic risks"><abbr title="Edit this template">e</abbr></a></li></ul></div><div id="Global_catastrophic_risks" style="font-size:114%;margin:0 4em"><a href="/enwiki/wiki/Global_catastrophic_risk" title="Global catastrophic risk">Global catastrophic risks</a></div></th></tr><tr><td class="navbox-abovebelow" colspan="2"><div>
<ul><li><a href="/enwiki/wiki/Future_of_Earth" title="Future of Earth">Future of the Earth</a></li>
<li><a href="/enwiki/wiki/Future_of_an_expanding_universe" title="Future of an expanding universe">Future of an expanding universe</a>
<ul><li><a href="/enwiki/wiki/Ultimate_fate_of_the_universe" title="Ultimate fate of the universe">Ultimate fate of the universe</a></li></ul></li></ul>
</div></td></tr><tr><th scope="row" class="navbox-group" style="width:1%">Technological</th><td class="navbox-list-with-group navbox-list navbox-odd" style="width:100%;padding:0"><div style="padding:0 0.25em">
<ul><li><a href="/enwiki/wiki/Chemical_warfare" title="Chemical warfare">Chemical warfare</a></li>
<li><a href="/enwiki/wiki/Cyberattack" title="Cyberattack">Cyberattack</a>
<ul><li><a href="/enwiki/wiki/Cyberwarfare" title="Cyberwarfare">Cyberwarfare</a></li>
<li><a href="/enwiki/wiki/Cyberterrorism" title="Cyberterrorism">Cyberterrorism</a></li>
<li><a href="/enwiki/wiki/Cybergeddon" title="Cybergeddon">Cybergeddon</a></li></ul></li>
<li><a href="/enwiki/wiki/Gray_goo" title="Gray goo">Gray goo</a></li>
<li><a href="/enwiki/wiki/Industrial_applications_of_nanotechnology#Weapons" title="Industrial applications of nanotechnology">Nanoweapons</a></li>
<li><a href="/enwiki/wiki/Kinetic_bombardment" title="Kinetic bombardment">Kinetic bombardment</a>
<ul><li><a href="/enwiki/wiki/Kinetic_energy_weapon" title="Kinetic energy weapon">Kinetic energy weapon</a></li></ul></li>
<li><a href="/enwiki/wiki/Nuclear_warfare" title="Nuclear warfare">Nuclear warfare</a>
<ul><li><a href="/enwiki/wiki/Mutual_assured_destruction" title="Mutual assured destruction">Mutual assured destruction</a></li>
<li><a href="/enwiki/wiki/Dead_Hand" title="Dead Hand">Dead Hand</a></li>
<li><a href="/enwiki/wiki/Doomsday_Clock" title="Doomsday Clock">Doomsday Clock</a></li>
<li><a href="/enwiki/wiki/Doomsday_device" title="Doomsday device">Doomsday device</a></li>
<li><a href="/enwiki/wiki/Antimatter_weapon" title="Antimatter weapon">Antimatter weapon</a></li></ul></li>
<li><a href="/enwiki/wiki/Electromagnetic_pulse" title="Electromagnetic pulse">Electromagnetic pulse</a> (EMP)</li>
<li><a href="/enwiki/wiki/Safety_of_high-energy_particle_collision_experiments" title="Safety of high-energy particle collision experiments">Safety of high-energy particle collision experiments</a>
<ul><li><a href="/enwiki/wiki/Micro_black_hole" title="Micro black hole">Micro black hole</a></li>
<li><a href="/enwiki/wiki/Strangelet" title="Strangelet">Strangelet</a></li></ul></li>
<li><a href="/enwiki/wiki/Synthetic_intelligence" title="Synthetic intelligence">Synthetic intelligence</a> / <a href="/enwiki/wiki/Artificial_intelligence" title="Artificial intelligence">Artificial intelligence</a>
<ul><li><a class="mw-selflink selflink">AI takeover</a></li>
<li><a href="/enwiki/wiki/Existential_risk_from_artificial_general_intelligence" title="Existential risk from artificial general intelligence">Existential risk from artificial intelligence</a></li>
<li><a href="/enwiki/wiki/Technological_singularity" title="Technological singularity">Technological singularity</a></li></ul></li>
<li><a href="/enwiki/wiki/Transhumanism" title="Transhumanism">Transhumanism</a></li></ul>
</div></td></tr><tr><th scope="row" class="navbox-group" style="width:1%">Sociological</th><td class="navbox-list-with-group navbox-list navbox-even" style="width:100%;padding:0"><div style="padding:0 0.25em">
<ul><li><a href="/enwiki/wiki/Anthropogenic_hazard" class="mw-redirect" title="Anthropogenic hazard">Anthropogenic hazard</a></li>
<li><a href="/enwiki/wiki/Collapsology" title="Collapsology">Collapsology</a></li>
<li><a href="/enwiki/wiki/Doomsday_argument" title="Doomsday argument">Doomsday argument</a>
<ul><li><a href="/enwiki/wiki/Self-indication_assumption_doomsday_argument_rebuttal" title="Self-indication assumption doomsday argument rebuttal">Self-indication assumption doomsday argument rebuttal</a></li>
<li><a href="/enwiki/wiki/Self-referencing_doomsday_argument_rebuttal" title="Self-referencing doomsday argument rebuttal">Self-referencing doomsday argument rebuttal</a></li></ul></li>
<li><a href="/enwiki/wiki/Economic_collapse" title="Economic collapse">Economic collapse</a></li>
<li><a href="/enwiki/wiki/Malthusianism" title="Malthusianism">Malthusian catastrophe</a></li>
<li><a href="/enwiki/wiki/New_World_Order_(conspiracy_theory)" class="mw-redirect" title="New World Order (conspiracy theory)">New World Order (conspiracy theory)</a></li>
<li><a href="/enwiki/wiki/Nuclear_holocaust" title="Nuclear holocaust">Nuclear holocaust</a>
<ul><li><a href="/enwiki/wiki/Cobalt_bomb" title="Cobalt bomb">cobalt</a></li>
<li><a href="/enwiki/wiki/Nuclear_famine" title="Nuclear famine">famine</a></li>
<li><a href="/enwiki/wiki/Nuclear_winter" title="Nuclear winter">winter</a></li></ul></li>
<li><a href="/enwiki/wiki/Societal_collapse" title="Societal collapse">Societal collapse</a></li>
<li><a href="/enwiki/wiki/World_War_III" title="World War III">World War III</a></li></ul>
</div></td></tr><tr><th scope="row" class="navbox-group" style="width:1%"><a href="/enwiki/wiki/Climate_apocalypse" title="Climate apocalypse">Ecological</a></th><td class="navbox-list-with-group navbox-list navbox-odd" style="width:100%;padding:0"><div style="padding:0 0.25em"></div><table class="nowraplinks navbox-subgroup" style="border-spacing:0"><tbody><tr><th scope="row" class="navbox-group" style="width:1%"><a href="/enwiki/wiki/Climate_variability_and_change" title="Climate variability and change">Climate change</a></th><td class="navbox-list-with-group navbox-list navbox-odd" style="width:100%;padding:0"><div style="padding:0 0.25em">
<ul><li><a href="/enwiki/wiki/Anoxic_event" title="Anoxic event">Anoxic event</a></li>
<li><a href="/enwiki/wiki/Biodiversity_loss" title="Biodiversity loss">Biodiversity loss</a>
<ul><li><a href="/enwiki/wiki/Mass_mortality_event" title="Mass mortality event">Mass mortality event</a></li></ul></li>
<li><a href="/enwiki/wiki/Cascade_effect_(ecology)" title="Cascade effect (ecology)">Cascade effect</a></li>
<li><a href="/enwiki/wiki/Cataclysmic_pole_shift_hypothesis" title="Cataclysmic pole shift hypothesis">Cataclysmic pole shift hypothesis</a></li>
<li><a href="/enwiki/wiki/Climate_change_and_civilizational_collapse" title="Climate change and civilizational collapse">Climate change and civilizational collapse</a></li>
<li><a href="/enwiki/wiki/Deforestation" title="Deforestation">Deforestation</a></li>
<li><a href="/enwiki/wiki/Desertification" title="Desertification">Desertification</a></li>
<li><a href="/enwiki/wiki/Extinction_risk_from_climate_change" title="Extinction risk from climate change">Extinction risk from climate change</a>
<ul><li><a href="/enwiki/wiki/Tipping_points_in_the_climate_system" title="Tipping points in the climate system">Tipping points in the climate system</a></li></ul></li>
<li><a href="/enwiki/wiki/Flood_basalt" title="Flood basalt">Flood basalt</a></li>
<li><a href="/enwiki/wiki/Global_dimming" title="Global dimming">Global dimming</a></li>
<li><a href="/enwiki/wiki/Global_terrestrial_stilling" title="Global terrestrial stilling">Global terrestrial stilling</a></li>
<li><a href="/enwiki/wiki/Climate_change" title="Climate change">Global warming</a></li>
<li><a href="/enwiki/wiki/Hypercane" title="Hypercane">Hypercane</a></li>
<li><a href="/enwiki/wiki/Ice_age" title="Ice age">Ice age</a></li>
<li><a href="/enwiki/wiki/Ecocide" title="Ecocide">Ecocide</a></li>
<li><a href="/enwiki/wiki/Ecological_collapse" class="mw-redirect" title="Ecological collapse">Ecological collapse</a></li>
<li><a href="/enwiki/wiki/Environmental_degradation" title="Environmental degradation">Environmental degradation</a></li>
<li><a href="/enwiki/wiki/Habitat_destruction" title="Habitat destruction">Habitat destruction</a></li>
<li><a href="/enwiki/wiki/Human_impact_on_the_environment" title="Human impact on the environment">Human impact on the environment</a>
<ul><li><a href="/enwiki/wiki/Environmental_issues_with_coral_reefs" title="Environmental issues with coral reefs">coral reefs</a></li>
<li><a href="/enwiki/wiki/Human_impact_on_marine_life" title="Human impact on marine life">on marine life</a></li></ul></li>
<li><a href="/enwiki/wiki/Land_degradation" title="Land degradation">Land degradation</a></li>
<li><a href="/enwiki/wiki/Land_consumption" title="Land consumption">Land consumption</a></li>
<li><a href="/enwiki/wiki/Land_surface_effects_on_climate" title="Land surface effects on climate">Land surface effects on climate</a></li>
<li><a href="/enwiki/wiki/Ocean_acidification" title="Ocean acidification">Ocean acidification</a></li>
<li><a href="/enwiki/wiki/Ozone_depletion" title="Ozone depletion">Ozone depletion</a></li>
<li><a href="/enwiki/wiki/Resource_depletion" title="Resource depletion">Resource depletion</a></li>
<li><a href="/enwiki/wiki/Sea_level_rise" title="Sea level rise">Sea level rise</a></li>
<li><a href="/enwiki/wiki/Supervolcano" title="Supervolcano">Supervolcano</a>
<ul><li><a href="/enwiki/wiki/Volcanic_winter" title="Volcanic winter">winter</a></li></ul></li>
<li><a href="/enwiki/wiki/Verneshot" title="Verneshot">Verneshot</a></li>
<li><a href="/enwiki/wiki/Water_pollution" title="Water pollution">Water pollution</a></li>
<li><a href="/enwiki/wiki/Water_scarcity" title="Water scarcity">Water scarcity</a></li></ul>
</div></td></tr><tr><th scope="row" class="navbox-group" style="width:1%"><a href="/enwiki/wiki/Earth_Overshoot_Day" title="Earth Overshoot Day">Earth Overshoot Day</a></th><td class="navbox-list-with-group navbox-list navbox-even" style="width:100%;padding:0"><div style="padding:0 0.25em">
<ul><li><a href="/enwiki/wiki/Overexploitation" title="Overexploitation">Overexploitation</a></li>
<li><a href="/enwiki/wiki/Overpopulation" title="Overpopulation">Overpopulation</a>
<ul><li><a href="/enwiki/wiki/Human_overpopulation" title="Human overpopulation">Human overpopulation</a></li></ul></li></ul>
</div></td></tr></tbody></table><div></div></td></tr><tr><th scope="row" class="navbox-group" style="width:1%">Biological</th><td class="navbox-list-with-group navbox-list navbox-odd" style="width:100%;padding:0"><div style="padding:0 0.25em"></div><table class="nowraplinks navbox-subgroup" style="border-spacing:0"><tbody><tr><th scope="row" class="navbox-group" style="width:1%"><a href="/enwiki/wiki/Extinction" title="Extinction">Extinction</a></th><td class="navbox-list-with-group navbox-list navbox-odd" style="width:100%;padding:0"><div style="padding:0 0.25em">
<ul><li><a href="/enwiki/wiki/Extinction_event" title="Extinction event">Extinction event</a></li>
<li><a href="/enwiki/wiki/Holocene_extinction" title="Holocene extinction">Holocene extinction</a></li>
<li><a href="/enwiki/wiki/Human_extinction" title="Human extinction">Human extinction</a></li>
<li><a href="/enwiki/wiki/List_of_extinction_events" title="List of extinction events">List of extinction events</a></li>
<li><a href="/enwiki/wiki/Genetic_erosion" title="Genetic erosion">Genetic erosion</a></li>
<li><a href="/enwiki/wiki/Genetic_pollution" title="Genetic pollution">Genetic pollution</a></li></ul>
</div></td></tr><tr><th scope="row" class="navbox-group" style="width:1%">Others</th><td class="navbox-list-with-group navbox-list navbox-even" style="width:100%;padding:0"><div style="padding:0 0.25em">
<ul><li><a href="/enwiki/wiki/Biodiversity_loss" title="Biodiversity loss">Biodiversity loss</a>
<ul><li><a href="/enwiki/wiki/Decline_in_amphibian_populations" title="Decline in amphibian populations">Decline in amphibian populations</a></li>
<li><a href="/enwiki/wiki/Decline_in_insect_populations" title="Decline in insect populations">Decline in insect populations</a></li></ul></li>
<li><a href="/enwiki/wiki/Biotechnology_risk" title="Biotechnology risk">Biotechnology risk</a>
<ul><li><a href="/enwiki/wiki/Biological_agent" title="Biological agent">Biological agent</a></li>
<li><a href="/enwiki/wiki/Biological_warfare" title="Biological warfare">Biological warfare</a></li>
<li><a href="/enwiki/wiki/Bioterrorism" title="Bioterrorism">Bioterrorism</a></li></ul></li>
<li><a href="/enwiki/wiki/Colony_collapse_disorder" title="Colony collapse disorder">Colony collapse disorder</a></li>
<li><a href="/enwiki/wiki/Defaunation" title="Defaunation">Defaunation</a></li>
<li><a href="/enwiki/wiki/Dysgenics" title="Dysgenics">Dysgenics</a></li>
<li><a href="/enwiki/wiki/Interplanetary_contamination" title="Interplanetary contamination">Interplanetary contamination</a></li>
<li><a href="/enwiki/wiki/Pandemic" title="Pandemic">Pandemic</a></li>
<li><a href="/enwiki/wiki/Pollinator_decline" title="Pollinator decline">Pollinator decline</a></li>
<li><a href="/enwiki/wiki/Overfishing" title="Overfishing">Overfishing</a></li></ul>
</div></td></tr></tbody></table><div></div></td></tr><tr><th scope="row" class="navbox-group" style="width:1%">Astronomical</th><td class="navbox-list-with-group navbox-list navbox-odd" style="width:100%;padding:0"><div style="padding:0 0.25em">
<ul><li><a href="/enwiki/wiki/Big_Crunch" title="Big Crunch">Big Crunch</a></li>
<li><a href="/enwiki/wiki/Big_Rip" title="Big Rip">Big Rip</a></li>
<li><a href="/enwiki/wiki/Coronal_mass_ejection" title="Coronal mass ejection">Coronal mass ejection</a></li>
<li><a href="/enwiki/wiki/Cosmological_phase_transition" title="Cosmological phase transition">Cosmological phase transition</a></li>
<li><a href="/enwiki/wiki/Geomagnetic_storm" title="Geomagnetic storm">Geomagnetic storm</a></li>
<li><a href="/enwiki/wiki/False_vacuum_decay" class="mw-redirect" title="False vacuum decay">False vacuum decay</a></li>
<li><a href="/enwiki/wiki/Gamma-ray_burst" title="Gamma-ray burst">Gamma-ray burst</a></li>
<li><a href="/enwiki/wiki/Heat_death_of_the_universe" title="Heat death of the universe">Heat death of the universe</a></li>
<li><a href="/enwiki/wiki/Proton_decay" title="Proton decay">Proton decay</a></li>
<li><a href="/enwiki/wiki/Virtual_black_hole" title="Virtual black hole">Virtual black hole</a></li>
<li><a href="/enwiki/wiki/Impact_event" title="Impact event">Impact event</a>
<ul><li><a href="/enwiki/wiki/Asteroid_impact_avoidance" title="Asteroid impact avoidance">Asteroid impact avoidance</a></li>
<li><a href="/enwiki/wiki/Asteroid_impact_prediction" title="Asteroid impact prediction">Asteroid impact prediction</a></li>
<li><a href="/enwiki/wiki/Potentially_hazardous_object" title="Potentially hazardous object">Potentially hazardous object</a>
<ul><li><a href="/enwiki/wiki/Near-Earth_object" title="Near-Earth object">Near-Earth object</a></li></ul></li>
<li><a href="/enwiki/wiki/Impact_winter" title="Impact winter">winter</a></li>
<li><a href="/enwiki/wiki/Rogue_planet" title="Rogue planet">Rogue planet</a></li></ul></li>
<li><a href="/enwiki/wiki/Near-Earth_supernova" title="Near-Earth supernova">Near-Earth supernova</a></li>
<li><a href="/enwiki/wiki/Hypernova" title="Hypernova">Hypernova</a></li>
<li><a href="/enwiki/wiki/Micronova" title="Micronova">Micronova</a></li>
<li><a href="/enwiki/wiki/Solar_flare" title="Solar flare">Solar flare</a></li>
<li><a href="/enwiki/wiki/Stellar_collision" title="Stellar collision">Stellar collision</a></li></ul>
</div></td></tr><tr><th scope="row" class="navbox-group" style="width:1%"><a href="/enwiki/wiki/Eschatology" title="Eschatology">Eschatological</a></th><td class="navbox-list-with-group navbox-list navbox-even" style="width:100%;padding:0"><div style="padding:0 0.25em">
<ul><li><a href="/enwiki/wiki/Buddhist_eschatology" title="Buddhist eschatology">Buddhist</a>
<ul><li><a href="/enwiki/wiki/Maitreya" title="Maitreya">Maitreya</a></li>
<li><a href="/enwiki/wiki/Three_Ages_of_Buddhism" title="Three Ages of Buddhism">Three Ages</a></li></ul></li>
<li><a href="/enwiki/wiki/Hindu_eschatology" title="Hindu eschatology">Hindu</a>
<ul><li><a href="/enwiki/wiki/Kalki" title="Kalki">Kalki</a></li>
<li><a href="/enwiki/wiki/Kali_Yuga" title="Kali Yuga">Kali Yuga</a></li></ul></li>
<li><a href="/enwiki/wiki/Last_Judgment" title="Last Judgment">Last Judgement</a></li>
<li><a href="/enwiki/wiki/Second_Coming" title="Second Coming">Second Coming</a>
<ul><li><a href="/enwiki/wiki/Book_of_Enoch" title="Book of Enoch">1 Enoch</a></li>
<li><a href="/enwiki/wiki/Book_of_Daniel" title="Book of Daniel">Daniel</a>
<ul><li><a href="/enwiki/wiki/Abomination_of_desolation" title="Abomination of desolation">Abomination of desolation</a></li>
<li><a href="/enwiki/wiki/Prophecy_of_Seventy_Weeks" title="Prophecy of Seventy Weeks">Prophecy of Seventy Weeks</a></li></ul></li>
<li><a href="/enwiki/wiki/Messiah" title="Messiah">Messiah</a></li>
<li><a href="/enwiki/wiki/Christian_eschatology" title="Christian eschatology">Christian</a>
<ul><li><a href="/enwiki/wiki/Futurism_(Christianity)" title="Futurism (Christianity)">Futurism</a></li>
<li><a href="/enwiki/wiki/Historicism_(Christianity)" title="Historicism (Christianity)">Historicism</a>
<ul><li><a href="/enwiki/wiki/Historicist_interpretations_of_the_Book_of_Revelation" title="Historicist interpretations of the Book of Revelation">Interpretations of Revelation</a></li></ul></li>
<li><a href="/enwiki/wiki/Idealism_(Christian_eschatology)" title="Idealism (Christian eschatology)"> Idealism</a></li>
<li><a href="/enwiki/wiki/Preterism" title="Preterism">Preterism</a></li>
<li><a href="/enwiki/wiki/2_Esdras" title="2 Esdras">2 Esdras</a></li>
<li><a href="/enwiki/wiki/Second_Epistle_to_the_Thessalonians" title="Second Epistle to the Thessalonians">2 Thessalonians</a>
<ul><li><a href="/enwiki/wiki/Man_of_sin" title="Man of sin">Man of sin</a></li>
<li><a href="/enwiki/wiki/Katechon" title="Katechon">Katechon</a></li></ul></li>
<li><a href="/enwiki/wiki/Antichrist" title="Antichrist">Antichrist</a></li>
<li><a href="/enwiki/wiki/Book_of_Revelation" title="Book of Revelation">Book of Revelation</a>
<ul><li><a href="/enwiki/wiki/Events_of_Revelation" title="Events of Revelation">Events</a>
<ul><li><a href="/enwiki/wiki/Four_Horsemen_of_the_Apocalypse" title="Four Horsemen of the Apocalypse">Four Horsemen of the Apocalypse</a></li>
<li><a href="/enwiki/wiki/Lake_of_fire" title="Lake of fire">Lake of fire</a></li>
<li><a href="/enwiki/wiki/Number_of_the_beast" title="Number of the beast">Number of the Beast</a></li>
<li><a href="/enwiki/wiki/Seven_bowls" title="Seven bowls">Seven bowls</a></li>
<li><a href="/enwiki/wiki/Seven_seals" title="Seven seals">Seven seals</a></li>
<li><a href="/enwiki/wiki/The_Beast_(Revelation)" title="The Beast (Revelation)">The Beast</a></li>
<li><a href="/enwiki/wiki/Two_witnesses" title="Two witnesses">Two witnesses</a></li>
<li><a href="/enwiki/wiki/War_in_Heaven" title="War in Heaven">War in Heaven</a></li>
<li><a href="/enwiki/wiki/Whore_of_Babylon" title="Whore of Babylon">Whore of Babylon</a></li></ul></li></ul></li>
<li><a href="/enwiki/wiki/Great_Apostasy" title="Great Apostasy">Great Apostasy</a></li>
<li><a href="/enwiki/wiki/New_Earth_(Christianity)" title="New Earth (Christianity)">New Earth</a></li>
<li><a href="/enwiki/wiki/New_Jerusalem" title="New Jerusalem">New Jerusalem</a></li>
<li><a href="/enwiki/wiki/Olivet_Discourse" title="Olivet Discourse">Olivet Discourse</a>
<ul><li><a href="/enwiki/wiki/Great_Tribulation" title="Great Tribulation">Great Tribulation</a></li></ul></li>
<li><a href="/enwiki/wiki/Son_of_perdition" title="Son of perdition">Son of perdition</a></li>
<li><a href="/enwiki/wiki/The_Sheep_and_the_Goats" title="The Sheep and the Goats">Sheep and Goats</a></li></ul></li>
<li><a href="/enwiki/wiki/Islamic_eschatology" title="Islamic eschatology">Islamic</a>
<ul><li><a href="/enwiki/wiki/Qa%27im_Al_Muhammad" title="Qa'im Al Muhammad">Al-Qa'im</a></li>
<li><a href="/enwiki/wiki/Beast_of_the_Earth" title="Beast of the Earth">Beast of the Earth</a></li>
<li><a href="/enwiki/wiki/Dhu_al-Qarnayn" title="Dhu al-Qarnayn">Dhu al-Qarnayn</a></li>
<li><a href="/enwiki/wiki/Dhul-Suwayqatayn" title="Dhul-Suwayqatayn">Dhul-Suwayqatayn</a></li>
<li><a href="/enwiki/wiki/Al-Masih_ad-Dajjal" title="Al-Masih ad-Dajjal">Dajjal</a></li>
<li><a href="/enwiki/wiki/Israfil" title="Israfil">Israfil</a></li>
<li><a href="/enwiki/wiki/Mahdi" title="Mahdi">Mahdi</a></li>
<li><a href="/enwiki/wiki/Sufyani" title="Sufyani">Sufyani</a></li></ul></li>
<li><a href="/enwiki/wiki/Jewish_eschatology" title="Jewish eschatology">Jewish</a>
<ul><li><a href="/enwiki/wiki/Messiah_in_Judaism" title="Messiah in Judaism">Messiah</a></li>
<li><a href="/enwiki/wiki/Gog_and_Magog" title="Gog and Magog">War of Gog and Magog</a></li>
<li><a href="/enwiki/wiki/Third_Temple" title="Third Temple">Third Temple</a></li></ul></li></ul></li>
<li><a href="/enwiki/wiki/Ragnar%C3%B6k" title="Ragnarök">Norse</a></li>
<li><a href="/enwiki/wiki/Frashokereti" title="Frashokereti">Zoroastrian</a>
<ul><li><a href="/enwiki/wiki/Saoshyant" title="Saoshyant">Saoshyant</a></li></ul></li></ul>
</div></td></tr><tr><th scope="row" class="navbox-group" style="width:1%">Others</th><td class="navbox-list-with-group navbox-list navbox-odd" style="width:100%;padding:0"><div style="padding:0 0.25em">
<ul><li><a href="/enwiki/wiki/2011_end_times_prediction" title="2011 end times prediction">2011 end times prediction</a></li>
<li><a href="/enwiki/wiki/2012_phenomenon" title="2012 phenomenon">2012 phenomenon</a></li>
<li><a href="/enwiki/wiki/Apocalypse" title="Apocalypse">Apocalypse</a></li>
<li><a href="/enwiki/wiki/Apocalyptic_literature" title="Apocalyptic literature">Apocalyptic literature</a></li>
<li><a href="/enwiki/wiki/Apocalypticism" title="Apocalypticism">Apocalypticism</a></li>
<li><a href="/enwiki/wiki/Armageddon" title="Armageddon">Armageddon</a></li>
<li><a href="/enwiki/wiki/Blood_moon_prophecy" title="Blood moon prophecy">Blood moon prophecy</a></li>
<li><a href="/enwiki/wiki/Earth_Changes" title="Earth Changes">Earth Changes</a></li>
<li><a href="/enwiki/wiki/Global_catastrophic_risk" title="Global catastrophic risk">End time</a></li>
<li><a href="/enwiki/wiki/Gog_and_Magog" title="Gog and Magog">Gog and Magog</a></li>
<li><a href="/enwiki/wiki/List_of_dates_predicted_for_apocalyptic_events" title="List of dates predicted for apocalyptic events">List of dates predicted for apocalyptic events</a></li>
<li><a href="/enwiki/wiki/Messianism" title="Messianism">Messianism</a>
<ul><li><a href="/enwiki/wiki/Messianic_Age" title="Messianic Age">Messianic Age</a></li></ul></li>
<li><a href="/enwiki/wiki/Millenarianism" title="Millenarianism">Millenarianism</a></li>
<li><a href="/enwiki/wiki/Millennialism" title="Millennialism">Millennialism</a>
<ul><li><a href="/enwiki/wiki/Premillennialism" title="Premillennialism">Premillennialism</a></li>
<li><a href="/enwiki/wiki/Amillennialism" title="Amillennialism">Amillennialism</a></li>
<li><a href="/enwiki/wiki/Postmillennialism" title="Postmillennialism">Postmillennialism</a></li></ul></li>
<li><a href="/enwiki/wiki/Nemesis_(hypothetical_star)" title="Nemesis (hypothetical star)">Nemesis (hypothetical star)</a></li>
<li><a href="/enwiki/wiki/Nibiru_cataclysm" title="Nibiru cataclysm">Nibiru cataclysm</a></li>
<li><a href="/enwiki/wiki/Rapture" title="Rapture">Rapture</a>
<ul><li><a href="/enwiki/wiki/Rapture#Prewrath_premillennialism" title="Rapture">Prewrath</a></li>
<li><a href="/enwiki/wiki/Post-tribulation_rapture" title="Post-tribulation rapture">Post-tribulation rapture</a></li></ul></li>
<li><a href="/enwiki/wiki/Universal_resurrection" title="Universal resurrection">Resurrection of the dead</a></li>
<li><a href="/enwiki/wiki/World_to_come" title="World to come">World to come</a></li></ul>
</div></td></tr><tr><th scope="row" class="navbox-group" style="width:1%">Fictional</th><td class="navbox-list-with-group navbox-list navbox-even" style="width:100%;padding:0"><div style="padding:0 0.25em">
<ul><li><a href="/enwiki/wiki/Alien_invasion" title="Alien invasion">Alien invasion</a></li>
<li><a href="/enwiki/wiki/Apocalyptic_and_post-apocalyptic_fiction" title="Apocalyptic and post-apocalyptic fiction">Apocalyptic and post-apocalyptic fiction</a>
<ul><li><a href="/enwiki/wiki/List_of_apocalyptic_and_post-apocalyptic_fiction" title="List of apocalyptic and post-apocalyptic fiction">List of apocalyptic and post-apocalyptic fiction</a></li>
<li><a href="/enwiki/wiki/List_of_apocalyptic_films" title="List of apocalyptic films">List of apocalyptic films</a></li></ul></li>
<li><a href="/enwiki/wiki/Climate_fiction" title="Climate fiction">Climate fiction</a></li>
<li><a href="/enwiki/wiki/Disaster_film" title="Disaster film">Disaster films</a>
<ul><li><a href="/enwiki/wiki/List_of_disaster_films" title="List of disaster films">List of disaster films</a></li></ul></li>
<li><a href="/enwiki/wiki/List_of_fictional_doomsday_devices" title="List of fictional doomsday devices">List of fictional doomsday devices</a></li>
<li><a href="/enwiki/wiki/Zombie_apocalypse" title="Zombie apocalypse">Zombie apocalypse</a>
<ul><li><a href="/enwiki/wiki/Zombie" title="Zombie">Zombie</a></li></ul></li></ul>
</div></td></tr><tr><th scope="row" class="navbox-group" style="width:1%">Organizations</th><td class="navbox-list-with-group navbox-list navbox-odd" style="width:100%;padding:0"><div style="padding:0 0.25em">
<ul><li><a href="/enwiki/wiki/Centre_for_the_Study_of_Existential_Risk" title="Centre for the Study of Existential Risk">Centre for the Study of Existential Risk</a></li>
<li><a href="/enwiki/wiki/Future_of_Humanity_Institute" title="Future of Humanity Institute">Future of Humanity Institute</a></li>
<li><a href="/enwiki/wiki/Future_of_Life_Institute" title="Future of Life Institute">Future of Life Institute</a></li>
<li><a href="/enwiki/wiki/Nuclear_Threat_Initiative" title="Nuclear Threat Initiative">Nuclear Threat Initiative</a></li></ul>
</div></td></tr><tr><th scope="row" class="navbox-group" style="width:1%">General</th><td class="navbox-list-with-group navbox-list navbox-even" style="width:100%;padding:0"><div style="padding:0 0.25em">
<ul><li><a href="/enwiki/wiki/Ransomware" title="Ransomware">Ransomware</a></li>
<li><a href="/enwiki/wiki/Cyberwarfare" title="Cyberwarfare">Cyberwarfare</a></li>
<li><a href="/enwiki/wiki/Economic_depression" title="Economic depression">Depression</a></li>
<li><a href="/enwiki/wiki/Drought" title="Drought">Droughts</a></li>
<li><a href="/enwiki/wiki/Epidemic" title="Epidemic">Epidemic</a></li>
<li><a href="/enwiki/wiki/Famine" title="Famine">Famine</a></li>
<li><a href="/enwiki/wiki/Financial_crisis" title="Financial crisis">Financial crisis</a></li>
<li><a href="/enwiki/wiki/Pandemic" title="Pandemic">Pandemic</a></li>
<li><a href="/enwiki/wiki/Riot" title="Riot">Riots</a></li>
<li><a href="/enwiki/wiki/Social_crisis" title="Social crisis">Social crisis</a></li>
<li><a href="/enwiki/wiki/Survivalism" title="Survivalism">Survivalism</a></li></ul>
</div></td></tr><tr><td class="navbox-abovebelow" colspan="2"><div>
<ul><li><b><span class="nowrap"><span class="noviewer" typeof="mw:File"><a href="/enwiki/wiki/File:The_Earth_seen_from_Apollo_17.jpg" class="mw-file-description"><img alt="" src="/upwiki/wikipedia/commons/thumb/9/97/The_Earth_seen_from_Apollo_17.jpg/16px-The_Earth_seen_from_Apollo_17.jpg" decoding="async" width="16" height="16" class="mw-file-element" srcset="/upwiki/wikipedia/commons/thumb/9/97/The_Earth_seen_from_Apollo_17.jpg/24px-The_Earth_seen_from_Apollo_17.jpg 1.5x, /upwiki/wikipedia/commons/thumb/9/97/The_Earth_seen_from_Apollo_17.jpg/32px-The_Earth_seen_from_Apollo_17.jpg 2x" data-file-width="3000" data-file-height="3002" /></a></span> </span><a href="/enwiki/wiki/Portal:World" title="Portal:World">World portal</a></b></li>
<li><span class="noviewer" typeof="mw:File"><span title="Category"><img alt="" src="/upwiki/wikipedia/en/thumb/9/96/Symbol_category_class.svg/16px-Symbol_category_class.svg.png" decoding="async" width="16" height="16" class="mw-file-element" srcset="/upwiki/wikipedia/en/thumb/9/96/Symbol_category_class.svg/23px-Symbol_category_class.svg.png 1.5x, /upwiki/wikipedia/en/thumb/9/96/Symbol_category_class.svg/31px-Symbol_category_class.svg.png 2x" data-file-width="180" data-file-height="185" /></span></span> Categories
<ul><li><a href="/enwiki/wiki/Category:Apocalypticism" title="Category:Apocalypticism">Apocalypticism</a></li>
<li><a href="/enwiki/wiki/Category:Future_problems" title="Category:Future problems">Future problems</a></li>
<li><a href="/enwiki/wiki/Category:Hazards" title="Category:Hazards">Hazards</a></li>
<li><a href="/enwiki/wiki/Category:Risk_analysis" title="Category:Risk analysis">Risk analysis</a></li>
<li><a href="/enwiki/wiki/Category:Doomsday_scenarios" title="Category:Doomsday scenarios">Doomsday scenarios</a></li></ul></li></ul>
</div></td></tr></tbody></table></div></div>' |
