Iyad Rahwan#The Nightmare Machine

{{Short description|Syrian-Australian computational social scientist}}

{{Infobox scientist

| name = Iyad Rahwan

| native_name = إياد رهوان

| native_name_lang = lang-ar

| image = Iyad Rahwan (24346536449).jpg

| birth_date = 1978

| birth_place = Aleppo, Syria

| alma_mater = University of Melbourne

| doctoral_advisor = Liz Sonenberg

| academic_advisors = Alex Pentland

| website = https://rahwan.me/

| field = Computational social science, Artificial intelligence, Ethics, Cognitive science, Game theory, Crowdsourcing

| work_institution = Max Planck Institute for Human Development

}}Iyad Rahwan ({{langx|ar|إياد رهوان}}), is a Syrian-Australian scientist. He is the director of the Center for Humans and Machines at the Max Planck Institute for Human Development.{{Cite web|url=https://www.mpib-berlin.mpg.de/en/media/2019/04/new-director-iyad-rahwans-research-focuses-on-the-societal-challenges-of-digitization|title=New Director: Iyad Rahwan's research focuses on the societal challenges of digitization {{!}} Max Planck Institute for Human Development|website=www.mpib-berlin.mpg.de|access-date=2019-06-20}} Between 2015 and 2020, he was an associate professor of Media Arts & Sciences at the MIT Media Lab.{{Cite web|url=https://rahwan.me/|title=Iyad Rahwan|website=Iyad Rahwan|language=en-US|access-date=2019-06-20}} Rahwan's work lies at the intersection of the computer and social sciences, where he has investigated topics in computational social science, collective intelligence, large-scale cooperation, and the social aspects of artificial intelligence.{{Cite web|url=http://www.tedxcambridge.com/speaker/iyad-rahwan/|title=Iyad Rahwan - TEDxCambridge|access-date=2017-04-16|archive-date=2021-02-27|archive-url=https://web.archive.org/web/20210227094542/http://www.tedxcambridge.com/speaker/iyad-rahwan/|url-status=dead}}

Biography

Rahwan was born in Aleppo, Syria. He earned an Information Systems PhD in 2005 from the University of Melbourne. As an assistant and then associate professor in Computing and Information Science at MIT-partnered Masdar Institute of Science and Technology, Rahwan investigated scalable social mobilization's possibilities, limits, and challenges in various contexts by analyzing data from the 2009 DARPA Network Challenge,{{Cite web|url=http://www.livescience.com/28341-social-media-helps-mobilize-society.html|title=How Social Media Mobilizes Society - LiveScience|website=Live Science |date=April 2013 }}{{Cite journal|title=A. Rutherford, M. Cebrian, S. Dsouza, E. Moro, A. Pentland, and I. Rahwan (2013). Limits of Social Mobilization|journal=Proceedings of the National Academy of Sciences|volume=110|issue=16|pages=6281–6286|doi=10.1073/pnas.1216338110|pmid = 23576719|pmc=3631633|year=2013|last1=Rutherford|first1=A.|last2=Cebrian|first2=M.|last3=Dsouza|first3=S.|last4=Moro|first4=E.|last5=Pentland|first5=A.|last6=Rahwan|first6=I.|doi-access=free}} the DARPA Shredder Challenge 2011,{{Cite web|url=http://nautil.us/issue/18/genius/how-crowdsourcing-turned-on-me|title=How Crowdsourcing Turned On Me - Nautilus|date=2014-10-23|access-date=2017-04-17|archive-date=2021-06-08|archive-url=https://web.archive.org/web/20210608220352/https://nautil.us/issue/18/genius/how-crowdsourcing-turned-on-me|url-status=dead}}{{Cite journal|title=N. Stefanovitch, A. Alshamsi, M. Cebrian, I. Rahwan (2014). Error and attack tolerance of collective problem solving: The DARPA Shredder Challenge|journal=EPJ Data Science|volume=3|doi=10.1140/epjds/s13688-014-0013-1|year=2014|last1=Stefanovitch|first1=Nicolas|last2=Alshamsi|first2=Aamena|last3=Cebrian|first3=Manuel|last4=Rahwan|first4=Iyad|doi-access=free|hdl=21.11116/0000-0002-D39F-D|hdl-access=free}} and the 2012 US State Department Tag Challenge.{{Cite journal|url=http://www.nature.com/news/crowdsourcing-in-manhunts-can-work-1.12867|title=Crowdsourcing in manhunts can work : Nature News & Comment|journal=Nature|doi=10.1038/nature.2013.12867|year=2013|last1=Ball|first1=Philip|s2cid=61684214|url-access=subscription}}{{Cite journal|title= Targeted Social Mobilization in a Global Manhunt|journal=PLOS ONE|volume=8|issue=9|pages=e74628|doi=10.1371/journal.pone.0074628|pmid=24098660|pmc = 3786994|year=2013|last1=Rutherford|first1=Alex|last2=Cebrian|first2=Manuel|last3=Rahwan|first3=Iyad|last4=Dsouza|first4=Sohan|last5=McInerney|first5=James|last6=Naroditskiy|first6=Victor|last7=Venanzi|first7=Matteo|last8=Jennings|first8=Nicholas R.|last9=Delara|first9=J. R.|last10=Wahlstedt|first10=Eero|last11=Miller|first11=Steven U.|bibcode=2013PLoSO...874628R|arxiv=1304.5097|doi-access=free}}{{Cite journal|last1=Rahwan|first1=Iyad|last2=Dsouza|first2=Sohan|last3=Rutherford|first3=Alex|last4=Naroditskiy|first4=Victor|last5=McInerney|first5=James|last6=Venanzi|first6=Matteo|last7=Jennings|first7=Nicholas R.|last8=Cebrian|first8=Manuel|date=April 2013|title=Global Manhunt Pushes the Limits of Social Mobilization|journal=Computer|language=en-US|volume=46|issue=4|pages=68–75|doi=10.1109/mc.2012.295|issn=0018-9162|url=https://eprints.soton.ac.uk/342509/1/CO_COM-2012-07-0132_Rahwan.pdf|hdl=21.11116/0000-0002-D5A8-0|s2cid=17449337|hdl-access=free}} In 2015, Rahwan started the Scalable Cooperation Group at the MIT Media Lab, where he is the AT&T Career Development Professor and an Associate Professor of Media Arts & Sciences,{{Cite web|url=https://www.media.mit.edu/people/irahwan/overview/|title=Person Overview ‹ Iyad Rahwan – MIT Media Lab}} as well as an affiliate faculty at the MIT Institute of Data, Systems and Society.{{Cite web|url=https://idss.mit.edu/staff/iyad-rahwan/|title=Iyad Rahwan – IDSS|access-date=2017-04-17|archive-date=2020-08-07|archive-url=https://web.archive.org/web/20200807213918/https://idss.mit.edu/staff/iyad-rahwan/|url-status=dead}} Since 2019 Rahwan is a director of the Max Planck Institute for Human Development in Berlin, where he founded and directs the Center for Humans and Machines.{{Cite web|url=https://www.mpib-berlin.mpg.de/en/research/humans-and-machines|title=Humans and Machines {{!}} Max Planck Institute for Human Development|website=www.mpib-berlin.mpg.de|access-date=2019-06-20}}

Machine Behavior

Together with Manuel Cebrian and Nick Obradovich, Rahwan spearheaded an effort to establish the field of Machine Behavior.{{Cite web|url=https://www.technologyreview.com/s/613440/ai-researchers-want-to-study-ai-the-same-way-social-scientists-study-humans/|title=Artificial Intelligence Is Now Far Too Big To Be Limited To Computer Science|date=|newspaper=Forbes|last1=McKendrick|first1=Joe|access-date=}} This field is concerned with the scientific study of Artificial Intelligence systems, not as engineering artifacts, but as a class of actors with particular behavioral patterns and ecology. This field overlaps with, but is distinct from, computer science and robotics. It treats machine behaviour empirically, in the same way that ethology and behavioral ecology study animal behavior without a full understanding of the bio-chemical mechanisms. The contours and fundamental research questions in the field of Machine Behavior were outlined by Rahwan, Obradovich and Cebrian, together with twenty co-authors from across the computational and behavioral sciences, in an article in the journal Nature.{{cite journal |last1=Rahwan |first1=Iyad |last2=Obradovich |first2=Nick |last3=Bongard |first3=Josh |last4=Bonnefon |first4=Jean-François |last5=Breazeal |first5=Cynthia |last6=Crandall |first6=Jacob W. |last7=Bonnefon |first7=Jean-François |last8=Christakis |first8=Nicholas A. | last9=Iain D. | first9=Couzin | last10=Jackson | first10=Matthew O. | last11=Jennings | first11=Nicholas R. | last12=Kamar | first12=Ece | last13=Kloumann | first13=Isabel M. | last14=Larochelle | first14=Hugo | last15=Lazer | first15=David | last16=McElreath | first16=Richard | last17=Mislove | first17=Alan | last18=Parkes | first18=David C. | last19=Pentland | first19=Alex | last20=Roberts | first20=Margaret E. | last21=Shariff | first21=Azim | last22=Tenenbaum | first22=Joshua B. | last23=Wellman | first23=Michale |title=Machine Behaviour|journal=Nature |date=24 April 2019 |volume=568 |issue=7753 |pages=477–486 |doi=10.1038/s41586-019-1138-y|pmid=31019318 |bibcode=2019Natur.568..477R | doi-access=free | hdl=10044/1/70375 | hdl-access=free }}

Morality and Machines

= Ethics of Autonomous Vehicles =

Rahwan is one of the first to consider the problem of self autonomous vehicles as an ethical dilemma. His 2016 paper, The Social Dilemma of Autonomous Vehicles, showed that people approved of utilitarian autonomous vehicles, and wanted others to purchase these vehicles, but they themselves would prefer to ride in an autonomous vehicle that protected its passenger at all costs, and would not use self-driving vehicles if utilitarianism was imposed on them by law. Thus the paper concludes the regulation of utilitarian algorithms could paradoxically increase casualties by driving by inadvertently postponing the adoption of a safer technology.{{Cite journal|title=J. F. Bonnefon, A. Shariff, I. Rahwan (2016). The Social Dilemma of Autonomous Vehicles|journal=Science|volume=352|issue=6293|pages=1573–1576|doi=10.1126/science.aaf2654|pmid = 27339987|year=2016|last1=Bonnefon|first1=J.-F.|last2=Shariff|first2=A.|last3=Rahwan|first3=I.|arxiv=1510.03346|bibcode=2016Sci...352.1573B|s2cid=35400794}} The paper spurred much coverage about the role of ethics in the creation of artificially intelligent driving systems.{{Cite web|url=https://www.weforum.org/agenda/2016/08/the-ethics-of-self-driving-cars-what-would-you-do/|title=World Forum discuses how self-driving cars will make life or death decisions}}{{Cite news|url=https://www.nytimes.com/2016/06/24/technology/should-your-driverless-car-hit-a-pedestrian-to-save-your-life.html|title=Should Your Driverless Car Hit a Pedestrian to Save Your Life - The New York Times|date=2016-06-23|newspaper=The New York Times|last1=Markoff|first1=John}}{{Cite news|url=https://www.nytimes.com/2016/11/06/opinion/sunday/whose-life-should-your-car-save.html|title=Whose Life Should Your Car Save? - The New York Times|date=2016-11-03|newspaper=The New York Times|last1=Shariff|first1=Azim|last2=Rahwan|first2=Iyad|last3=Bonnefon|first3=Jean-François}}{{Cite web|url=http://www.tedxcambridge.com/speaker/iyad-rahwan/|title=TedxCambridge: The social dilemma of driverless cars|access-date=2017-04-16|archive-date=2021-02-27|archive-url=https://web.archive.org/web/20210227094542/http://www.tedxcambridge.com/speaker/iyad-rahwan/|url-status=dead}}{{Cite news|url=https://www.washingtonpost.com/news/energy-environment/wp/2016/06/23/save-the-driver-or-save-the-crowd-scientists-wonder-how-driverless-cars-will-choose/|title=Save the driver or save the crowd? Scientists wonder how driverless cars will 'choose' - The Washington Post|newspaper=The Washington Post }}{{Cite web|url=https://time.com/4378108/driverless-car-study/|title=Driverless Cars Pose Difficult Ethical Question - Time.com|date=23 June 2016 }}{{Cite web|url=https://www.independent.co.uk/news/science/driverless-cars-autonomous-vehicles-safety-accidents-a7097276.html|title=Driverless car safety revolution could be scuppered by moral dilemma - The Independent|website=Independent.co.uk |date=2016-06-23}}

= Moral Machine =

Moral Machine{{Cite web|url=http://moralmachine.mit.edu|title=Moral Machine}} is an online platform that generates ethical dilemma scenarios faced by hypothetical autonomous machines, allowing visitors to assess the scenarios and vote on the most morally acceptable between two unavoidable harm outcomes. The presented scenarios are often variations of the trolley problem.{{Cite web|url=https://www.latimes.com/science/sciencenow/la-sci-sn-autonomous-cars-ethics-20160623-snap-story.html|title=Ethical dilemma on four wheels: How to decide when your self-driving car should kill you - LA Times|website=Los Angeles Times |date=23 June 2016 }}{{Cite web|url=https://apnews.com/e3b6b54f02d24375bb1d7ba2e7dd9446/For-driverless-cars,-a-moral-dilemma:-Who-lives-or-dies|title=For driverless cars, a moral dilemma: Who lives or dies? - Associated Press|website=Associated Press |date=18 January 2017 }}{{Cite web|url=https://www.latimes.com/science/sciencenow/la-sci-sn-autonomous-cars-ethics-20160623-snap-story.html|title=Ethical dilemma on four wheels: How to decide when your self-driving car should kill you|website=Los Angeles Times |date=23 June 2016 }} As of December 2017, the platform has collected 40 million decisions from millions of visitors from 233 countries and territories. Analysis of the data showed broad differences in relative preferences among different countries, and correlations between these preferences and various national metrics.{{cite journal |last1=Awad |first1=Edmond |last2=Dsouza |first2=Sohan |last3=Kim |first3=Richard |last4=Schulz |first4=Jonathan |last5=Henrich |first5=Joseph |last6=Shariff |first6=Azim |last7=Bonnefon |first7=Jean-François |last8=Rahwan |first8=Iyad |title=The Moral Machine experiment |journal=Nature |date=24 October 2018 |volume=563 |issue=7729 |pages=59–64 |doi=10.1038/s41586-018-0637-6 |pmid=30356211 |hdl=10871/39187 |hdl-access=free |bibcode=2018Natur.563...59A |s2cid=53029241 }}

=Cooperating with Machines =

Together with Jacob Crandall and others, Rahwan studied human-machine cooperation by exploring how state-of-the-art reinforcement learning algorithms perform when playing repeated games against humans. The authors showed that providing a medium of communication can result in an algorithm learning to cooperate with its human partner faster and more effectively than a human in these strategic games.{{Cite journal|last1=Crandall|first1=Jacob W.|last2=Oudah|first2=Mayada|last3=Tennom|last4=Ishowo-Oloko|first4=Fatimah|last5=Abdallah|first5=Sherief|last6=Bonnefon|first6=Jean-François|last7=Cebrian|first7=Manuel|last8=Shariff|first8=Azim|last9=Goodrich|first9=Michael A.|date=2018-01-16|title=Cooperating with machines|journal=Nature Communications|language=En|volume=9|issue=1|pages=233|doi=10.1038/s41467-017-02597-8|issn=2041-1723|pmc=5770455|pmid=29339817|arxiv=1703.06207|bibcode=2018NatCo...9..233C}}{{Cite journal|title=Cooperating with Machines|journal=Nature Communications|volume=9|issue=233|pages=233|arxiv=1703.06207|last1 = Crandall|first1 = Jacob W|last2=Oudah|first2=Mayada|author3=Tennom|last4=Ishowo-Oloko|first4=Fatimah|last5=Abdallah|first5=Sherief|last6=Bonnefon|first6=Jean-François|last7=Cebrian|first7=Manuel|last8=Shariff|first8=Azim|last9=Goodrich|first9=Michael A|last10=Rahwan|first10=Iyad|year=2017|doi=10.1038/s41467-017-02597-8|pmid=29339817|pmc=5770455|bibcode=2018NatCo...9..233C}}{{Cite web|url=https://www.technologyreview.com/s/603995/ai-can-beat-us-at-pokernow-lets-see-if-it-can-work-with-us/|title=AI Can Beat Us at Poker—Now Let's See If It Can Work with Us - MIT Technology Review}}

AI and the Future of Work

Together with his student Morgan Frank and collaborators, Rahwan explored the relationship between city size and the potential impact of Artificial Intelligence and automation on employment. They used a variety of estimates of the risk of automation of different jobs.{{Cite journal|title=OECD Social, Employment and Migration Working Papers|journal=Social Employment and Migration Working Papers|language=en|doi=10.1787/1815199x|issn=1815-199X|year=2011|last1=Widmaier|first1=Sarah|last2=Dumont|first2=Jean-Christophe|doi-access=free}}{{Cite journal|last1=Frey|first1=Carl Benedikt|last2=Osborne|first2=Michael A.|date=January 2017|title=The future of employment: How susceptible are jobs to computerisation?|journal=Technological Forecasting and Social Change|volume=114|pages=254–280|doi=10.1016/j.techfore.2016.08.019|issn=0040-1625|citeseerx=10.1.1.395.416}} Their main finding is that smaller cities may experience greater impact due to automation.{{Cite journal|last1=Frank|first1=Morgan R.|last2=Sun|first2=Lijun|last3=Cebrian|first3=Manuel|last4=Youn|first4=Hyejin|last5=Rahwan|first5=Iyad|date=2018-02-01|title=Small cities face greater impact from automation|journal=Journal of the Royal Society Interface|language=en|volume=15|issue=139|pages=20170946|doi=10.1098/rsif.2017.0946|issn=1742-5689|pmc=5832739|pmid=29436514}} Related work explores the polarization of the US labor market, due to the underlying polarized structure of workplace skills.

Other projects

= The Tag Challenge =

Rahwan led the winning team in the 2012 US State Department Tag Challenge, using crowdsourcing and a referral-incentivizing reward mechanism (similar to the one used in the 2009 DARPA Network Challenge) to locate individuals in European and American cities within 12 hours each, given only their photographic portraits.{{Cite web|url=https://www.scientificamerican.com/article/crowdsourcing-in-manhunts-can-work/|title=Crowdsourcing in Manhunts Can Work - Scientific American|website=Scientific American }}{{Cite web|url=https://www.newscientist.com/article/dn23427-nowhere-to-hide-the-next-manhunt-will-be-crowdsourced/|title=Nowhere to hide: The next manhunt will be crowdsourced - New Scientist}}{{Cite news|url=http://www.economist.com/node/21560977|title=Six degrees of mobilisation |newspaper=The Economist|date=September 2012}}

= The Nightmare Machine =

The Nightmare Machine,{{Cite web|url=http://nightmare.mit.edu|title=The Nightmare Machine}} developed under Rahwan's guidance, creates computer generated imagery powered by deep learning algorithms to learn from human feedback and generate a visual approximation of what humans might find "scary".{{Cite web|url=https://www.npr.org/sections/thetwo-way/2016/10/25/499334210/researchers-build-nightmare-machine|title=Researchers Build 'Nightmare Machine' : The Two-Way : NPR|website=NPR }}{{Cite news|url=https://www.washingtonpost.com/news/morning-mix/wp/2016/10/24/clinton-trump-the-white-house-too-terrifyingly-transformed-by-mits-nightmare-machine/|title=Clinton, Trump, the White House too, terrifyingly transformed by MIT's 'Nightmare Machine' - The Washington Post|newspaper=The Washington Post }}

References