Back to all posts

The Humans Working Behind the AI Curtain

Just how artificial is Artificial Intelligence? Facebook created a PR firestorm last summer when reporters discovered a human “editorial team” – rather than just unbiased algorithms – selecting stories for its trending topics section. The revelation highlighted an elephant in the room of our tech world: companies selling the magical speed, omnipotence, and neutrality of artificial intelligence (AI) often can’t make good on their promises without keeping people in the loop, often working invisibly in the background.

jan17-06-HS2593-001


So who are the people behind the AI curtain?

Cut to Bangalore, India, and meet Kala, a middle-aged mother of two sitting in front of her computer in the makeshift home office that she shares with her husband. Our team at Microsoft Research met Kala three months into studying the lives of people picking up temporary “on-demand” contract jobs via the web, the equivalent of piecework online. Her teenage sons do their homework in the adjoining room. She describes calling them into the room, pointing at her screen and asking: “Is this a bad word in English?” This is what the back end of AI looks like in 2016. Kala spends hours every week reviewing and labeling examples of questionable content. Sometimes she’s helping tech companies like Google, Facebook, Twitter, and Microsoft train the algorithms that will curate online content. Other times, she makes tough, quick decisions about what user-generated materials to take down or leave in place when companies receive customer complaints and flags about something they read or see online.

Whether it is Facebook’s trending topics; Amazon’s delivery of Prime orders via Alexa; or the many instant responses of bots we now receive in response to consumer activity or complaint, tasks advertised as AI-driven involve humans, working at computer screens, paid to respond to queries and requests sent to them through application programming interfaces (APIs) of crowdwork systems. The truth is, AI is as “fully-automated” as the Great and Powerful Oz was in that famous scene from the classic film, where Dorothy and friends realize that the great wizard is simply a man manically pulling levers from behind a curtain. This blend of AI and humans, who follow through when the AI falls short, isn’t going away anytime soon. Indeed, the creation of human tasks in the wake of technological advancement has been a part of automation’s history since the invention of the machine lathe.

We call this ever-moving frontier of AI’s development, the paradox of automation’s last mile: as AI makes progress, it also results in the rapid creation and destruction of temporary labor markets for new types of humans-in-the-loop tasks. By 2033, economists predict that tech innovation could convert 30% of today’s full-time occupations into augmented services completed “on demand” through a mix of automation and human labor. In short, AI will eliminate some work as it opens up opportunities for redefining what work humans do best. These AI-assisted augmented services, delivered by people quietly working in concert with bots, are poised to enhance our daily productivity but they also introduce new social challenges.

Much of the crowdwork done on contract today covers for AI when it can’t do something on its own. The dirty little secret of many services — from FacebookM to the “automatic” removal of heinous videos on YouTube, as well as many others — is that real live human beings clean up much of the web, behind the scenes. Those magical bots responding to your tweets complaining about your delayed pizza delivery or the service on your flight back to Boston? They are the new world of contract labor hidden underneath a layer of AI. A hybrid of humans and AI is remaking retail, marketing, and customer service. It turns out that AI, just like humans, struggles to make tough decisions about what content should and should not be included in our daily diets of social media, depending on what criteria or values we want to impose.

The real story isn’t whether Facebook biased its trending topics by involving human editors; it is that the AI of today can’t function without humans in the loop, whether it’s delivering the news or a complicated pizza order. Content moderation and curation — from newsfeeds, and search results to adjudicating disputes over appropriate content — involve people hired by technology and media companies to make judgments about what to leave up or take down. Remember that classic moment in the 2012 presidential campaign when Mitt Romney uttered the phrase “binders full of women”? Twitter needed contracted, on-demand workers to figure out, in real-time, why such an obtuse phrase so quickly became such a popular hashtag and whether it was an appropriate thing to post to its trending topics.

Who are these workers behind the AI curtain? Many are like Kala: everyday people, typically paid a low, flat rate, working independently or through temp agencies, many operating outside the United States. It is not common knowledge that the bulk of content moderation is outsourced to contract workers around the globe with little transparency about their training, work environments, or protocols for making editorial decisions. In fact, it is striking, especially after the Facebook “editorial team” incident, that more consumers haven’t asked: what are the content moderation practices of social media? Who has a hand in creating the content that lands on our virtual doorsteps? The incident left only room for speculation about the team’s credentials and support for complicated editorial work.

Our team learned from two years of researching the world of paid crowdwork, where content moderation is a steady stream of gig work, that the inside practices of both the largest and the smallest companies in the tech world involve literally thousands of decisions about what content to keep or delete. Contract workers are needed to train algorithms to make some of the most important decisions about content. And, more than we realize, they are charged with stepping in to make snap decisions about what stays on a site, and what’s deleted. This is a new form of employment that we should all value, as these people keep the internet from becoming a swampy pool of spam. Companies rely heavily on part-time contract workers hired through crowdsourcing platforms like Crowdflower and Amazon Mechanical Turk, or vendor management systems like Clickworker.

We need to think seriously about the human labor in the loop driving AI. This workforce deserves training, support and compensation for being at-the-ready and willing to do an important job that many might find tedious or too demanding. A host of future jobs, going far beyond editorial treatments of trending topics, will require the creative efforts of humans to channel the speed, reach, and efficiencies of AI. The first step is to require more transparency from tech companies that have been selling AI as devoid of human labor. We should demand truth in advertising with regard to where humans have been brought in to benefit us — whether it’s to curate our news to inform our body politic, or to field complaints about what some troll just posted to our favorite social media site. We should know there’s human labor in the loop because we want to have both the capacity to recognize the value of their work, and also to have a chance to understand the training and support that informed their decision-making, especially if their work touches on the public interest.

As consumers, we have a right to know what ingredients and processes are in the AI that compiles our news and media content, in the same way that we should know what’s in the food we feed our families. As citizens, we have a need to know where our information comes from. And, as human beings, we should always know when humans are at work, producing what we consume, whether physical or digital. The labor of these hardworking people around the world should not be rendered invisible or opaque by the shibboleth of AI. Just as we need companies to be accountable for the labor practices that produce our food, clothes, and computers, so, too, do we need accountability to both consumers and workers producing and shaping digital content.

Can we take you from stuck to unstuck?

We'd love to hear from you

Product Design

The ‘Product’ is the website, service, application, interactive thing being worked on by the business. The practice of Product Design is similar in a lot of ways to UX Design. It involves the coming together of many specific design disciplines...

Call to action (CTA)

A call to action is a marketing term that refers to a prompt that invokes a response leading to a sale. When referring to a call to action (CTA) in the digital design world we usually mean the interactive element that leads to the next step in the experience - something that needs to be clicked or tapped.

User testing

User testing refers to a technique used in the design process to evaluate a product, feature or prototype with real users. There are several reasons why you might want to undergo usability testing, the most common is that it allows the design team to identify friction in a user experience they are designing, so that it can be addressed before being built or deployed.

WYSIWYG

WYSIWYG (pronounced WIZ-ee-wig) is an acronym for "What You See Is What You Get". It helps identify an an interface that allows user input resulting in an output that is rendered in a similar way. For example; a word processor application interface might resemble a piece of paper,so when printed the user can see how the output will appear.

Content Management System

A content management system (CMS) is an tool that allows a website editor/administrator to manage the content that is displayed. Websites are made of HTML and CSS to create pages. Pages can be hard-coded but would require technical development skills to make changes. A CMS usually allows a person without coding knowledge to amend existing and add new content to a website using a WYSIWYG interface.

Responsive Web Design

Responsive web design refers to a web page that dynamically adapts its layout to fit the size and orientation of the device on which it is viewed. A responsive design allows for a more optimised user experience across desktop and laptop computers as well as smartphones and tablets of varying sizes.

User Stories

User stories allow the functionality of a product or service to be expressed as written descriptions of an experience as seen from the users perspective. The writing of user stories creates a list of design and development tasks to complete in order to create any required functionality.

User Interface

A user interface (UI) is a conduit between human and computer interaction - the space where a user will interact with a computer or machine to complete tasks. The purpose of a UI is to enable a user to effectively control a computer or machine they are interacting with, and for feedback to be received in order to communicate effective completion of tasks.

Personas

A persona in UX Design is the characterisation of a user who represents a segment of your target audience. On a project you might create any number of personas to be representative of a range of user needs and desires. The solutions you design must answer these needs in order to deliver value to your target audience.

Card sorting

A great, reliable, inexpensive method for discovering patterns in how users would expect to find content or functionality. Card sorting is used to test the taxonomy of data with a group of subjects, usually to help inform the creation of the information architecture, user flow, or menu structure on a project.

Brainstorming

A technique used to generate ideas around a specific topic. Often done in groups, but can be done individuals. The process usually involves writing down all ideas around a topic onto paper, a whiteboard or stickies often implying some kind of association.

Minimum Viable Product

An MVP is a product that has the minimum set of features to prove the most essential hypothesis for a product. Businesses building a new product can create a Minimum Viable Product to prove that an idea is viable and warrants further investment. A further benefit being that the next stage of development can be informed by feedback obtained from testing that MVP.

Sitemap

A sitemap is a diagrammatic representation of a hierarchical system. It usually depicts the parent-sibling relationship between pages in a website, showing how sub pages might be arranged underneath their parent groupings. This arrangement forms a map of the site.

User journey

A user journey represents a sequence of events or experiences a user might encounter while using a product or service. A user journey can be mapped or designed to show the steps and choices presented as interactions, and the resulting actions.

Prototype

A prototype is draft representation built to test ideas for layout, behaviour and flow in a system. Prototypes are an indispensable tool for resolving a large number of potential issues in a concept or business before too many resources are deployed to put a design into production.

Wireframes

A Wireframe is a visual schematic that conveys a basic level of communication, structure and behaviour during the design of a system. Wireframes are low-fidelity designs that bypass including a detailed user interface or visual design, conveying just enough to get across the core idea.

Usability

To say something is usable is a qualitative statement about how easy that thing is to use. Usability is an assessment of how learnable a system is and how easy a user finds it to use. The usability of a system or product is a key factor in determining whether the user experience is a good one.

Information Architecture

Information architecture is the design and organisation of content, pages and data into a structure that aids users understanding of a system. A more organised system enables users to more easily find the information they require and complete the intended tasks.

UI Design

User Interface Design is the discipline of designing software interfaces for devices, ideally with a focus on maximising efficiency, responsiveness and aesthetics to foster a good user experience.

UX Design

The practice of User Experience (UX) Design is the coming together of many specific design related disciplines to improve the usability, responsiveness, uptake and aesthetics of a product or service.

User Experience

A general term that covers all aspects of a user's participation while engaging with something that has been designed. Usually when talking about User Experience in the digital design field it refers to the interactions, reactions, emotions and perceptions while using an app, service, website or product.