Blend Images/Shutterstock.com

The Algorithms That Tell Bosses How Employees Are Feeling

Sentiment-analysis software can help companies figure out what’s bothering workers—or what they’re excited about.

Every day, humans type out more than 200 billion emails, hundreds of millions of tweets, and innumerable texts, chats, and private messages. No one person could pick through even a tiny sliver of this information and stitch together themes and trends—but computers are starting to be able to. For more than a decade, researchers have been developing computer programs that can ingest enormous amounts of writing to try and understand the emotions stirred up by an idea or a product.

The field—known as sentiment analysis—got its start in market research. As online reviews started to gather steam in the mid-2000s, companies who wanted to understand how their products—or their competitors’ offerings—were being received  began to use algorithms to aggregate reviews, says Bing Liu, a professor of computer science at the University of Illinois, Chicago, who has written extensively about the history of sentiment analysis. The algorithmic approach could reveal broader insights than a focus groups or surveys, the thinking went.

Sentiment analysis has bloomed into a large and lucrative industry. Dozens of startups now focus exclusively on providing these services to other companies, Liu says, and many bigger tech corporations have developed their own software.

More recently, the corporate world has turned these same tools inward. Large companies like Accenture, Intel, IBM, and Twitter have started using the software to understand how their own employees feel about their jobs, and identify problems that might escape a harried supervisor during annual-review time.

Twitter, for example, hired a company called Kanjoya to analyze employees’ responses to regular surveys about their workplace experiences. The surveys used to be administered twice yearly, and included just one or two open-ended questions, The Wall Street Journal reported last year. But with Kanjoya, Twitter started sending the survey to one-sixth of its workforce every month—and increased the number of open-ended questions it asked. Kanjoya’s analysis tools ran through the narrative answers, extracting patterns that were then shared with executives.

Other companies have focused on analyzing employee chatter outside of formal reviews or surveys. To catch grievances that might not surface in structured responses, or identify policies that are working, IBM has for years been scooping up employees’ posts and comments on the company’s internal social networking platform.

That platform, called Connections, is available to all of IBM’s 380,000 employees in 170 countries. It functions like Facebook, Dropbox, and Wikipedia bundled into one package, allowing employees to publish posts, comment on others’, or collaborate in smaller groups. (IBM also sells a version of Connections to other companies.) An internally developed sentiment-analysis tool called Social Pulse monitors posts and comments for trends and red flags.

Last year, IBM used the program to engage its employees in a revamp of its performance-review system. Its HR department set up a forum to solicit feedback on proposals for a new system, and received tens of thousands of responses. Instead of assigning a team of analysts to comb through the reams of feedback, IBM set Social Pulse loose on the data.

The software helped surface a widespread complaint: Employees were unhappy that their performances were graded on a curve. The company promptly did away with the method, says Sadat Shami, who manages IBM’s Center for Engagement & Social Analytics.

“Without our social listening capabilities, we wouldn't have been able to surface that in time to make that decision,” says Shami. “What traditionally happens in a month or two, we did in real-time.”

Kanjoya, the company that helps Twitter interpret its employee-survey results, also offers a service that piggybacks on workplace social networks. A page on its website advertises that the company’s sentiment-analysis tools work with Yammer, a social network that was acquired for more than a billion dollars by Microsoft in 2012. (Microsoft announced this week that it’s combining Yammer with its Office 365 Groups service.) Kanjoya’s product offers “employee engagement tracking,” which promises to trace positive or negative emotions over time, and a search function that responds to queries with an analysis of the sentiment surrounding it.

Broadening the scope of data-gathering from surveys and reviews to social-media posts risks invading employees’ privacy. That’s why IBM restricts its data-mining to posts and comments that are shared with the entire company, and doesn’t touch emails, chats, or interactions in private groups. Kanjoya was not available for comment on its privacy policies.

(Federal insider threat-detection programs are experimenting with sentiment analysis, too, to suss out moles inside their own agencies. The National Geospatial-Intelligence Agency will award a contract to implement sentiment-analysis technology, NextGov reported earlier this month, the details of which are still vague.)

Sentiment analysis is far from a polished technology. “The computer’s understanding of natural language is still bad,” says Liu. “Accuracy is not very easy.” A research project that tested basic analysis tools on a trove of emails sent between developers of an open-source server software suite only had a maximum accuracy rate of 30 percent. (Interestingly, when two people tried to determine the emotions expressed in 50 emails, they could only agree on three-quarters of them, says Tourani Parastou, the main author of the research paper at Polytechnique Montréal.)

The human element still remains an important check on emotion-sensing algorithms. Even IBM’s 3-year-old Social Pulse software is bolstered by human eyes: A small team of analysts routinely examine the trends it identifies to make sure it got them right before sending them up the chain to management.

Advancements in machine learning continue to improve algorithms’ ability to understand human writing—but researchers are already looking for the next emotion-detection technology. A pair of computer scientists at Sathyabama University in India published a paper last year that proposed a new way of determining employees’ attitudes and well-being: facial scans. The system they created captures images of employees’ faces every time they enter the building to determine whether they’re happy, sad, depressed, or angry, with the intention of using that data to optimize productivity and employee performance.

X
This website uses cookies to enhance user experience and to analyze performance and traffic on our website. We also share information about your use of our site with our social media, advertising and analytics partners. Learn More / Do Not Sell My Personal Information
Accept Cookies
X
Cookie Preferences Cookie List

Do Not Sell My Personal Information

When you visit our website, we store cookies on your browser to collect information. The information collected might relate to you, your preferences or your device, and is mostly used to make the site work as you expect it to and to provide a more personalized web experience. However, you can choose not to allow certain types of cookies, which may impact your experience of the site and the services we are able to offer. Click on the different category headings to find out more and change our default settings according to your preference. You cannot opt-out of our First Party Strictly Necessary Cookies as they are deployed in order to ensure the proper functioning of our website (such as prompting the cookie banner and remembering your settings, to log into your account, to redirect you when you log out, etc.). For more information about the First and Third Party Cookies used please follow this link.

Allow All Cookies

Manage Consent Preferences

Strictly Necessary Cookies - Always Active

We do not allow you to opt-out of our certain cookies, as they are necessary to ensure the proper functioning of our website (such as prompting our cookie banner and remembering your privacy choices) and/or to monitor site performance. These cookies are not used in a way that constitutes a “sale” of your data under the CCPA. You can set your browser to block or alert you about these cookies, but some parts of the site will not work as intended if you do so. You can usually find these settings in the Options or Preferences menu of your browser. Visit www.allaboutcookies.org to learn more.

Sale of Personal Data, Targeting & Social Media Cookies

Under the California Consumer Privacy Act, you have the right to opt-out of the sale of your personal information to third parties. These cookies collect information for analytics and to personalize your experience with targeted ads. You may exercise your right to opt out of the sale of personal information by using this toggle switch. If you opt out we will not be able to offer you personalised ads and will not hand over your personal information to any third parties. Additionally, you may contact our legal department for further clarification about your rights as a California consumer by using this Exercise My Rights link

If you have enabled privacy controls on your browser (such as a plugin), we have to take that as a valid request to opt-out. Therefore we would not be able to track your activity through the web. This may affect our ability to personalize ads according to your preferences.

Targeting cookies may be set through our site by our advertising partners. They may be used by those companies to build a profile of your interests and show you relevant adverts on other sites. They do not store directly personal information, but are based on uniquely identifying your browser and internet device. If you do not allow these cookies, you will experience less targeted advertising.

Social media cookies are set by a range of social media services that we have added to the site to enable you to share our content with your friends and networks. They are capable of tracking your browser across other sites and building up a profile of your interests. This may impact the content and messages you see on other websites you visit. If you do not allow these cookies you may not be able to use or see these sharing tools.

If you want to opt out of all of our lead reports and lists, please submit a privacy request at our Do Not Sell page.

Save Settings
Cookie Preferences Cookie List

Cookie List

A cookie is a small piece of data (text file) that a website – when visited by a user – asks your browser to store on your device in order to remember information about you, such as your language preference or login information. Those cookies are set by us and called first-party cookies. We also use third-party cookies – which are cookies from a domain different than the domain of the website you are visiting – for our advertising and marketing efforts. More specifically, we use cookies and other tracking technologies for the following purposes:

Strictly Necessary Cookies

We do not allow you to opt-out of our certain cookies, as they are necessary to ensure the proper functioning of our website (such as prompting our cookie banner and remembering your privacy choices) and/or to monitor site performance. These cookies are not used in a way that constitutes a “sale” of your data under the CCPA. You can set your browser to block or alert you about these cookies, but some parts of the site will not work as intended if you do so. You can usually find these settings in the Options or Preferences menu of your browser. Visit www.allaboutcookies.org to learn more.

Functional Cookies

We do not allow you to opt-out of our certain cookies, as they are necessary to ensure the proper functioning of our website (such as prompting our cookie banner and remembering your privacy choices) and/or to monitor site performance. These cookies are not used in a way that constitutes a “sale” of your data under the CCPA. You can set your browser to block or alert you about these cookies, but some parts of the site will not work as intended if you do so. You can usually find these settings in the Options or Preferences menu of your browser. Visit www.allaboutcookies.org to learn more.

Performance Cookies

We do not allow you to opt-out of our certain cookies, as they are necessary to ensure the proper functioning of our website (such as prompting our cookie banner and remembering your privacy choices) and/or to monitor site performance. These cookies are not used in a way that constitutes a “sale” of your data under the CCPA. You can set your browser to block or alert you about these cookies, but some parts of the site will not work as intended if you do so. You can usually find these settings in the Options or Preferences menu of your browser. Visit www.allaboutcookies.org to learn more.

Sale of Personal Data

We also use cookies to personalize your experience on our websites, including by determining the most relevant content and advertisements to show you, and to monitor site traffic and performance, so that we may improve our websites and your experience. You may opt out of our use of such cookies (and the associated “sale” of your Personal Information) by using this toggle switch. You will still see some advertising, regardless of your selection. Because we do not track you across different devices, browsers and GEMG properties, your selection will take effect only on this browser, this device and this website.

Social Media Cookies

We also use cookies to personalize your experience on our websites, including by determining the most relevant content and advertisements to show you, and to monitor site traffic and performance, so that we may improve our websites and your experience. You may opt out of our use of such cookies (and the associated “sale” of your Personal Information) by using this toggle switch. You will still see some advertising, regardless of your selection. Because we do not track you across different devices, browsers and GEMG properties, your selection will take effect only on this browser, this device and this website.

Targeting Cookies

We also use cookies to personalize your experience on our websites, including by determining the most relevant content and advertisements to show you, and to monitor site traffic and performance, so that we may improve our websites and your experience. You may opt out of our use of such cookies (and the associated “sale” of your Personal Information) by using this toggle switch. You will still see some advertising, regardless of your selection. Because we do not track you across different devices, browsers and GEMG properties, your selection will take effect only on this browser, this device and this website.