Solving the New Equation for Advanced Analytics Talent
- Date Posted:
- Is Database:
- Database
The global demand for data analytics workers is set to rise significantly, with the talent pool expected to double by 2020, reaching 1m people from 500,000 in 2018.
Chris Brahm, Arpan Sheth, Velu Sinha and Jessica Dai, "Solving the New Equation for Advanced Analytics Talent," Bain & Company, April 30, 2019, https://www.bain.com/insights/solving-the-new-equation-for-advanced-analytics-talent/
Solving the New Equation for Advanced Analytics Talent
At a Glance
In the next two years, the global supply of advanced analytics talent will double, with India’s talent pool growing especially quickly.
In the US, talent shortages will persist for experienced hires and certain key jobs, like data engineers and architects.
Companies will struggle to hire experts away from the analytically mature sectors that are the most attractive to employees and that themselves plan to expand quickly.
A successful tiered talent strategy incorporates new hires and internal retraining, while also tapping data hubs, third-party service firms and crowdsourcing.
Innovation in analytics is a priority for almost every organization today. Yet bottlenecks in the key areas of talent, data and analytics strategy often block progress. In order to better understand the talent bottleneck and how to release it, Bain & Company assessed the global market for analytics talent—both supply and demand—interviewing practitioners and experts, reviewing job boards and professional community listings, and studying educational program statistics.
We found a workforce on the verge of dramatic change.
For years, companies have been stuck chasing either a limited supply of experienced professionals or new university graduates. Today, however, the global supply of advanced analytics talent is about to explode. By 2020, the advanced analytics talent pool is expected to reach 1 million people, up from half a million in 2018.
The growth in advanced analytics talent arises from a pivot in traditional and nontraditional education so rapid that it’s hard to find a historical precedent. The best comparison may be the 1990s, when India invested heavily in training programmers, especially in legacy systems, ahead of Y2K systems upgrades. That was when the subcontinent became the outsourcing giant it remains today.
Once again, India is taking the lead, but this time through a combination of retraining and a flood of graduates with advanced degrees in subjects suited to advanced analytics work, like computer science and data science. By the end of 2020, Bain estimates that India will have three times as many candidates for advanced analytics work as it did in 2018, expanding from 65,000 people to more than 200,000 in just two years. The analytics talent supply will climb in China, Western Europe and North America as well, but not quite as quickly.
This ramp-up, however, won’t entirely solve the advanced analytics talent challenge. Many countries will still have fewer analytics experts than needed. Most available advanced analytics talent has recently graduated, but people with greater tenure, who are needed to lead and manage these teams, are in short supply. The United States will suffer shortages in certain critical roles, like data engineers and architects, while facing a possible oversupply of data scientists.
Additional long-term demand will come from sectors like retail, media, consumer goods, and industrial goods and services, as companies apply analytics capabilities to their businesses. According to Bain’s research, among banks today, slightly more than 1% of white-collar employees work in advanced analytics, on average. By contrast, technology companies average nearly 3% of staff aligned with advanced analytics, and the most analytically advanced digital native companies have 10% (see Figure 1). The business models differ greatly across these sectors, of course, but it’s clear that, in nearly every large enterprise, the analytic intensity of the employee base is increasing.

Building an advanced analytics team
Companies should not expect to fill this gap entirely by wooing experienced talent from other employers. The most analytically mature sectors plan to expand their teams fastest, and employees are most interested in working for companies with well-established track records in analytics, our recent survey of more than 200 industry participants found.
Creative, flexible approaches for expanding the talent base include building centers of excellence for pools of hired analytics experts, and also retraining capable existing employees and giving them access to automation tools. Importantly, rather than trying to do everything in-house, a tiered talent strategy should focus a core, in-house analytics team on strategic tasks while tapping offshore data hubs, third-party service firms and crowdsourcing for other work. Even the most sophisticated companies leverage a combination of internal and external supply chains for analytics capabilities.
What is the optimal blend of advanced analytics roles? How are teams best configured? The exact balance varies depending on the sector and maturity of a company’s analytics practice, but teams will draw from eight key roles (see Figure 2). With companies hiring to create balanced advanced analytics teams, certain skills are in higher demand.

A mixed global outlook
The growth in advanced analytics-trained talent will occur primarily outside the US (see Figure 3). Long the largest market for analytics talent, the US will retain that top spot, but other global tech powers are catching up.

The outlook is especially bright in India, where two trends are simultaneously expanding the talent pool. First, STEM undergraduate and graduate degree holders, whose programs of study emphasize data and analytics skills, continue to join the workforce in increasing numbers. Augmenting that is India’s deep existing ecosystem in information technology, especially in programming and systems integration. Outsourcing firms and the India IT centers of global corporations house many ideal candidates for learning new advanced analytics skills. These two sources have combined to make India a vital hub of analytics expertise and have fueled the growth of its analytics outsourcing industry.
The future is less clear for China. Thanks to its relatively supportive regulatory environment and access to consumer data, China is often described as winning the race to dominate artificial intelligence and advanced analytics. But on advanced analytics talent, the country may need to accelerate. Recent trends point to a growing focus on talent in China, including a significant expansion in data science bachelor's degree programs and high levels of US recruiting and pay among Chinese digital natives and technology companies. Without an expansion in supply, talent could become a bottleneck, slowing analytics progress in China, especially for companies in traditional sectors.
Breaking the talent bottleneck
The historical shortage of analytics talent has caused many organizations to rely on a combination of internal and external advanced analytics expertise. This hybrid model also turns out to be a good match for the breadth of advanced analytics expertise needed in the future. A multilayered approach will continue to make more sense than full vertical integration for many companies. When possible, companies should develop critical mass internally in the most important aspects of advanced analytics, such as data-science team leadership and model development, and tap the external supply chain for less-critical skills, like tactical data management and model maintenance. Today, only 30% of companies are fully integrated in advanced analytics. The other 70% augment their internal skills with some combination of offshore outsourcing, freelancers, advanced analytics consultants and crowdsourcing.
Part of developing this talent ecosystem involves harnessing shadow analytics talent—that is, taking people currently walking the halls and helping them develop new analytical skills. Existing employees already know the company, the industry and how to operate effectively across the organization. Many have the quantitative background to learn analytical skills, and nearly a quarter of Bain survey respondents report that their companies have implemented advanced analytics training programs.
IBM’s Data Scientist Academy, for example, is an eight-day boot camp followed by individual online learning, and includes shadowing IBM data scientists and a capstone project. Airbnb’s Data University offers more than 30 classes in data awareness, collection, visualization and data at scale, and more than 500 employees (1 out of every 8) took part during the university’s first six months. Other training options include free MOOCs—massive open online courses—and paid retraining programs.
Some companies with a good data science workbench and the right set of data engineering tools also use advanced analytics automation to enable people without strong coding skills to build models and engineer data. Of survey respondents currently using technologies to automate advanced analytics tasks, more than half say these technologies enable existing staff to be rapidly trained to take on responsibilities of a data scientist or data engineer.
Fostering the talent ecosystem
Embracing this tiered approach will help companies today and in the future. It allows them to tap into the rapidly growing global talent supply and to create a more flexible model, all while leaving room to redeploy existing talent in new and creative ways. Companies cannot afford to let a bottleneck in analytics talent slow them down, and they don’t have to.
Chris Brahm is a Bain & Company partner in San Francisco and leads the firm’s Global Advanced Analytics practice. Arpan Sheth is a Bain partner based in the Bangalore office and leads the firm’s Information Technology practice in Asia-Pacific. Velu Sinha is a Bain partner in Shanghai, and Jessica Dai is a principal based in San Francisco.












Ed Comment:“We saw in recent paper that the quality of researchers declines as the share of researchers increases. For the same reason (.i.e., a shortage of talent) every increase in a research is a decrease in the quality of people employed to other critical endeavors such as commercialization.”
New paper replicates Bloom'sAre Ideas Getting Harder To Findfor China and Germany and finds evidence of a decline in research productivity in both countries providing support to Bloom's work
What they did, “….Following Bloom et al., we calculate the research productivity parameter,𝛼𝛼, in equation (1),by taking the average of output growth per firm and decade (1990s, 2000s, and 2010s), and dividing by average input levels. As measures for output we use sales revenue, employment, revenue labor productivity, and market capitalization (monetary units deflated by the GDP implicit price deflator). Market capitalization is not available for Germany’s predominantly privately owned companies and we substitute it with sales revenue from innovative products and services. Regarding inputs, Bloom et al. (2020) show theoretically that research inputs in (1) can be measured by𝑆𝑆̃𝑡𝑡, the“effective number of researchers”, by deflating a firm’s R&D expenditures, 𝑆𝑆with the nominal wage rate for high-skilled workers in the economy…”
Bottom line, “….Table 1 depicts our results. In Germany, the effective number of researchers grows at an annual rate of 1.5% to 4.9%. Like Bloom et al.’s findings for the U.S., however, such input growth is not met with a proportional growth in output.As a result, we find declines in research productivity ranging from3.7% to 7.8% per year. The average of the four estimates, equal to -5.225%, implies that research productivity halves every fourteen years, which is very close to the estimated halflife of thirteen years for the U.S. (Bloom et al., 2020). In China, we observe an extremely rapid expansion of research activities during the first and second decades of the 21st century, with growth rates for effective researchers ranging between 21% and 24%.5 The resulting output growth, again, is not proportional to such inputs, which is reflected in a decrease in research productivity estimated between 15.4% and 29.3%. Averaged across estimates, this amounts to a decline of -23.775% per year, or a half-life of around 3 years….”
Note they theorize that China might see a quicker decline in research productivity due to internal constraints, “….Overall, ideas are not only getting harder to find in the U.S., but that the same holds true for the largest R&D-spending countries in Europe and Asia respectively. Although estimates are difficult to compare, due to differences between data sources, negative growth rates are, in fact, remarkably similar across Germany and the U.S. China has undergone an even larger decline in research productivity in the last two decades, which reflects its rapid transformation from principally capital-driven growth toward more innovation-led growth. It remains to be seen whether China will start to follow productivity trends of advanced economies. The increasingly inward looking and mission-driven nature of Chinese innovation policy (Chinese State Council, 2020), however, suggests that research productivity might continue to decline faster in China than elsewhere. Knowledge production at the technology frontier crucially relies on creative freedom, serendipitous discovery, and exchange…”
