| This post was kindly contributed by SAS – r4stats.com - go there to comment and to read the full post. |
The Bureau of Labor Statistics projects that jobs for statisticians will grow by 34% between 2014 and 2024. However, according to the nation’s largest job web site, the number of companies looking for “statisticians” is actually in sharp decline. Those jobs are likely being replaced by postings for “data scientists.”
I regularly monitor the Popularity of Data Science Software, and as an offshoot of that project, I collected data that helps us understand how the term “data science” is defined. I began by finding jobs that required expertise in software used for data science such as R or SPSS. I then examined the tasks that the jobs entailed, such as “analyze data,” and looked up jobs based only on one task at a time. I switched back and forth between searching for software and for the terms used to describe the jobs, until I had a comprehensive list of both. In the end, I had searched for over 50 software packages and over 40 descriptive terms or tasks. I had also skimmed thousands of job advertisements. (Additional details are here).
| Search Terms | 2/26/2017 | 2/17/2014 | Ratio |
| Big Data | 20,646 | 10,378 | 1.99 |
| Data analytics | 15,774 | 6,209 | 2.54 |
| Machine learning | 12,499 | 3,658 | 3.42 |
| Statistical analysis | 11,397 | 9,719 | 1.17 |
| Data mining | 9,757 | 7,776 | 1.25 |
| Data Science | 6,873 | 973 | 7.06 |
| Quantitative analysis | 4,095 | 3,365 | 1.22 |
| Business analytics | 4,043 | 2,867 | 1.41 |
| Advanced Analytics | 3,479 | 1,497 | 2.32 |
| Data Scientist | 3,272 | 974 | 3.36 |
| Statistical software | 2,835 | 2,102 | 1.35 |
| Predictive analytics | 2,411 | 1,497 | 1.61 |
| Artificial intelligence | 2,404 | 794 | 3.03 |
| Predictive modeling | 2,264 | 1,804 | 1.25 |
| Statistical modeling | 2,040 | 1,462 | 1.40 |
| Quantitative research | 1,837 | 1,380 | 1.33 |
| Research analyst | 1,756 | 1,722 | 1.02 |
| Statistical tools | 1,414 | 1,121 | 1.26 |
| Statistician | 904 | 1,711 | 0.53 |
| Statistical packages | 784 | 559 | 1.40 |
| Survey research | 440 | 559 | 0.79 |
| Quantitative modeling | 352 | 322 | 1.09 |
| Statistical research | 208 | 174 | 1.20 |
| Statistical computing | 153 | 108 | 1.42 |
| Research computing | 133 | 97 | 1.37 |
| Statistical analyst | 125 | 141 | 0.89 |
| Data miner | 34 | 19 | 1.79 |
Many terms were used outside the realm of data science. Other terms were used both in data science jobs and in jobs that require little analytic skill. Terms that could not be used to specifically find data science jobs were: analytics, data visualization, graphics, data graphics, statistics, statistical, survey, research associate, and business intelligence. One term, econometric(s), required deep analytical skills, but was too focused on one field.
The search terms that were well-focused on data science, but not overly focused in a single field are listed in the following table. The table is sorted by the number of jobs found on Indeed.com on February 26, 2017. While each column displays counts taken on a single day, the large size of Indeed.com’s database of jobs keeps its counts stable. The correlation between the logs of the two counts is quite strong, r=.95, p= 4.7e-14.
During this three-year period, the overall unemployment rate dropped from 6.7% to 4.7%, indicating a period of job growth for most fields. Three terms grew very rapidly indeed with “data science” growing 7-fold, and both “data scientist” and “artificial intelligence” tripling in size. The biggest surprise was that the use of the term “statistician” took a huge hit, dropping to only 53% of its former value.
That table covers a wide range of terms, but only on two dates. What does the long-term trend look like? Indeed.com has a trend-tracking page that lets us answer that question. The figure below shows solid the growth in the percentage of advertisements that used the term “data scientist” (blue, top right), while those using the term “statistician” (yellow, lower right) are steadily declining.
The plot on the company’s site is interactive (the one shown here is not) allowing me to see that the most recent data points were recorded on December 27, 2016. On that date, the percentage of jobs for data scientist were 474% of those for statistician.
As an accredited professional statistician, am I worried about this trend? Not at all. Statistical analysis software has broadened its scope to include many new capabilities including: machine learning, artificial intelligence, Structured Query Language, advanced visualization techniques, interfaces to Python, R, and Apache Spark. The software has changed because the job known as “statistician” has changed. Statisticians aren’t going away, their jobs are evolving into what we now know as data science. And that field is growing quite nicely!
| This post was kindly contributed by SAS – r4stats.com - go there to comment and to read the full post. |