Industry Benchmarks and Employee Engagement
If you want industry-specific benchmarks for your employee survey, you probably already understand that benchmark data are important, but you may not fully appreciate why and how benchmarks are critical.
Believe it or not, the primary purpose of benchmark data is NOT to compare your organization to other organizations. For the most part, benchmarking on an employee engagement survey has relatively little to do with the types of companies that the benchmarks are based on.
Benchmarking works a lot like a handicap in golf. Amateur golfers with different skill levels have different handicaps. When golfers play against one another, each person's final score is adjusted by his or her handicap. This allows players with different skill levels to play against each other on equal terms, and to determine winners and losers not on an absolute basis, but rather, on an adjusted basis that accounts for each person's skill level.
Every item in an employee survey has its own natural "behavior" or "handicap". Some items tend to get higher scores and some items tend to get lower scores. This can be due to the way an item is worded or it can have to do with the topic that the item addresses - or both. Benchmarking eliminates these natural differences between items, which allows you to compare scores across items. Benchmarking also tells you whether those scores are high or low.
View a more detailed explanation and specific examples here.
Industry Differences by Item
The high-level view of engagement illustrated above shows relatively little difference across industries, but our research shows that there are actually some industry differences when we look at specific survey questions. These differences are typically limited to a handful of questions that reflect the unique cultural aspects of those industries.
When we do identify industry differences on specific survey questions, we have to consider whether it makes sense to use industry-specific benchmarks instead of broader benchmarks that span all industries. Ultimately, this becomes a philosophical question: Should we adjust the bar in those areas where an industry scores higher or lower?
Consider the example below, which shows the largest differences for the health care industry (i.e. hospitals and medical clinics).
It makes sense that people in the healthcare industry have a clear understanding of their organizations' strategic goals (healing sick people, for example). We can all be thankful that "quality and customer focus" are priorities in the healthcare industry, and that the people in this industry seem to have better than average resources to do their jobs.
We can also be concerned that there seems to be some lack of accountability within the healthcare industry and that there is inconsistency in living up to organizational values.
Now imagine you are the leader of a health care organization. What information is relevant to you? Do you want to be compared to other organizations in your industry, or do you want to look at the bigger picture?
If you choose industry benchmarks, you automatically raise or lower the bar, depending on the area in question. For the items that have higher industry benchmarks, is your goal to be even more quality and customer focused than others in your industry, or is your goal simply to be quality and customer focused?
Let's assume that quality and customer focus are priorities for your organization, and let's assume that these things cost money. If your reference point is the already-high industry benchmark and your score is about average or maybe even a bit below average compared to this benchmark, is it possible that you might end up focusing resources in these areas at the expense of other areas where those resources might be put to better use?
For the items that have a lower industry benchmark the philosophical question has a darker side - do you really want to lower the bar in areas such as "values" and "accountability" just because it might be a bit of a problem throughout your industry?
The next example is a bit less ominous, but it raises the same kinds of questions. These are benchmarks for the high-tech industry (i.e. internet and software companies). It appears that some cliches hold true within this industry - high-tech employees are much more empowered and have more freedom of expression compared to employees in other industries.
(What we haven't shown here are the 80% of items where the industry and global benchmarks are essentially the same.)
Using industry benchmarks, if a company gets an average or slightly low score on empowerment, does this suggest that the company needs to increase the level of employee empowerment? Remember, we are talking about a score that is average or slightly below average for the high-tech industry, but quite high compared to companies in other industries. Should the leaders of this company focus on increasing employee empowerment, or should they spend their time working on other areas? If a company scores high on empowerment compared to other high-tech companies, is that even a good thing? When does this become too much of a good thing?
There is no absolute right or wrong answer to these questions. There are good reasons for wanting to know how a company compares to other companies in the same industry, and there are good reasons for sticking with the global benchmarks that span all industries.
We generally come down on the side of global benchmarks for the following reasons:
The problem is that when organizations are given both global and industry-specific benchmarks, there is a strong temptation to choose the story that is more favorable and to discount the less favorable. Whether conscious or unconscious, having two different reference points to choose from makes it a lot easier to pick a preferred or easier path instead of what might be the harder but more relevant one.
Nevertheless, we understand that there is a case to be made for having both global and industry benchmarks, so we do provide them to our clients upon request in cases where we have sufficient data.
Are there exceptions?
There are some areas where the industry-specific benchmarks are so different from what we see in other industries that we need to take a separate look at the issues and conclusions raised above.
Manufacturing is an example of one of these industries. The industry averages are lower on every single survey item for the manufacturing industry. The highest and lowest item scores for manufacturing are shown below.
At the bottom of the list, we see that personal expression and fairness are very low. Meanwhile, at the top of the list, scores for accountability are below average compared to all industries, but they are a lot higher than most other areas.
Should we use global benchmarks here, knowing that most manufacturing companies are going to get low scores? Or should we use industry benchmarks, knowing that this means we are lowering the bar in all areas, including those very low scoring areas like personal expression and fairness?
Neither of these options is going to give us a good outcome. Global benchmarks will result in too much bad news, which makes it hard to know where to focus change efforts. Low scores are also just plain discouraging, sometimes resulting in companies choosing to discount, ignore, or rationalize the survey results - and some of this would be justified given what we know about the industry data.
On the other hand, using industry benchmarks would mean that we completely discount or ignore what appear to be industry-wide problem areas. Consider the raw score for the item "Everybody is treated fairly in this organization." At 2.9 on a 5-point scale, more people disagreed with this statement than agreed with it. In fact, 40% of manufacturing employees disagreed with this statement, while only 32% agreed - and these percentages include responses from management and senior leadership! Even if we ignore the benchmark data entirely, we can still see that there is something going on here.
The approach we use in this case is to simply adjust all the global benchmarks by the same amount so that the average score for manufacturing across all items results in a T-Score of 50. In this example, the average T-Score across all survey items was 46, so we add 4 to every T-Score. The chart below shows what this shift looks like.
Now, most manufacturing companies score above average on accountability. They still score below average on fairness and personal expression, but not quite as low as before. If we step back and think about what assumptions we would make about this industry, these adjusted score seem to fit. In other words, it makes sense that manufacturing companies are generally good at accountability, and not so good at promoting personal expression.