goc logo
Français

Talent Cloud Results Report

Five Factor Matching

The Problem

Many of the managers in Talent Cloud’s early workshops in 2017 reported that the hires they had secured through pool staffing processes in previous years had proved to be poor fits in the long run. This had led to frustration, further staffing gaps, and time and effort wasted.

Several managers mentioned in these same workshops that their preferred staffing process was through “internal networking” (basically, poaching talent from other departments using personal networks). Managers reported that this practice was common among peers. Significantly, it wasn’t their preferred staffing method only because it was faster. It also allowed managers to get insights (before committing to a hire) about the soft skills and culture fit side of recruitment that was hard to come by otherwise. However, hiring managers and GC senior management who participated in interviews reported that the practice of internal poaching was unsustainable and harmful in large numbers; it was creating internal instability in teams requiring high-demand skills, and was failing to refresh the GC talent pool. This was particularly acute in digital talent and, ironically, HR related positions.

External applicants in workshops in 2017 reported frustration with applying for jobs where they knew nothing about the work environment or team they might be joining, and the absence of this information was a deterrent for highly qualified applicants with multiple employment choices. GC employee workshop participants who had previously been recruited to a team where the fit proved to be poor reported that they swiftly moved on to other positions (or intended to move on in the near future).

The Hypotheses

Note: The overarching hypothesis to factor in culture carries a risk - one that we had to not only be aware of, but also actively work to guard against. When staffing processes strengthen culture fit, there is also the potential for a model that facilitates the “like hires like” scenario, which exacerbates gaps in inclusion and diversity, and works against equity-seeking groups. Awareness of this risk led the team to develop bias reduction elements, working in tandem with elements designed to optimize the talent-to-team match. (See Research Section 3 on the team’s diversity and inclusion theory and designs.)

Most work isn't done in isolation. So why design hiring models like this?

Standard Process:
Two Factor Match

  • Applicant
  • Job

Modern recruitment looks at human factors.

Talent Cloud's Process:
Five Factor Match

  • Applicant
  • Job
  • Manager
  • Team Culture
  • Work Environment

The Experiment

To begin, Talent Cloud needed to first identify which “human elements” to choose to test in a new type of GC job advertisement. The team held a series of workshops in 2017 to identify promising elements.

Taking the top 10 components of a job advertisement that recurred most often in workshops, Talent Cloud then conducted a survey (as a subset of other workshops) with internal and external applicants in 2017-18. This was a simple form that asked people to rank the order of importance for information on the job advertisement. The top three factors in our research were key tasks of the job, team culture, and impact.

Because Talent Cloud was already separately working on testing the intersection of key tasks, impact, and skills required (see Impact-Driven Staffing in this research section), we expanded on the concept of team culture. In the end, Talent Cloud elected to add manager profile, team culture and work environment to the job advertisement.

Talent Cloud tested these elements in live job processes, and interviewed applicants about the influence of these factors on their decision to apply.

Talent Cloud realized that if the information about “human elements” was to influence the hiring outcome, it needed to also factor into the screening criteria at the heart of the hiring process. Otherwise, the new information being shared might influence an applicant’s decision to apply, but it would fail to shape the other half of the equation: how managers decide on their final hire.

In order to connect the three human factors (team culture, manager leadership style and work environment) to the selection criteria, Talent Cloud tested the correlation between different workplaces and behaviours that were successful in different contexts. Talent Cloud ran a series of workshops in 2018 with managers, asking them to identify “the good, the bad and the ugly” when it came to GC workplaces, and then to work together to identify who succeeded in each of these environments. The results produced a “map” of sorts that Talent Cloud then used to design a semi-automated tool for managers in selecting essential and asset criteria for the job advertisement.

For example, if in their checklist on the manager’s job advertisement tool, managers identified that a workplace was high stress, resilience would be suggested to them as a soft skill to add to the job poster. This wasn’t so much behavioural psychology as it was an exercise in giving individual managers the benefit of collective advice from their peers. Managers made the final decision on whether or not to include the suggested soft skills. Managers were also given draft text by the tool (based on what elements of the work environment they selected) to help them craft a work environment statement for the job advertisement. (We found that managers procrastinated with this task significantly - blank text boxes on culture were daunting - until we gave them some rough text to start with. Managers love to edit - it’s what they’re trained for. This resolved the procrastination issue and automated the acceleration towards stronger, faster job advertisement drafts for HR advisors to review.)

Following the mapping exercise in 2018, and live testing in 2018-19, Talent Cloud revalidated and refined the insights by repeating the exercise in 2019, as part of refining its taxonomy for transferable skills. A fuller automation of this work has been designed and is in early testing stages.

Article continues below

The Results

While small in sample size, Talent Cloud found the five factor matching model enormously effective. Talent Cloud boasts an impressive rate of 9% of all applicants being “ready to receive an offer”. That’s to say, they’re deemed to be fully qualified for the position. In comparison, the private sector average is 2-3%. (No statistics were available from the GC for a comparison.)

We also did follow-up interviews with managers 1-2 years after their initial hire to find out how the fit went, and what the long-term impact of the hiring approach had been for overall successful work delivery and government fit. The results were impressive. We were able to interview 55% of our hiring managers, many of whom had made multiple hires through the platform. Retention rates for the recruited talent were enormously high at 94% still in the Government of Canada 1-2 years after the initial term hire (bearing in mind that the initial term positions were for 6 months - 1 year). 77% of these hires were still on the same team, and many had already had a term extension or conversion into an indeterminate position. In all but one case, managers reported that they were happy with the hiring fit, and would repeat the approach.

Perhaps more importantly, managers reported that they thought the culture fit was strong and liked working with the employees hired. The applicants hired that we were able to interview reported the same thing, expressing fondness and loyalty to the team, and a strong culture fit. The hiring approach produced both productivity and happiness, which are workplace outcomes worth having. (See also Case Study: Manager and Applicant Interviews in Section 2 of this report.)

External Research

In the academic literature on workplace recruitment and retention, there is strong consensus that organizational culture matters enormously. Whether an applicant is considering joining Google, a gig-based employer, the military or the company that’s been around for 100 years, the organization’s stated cultural values (and their demonstrated reputation for upholding them) are key factors in an organization’s ability to attract and retain the talent it needs to succeed. Consistently, the following things matter to applicants and employees: the work environment, who their manager and team is/will be, and what the overarching culture is in the organization.

One of the important things to note is that while there are certain leadership values that are consistently important (see Why Flexibility and Authenticity Matter in this report), there is significant diversity when it comes to successful organizational cultures. This is often dependent on the size of the organization, their mandate or product, and what they offer in terms of a value proposition to customers and employees. In this context, it’s not about promoting a single correct model for organizational culture - it’s all about optimizing the fit between a diverse range of organizations and the employees they attract. Not all humans learn and work the same way, and neither do organizations. Organizations that succeed with recruitment and retention tend to have a strong level of organizational self-awareness, and design their recruitment strategies to attract talent that will be a strong fit to their specific culture.

Workplaces that wish to attract innovators and creative thinkers need to take special care to ensure that applicants are able to see themselves in the organization when being recruited, and that the organization is able to provide an environment where this type of talent can flourish.

Insights

The effort to optimize the hiring fit between applicants and teams has led to numerous elements on the Talent Cloud platform, large and small. As with many “solutions”, it’s not about any one feature; it’s about adopting an approach that is considered in every feature. For us, our approach says that a strong fit between an incoming individual and their team is critical to successful work delivery. To account for this, systems and process design should approach actors in the system as humans, with emotions, work styles, preferences and lives beyond their jobs… and the fit between these humans will be as important as the skills each possesses individually. This base assumption has led to a platform that is radically different in feature design and operations than the standard GC hiring approach.

While there are ways to achieve this success through various features and design choices, systems that wish to optimize the talent-to-team match will need to extensively user test their choices, and should strongly consider including a focus on work environment, team culture and manager leadership style.

Who Uses Profiles and When?

Talent Cloud introduced profiles for both managers and applicants. These profiles were voluntary. We wanted to see how they would get used and if they added value to the platform.

Interestingly, applicants reported that the presence of an authentic manager profile was extremely important to them in the application process, even if the profile was relatively brief. In the only two cases where a Talent Cloud hiring manager declined to provide a profile, the final qualified candidates accepted other positions after the interview phase, resulting in no hire being made. While this could also be a coincidence, we think not. We had an instance where a manager with a profile and a manager without a profile posting almost identical jobs in the same period. The manager with the profile received almost twice as many applications, and had twice as many qualified candidates after the interview stage, leading to multiple hires.

On the other hand, when it came to applicant profiles, managers reported almost never referring to them. Instead, they focused their screening efforts on the application itself. This showcased the importance of applicants understanding the need to include details about how they came to earn their skills in the application itself, and factored significantly into the Timeline design Talent Cloud released in early 2021. (See Skills, Not Experience in Research Section 3 for more information.)

Return to Table of Contents