Results released from a validation study examining ServiceFit® for Retail showed a high correlation between assessment scores and internal manager performance ratings. Conducted in February 2012 by Select International, the study examined the performance of hourly employees at a Fortune 100 retailer.
In preparation for the validation study, an extensive job analysis was conducted from December 2011 to January 2012. The job analysis process included site tours, Job Content Expert focus groups, and Competency Analysis Questionnaires. Data was collected at multiple sites throughout the U.S. for six hourly job families.
Potential participants were narrowed down by the following criteria and then chosen at random:
• Minimum one-year tenure
• Supervised by rating manager for at least 6 months
• Low, medium and high performers
The participating incumbents then completed a customized version of ServiceFit for Retail, a brief online employee assessment that identifies candidates considered high-risk on factors negatively related to job performance. The tool measures nine competency areas, comprised of seven risk factors and two job potential factors:
• Quality Risk
• Stress Risk
• Productivity Risk
• Absenteeism Risk
• Turnover Risk
• Safety Risk
• Integrity
• Service Potential
• Sales Potential
To provide the analytical comparison, managers also completed performance rating forms measuring four major performance dimensions: Overall Performance, Counter-Productive Work Behaviors (CWB), Safety Performance and Sales Performance.
Analysis of all the data showed strong correlations between the employee assessment and managers’ performance ratings, some of which included:
• Job Position #1
– Incumbents with assessment scores in the Bottom 25% had 99 supervisor-reported CWBs; those who performed in the Top 25% had 35 CWBs.
– Final composite validity for each performance dimension:
Criteria: Validity Estimate
Overall: 0.58
Safety: 0.17*
Sales: 0.17*
CWB: -0.29
p<.001 ** p<.01 * p<.05
• Job Position #2
– Incumbents with assessment scores in the Bottom 25% had 85 supervisor-reported CWBs; those who performed in the Top 25% had 46 CWBs.
– Final composite validity for each performance dimension:
Criteria: Validity Estimate
Overall: 0.37
Safety: 0.22*
Sales: 0.40*
CWB: -0.32
p<.001 ** p<.01 * p<.05
• Job Position #3
– Incumbents with assessment scores in the Bottom 25% had 71 supervisor-reported CWBs; those who performed in the Top 25% had 38 CWBs.
– Final composite validity for each performance dimension:
Criteria: Validity Estimate
Overall: 0.27
Safety: 0.12*
Sales: 0.00*
CWB: -0.12
p<.001 ** p<.01 * p<.05
• Job Position #4
– Incumbents with assessment scores in the Bottom 25% had 22 supervisor-reported CWBs; those who performed in the Top 25% had 0 CWBs.
– Final composite validity for each performance dimension:
Criteria: Validity Estimate
Overall: 0.40
Safety: 0.08*
Sales: 0.29*
CWB: -0.52
p<.001 ** p<.01 * p<.05
“This validation study provided our client with valuable information on its current hourly workforce,” said Dr. Ted Kinney, Senior Project Consultant at Select International. “This study not only illustrates the effectiveness of the ServiceFit for Retail assessment, but also shows how making accurate hiring decisions can positively impact an organization’s overall performance.”
The full report detailing the validation study results will be available upon request. To request a copy, email Select International at [email protected].
About Select International
Select International develops employee assessments and hiring systems to help organizations identify, select and develop a strong, productive workforce. The company’s employee selection and development solutions include pre employment assessments, executive assessment, online interview training, manufacturing assessment tests, healthcare hiring assessments, customer service assessment tests, and tools to help organizations hire safe workers. Select International works closely with its clients to improve hiring at all levels, and across all industries, including manufacturing, healthcare, customer service, energy, retail, transportation and logistics, and distribution.
Select International is headquartered in Pittsburgh, PA, and maintains offices throughout North America and around the globe. For more information on Select International, call 1-800-786-8595 or visit http://www.selectinternational.com.