Based on research on MAP-X conducted in collaboration with Justus-Liebig-University (JLU, Germany), we have made a revision of the current version of MAP-X with even better psychometric properties. The new version will be available in Assessio Platform on 26-09-2024.
Why do we need to make changes to an existing assessment?
There can be several reasons for changing an existing assessment tool. With time, the theoretical landscape, and the research within the field of assessments evolve, which can lead to new insights and methods that will increase the probability of success when applying the assessment in HR processes.
Also, when developing, documenting, and evaluating an assessment tool, we gain valuable insights into potential routes for improvement.
As a professional assessment provider, we see it as our obligation to use these insights and continuously improve our assessment tools and ensure that our clients get the highest value possible from our offer.
What were the reasons for revising MAP-X?
As part of the ongoing documentation and quality assurance of MAP-X we conducted a cross-validation study, in collaboration with researchers from Justus-Liebig-University (JLU, Germany), to prove the results found in the initial data set used for development of the tool.
Although the new data set showed similar results compared to the initial data, it also suggested a slightly different item sub-set to compute the MAP-X scales from- However, comparing the two data set on a different level, looking at sub-scale correlations to the criteria, proved increased consistency between the two data sets. In short, having two different options to base MAP-X scales on; item sub-sets or scale combinations, the latter showed the best results across the two data sets, why the MAP-X scales in the new version are based on scale combinations from MAP sub-scales.
What does this mean to me?
MAP-X still measures extremes based on the big-5, assessing test subjects’ risk behaviors and mapping how test subjects’ positive features may result in aversive behaviors. MAP-X provide an excellent insight regarding features of one’s personality that may impair the test subject’s collaboration, success, or adaptiveness resulting in undesired situations for themselves and their surroundings - information that may lead to enhanced self-awareness and form the basis for personal development and improved team-fit.
When interpreting the scales, it is important to consider the following minor changes to the old operationalization of the extreme:
- Withdrawn – Attention seeking: The new construct does not include notions of impatience, excessive energy or risk-taking, but holds a higher emphasis on the need for other people, why Attention seeking was deemed a more suitable label for the high-end extreme.
- Insensitive – Overcaring: The label oversensitive was deemed too easily confused with low-end extreme for emotional stability, why it was changed to Overcaring. No major changes have been made to the content of this extreme, however, less emphasis is on Communication in the operationalization of the scale.
- Impulsive – Rigid: The new construct does not include notions of ambition but holds a heavier weight on perfectionism and not being willing to compromise, why the existing labels were deemed highly suitable.
- Emotional – Unresponsive: The new construct does not include notions of the candidates’ level of confidence but captures their tendency to react to aversive situations. The labels were changed from Intense – Unemotional to Emotional – Unresponsive to make the connection to emotional stability clearer and underly the aversive nature of the high-end extreme.
- Conformist – Eccentric: No major changes
Generally, no major score changes are expected from this update as correlations between the old and new algorithms have proved to be very high.
There will be no changes to existing candidates’ extreme scores in the platform, however, texts will be updated.
For all new recruitments, after the release date, all candidates’ extremes will be calculated based on the new MAP-X algorithm.
When adding candidates to an existing recruitment process, all new candidates’ extremes will be calculated based on the old MAP-X algorithm, thus ensuring the possibility to compare candidates’ extremes.
If candidates from previous recruitment processes are added to a new recruitment, their extreme scores will be recalculated based on the new algorithm to ensure the possibility to compare candidates’ extremes.
All extreme scores in the development module will be updated upon release.
What are the major changes?
To accommodate the possible routes for improvement discovered for MAP-X, the following has been done:
- Changing the algorithm from relying on an item sub-set to relying on MAP sub-scale combinations.
- Renaming Unrestrained to Attention seeking, Oversensitive to Overcaring, Intense to Emotional and Unemotional to Unresponsive to make the extremes easier to separate and more relatable to their intended big-5 trait.
- Revising descriptions in the platform to reflect the small changes in content resulting from the changes to the algorithm.