New Ways of Working: Construction, Evidence of Validity, and Reliability of a Checklist

https://doi.org/10.5935/rpot/2023.4.24348

Abstract

The globalization of technological advancement has significantly changed the organization of work. The availability of an instrument that characterizes new forms of work can help identify essential information that makes it possible to understand the characteristics of work and its forms of organization. This study reports the construction, evidence of validity, and reliability of evidence of a checklist to characterize new ways of working. Five judges participated in the validation stage, and reliability was tested with 23 entrepreneurs and managers. The analysis was carried out using Kendall’s, Kappa and intraclass correlation coefficients, as well as Bland-Altman graph analyses. The evaluation of the judges showed the need of adapting all items regarding their face (W = 0.536, p = 0.000) and content validity (W = 0.275; p = 0.027). Both inter-evaluator (ICC = 0.95; p = 0.000) and test-retest (ICC = 0.90; p = 0.000) reliability were very high, with most items showing almost perfect (kw > 0.81) or strong (0.61 < kw  >0.80) reliability. Graphical analyses did not indicate systematic differences. The final version of the checklist presented excellent reliability and can be used to characterize new forms of work.