Ergonomics, Occupational Health and Safety Management System, Performance evaluation, ProKnow-C.


Considering that the most significant impact of accidents is on the worker themself, ergonomics with its systemic approach considering the domains of specialization can contribute to planning and executing the OHSMS, particularly with the use of more accurate indicators to evaluate the system's performance. This article aims to identify and characterize the methodologies and indicators used to assess the OHSMS through an RSL. To select and analyze articles on OHSMS evaluation methods, ProKnow-C was applied, using Advanced and Systemic Analyzes, to identify the types of methods and the organization's scope and participation. As a result, it was possible to identify that, in the 28 studies analyzed, a normative or descriptive approach was used, generic in 12 and specific in six. In contrast, the context was generic in three studies and specific in six. Furthermore, 28 selected works are based on generic indicators, 18 used Leading indicators, and ten used the combination of Lagging and Leading indicators without mentioning or analyzing the ergonomics domains of specialization. Likewise, it was evident that they did not analyze the organizational context to define the indicators. It is considered that the assessment components must be defined based on the organization's context, helping to identify the problems and critical situations that interfere with the risk management activities. Thus, the organization can define how to manage the workers and contribute to their well-being, allowing continuous improvements in the OHSMS. All of this supports the need to develop assessment methodologies using specific indicators to the organization's context.

Biografia do Autor

Carmen Elena Martinez Riascos, Universidade Federal de Santa Catarina - UFSC

Doutoranda em Engenharia de Produção na Universidade Federal de Santa Catarina, Mestre em energia pela Universidade Federal do ABC, Esp em Higiene e Segurança Industrial pela Universidade Autonoma de Occidente, Engenheira Industrial pela Universidad del Valle.

Sandra Rolim Ensslin, Federal University of Santa Catarina

Possui graduação em Ciência Contábeis pela Universidade Católica de Pelotas, mestrado em Engenharia de Produção pela Universidade Federal de Santa Catarina, doutorado em Engenharia de Produção pela Universidade Federal de Santa Catarina e Pós-Doutorado pela Universidad de Valencia - Espanha. 

Eugenio Andrés Díaz Merino, Federal University of Santa Catarina

Possui graduação em Desenho Industrial pela Universidade Federal do Rio de Janeiro, mestrado em Engenharia de Produção pela Universidade Federal de Santa Catarina e doutorado em Engenharia de Produção pela Universidade Federal de Santa Catarina. 


Ale, B. J. M., Baksteen, H., Bellamy, L. J., Bloemhof, A., Goossens, L., Hale, A., & Whiston, J. Y. (2008). Quantifying occupational risk: The development of an occupational risk model. Safety Science, 46(2), 176–185.

Barbeau, E., Roelofs, C., Youngstrom, R., Sorensen, G., Stoddard, A., & Lamontagne, A. . (2004). Assessment of Occupational Safety and Health Programs in Small Businesses. American Journal of Industrial Medicine, 45(November 2003), 371–379.

Bititci, U., Garengo, P., Dörfler, V., & Nudurupati, S. (2012). Performance Measurement: Challenges for Tomorrow. International Journal of Management Reviews, 14(3), 305–327.

Burke, M. J., Sarpy, S. A., Tesluk, P. E., & Smith-Crowe, K. (2002). General safety performance: A test of a grounded theoretical model. Personnel Psychology, 55, 429–457.

Cadieux, J., Roy, M., & Desmarais, L. (2006). A preliminary validation of a new measure of occupational health and safety. Journal of Safety Research, 37(4), 413–419.

Cardoso, T. L., Ensslin, S. R., Ensslin, L., Ripoll-Feliu, V. M., & Dutra, A. (2015). Reflexões para avanço na área de Avaliação e Gestão do Desempenho das universidades: uma análise da literatura científica. Seminários Em Administração (XVIII SEMEAD).

Cox, S. ., & Cheyne, A. J. . (2000). Assessing safety culture in offshore environments. Safety Science, 34(1), 111–129.

Curcuruto, M., Griffin, M. A., & Hodkiewicz, M. R. (2017). Dynamic safety capability and organizational management systems: An assessment tool to evaluate the “fitness-to-operate” in high-risk industrial environments. Chemical Engineering Transactions, 57(May), 289–294.

Deighan, C., Lansdown, T., & Brotherton, C. (2009). Using “stage of change” and “business activity models” to assess and improve health and safety behaviours in SMEs. Policy and Practice in Health and Safety, 7(1), 69–83.

Dutra, A., Ensslin, S. R., Ensslin, L., Ripoll-Feliu, V. M., & Fillol, A. G. (2015). The construction of knowledge from the scientific literature about the theme seaport performance evaluation. International Journal of Productivity and Performance Management, 64(2), 243–269.

Ensslin, L, Ensslin, S. ., Dutra, A., Nunes, N. ., & Reis, C. (2017). BPM governance: a literature analysis of performance evaluation. Business Process Management Journal, 23(1), 71–86.

Ensslin, Leonardo, Ensslin, S. R., & Pacheco, G. C. (2012). Um estudo sobre segurança em estádios de futebol baseado na análise bibliométrica da literatura internacional A study about safety in football stadiums based on bibliometric analysis of international literature. Perspectivas Em Ciência de Informação, 17(2), 71–91.

Ensslin, S. R., Ensslin, L., Imlau, J. M., & Chaves, L. C. (2014). Processo de Mapeamento das Publicações Científicas de um Tema : Portfólio Bibliográfico e Análise Bibliométrica sobre avaliação de desempenho de cooperativas de produção agropecuária. Revista de Economia e Sociologia Rural, 52(3), 587–608.

Fernández-Muñiz, B., Montes-Peón, J. M., & Vázquez-Ordás, C. J. (2007). Safety management system: Development and validation of a multidimensional scale. Journal of Loss Prevention in the Process Industries, 20(1), 52–68.

Ghalayini, A. M., & Noble, J. S. (1996). The changing basis of performance measurement. International Journal of Operations & Production Management, 16(8), 63–80.

Grote, G., & Künzler, C. (2000). Diagnosis of safety culture in safety management audits. Safety Science, 34(1–3), 131–150.

Hoffmeister, K., Gibbons, A., Schwatka, N., & Rosecrance, J. (2015). Ergonomics Climate Assessment: A measure of operational performance and employee well-being. Applied Ergonomics, 50, 160–169.

Hsiao, Y.-L., Drury, C., Wu, C., & Paquet, V. (2013). Predictive models of safety based on audit findings: Part 2: Measurement of model validity. Applied Ergonomics, 44(4), 659–666.

Hsiao, Y. L., Drury, C., Wu, C., & Paquet, V. (2013). Predictive models of safety based on audit findings: Part 1: Model development and reliability. Applied Ergonomics, 44(2), 261–273.

IEA. (2019). International Ergonomics Association. Definition and Domains of Ergonomics.

ILO. (2019). International Labour Organization.

Ketola, J., Liuhamo, M., & Mattila, M. (2002). Application of Performance-Excellence Criteria to Improvement of Occupational Safety. 12(4), 407–426.

Khodabocus, B. F., & Constant, K. C. (2010). Implementing OHSAS 18001:2007: A Case Study of Hazard Analysis from the Printing Industry. International Journal of Engineering Research in Africa, 1, 17–27.

LaMontagne, A. D., Barbeau, E., Youngstrom, R. A., Lewiton, M., Stoddard, A., McLellan, D., Wallace, L. M., & Sorensen, G. (2004). Assessing and intervening on OSH programmes: effectiveness evaluation of the Wellworks-2 intervention in 15 manufacturing worksites. Occupational and Environmental Medicine, 61(8), 651–660.

Law, W. K., Chan, a. H. S., & Pun, K. F. (2006). Prioritising the safety management elements. Industrial Management & Data Systems, 106(6), 778–792.

Lin, J., & Mills, A. (2001). Measuring the occupational health and safety performance of construction companies in Australia. Facilities, 19, 131–139.

Lingard, H., Wakefield, R., & Cashin, P. (2011). The development and testing of a hierarchical measure of project OHS performance. Engineering, Construction and Architectural Management, 18(1), 30–49.

Neely, A. (1999). The performance measurement revolution: why now and what next? International Journal of Operations & Production Management, 19(2), 205–228.

Neely, A., Gregory, M., & Platts, K. W. (1995). Performance measurement system design: a literature review and research agenda. International Journal of Operations & Production Management, 15(4), 80–116.

Podgorski, D. (2000). Occupational Health and Safety Management in Polish Enterprises Implementing Total Quality Management Systems. International Journal of Occupational Safety and Ergonomics, 6(sup1), 85–101.

Podgórski, D. (2015). Measuring operational performance of OSH management system - A demonstration of AHP-based selection of leading key performance indicators. Safety Science, 73, 146–166.

Pourreza, P., Saberi, M., Azadeh, A., Chang, E., & Hussain, O. (2018). Health, Safety, Environment and Ergonomic Improvement in Energy Sector Using an Integrated Fuzzy Cognitive Map–Bayesian Network Model. International Journal of Fuzzy Systems, 20(4), 1346–1356.

Ramli, A. A., Watada, J., & Pedrycz, W. (2011). Possibilistic regression analysis of influential factors for occupational health and safety management systems. Safety Science, 49(8–9), 1110–1117.

Redinger, C. F., Levine, S. P., Blotzer, M. J., & Majewski, M. P. (2002a). Evaluation of an Occupational Health and Safety Management System Performance Measurement Tool—II: Scoring Methods and Field Study Sites. AIHA Journal, 63(1), 34–40.

Redinger, C. F., Levine, S. P., Blotzer, M. J., & Majewski, M. P. (2002b). Evaluation of an occupational health and safety management system performance measurement tool - III: Measurement of initiation elements. Aihaj, 63(1), 41–46.<0041:EOAOHA>2.0.CO;2

Robson, L. S., Clarke, J. A., Cullen, K., Bielecky, A., Severin, C., Bigelow, P. L., Irvin, E., Culyer, A., & Mahood, Q. (2007). The effectiveness of occupational health and safety management system interventions: A systematic review. Safety Science, 45(3), 329–353.

Saedi, A. M., Thambirajah, J. J., & Pariatamby, A. (2014). A HIRARC model for safety and risk evaluation at a hydroelectric power generation plant. Safety Science, 70, 308–315.

Seixas, N., Crollard, A., Neitzel, R., Stover, B., & Dominguez, C. (2013). Intervening at the bottom: Can a health and safety committee intervention influence management commitment? Policy and Practice in Health and Safety, 11(1), 61–78.

Sgourou, E., Katsakiori, P., Goutsos, S., & Manatakis, E. (2010). Assessment of selected safety performance evaluation methods in regards to their conceptual, methodological and practical characteristics. Safety Science, 48(8), 1019–1025.

Shikdar, A. A., & Sawaqed, N. M. (2004). Ergonomics, and occupational health and safety in the oil industry: A managers’ response. Computers and Industrial Engineering, 47(2–3), 223–232.

Torp, S., & Moen, B. E. (2006). The effects of occupational health and safety management on work environment and health: A prospective study. Applied Ergonomics, 37(6), 775–783.

Valmorbida, S. M. ., Ensslin, S. ., Ensslin, L., & Ripoll-Feliu, V. . (2016). Rankings universitários mundiais: que dizem os estudos internacionais? REICE. Revista Iberoamericana Sobre Calidad, Eficacia y Cambio En Educación, 14(2), 1–25.

Valmorbida, S. M. I., & Ensslin, S. R. (2015). Avaliação de Desempenho de Rankings Universitários: Revisão da Literatura e diretrizes para futuras investigações. Anais Do Encontro Da ANPAD (XXXIX EnANPAD 2015).

van Holland, B. J., Boer, M. R. de, Brouwer, S., Soer, R., & Reneman, M. F. (2012). Sustained employability of workers in a production environment: design of a stepped wedge trial to evaluate effectiveness and cost-benefit of the POSE program. BMC Public Health, 12(1), 1003.

Wurzelbacher, S., & Jin, Y. (2011). A framework for evaluating OSH program effectiveness using leading and trailing metrics. Journal of Safety Research, 42(3), 199–207.

Zhao, T., Kazemi, S. E., Liu, W., & Zhang, M. (2018). The Last Mile: Safety Management Implementation in Construction Sites. Advances in Civil Engineering, 2018(Figure 1), 1–15.