Measuring the Impact of Training in the Implementation of Project Management Information Systems

Abstract

Organizations can use training to maximize the benefits realized through the implementation of project, program, and portfolio management software. However, the relationship between Project Management Information System (PMIS) training and the creation of organizational value is not well understood. The goal of the research is to create a better understanding of current industry project management software training practices and outcomes. This research investigates training utilization and outcomes in the PMIS industry, the prevalence, relative effectiveness and efficiency of several commonly used training delivery methods at increasing PMIS outcomes, and the relationships of individual and organizational characteristics on outcomes.

An expansive multi-disciplinary review of existing scholarly literature was undertaken to develop a framework for the measurement of project management software training outcomes. Expert input from a panel of 9 practitioners averaging 16.7 years of professional experience related to PM, and 15.1 years of years of professional experience related to PM software usage was used to objectively select a small number of the best-scoring elements of the proposed framework for inclusion in a survey to be administered to practitioners.

In total, 1,021 completed surveys were collected and analyzed using statistical methods. Research findings suggest statistically significant differences in consumption rates, effectiveness and efficiency among the examined training delivery methods. This research may contribute to training that is more effective and more efficient, based on the unique requirements of each individual and organization, at a reasonable cost. The methodologies and findings of this research have immediate implications in improving the planning, delivery, and measurement of PMIS training.