assignment” which asked them to identify preferred groups to measure and to develop a preliminary list of possible indicators and the data quality issues associated with those indicators to determine whether their group of choice was viable for the measurement project. See Section 2 for summer work assignments.
1.4 FURTHER TRAINING ON DATA QUALITY AND STATISTICAL APPROACHES
The Project Management Team contracted with a firm to provide further data quality training on the use of ERP-type statistical methods, data collection instruments, sampling procedures and data quality indicators. This meeting took place on September 28, 2006 and the course addressed the following issues:
Overview of the six Data Quality Indicators that should be considered in any measurement project: precision, bias, completeness, representativeness, comparability and sensitivity.
Use of statistics in measuring innovative policy approaches, particularly focusing upon the techniques used in the Environmental Results Program (this two-part session included an introduction to statistics, benchmarking and comparisons).
Identification of the sampling frame, also known as establishing the universe of facilities.
Principles of good data collection, including the characteristics of good data collection instruments.
Quality considerations specific to the use of secondary data.
An interactive session where states worked in smaller groups on applying the
concepts that were learned.
See Appendix C for Introductory Training and Quality Measurement information.
OBSERVATIONS AND LESSONS LEARNED FROM PHASE 1
The kick-off meeting was helpful to states in defining goals and objectives for the project. This first meeting was a critical step in establishing common understandings and a vision for the 3 year project.
Some of the state participants initially thought the project was going to involve a full ERP, i.e. certification, outreach and measurement program. Phase 1 helped clarify that the States Common Measures Project would focus on performance measurement across states, not compliance certification or other ERP techniques.
The States Common Measures Project Final Report