Research & Evaluation
ECA has ample experience utilizing mixed, multi-informant designs to both examine program implementation across ecological contexts and evaluate effectiveness at the child, provider, and program levels. Our work is largely guided by principles of implementation science as well as frameworks of theory of change and ecological systems. We collect a range of data that have uniquely informed the aims and implications of all our projects. With substantial experience utilizing quantitative assessment strategies, our methods extend from the development of brief evaluative surveys to observation and the application of well-established rubrics and tools. These data are often triangulated with qualitative interviews or focus groups to gain multi-stakeholder perspectives. ECA is adept at conducting child and adult assessments in culturally, linguistically, and socioeconomically diverse populations, and we use and train others on child assessment tools that align with the Child Outcomes framework for monitoring the progress of children with disabilities. Further, we have studied and measured collaboration initiatives in several state and city-funded projects across the early childhood mixed delivery system and employ cutting-edge technology to support evaluations near and far.
As organizations think about what their accountability should look like, good data and program monitoring are critical components. Leaders learn essential terminology; how evaluation feeds into the continuous improvement feedback loop; how to select the right methods for your evaluation study; how to analyze and interpret data; and how to use data to make compelling arguments.
At the state level, we explore impact of an innovative statewide initiate, such as a peer coaching model from the perspective of multiple constituents including, coaches, teachers, classrooms, schools, and districts.
At the federal level, we measure outcomes and impact of federal grants. ECA consolidates and analyzes data from a multitude of sources to measure changes in teachers’ pedagogy, classroom quality, child outcomes, parent engagement, and collaboration. These findings contribute to policy and funding recommendations.
At the local level, ECA develops plans for continuous improvement after conferencing with administrators and teachers to review individual strengths and opportunities for growth in teacher interactions, instructional practices and student engagement.
At the state level, ECA works with stakeholders to develop online reporting protocols, as well as website and social media tools to improve communication to the field.
At the federal level, ECA streamlines complex evaluation findings to support policy makers in decisions about program structure, policies and future funding opportunities.