EdSpeak01.JPG

Events Calendar

May 2012
S M T W T F S
29 30 1 2 3 4 5
6 7 8 9 10 11 12
13 14 15 16 17 18 19
20 21 22 23 24 25 26
27 28 29 30 31 1 2
Longitudinal Assessment of Comprehensive School Reform PDF Print E-mail
Written by Maryellen Rogusky   
Thursday, 02 February 2006 01:59
In 1998, Congress appropriated $145 million for the Comprehensive school reform Demonstration (CSRD) program. It was designed not as an add-on to be placed on top of already existing programs and efforts but as a way to encourage schools to integrate local, state, and federal resources into a comprehensive effort that would better meet student learning needs. Like schoolwide Title I programs, CSRD was intended to help schools use multiple sources of funds and integrate programs while allowing flexibility and enhancing accountability for student learning. Its unique aspect was the expectation that schools would collaborate with expert partners to implement whole-school reform models that had a strong research base and a successful replication record.

With the passage of the No Child Left Behind (NCLB) Act in 2002, CSR became a fully authorized program and is no longer a demonstration program. Further, NCLB described 11 components of comprehensive school reform, and, some argue, focused less on models than on the underlying processes that facilitate the kinds of changes needed in order for schools to ensure that all students learn.

Eleven Components of Comprehensive School Reform
Described in the No Child Left Behind Act
  1. Proven methods and strategies for student learning, teaching, and school management that are based on scientifically based research and effective practices and have been replicated successfully in schools with diverse characteristics.
  2. Comprehensive design for effective school functioning, integrating instruction, assessment, Classroom Management, and Professional Development and aligning these functions into a schoolwide reform plan designed to enable all students to meet challenging state content and performance standards and address needs identified through a school needs assessment.
  3. Professional development. High-quality and continuous teacher and staff professional development and training.
  4. Measurable goals for student performance and benchmarks for meeting those goals.
  5. Support from staff. Support from school faculty, administrators, and staff.
  6. Support for staff. Support for school faculty, administrators, and staff. (Added in 2001)
  7. Parent and community involvement. Meaningful involvement of parents and the local community in planning and implementing School Improvement activities.
  8. External assistance. High-quality external support and assistance from a comprehensive school reform entity (which may be a university) with experience in schoolwide reform and improvement.
  9. evaluation. Plan to evaluate the Implementation of school reforms and the student results achieved.
  10. Coordination of resources. Identification of how other available resources (federal, state, local, or private) will help the school coordinate services to support and sustain the school reform.
  11. Scientifically based research. Scientifically based research to significantly improve the academic achievement of students participating in such programs as compared with students in schools who have not participated in such programs or strong evidence that such programs will significantly improve the academic achievement of participating children. (Added in 2001)
Source: No Child Left Behind Act, Title I, Part F, Section 1606.

Study Purpose
The Longitudinal Assessment of Comprehensive School Reform Implementation and Outcomes (LACIO) responds to the NCLB Act’s requirement for an evaluation of the federal Comprehensive School Reform (CSR) program. The legislation stipulates two broad goals for the evaluation: first, to evaluate the implementation and outcomes achieved by schools after three years of implementing comprehensive school reforms and, second, to assess the effectiveness of comprehensive school reform in schools with diverse characteristics. In order to address these requirements, the study focused on four evaluation questions:
  1. How are CSR funds being targeted?
  2. How is comprehensive school reform implemented in schools receiving CSR funds, in schools receiving Title I funds and in other schools?
  3. What is the relationship between CSR implementation and student achievement outcomes?
  4. What conditions (at the state and district level) influence the implementation of comprehensive reform programs?
This report presents data collected from a random sample of 400 CSR schools that received funding in 2002 and 400 non-CSR schools with similar demographic and achievement characteristics.1 It draws from three data sources—school-level surveys of principals and teachers, the National School-Level State Assessment Score Database and the National Center for Educational Statistics (NCES) Common Core of Data (CCD). The data were collected in spring 2003 at the end of the first year of CSR implementation (2002-03). The emphasis in this report is on the first two evaluation questions that focus on school reform activities and the targeting of CSR program funds.

First-Year Findings
The first year of the evaluation has yielded information with implications for federal Policy. The implications relate to two key findings:

  • Although both CSR and non-CSR schools are engaged in reform, reform in CSR schools is more likely to include adoption of models and other activities closely associated with research-based models.
  • CSR funds are strongly targeted to high-poverty schools and low-performing schools, and schools receiving CSR funds are lower performing than are other schools with similar demographic characteristics at the time they receive awards.

The sample of 400 represents 36 percent of the approximately 1,100 schools reported to receive CSR funds for the calendar year 2002. As a random sample, it does not mirror the universe on all characteristics. The distribution of the sample across locale and school level were comparable to the distributions of the universe, while reading and mathematics scores were slightly higher for the CSR sample. Similarly, the non-CSR schools, which were required to be in the same districts as the sample schools and with no current or past CSR funding, had slightly higher baseline achievement levels. These comparison schools represent the best available matches given these requirements. Further, analyses of achievement outcomes will control for variables such as achievement and poverty level, among others.

Implementation of School Reform Activities in CSR Schools and Other Schools
Both CSR and non-CSR schools reported they were implementing specific activities that prior research indicates are associated with reform. However, as discussed below, the CSR schools differed from the non-CSR schools in their implementation of components directly related to selecting, implementing and evaluating models for reform. Further, CSR funding seems to contribute to Building Capacity for ongoing reform, with schools reporting more school activity that reflects coherence and cohesiveness during the first year of implementation (2002-03) compared with the previous year.

School Improvement Plans

Nearly all schools in the sample (CSR and non-CSR schools) reported they had formal comprehensive plans for school reform. Principals at both CSR and non-CSR schools indicated these plans included components similar to the 11 CSR components, although CSR schools were more likely to report seeking research evidence about a proposed reform and adopting a reform created outside of the school.

Teachers and school administrators were involved in selecting the reform model or approach being implemented, both at CSR schools and non-CSR schools. However, the school board and the district central office played a more significant role in selecting reform at non-CSR schools than at CSR schools, indicating more “top-down” requirements for changes in practice in non-CSR schools. One third of CSR schools reported that the district central office was one of several entities responsible for selecting the reform, compared with 57 percent of non-CSR schools, which reported this method. Non-CSR schools reported that school board members were involved in the decision at a higher rate than did CSR schools (24 percent for non-CSR schools compared with 15 percent of CSR schools). Further, state or district mandates were more likely to contribute to the selection of reform at non-CSR schools (60 percent) than at CSR schools (31 percent).

U.S. Department of Education
Rod Paige
Secretary

Office of the Deputy Secretary
Eugene Hickok
Deputy

Secretary Policy and Program Studies Service
Alan Ginsburg
Director

Policy and Analytic Studies Division
David Goodwin
Director