AISR logo Sitemap | Jobs | Contact Usenvelope  


Building Smart Education Systems



Voices in Urban Education

Archives

High School Redesign
VUE Number 8, Summer 2005

| VUE Home | Archives | Order Print Copy |

Reinventing High School Accountability: Authenticity, Pressure, and Support

By S. Paul Reville
S. Paul Reville is a lecturer at the Harvard Graduate School of Education and the executive director of the Rennie Center for Education Research and Policy at MassINC.
> Author’s Biographies



Accountability policies are critical to ensuring that new high school designs thrive. An effective system should provide authentic information about school performance and provide pressure and support for improvement.


From the White House to the National Governors Association, a clarion call has risen, articulated recently by none other than Bill Gates, for a transformation of the American high school. Gates (2005) minced no words in describing the challenge: "American high schools are obsolete. . . . By obsolete I don't just mean that our high schools are broken, flawed, and underfunded. . . . I mean that our high schools – even when they are working exactly as designed – cannot teach our kids what they need to know today."

Some foundations, like Carnegie Corporation of New York and Gates's own Bill & Melinda Gates Foundation, have, in collaboration with many reform partners and school systems, been seeding high school reform for some years. The investments have been huge. Prescriptions for new policies and practice abound and sometimes conflict. In the field, there is excitement – and some apprehension – about this long overdue attention to the nation's most reform-resistant category of schools.

The case for reform is compelling. High schools have indeed been slow to reform. They continue to fail badly with certain populations, especially low income, urban youth. They inadequately prepare significant numbers of young people for higher education and employment; for instance, approximately 40 percent of graduates reported key gaps in their preparation in a recent poll (Achieve and the National Governors Association 2005). And they are generally organized in ways that better serve the interests of early-twentieth-century America, rather than the world of today.

As the efforts to redesign high schools move forward, though, it is essential that the policies being put in place at the district, state, and federal levels fit with and support the new educational designs of schools and school systems. Accountability policies are critical. As anyone who has watched school reform since the enactment of the No Child Left Behind Act (NCLB) knows, accountability can be a powerful tool – for good or for ill. An accountability system for high schools that supports improvement can accelerate change; an ill-conceived plan can stifle reform.

President Bush proposes to bring the accountability pressure of NCLB to bear on high schools. Secondary educators, now in the spotlight (or is it headlights?) express a new sense of possibility, coupled with uncertainty and apprehension, about the direction and substance of the reforms as well as the operation of new accountability systems. Scholars such as Michael Kirst of Stanford University have noted that the power of accountability systems to drive reform and school improvement may vary depending on level of schooling. Based on his analysis of reform in California, he finds gains in elementary schools, but no improvement in the high schools, even with an accountability system that operated similarly for all schools. This variability, coupled with the myriad problems associated with the implementation of NCLB's accountability provisions to date, suggest that a headlong rush to applying the same NCLB accountability approach to high schools would be unwise.

The complexity of high schools, the need for multiple and qualitative indicators of success, the variability of the high schools, and the sheer scale of these schools are all factors that call for a fundamentally different approach to accountability than has been applied at the elementary level. How can policymakers avoid the mistakes of the past and craft a more realistic, genuine, and helpful accountability mechanism for American high schools?


Basic Principles

Achieve Inc. and the National Governors Association (2005, p. 17), the organizations that sponsored the meeting at which Gates made his provocative remarks, advised that data produced by a new accountability mechanism ought to be "more focused on the success of each high school in preparing students for college, work and citizenship." What kind of a system would produce such data?

Here are a few basic principles that a new system might strive to attain, along with some potential indicators.

Genuine Accountability
The accountability system should present a rich portrait of school performance that presents meaningful, actionable data for school-improvement purposes. The focus of the system should be on the degree to which the school increases student learning of the knowledge and skills needed to be successful in the next stage of the student's life. Naturally, the system should employ instruments that are valid and reliable.

Pressure for Improvement
The accountability system should leverage pressure for school improvement. The system should have consequences for performance, especially intervention with support and assistance for those not making progress.

Useful, Diagnostic Data
The system should provide data that administrators and teachers can use to shape strategies for improving student learning and school performance. The data should drive increased productivity in education by pointing to the areas in which capacity and performance need to be increased.

Constructive Consequences
The consequences for persistent underperformance should be real and work to maximize benefit and opportunity for children. Consequences like the schoolchoice provisions of NCLB have been largely ineffective, for a variety of reasons. At the same time, the technical assistance functions that were expected to be offered to schools "in need of improvement" have frequently not materialized.


The consequences for persistent underperformance should be real and work to maximize benefit and opportunity for children. Consequences should feature strengthened intervention and technical assistance for schools, coupled with enhanced, supplemental extended learning opportunities for individual students.


Consequences under a new high school accountability mechanism should feature strengthened intervention and technical assistance for schools, coupled with enhanced, supplemental extended learning opportunities for individual students. Also, some form of recognition/reward system should be applied to those schools making continuous progress. Public acknowledgment, regulatory relief, and modest financial rewards for whole schools should be part of the system.

Growth Oriented
Any high school accountability system ought to focus on growth in learning. Individual student learning progress ought to be tracked longitudinally through the use of "value-added" systems that measure improvement from a baseline. Individual growth ought to be aggregated into collective indicators for schools and systems; then such data ought to be disaggregated for analysis by subgroups such as race, ethnicity, socioeconomic status, grade level, etc. The focus should be on school improvement, not just attaining a level of proficiency.

Reasonable and Research-Based
A new accountability system ought to incorporate research-based assumptions about expected rates of growth. The emphasis should be on improvement and closing the achievement gaps, but the expected growth intervals ought to be based on what we know about learning and school improvement. Unlike NCLB targets, which in many cases are far higher than any school has yet demonstrated, growth expectations in a new high school accountability system ought to be reasonable and founded on evidence drawn from the experience of improved schools.

Flexible to Accommodate Variability
Comprehensive high schools prepare some students for higher education, at a wide array of colleges, and some for employment. We also have vocational high schools, alternative high schools, and small learning communities, to name just a few of the many variations on the high school that students experience. The new accountability system needs to be flexible enough to recognize these varying goals.

Affordable
The costs of the NCLB accountability mandates have been the subject of much controversy, dispute, and litigation. Additional NCLB accountability mandates must not only be feasible, but also, to the extent that they are federally mandated, they should be federally funded. In any event, there will be significant new costs to bring a strong accountability system to bear on high schools. If the federal government seeks to have a major impact on high school education, government leaders might wisely invest in fully supporting a radically more comprehensive accountability system.


Multiple Measures of Performance

One of the most challenging aspects of designing the new system of high school accountability is determining appropriate measures of school performance. Issues of measurement are, of necessity, complex and somewhat technical. However, architects of this system must strive to make the data it produces understandable and readily available to educators and the general public. As Achieve and National Governors Association put it, the results ought to be both "user friendly and accessible."


It's much easier to say that we should have multiple indicators of school success than it is to put that concept into practice.


In contrast to NCLB, the new system should include multiple measures of school success, rather than just test scores. The emphasis on test scores is obvious and logical because we want to know the extent to which students attain mastery of academic standards. But the weaknesses and limitations of tests are well known.We should have other indicators of school performance to supplement test data and reduce the misuse associated with overreliance on a single measure.

However, it's much easier to say that we should have multiple indicators of school success than it is to put that concept into practice. Finding other measures that are not only valid and reliable but practical to administer, as well as financially and politically feasible, is no easy task. The following types of performance measures might meet such criteria, in addition to test data from a variety of sources and instruments.

Graduation and Drop-Out Rates
Although experts regularly and sharply disagree on methods of calculating persistence to graduation, a new system must set a standard for judging the capacity of schools to prepare all their students to meet graduation requirements. Close consideration should be given to the intervals during which graduation is expected. New, higher standards may require more time in high school, thereby making a four-year standard obsolete. A six-year "persistence to graduation" indicator would be helpful. Distinctions should be drawn between graduation from school and earning a diploma via the GED (General Educational Development) exam.

Next-Stage Success: College and Employment
The time has come to make the investment in measuring the success of education by looking directly at how well prepared an individual is to succeed at the challenges presented at the next stage of his or her life, usually higher education or employment. Such followup work is labor intensive and therefore costly, but it is so immediately relevant to understanding school performance that we can no longer afford to ignore it.


The time has come to make the investment in measuring the success of education by looking directly at how well prepared an individual is to succeed at the challenges presented at the next stage of his or her life.


Small samples of employers' and college faculty members' views on high school graduates' readiness are regularly done by academics, national commissions, and various associations. But school systems seldom gather this information because of the labor and costs of such research. If we acknowledge that the primary short-term users, or "consumers," of graduates' skills and knowledge are employers and colleges, then it seems foolhardy not to include their views, in some measure, in our assessment of high school effectiveness.

Customer Satisfaction
Next-stage research will involve surveying consumers like employers and college faculty on how well prepared graduates are, but we also need to ask the "customers" themselves. How do high school graduates rate their preparation to meet the challenges they face after graduating? How do families rate the education their children receive?

Some school districts, like Duval County, Florida, and Cambridge, Massachusetts, routinely take satisfaction surveys of parents, teachers, and students (Grossman, Honan & King 2004; Cambridge Public School District, n.d.). The Donahue Institute at the University of Massachusetts has done one-time surveys for a handful of school districts of graduates' views of their preparedness.

Expert On-Site, Qualitative Review
All high schools should have a regular visitation by an expert review team. Such visits would be similar to, but more frequent than, the periodic visits made by regional accrediting associations. The review team would be charged with making qualitative judgments about a range of important topics such as school climate and expectations; the quality of teaching and learning; the degree of rigor of the curriculum; the availability of Advanced Placement and collegelevel courses; the nature of studentfaculty relationships; the availability of support services; the equity in course offerings and enrollments; drop-out prevention/retrieval; occupational preparation; and success in the development of nonacademic skills in problem solving, interpersonal relations, and collaboration. A number of states, including Massachusetts and Rhode Island, are already employing comprehensive school visitation models (including qualitative elements) that could be adapted to the particular circumstances of high schools.

Undeniably, these subjects are each, in themselves, complex, presenting challenging measurement problems. But there is no reason that educators, like service providers in other sectors, cannot devise a fair and reasonable approach to making some qualitative judgments about educational services. Ultimately, teams would be charged with summing up their assessments in the form of a hard numerical or letter-grade designation coupled with a written report. Tough decisions are central to this work.


Accountability for Educating All Students: Big Commitment, Unprecedented Goal

The proposed system is not only more costly but more labor-intensive and timeconsuming than current approaches. It certainly injects a substantial qualitative ingredient into the school-evaluation process. Devising such an accountability system would undoubtedly be challenging work. But if the ideals of such a system could be realized, then high school accountability could truly become an instrument for school improvement. Accountability "on the cheap," on the other hand, would only yield misleading information.

An accountability system such as that described here is not a silver bullet or an answer to all the woes afflicting high schools. Major issues like teacher quality and the poor preparation of entering students, to name just two, require urgent attention as well. Finally, this accountability system should complement – but not substitute for – human resource and professional development systems that must be designed and installed to build the expertise and effectiveness of educators to do what our society has never, until now, asked them to do: educate all students to a high standard of learning.





REFERENCES

Achieve Inc. and National Governors Association. 2005. An Action Agenda for Improving America's High Schools. Washington, DC, National Education Summit on High Schools (February).
> Summary and pdf

Cambridge Public School District. n.d. "Survey Finds Families Very Pleased with Cambridge Public Schools," News Story, Cambridge Public School District.
> Read news story

Elmore, R. 2005. School Reform from the Inside Out: Policy, Practice, and Performance. Cambridge, MA: Harvard University Press.

Gates, B. 2005. Speech at the National Education Summit on High Schools, Washington,DC (February 25).
> Read remarks, watch video

Grossman, A., J. P. Honan, and C. King. 2004. Learning to Manage with Data in Duval County Public Schools: Lake Shore Middle School. Cambridge, MA: Harvard Graduate School of Business.
> Description and ordering

Hess, F. M., and C. E. Finn, eds. 2004. Leaving No Child Behind? Options for Kids in Failing Schools. New York: Palgrave Macmillan.
> Description, reviews, table of contents, ordering

Murnane, R., and F. Levy. 1996. Teaching the New Basic Skills. New York: New Press.

Myatt, L. 2005. "Nine Friction Points in Moving to Smaller School Units," Education Week 24, no. 30:34, 36-37 (April 6).
> Article online (free registration required)

Ravitch, D. 2005. "Failing the Wrong Grades," New York Times (March 15).
> Abstract and ordering

Reville, S. P. 2001. "Multiple Measures," Education Week 21, no. 11:52 (November 14).
> Article online (free registration required)

Rothman, R. 2005. "No Adolescent Left Behind?" Harvard Education Letter 21, no. 3 (May/June).
> Abstract and ordering

Schwartz, R. 2004. "Multiple Pathways – and How to Get There." In Double the Numbers: Increasing Postsecondary Credentials for Underrepresented Youth, edited by R. Kazis, J. Vargas, and N. Hoffman, pp. 21-34. Cambridge, MA: Harvard Graduate School of Education.

Stevenson, H., and J. Stigler. 1992. The Learning Gap: Why Our Schools Are Failing and What We Can Learn from Japanese and Chinese Education. New York: Summit Books.



Top  |  Permissions