From the White House to the National
Governors Association, a clarion call has
risen, articulated recently by none other
than Bill Gates, for a transformation
of the American high school. Gates
(2005) minced no words in describing
the challenge: "American high schools
are obsolete. . . . By obsolete I don't just
mean that our high schools are broken,
flawed, and underfunded. . . . I mean
that our high schools even when they
are working exactly as designed cannot
teach our kids what they need to
know today."
Some foundations, like Carnegie
Corporation of New York and Gates's
own Bill & Melinda Gates Foundation,
have, in collaboration with many reform
partners and school systems, been seeding
high school reform for some years.
The investments have been huge. Prescriptions
for new policies and practice
abound and sometimes conflict. In the
field, there is excitement and some
apprehension about this long overdue
attention to the nation's most
reform-resistant category of schools.
The case for reform is compelling.
High schools have indeed been slow
to reform. They continue to fail badly
with certain populations, especially low income,
urban youth. They inadequately
prepare significant numbers of young
people for higher education and employment;
for instance, approximately 40
percent of graduates reported key gaps
in their preparation in a recent poll
(Achieve and the National Governors
Association 2005). And they are generally
organized in ways that better serve
the interests of early-twentieth-century
America, rather than the world of today.
As the efforts to redesign high
schools move forward, though, it is
essential that the policies being put in
place at the district, state, and federal
levels fit with and support the new educational
designs of schools and school
systems. Accountability policies are critical.
As anyone who has watched school
reform since the enactment of the No
Child Left Behind Act (NCLB) knows,
accountability can be a powerful tool
for good or for ill. An accountability
system for high schools that supports
improvement can accelerate change; an
ill-conceived plan can stifle reform.
President Bush proposes to bring
the accountability pressure of NCLB to
bear on high schools. Secondary educators,
now in the spotlight (or is it headlights?)
express a new sense of possibility,
coupled with uncertainty and apprehension,
about the direction and substance
of the reforms as well as the operation
of new accountability systems. Scholars
such as Michael Kirst of Stanford University
have noted that the power of
accountability systems to drive reform
and school improvement may vary
depending on level of schooling. Based
on his analysis of reform in California,
he finds gains in elementary schools,
but no improvement in the high schools,
even with an accountability system that
operated similarly for all schools. This
variability, coupled with the myriad
problems associated with the implementation
of NCLB's accountability
provisions to date, suggest that a headlong
rush to applying the same NCLB
accountability approach to high schools
would be unwise.
The complexity of high schools, the
need for multiple and qualitative indicators
of success, the variability of the
high schools, and the sheer scale of
these schools are all factors that call for
a fundamentally different approach to
accountability than has been applied at
the elementary level. How can policymakers
avoid the mistakes of the past
and craft a more realistic, genuine, and
helpful accountability mechanism for
American high schools?
Basic Principles
Achieve Inc. and the National Governors
Association (2005, p. 17), the organizations
that sponsored the meeting at
which Gates made his provocative
remarks, advised that data produced by a
new accountability mechanism ought to
be "more focused on the success of each
high school in preparing students for
college, work and citizenship." What kind
of a system would produce such data?
Here are a few basic principles that
a new system might strive to attain,
along with some potential indicators.
Genuine Accountability
The accountability system should present
a rich portrait of school performance that
presents meaningful, actionable data for
school-improvement purposes. The
focus of the system should be on the
degree to which the school increases
student learning of the knowledge and
skills needed to be successful in the
next stage of the student's life. Naturally,
the system should employ instruments
that are valid and reliable.
Pressure for Improvement
The accountability system should leverage
pressure for school improvement.
The system should have consequences
for performance, especially intervention
with support and assistance for those
not making progress.
Useful, Diagnostic Data
The system should provide data that
administrators and teachers can use to
shape strategies for improving student
learning and school performance. The
data should drive increased productivity
in education by pointing to the areas in
which capacity and performance need
to be increased.
Constructive Consequences
The consequences for persistent underperformance
should be real and work
to maximize benefit and opportunity for
children. Consequences like the schoolchoice
provisions of NCLB have been
largely ineffective, for a variety of reasons.
At the same time, the technical assistance
functions that were expected to be
offered to schools "in need of improvement"
have frequently not materialized.
The consequences for persistent underperformance
should be real and work
to maximize benefit and opportunity for
children. Consequences should feature
strengthened intervention and technical
assistance for schools, coupled with
enhanced, supplemental extended learning
opportunities for individual students.
Consequences under a new high
school accountability mechanism
should feature strengthened intervention
and technical assistance for schools,
coupled with enhanced, supplemental
extended learning opportunities for
individual students. Also, some form
of recognition/reward system should
be applied to those schools making
continuous progress. Public acknowledgment,
regulatory relief, and modest
financial rewards for whole schools
should be part of the system.
Growth Oriented
Any high school accountability system
ought to focus on growth in learning.
Individual student learning progress
ought to be tracked longitudinally
through the use of "value-added" systems
that measure improvement from a
baseline. Individual growth ought to be
aggregated into collective indicators for
schools and systems; then such data
ought to be disaggregated for analysis by
subgroups such as race, ethnicity, socioeconomic
status, grade level, etc. The
focus should be on school improvement,
not just attaining a level of proficiency.
Reasonable and Research-Based
A new accountability system ought to
incorporate research-based assumptions
about expected rates of growth.
The emphasis should be on improvement
and closing the achievement
gaps, but the expected growth intervals
ought to be based on what we know
about learning and school improvement.
Unlike NCLB targets, which in many
cases are far higher than any school has
yet demonstrated, growth expectations in
a new high school accountability system
ought to be reasonable and founded on
evidence drawn from the experience of
improved schools.
Flexible to Accommodate Variability
Comprehensive high schools prepare
some students for higher education, at
a wide array of colleges, and some for
employment. We also have vocational
high schools, alternative high schools,
and small learning communities, to
name just a few of the many variations
on the high school that students experience.
The new accountability system
needs to be flexible enough to recognize
these varying goals.
Affordable
The costs of the NCLB accountability
mandates have been the subject of
much controversy, dispute, and litigation.
Additional NCLB accountability
mandates must not only be feasible, but
also, to the extent that they are federally
mandated, they should be federally
funded. In any event, there will be significant
new costs to bring a strong
accountability system to bear on high
schools. If the federal government seeks
to have a major impact on high school
education, government leaders might
wisely invest in fully supporting a radically
more comprehensive accountability
system.
Multiple Measures
of Performance
One of the most challenging aspects
of designing the new system of high
school accountability is determining
appropriate measures of school performance.
Issues of measurement are, of
necessity, complex and somewhat technical.
However, architects of this system
must strive to make the data it produces
understandable and readily available
to educators and the general public.
As Achieve and National Governors
Association put it, the results ought to
be both "user friendly and accessible."
It's much easier to say that we should
have multiple indicators of school
success than it is to put that concept
into practice.
In contrast to NCLB, the new system
should include multiple measures
of school success, rather than just test
scores. The emphasis on test scores is
obvious and logical because we want
to know the extent to which students
attain mastery of academic standards.
But the weaknesses and limitations of
tests are well known.We should have
other indicators of school performance
to supplement test data and reduce the
misuse associated with overreliance on
a single measure.
However, it's much easier to say
that we should have multiple indicators
of school success than it is to put that
concept into practice. Finding other
measures that are not only valid and
reliable but practical to administer, as
well as financially and politically feasible,
is no easy task. The following types
of performance measures might meet
such criteria, in addition to test data from
a variety of sources and instruments.
Graduation and Drop-Out Rates
Although experts regularly and sharply
disagree on methods of calculating persistence
to graduation, a new system
must set a standard for judging the
capacity of schools to prepare all their
students to meet graduation requirements.
Close consideration should be
given to the intervals during which
graduation is expected. New, higher
standards may require more time in
high school, thereby making a four-year
standard obsolete. A six-year "persistence
to graduation" indicator would be
helpful. Distinctions should be drawn
between graduation from school and
earning a diploma via the GED (General
Educational Development) exam.
Next-Stage Success:
College and Employment
The time has come to make the investment
in measuring the success of education by looking directly at how well
prepared an individual is to succeed at
the challenges presented at the next
stage of his or her life, usually higher
education or employment. Such followup
work is labor intensive and therefore
costly, but it is so immediately relevant
to understanding school performance
that we can no longer afford to ignore it.
The time has come to make the
investment in measuring the success
of education by looking directly at
how well prepared an individual is to
succeed at the challenges presented
at the next stage of his or her life.
Small samples of employers' and
college faculty members' views on high
school graduates' readiness are regularly
done by academics, national commissions,
and various associations. But
school systems seldom gather this information
because of the labor and costs
of such research. If we acknowledge
that the primary short-term users, or
"consumers," of graduates' skills and
knowledge are employers and colleges,
then it seems foolhardy not to include
their views, in some measure, in our
assessment of high school effectiveness.
Customer Satisfaction
Next-stage research will involve surveying
consumers like employers and college
faculty on how well prepared graduates
are, but we also need to ask the "customers"
themselves. How do high
school graduates rate their preparation
to meet the challenges they face after
graduating? How do families rate the
education their children receive?
Some school districts, like Duval
County, Florida, and Cambridge, Massachusetts,
routinely take satisfaction
surveys of parents, teachers, and students
(Grossman, Honan & King 2004; Cambridge
Public School District, n.d.). The
Donahue Institute at the University
of Massachusetts has done one-time
surveys for a handful of school districts
of graduates' views of their preparedness.
Expert On-Site, Qualitative Review
All high schools should have a regular
visitation by an expert review team. Such
visits would be similar to, but more frequent
than, the periodic visits made by
regional accrediting associations. The
review team would be charged with
making qualitative judgments about a
range of important topics such as school
climate and expectations; the quality of
teaching and learning; the degree of
rigor of the curriculum; the availability
of Advanced Placement and collegelevel
courses; the nature of studentfaculty
relationships; the availability of
support services; the equity in course
offerings and enrollments; drop-out
prevention/retrieval; occupational
preparation; and success in the development
of nonacademic skills in problem
solving, interpersonal relations,
and collaboration. A number of states,
including Massachusetts and Rhode
Island, are already employing comprehensive
school visitation models (including
qualitative elements) that could be
adapted to the particular circumstances
of high schools.
Undeniably, these subjects are
each, in themselves, complex, presenting
challenging measurement problems. But
there is no reason that educators, like
service providers in other sectors, cannot
devise a fair and reasonable approach
to making some qualitative judgments
about educational services. Ultimately,
teams would be charged with summing
up their assessments in the form of a
hard numerical or letter-grade designation
coupled with a written report. Tough decisions are central to this work.
Accountability for
Educating All Students: Big Commitment, Unprecedented Goal
The proposed system is not only more
costly but more labor-intensive and timeconsuming
than current approaches. It
certainly injects a substantial qualitative
ingredient into the school-evaluation
process. Devising such an accountability
system would undoubtedly be challenging
work. But if the ideals of such
a system could be realized, then high
school accountability could truly become
an instrument for school improvement.
Accountability "on the cheap," on the
other hand, would only yield misleading
information.
An accountability system such as
that described here is not a silver bullet
or an answer to all the woes afflicting
high schools. Major issues like teacher
quality and the poor preparation of
entering students, to name just two,
require urgent attention as well. Finally,
this accountability system should complement
but not substitute for
human resource and professional development
systems that must be designed
and installed to build the expertise and
effectiveness of educators to do what
our society has never, until now, asked
them to do: educate all students to a
high standard of learning.
REFERENCES
Achieve Inc. and National Governors Association.
2005. An Action Agenda for Improving America's
High Schools. Washington, DC, National Education
Summit on High Schools (February).
> Summary and pdf
Cambridge Public School District. n.d. "Survey
Finds Families Very Pleased with Cambridge
Public Schools," News Story, Cambridge Public
School District.
> Read news story
Elmore, R. 2005. School Reform from the Inside
Out: Policy, Practice, and Performance. Cambridge,
MA: Harvard University Press.
Gates, B. 2005. Speech at the National Education
Summit on High Schools, Washington,DC
(February 25).
> Read remarks, watch video
Grossman, A., J. P. Honan, and C. King. 2004.
Learning to Manage with Data in Duval County
Public Schools: Lake Shore Middle School. Cambridge,
MA: Harvard Graduate School of Business.
> Description and ordering
Hess, F. M., and C. E. Finn, eds. 2004. Leaving
No Child Behind? Options for Kids in Failing
Schools. New York: Palgrave Macmillan.
> Description, reviews, table of contents, ordering
Murnane, R., and F. Levy. 1996. Teaching the
New Basic Skills. New York: New Press.
Myatt, L. 2005. "Nine Friction Points in Moving
to Smaller School Units," Education Week 24,
no. 30:34, 36-37 (April 6).
> Article online (free registration required)
Ravitch, D. 2005. "Failing the Wrong Grades,"
New York Times (March 15).
> Abstract and ordering
Reville, S. P. 2001. "Multiple Measures,"
Education Week 21, no. 11:52 (November 14).
> Article online (free registration required)
Rothman, R. 2005. "No Adolescent Left
Behind?" Harvard Education Letter 21, no. 3
(May/June).
> Abstract and ordering
Schwartz, R. 2004. "Multiple Pathways and
How to Get There." In Double the Numbers:
Increasing Postsecondary Credentials for
Underrepresented Youth, edited by R. Kazis,
J. Vargas, and N. Hoffman, pp. 21-34. Cambridge, MA: Harvard Graduate School of Education.
Stevenson, H., and J. Stigler. 1992. The Learning Gap: Why Our Schools Are Failing and What We
Can Learn from Japanese and Chinese Education. New York: Summit Books.