New Page 1
Information Works! 2002    
 
New Page 1
New Page 1
In$ite SALT Survey Reports SALT Visit Reports Infoworks 2001 Infoworks 2000 Infoworks 1999 Infoworks 1998
 

User's Guide: Introduction

 

Welcome to the 2002 Users Guide

For those of you new to Information Works!, please remember that the data is from school year 2000-2001. Each year of IW! crunches and displays a wealth of data gathered in the year prior to its publication.

The Users Guide presents three kinds of information:

  • The sections marked “What you’re looking at” and “What you’re looking for,” offer brief, user-friendly explanations for the data in each field, along with a notion of what we consider to be the information’s utility.
     

  • When relevant, the Guide provides the source of the numbers presented and, in some cases, how they were calculated.
     

  • The policies governing Rhode Island’s school accountability agenda are often in the process of being articulated, refined and adjusted with increasing detail. Information Works! is data-dense, so the Guide merely notes the changes that have resulted from state – and now federal – policy refinements, with short explanations of or references to the policy itself. In the interests of keeping the Users Guide brief and to the point, we make every attempt to refer the reader to original sources or further information about policy, regulations and legislation. Our principal concern here is to help the Information Works! users understand the meaning of their school, district and state data, not to explain comprehensively the considerable background or specific building blocks of RI’s school accountability agenda.

The big picture of RI’s school accountability efforts

The 2002 State Analysis explains the agenda, each of its data components and examples of how the information has led to change in schools.

The federal government gets much more involved – The “No Child Left Behind Act of 2001"

The most dramatic change on the national 2002 education landscape is the passage, in December 2001, of the dramatically revised Elementary and Secondary Education Act (ESEA, called the ‘No Child Left Behind Act of 2001'.) This act calls for annual testing of all public school children in grades 3 through 8, school report cards, various sanctions for “failing” schools, including the offer of alternative choices for students trapped in chronically low-performing schools, and generally increased accountability for schools, systems and states.

The new ESEA does not directly impact Information Works! as yet; no section has been changed to meet its mandates. To a degree, RI is already ahead of the federal curve because the state has been building an accountability system which already has most of the elements mandated by the new federal legislation. For example, we already publish school reports in Information Works!. Also, our testing program is one of only 16 states whose quality meets federal Title I requirements. RI will have to test more often, but the tests per se have passed muster. Information Works! will probably change over time, but those refinements will evolve with increased understanding of the massive ESEA law, which can be found at: http://edworkforce.house.gov.

Performance Progress

Long before the ESEA required them to do so, the Rhode Island Department of Education (RIDE) and the Board of Regents have been wrestling with the problem of how to identify and respond to persistently under-performing schools. This year RIDE developed criteria by which schools were judged to be on the one hand either ‘improving’ or 'not improving’ and on the other hand, high-, moderately- or low-performing. Unlike other states, RI resisted leaping to judgment with high-stakes testing, closing schools on the basis of test scores or withholding state aid. Instead, RI invested its school accountability efforts in developing a comprehensive data-gathering and feedback system to help school communities make informed decisions about their own unique populations.

But the time has come to turn the wealth of impressionistic information into realistic statements of where certain schools are, relative to one another. The lists which identify each school’s performance progress serve as triage, if you will, identifying which schools need the highest levels of immediate attention, support and in some cases, intervention. Since no school currently meets the RI goal of All Children to 100% Proficiency, every school – even those deemed ‘high-performing’ and ‘improving’ – will have requirements, at different levels of complexity and intensity, which they must follow to help all students reach proficiency in math and English language arts.

Both the criteria by which the schools were sorted and the lists themselves are available in the State Section.

This year RIDE used only test scores to make its determinations, but in the future, other indicators will be included. Under consideration are indicators such as student absenteeism and school climate data (based on the SALT survey). Over time, these lists will be strongly influenced by the way federal accountability initiatives play out.

As much as possible, RIDE and the Regents are making every attempt not to let the lists be merely an exercise in ‘naming and shaming,’ but one that brings as much support and attention as possible to those schools who are either not performing adequately, not improving or both. The state must help schools position themselves to weather and even fare well as the federal accountability bears down.
 

Information Works! continues to evolve. 
Please note the following changes from last year’s book to this year’s:

On Field #2, a bull’s eye now represents the school’s actual performance against the statistical target in order to provide a more precise graphic than the bar which had accidentally created some confusion.

This year’s SALT survey findings – Field #6 – focus on barriers to school improvement efforts as identified by the teachers.

Field #8 has changed from indicating the progress towards meeting 2001 targets to represent more accurately selected criteria by which the schools were grouped as to improving or not improving. Please note that to be improving, a school need improve by 3 percentage points in only two out of three math subtests and three out of four ELA subtests, but this chart shows the same four subtests no matter which were used in making the determination. All subtests are on the school details and goals page (available only on this website).
Field #8 – on the right-hand side – indicates the school’s designation as high-, moderately- or low-performing, without showing the data by which that designation was derived.

At the district level, the SALT survey findings focus on Parent Contact.

At the state level, new charts include:
  Proficiency on Alternative Assessments – A report on the results of the state’s alternative assessments for Special Needs children whose Individual Education Plans (IEP) require them to be assessed other than by the regular state tests
    The criteria that determines IMPROVING vs. NOT IMPROVING schools
    The criteria that determines PERFORMANCE levels
    Performance Progress charts – high, middle and elementary
  How to read the value-added charts
  How schools are assigned to cohorts in the value-added charts

Other resources available on this web site include:

Commissioner McWalters’ 2002 State of Education Address

Additional pages to each school's report, called School Details and Goals.

2002 Statewide Analysis 

School Performance – A value-added list

Technical Paper on the RI Statistically Generated Model

SALT Survey Results for 2002, 2000, 1998, 1999 (Survey was not administered in 2001)

2001 Information Works!

2000 Information Works!

1999 Information Works!

1998 Information Works!

Hotlinks to:

extensive In$ite financial information

SALT visit school reports

resources such as the RI Department of Education, home page, the RIEDX web site which has public discussions, forums, resources and opportunities for RI school communities and the 2001 ESEA legislation.

The school charts only available on the Web include:

Each school’s goals

Student suspensions by type

Teacher grievances by type

Average class size (elementary) or

Span of responsibility (secondary)

Teacher attendance

Each school’s complete set of 8 subtests that contribute to ‘Performance Progress’ designations

The Principal Sources of the data for Information Works! are:

State assessments – standardized student achievement tests administered by the state assessment program

SALT Surveys – school-level data from students, teachers, parents and administrators about classroom practice, school climate, expectations, and much more

Basic school-level statistics – School enrollment, demographic make up, socio-economic status, absenteeism, suspensions, etc. collected throughout the year by RIDE

Tax and income statistics – from the state Department of Administration’s Office of Municipal Affairs

In$ite financial data – school-level expenditure data 

Form 31 financial information – districts’ revenue and expenditure information submitted to the state through Form 31 provide this year’s revenue information at the district level. 

When data are statistically unreliable

When the number of test-takers drops below 10, the results are considered statistically unreliable and are not reported. Also, very small sample numbers could make it possible to identify or to invite guessing as to the test results of individual children. Information Works! is about the functioning of schools and districts, not about individual children. Very small classes of test-takers such as those in New Shoreham and the RI School for the Deaf also require leaving a number of fields empty.

An exception to the rule in Field #4

The only exception to this rule is in Field #4 where the number of test-takers can drop as low as 5, because it would be very difficult to identify specific students in data that is collected over the course of three different years (and classes) of testing.

 

 

 

 

For further information call the Rhode Island Department of Education at 401-222-4600 x2231.
Information Works!  is produced in collaboration with the National Center on Public Education & Social Policy,  Dr. Robert D. Felner, Director.