Testing Ethics Policy Adopted by the Hawaii State Board of ...

Test Security See SB TAM pp. 17- 20 for more detailed information HAWAII STATE DEPARTMENT OF EDUCATION HawaiiPublicSchools.org 1 Test Security ENSURING TEST SECURITY All summative test items and test materials are secure and must be appropriately handled. Security of the Test Environment Security requirements for the test environment before, during, and after testing includes all aspects of the testing situation while students are testing.

If you have witnessed, been informed of or suspect a Test Security Incident, follow the steps outlined in section Responding to Testing Improprieties, Irregularities, and Breaches in this manual on pages 16-20. HAWAII STATE DEPARTMENT OF EDUCATION HawaiiPublicSchools.org 2 Test Security Incidents When a Test Security Incident is detected, you must first determine the severity of the incident. Does the incident threaten the VALIDITY of the assessment? What is the scope of the validity threat? Categorize the incident Impropriety

Irregularity Breach See Smarter Balanced TAM 16; App. F and HSAP TAM 11-12. HAWAII STATE DEPARTMENT OF EDUCATION HawaiiPublicSchools.org 3 Definitions of Test Security Impropriety Definitions for Test Security Incidents Impropriety (Low Severity) Has a low impact on the individual or group of students who are testing and has a low risk of potentially affecting student preformance.

Examples Student(s) making distracting gestures/sounds or talking during the test session that creates a disruption in the test session for other students. Student(s) leave the test room without authorization. Administrator or Coordinator leaving related instructional materials on the walls in the testing room. HAWAII STATE DEPARTMENT OF EDUCATION HawaiiPublicSchools.org 4 Definitions of Test Security Irregularity Definitions for Test Security Incidents (Continued)

Irregularity (Medium Severity) Impacts an individual or group of students who are testing and may potentially affect student performance. Examples Student(s) cheating or providing answers to each other, including passing notes, giving help to other students during testing, or using hand-held electronic devices to exchange information. Student(s) accessing the Internet or any unauthorized software or applications during a testing event. Student(s) accessing or using unauthorized electronic equipment (e.g., cell phones, PDAs, iPods, or electronic translators) during testing. HAWAII STATE DEPARTMENT OF EDUCATION HawaiiPublicSchools.org 5

Definition of Test Security Breach Definitions for Test Security Incidents (Continued) Breach (High Severity) Poses a threat to the validity of the test. Examples may include such situations as a release of secure materials or a security/system risk. HAWAII STATE DEPARTMENT OF EDUCATION HawaiiPublicSchools.org 6 Consequences of a Test Security Breach

Due to the importance of test security for all of the statewide assessments, any school that has a student or staff member who which results in a breach of a test item will be subject to the following actions/consequences: 1. Involved students incomplete test or complete test that has been scored will be invalidated. 2. Retrain the staff 3.Retake the Test Administrator Certification Course. 4.Required to have a second adult present in the testing room. 5. The school will be required to pay for the cost of each test item that was

posted on a social networking site. 6. Must submit its detailed testing schedule that includes the date, time, and student seating chart for each test session for all statewide assessments administered. 7. Unannounced site monitoring. HAWAII STATE DEPARTMENT OF EDUCATION HawaiiPublicSchools.org 7 Test Security Incident Response Essentials Whenever an Incident occurs, get the facts straight. Record date, time and location (school and room identifier) of incident. Identify grade level and specific test component(s) at issue (i.e., Grade 4, ELA Section 1).

Identify the Test Administrator (and Proctor) assigned to the testing room. Determine key facts/allegations as quickly as possible. List all persons with knowledge of incident (i.e., school staff and students). Briefly summarize knowledge of each participant and witness. Identify and preserve relevant evidence (may include seating charts, social media posts, text messages, photographs). Include all facts in reports to District and State. HAWAII STATE DEPARTMENT OF EDUCATION HawaiiPublicSchools.org 8 Testing Incident Flowchart

9 Test Security Activity Lets check our understanding of the new Smarter Balanced test security requirements. What is the severity level of actual testing incidents that occurred in some of our schools during the last two school years? Impropriety (Low Severity) Irregularity (Medium Severity) Breach (High Severity) HAWAII STATE DEPARTMENT OF EDUCATION HawaiiPublicSchools.org

10 Test Security Activity 1. As the teacher was walking around during the test, found a student with earbuds in his ears, and iphone in his hand. Severity Level? ____________________Action?___________________________ 2. The teachers decided to post instructional strategies charts in each of their testing rooms on the morning of a test session and instruct students to use the strategies while answering questions. Severity Level? ____________________Action?___________________________ 3. A student kept her cell phone during the test, when told to put it in her backpack and took a picture of an ELA Performance Task, so she can work on it at home. Severity Level? ____________________Action?___________________________ 4. A Test Coordinator checking rooms to see how sessions are going, found a test room unsupervised with no TA or adult present and

students taking a test. Severity Level? ____________________Action?___________________________ HAWAII STATE DEPARTMENT OF EDUCATION HawaiiPublicSchools.org 11 Test Security Activity (Cont.) 5. A student was done with his test, logged out of the test session and accessed a webpage game and started playing. Severity Level? ____________________Action? ___________________________ 6. A student used a camera phone to take screen shots of test item and posted them on Snapchat. The students friends at other

schools saw the test item when they were at school or at home and informed their teachers or parents. Severity Level? ____________________Action? ___________________________ 7. Teacher passed out scratch paper and told students to write down all the things they knew about Language Arts and could use it as notes on the test. Then collected the scratch paper after and put them in her recycle box.. Severity Level? ____________________Action? ___________________________ HAWAII STATE DEPARTMENT OF EDUCATION HawaiiPublicSchools.org 12

Hawaii Test Security Compliance Program In collaboration with Caveon Test Security, the Department has initiated a new test security compliance program designed to prevent, detect and respond to potential test security breaches and to ensure the validity of assessment results and improve the integrity of all state assessment programs. The new test security compliance program will include the following components:

Data Forensics Analysis of state assessment response data Post-Administration Review of schools identified by Data Forensics Real-Time Monitoring of state assessment administrations Annual review and improvement of state assessment programs HAWAII STATE DEPARTMENT OF EDUCATION HawaiiPublicSchools.org 13 hitide.org 14 Introducing TIDE 15

alohahsap.org Logging in to TIDE Upon clicking Secure Login the TIDE dashboard will appear. A users privileges within TIDE vary by role group (test coordinator, test administrator, teachers, etc.) so the dashboards may vary. Some users have multiple roles, in those cases TIDE may prompt you to select a specific user role to complete the login process. 16 Navigating TIDE Once you log into the TIDE, a banner appears at the top of every page:

Also available through alohahsap.org 17 When you navigate away from the TIDE dashboard, a navigation toolbar appears at the top of the page: To access the dashboard, click in the upper-left corner. To view the task menus for a particular TIDE category, click the icon for that category above the toolbar. To access a particular task, click that task menu in the toolbar (such as Users) and select the required task from the list of options that appears. There is a Find Student by ID field where you can type in the student SSID # in

the upper-right corner of every page in TIDE. You can use this field to navigate to the View/Edit Student page filtered to a specified students record. To search for a student: 1. In the Find Student by ID field, enter a students SSID. 2. Click the magnifying glass. The View and Edit Student form for that student appears. 18 TIDE: Preparing for Testing (Users) 19 User Accounts Add Users:

Click Add User and enter the info in the fields indicated with an asterisk, then click SAVE: View /Edit/Export Users: Click View/Edit Export Users to View and Edit Users, fill in info in asterisked fields, you can search by individual name or by school, then click SEARCH User Accounts should be cleaned up early each school year 20

To select records for an action (such as printing or exporting), do one of the following: Mark the checkbox next to each record you wish to select. To select all records, mark the checkbox in the header row. Click the required action button above the table of retrieved records: : Exports the selected records to a PDF, Excel, or CSV file. : Deletes the selected records. 21 Upload Users: 1. On the file upload page, click Download Templates located at the top right and select the appropriate file type. 2. Open the file in a spreadsheet application, fill it out, and save it. 3. On the file upload page, click Browse and select the file you created in the previous step.

4. Click Next. The Preview page appears . Use the file preview on this page to verify you uploaded the correct file. 5. Click Next. TIDE validates the file and displays any errors Validate page. or warnings on the 22 TIDE: Preparing for Testing (Students) 23

Student Accounts Veiw/Edit Students: 1. From the Students task menu on the TIDE dashboard, select View/Edit Student. The View/Edit Student page appears. Fill in the fields needed as indicated by the asterisk or search a student by entering their SSID#. 2. In the list of retrieved students, click

for the student whose account you want to view. The View and Edit Student form appears. This is where you will enter the students Designated Supports and Accommodations. 24 Print Test Tickets: There are 2 areas where you can print Test Tickets: 1. Click Students or Test Setting and Tools Click View/Edit Students or View /Edit Test Setting and Tools Fill in required fields or if looking for just one student fill in the student SSID# then Click SEARCH.

2.Click the column headings to sort the retrieved students in the order you want the test tickets printed. 3. Do one of the following: Mark the checkboxes next to the name of the student(s) you want to print. Or mark the checkbox at the top of the table to print tickets for all retrieved students. 4. Click and then select Test Tickets. A layout model appears for selecting the printed layout. 5. Verify Test Tickets is selected in the Print Options section. 6. Click the layout you require, and then click Print. Your browser downloads the generated PDF. 25 TIDE: Preparing for Testing (Test Setting and Tools)

26 Viewing and Editing Test Settings and Tools To edit a students Test Settings and Tools: 1. Click Test Settings and Tools Click View/Edit Test Settings and Tools Fill in required fields or if looking for just one student fill in the student SSID# then Click SEARCH. 2. Retrieve the student accounts whose settings and tools you want to view. 3. In the list of retrieved students, click for the student whose test settings and tools you want to edit. The Edit Test Settings and Tools form appears.

4. The Edit Test Settings and Tools form is identical to the form used to modify student records. Instead of clicking on the + sign to open each selection, hover over the GO to buttons to the side and it will tell you what the sections name is. 27 Printing Students Test Setting 1. Click Test Settings and Tools Click View/Edit Test Settings and Tools Fill in required fields or if looking for just one student fill in the student SSID# then click SEARCH. 2. Click the column headings to sort the retrieved students in the order you want the records printed.

3. Do one of the following: Mark the checkboxes next to the name of the student(s) you want to print. Or mark the checkbox at the top of the table to print labels for all retrieved students. 4. Click and then select Student Settings and Tools. The Students Test Settings and Tools report appears. 5. Verify Student Settings and Tools is selected in the Print Options section 6. Click the layout you require, and then click Print. Your browser downloads the generated PDF. 28 TIDE: Preparing for Testing (Rosters) 29

Add/Delete Rosters To Add a Roster: Click Roster Click Add Roster Fill in required fields or if looking for just one student fill in the student SSID# then Click SEARCH Students will load to the left of the screen Enter the name of your Roster and select the Teacher name. Choose the students you want off the left side by clicking the box to the left of the name or click the box at the top to select all. To enter into the roster and click add all or add selected and the names Will move to the right side as the selected students. Then click SAVE To Delete Names From a Roster:

To remove one student from the roster clicking on the to the left of the name of the student. To remove selected students, mark the checkboxes to the left of the student names and select Remove Selected. To remove all students from the roster, click Remove All. Then click SAVE. 30 TIDE-Administering Tests Test Improprieties HAWAII STATE DEPARTMENT OF EDUCATION HawaiiPublicSchools.org

31 Types of Testing Incidents Grace period extension: A Grace Period Extension (GPE) allows students whose tests have been paused for more than 30 minutes to review previously answered questions. (State may approve) Reset: Resetting a students test removes that test from the system and enables the student to start a new test. (State may reset any test CAT or PT) Invalidation: Invalidating a students test eliminates the test. The test will not be scored. (State may invalidate)

HAWAII STATE DEPARTMENT OF EDUCATION HawaiiPublicSchools.org 32 Reopen Reopening a test allows a student to access a test that has already been submitted or has expired. If an expired test is reopened, the test will reopen at the location at which the student stopped the test. The student will be able to review items within the current segment of the test but cannot return to previous segments. If a submitted test is reopened, the test will reopen at the last page of the test. The student can review items in the current segment but cannot return to previous segments. (State may reopen)

Reopen Test Segment Reopening a test segment allows a student to access a test segment that the student inadvertently leaves. (State may reopen test segment) Restores Restoring a test returns a test from the Reset status to its prior status. This action can only be performed on tests that have been reset. (State may restore) HAWAII STATE DEPARTMENT OF EDUCATION HawaiiPublicSchools.org 33 How to Enter a Testing Incident in TIDE Click on the TIDE icon:

Once in TIDE, under Administering Tests click Test Impropriety: Then click on Create Test Impropriety: HAWAII STATE DEPARTMENT OF EDUCATION HawaiiPublicSchools.org 34 How to Enter a Testing Incident in TIDE (cont.) Step 1: Select a category

Step 2: Select a Search Step 3: Enter Student SSID HAWAII STATE DEPARTMENT OF EDUCATION HawaiiPublicSchools.org 35 How to Enter a Testing Incident in TIDE (cont.) Then click Search Student Results Next click Create and then, enter a reason for the

request in the window that pops up, then click Submit HAWAII STATE DEPARTMENT OF EDUCATION HawaiiPublicSchools.org 36 TIDE- Administering Tests Monitoring Test Progress HAWAII STATE DEPARTMENT OF EDUCATION HawaiiPublicSchools.org 37 Plan and Manage Testing

TIDE includes a Plan and Manage Testing report that details all of a students test opportunities and the status of those test opportunities. To generate a Plan and Manage Testing Report: click on Monitor Test Progress Then Plan and Manage Testing Step 1: Choose What panel, select parameters HAWAII STATE DEPARTMENT OF EDUCATION HawaiiPublicSchools.org 38 Step 2: Choose Who panel, select the parameters for whose information to include.

Step 3: Get Specific panel, select radio button for one of the options and then set the parameters for the option. Then click Generate Report. HAWAII STATE DEPARTMENT OF EDUCATION HawaiiPublicSchools.org 39 Participation Monitoring All students are to be tested. Test Coordinators must ensure all ELL/SPED/Disadvantaged/ Migrant students are tested. Test Coordinators are to utilize TIDE to

monitor the participation of all students including subgroups during the testing window. Assessment Section, Assessment & Accountability Branch, Office of Strategy, Innovation and Performance HAWAII STATE DEPARTMENT OF EDUCATION 40 Non-Participation See SB TAM pp 104-110 for more detailed information Assessment Section, Assessment & Accountability Branch, Office of Strategy, Innovation and Performance

HAWAII STATE DEPARTMENT OF EDUCATION 41 TIDE: After Testing Non-Participation Assessment Section, Assessment & Accountability Branch, Office of Strategy, Innovation and Performance HAWAII STATE DEPARTMENT OF EDUCATION 42 Management of Reasons for Non-Participation

In TIDE, add or modify or delete a students reason for non-participation. Using TIDE, you can view reasons for nonparticipation for students enrolled in your school. Assessment Section, Assessment & Accountability Branch, Office of Strategy, Innovation and Performance HAWAII STATE DEPARTMENT OF EDUCATION 43 Documenting and Reporting Reasons for Non-Participation Students who have not participated in an HSAP assessment need to have reasons for non-participation documented for accountability purposes.

Once a reason for non-participation is marked in TIDE, that reason persists until it is changed. Only one reason for non-participation can be selected for each test that a student is eligible to be administered. Assessment Section, Assessment & Accountability Branch, Office of Strategy, Innovation and Performance HAWAII STATE DEPARTMENT OF EDUCATION 44 Viewing and Editing a Students Reason for Non-Participation From the Data Cleanup task menu on the TIDE dashboard, select NonParticipation Codes. Fill in the required fields or enter a single students SSID# and click SEARCH. In the list of retrieved students, click for the student whose nonparticipation codes you want to edit. The Edit Non-Participation Codes

form appears, listing the students demographic information in the Student Information panel and the students available tests and reasons for non-participation in the Special Codes panel From the drop-down lists in the Special Codes panel, select the reason for non-participation for each available test, as required. For a listing of reasons for nonparticipation. Click Save. Assessment Section, Assessment & Accountability Branch, Office of Strategy, Innovation and Performance HAWAII STATE DEPARTMENT OF EDUCATION 45 Reasons for Non-Participation and

Their Descriptions Assessment Section, Assessment & Accountability Branch, Office of Strategy, Innovation and Performance HAWAII STATE DEPARTMENT OF EDUCATION 46 Assessment Section, Assessment & Accountability Branch, Office of Strategy, Innovation and Performance HAWAII STATE DEPARTMENT OF EDUCATION 47 Opt Out Requests Intranet: OSIP > Documents > Opt Out Guidance

Information points Information that parents should know about the assessment, including the importance of having their child participate in the testing, the benefit of the information, and the potential impact on their school. Procedure for addressing parent requests Examples of requests from parents and responses. Sample letter A form letter that can be sent to a parent who has submitted a written request for opting his/her child out of testing. Refusals- Parents/Students can refuse to be tested. Assessment Section, Assessment & Accountability Branch, Office of Strategy, Innovation and Performance HAWAII STATE DEPARTMENT OF EDUCATION

48 The Online Reporting System See the Online Reporting System User Guide for more detailed information Assessment Section, Assessment & Accountability Branch, Office of Strategy, Innovation and Performance HAWAII STATE DEPARTMENT OF EDUCATION 49 Online Reporting System (ORS)

ORS is a web-based system that displays Score Reports: Provides score data for each HSAP test. You can compare score data between individual students and the school, complex, complex area, or overall state average scores. ORS also provides information about performance on claims, reporting categories, and Interim Assessment Blocks (IAB); targets and benchmarks when applicable. Reports & Files: Provides Summary Statistics (count and percentages) of students who tested in a selected subject and grade level. Enables you to download student data files containing test scores and demographic information.

To access the ORS you will need to login using your TIDE User Name and Password. Assessment Section, Assessment & Accountability Branch, Office of Strategy, Innovation and Performance HAWAII STATE DEPARTMENT OF EDUCATION 50 Once you have logged in you can choose one of three options to get information regarding you student(s): Score Reports, Reports & Files, and Search Students.

* * Will be renamed Reports and Files Search Students: Allows a teacher to view all of a students test results over time and assessments. The search is based upon Assessment Section, Assessment & Accountability Branch, Office of Strategy, Innovation and Performance student SSIDs or Legal Name. HAWAII STATE DEPARTMENT OF EDUCATION 51 Generating a Data File or PDF of Individual Student Reports To generate a student data file or PDF of Individual Student Reports: From the Reports &

Files drop-down list, select Retrieve Student Results. The Retrieve Student Results & My Inbox page opens. Choose What section, select the report, test, grades, and other variables then click Generate: Assessment Section, Assessment & Accountability Branch, Office of Strategy, Innovation and Performance HAWAII STATE DEPARTMENT OF EDUCATION 52

Going Into ORS We will now log in as Test Coordinators at one of the fictitious schools, Kula ao Hawaii, with fictitious students created for system testing purposes. Once in ORS well look at: 1. Summary Statistics for the Grade 3 Smarter ICA 2. Score Reports for the school, classes, and students on the Grade 3 Smarter ICA 3. Search for specific students

http://alohahsap.org Assessment Section, Assessment & Accountability Branch, Office of Strategy, Innovation and Performance HAWAII STATE DEPARTMENT OF EDUCATION 53 ORS: Search Students Search Students is the easiest and quickest way to gather information on a handful of students but it does require the students SSID numbers or legal names. OR

Assessment Section, Assessment & Accountability Branch, Office of Strategy, Innovation and Performance HAWAII STATE DEPARTMENT OF EDUCATION 54 ORS: Search Students Click to expand Click to view score report Assessment Section, Assessment & Accountability Branch, Office of Strategy, Innovation and Performance HAWAII STATE DEPARTMENT OF EDUCATION

55 As the Elementary School (Grade 3) TC at Kula ao Hawaii use ORS to Check on Your Students SB ICAs 1. Go to alohahsap.org and log into ORS using the Kula ao Hawaii TC Username and Password provided. 2. Use Reports and Files: Retrieve Student Results to generate an Excel file of Grade 3 results for the ICA in 2015-16 3. Use the Score Report Tool to drill down and see the results on the SB ELA ICA for Disadvantaged students in Students with no group (identified teacher) in grade 5 4. View the Score Report of the male student in that group and the claim on which he did best. 5. Use the Search Student to look-up Nali E. Exzas testing history and results over time. 6. Use the Search Student to look-up the testing history and results over time for these 5 students: 9999990091, 9999990263, 9999990265, 9999990266, 9999990711

Assessment Section, Assessment & Accountability Branch, Office of Strategy, Innovation and Performance HAWAII STATE DEPARTMENT OF EDUCATION 56 ORS Resources 2015-2016 Online Reporting System User Guide alohahsap.org >>Smarter Balanced >>Test Coordinators>> Resources>>Test Coordinators>>Reporting Online Reporting System Webinar

alohahsap.org >> Smarter Balanced >>Test Coordinators>> Resources>>Webinars Assessment Section, Assessment & Accountability Branch, Office of Strategy, Innovation and Performance HAWAII STATE DEPARTMENT OF EDUCATION 57 Parent and Family Resources Assessment Section, Assessment & Accountability Branch, Office of Strategy, Innovation and Performance HAWAII STATE DEPARTMENT OF EDUCATION 58

PIBs and Parent Letters A Parent Information Booklet (PIB) is available in English and in 14 languages on the Smarter Balanced Resources page. The PIB includes information for the grades 3-8 and 11 Smarter Balanced ELA/Literacy and Mathematics Assessments and the grades 4 and 8 Hawaii State Science Assessments. Parent Letters are available in English and 14 languages for 12 student populations on the Smarter Balanced Resources page. The Parent Letters will include information for the grades 3-8 and 11 Smarter Balanced ELA/Literacy and Mathematics Assessments and the grades 4 and 8 Hawaii State Science Assessments. The Parent Fact Sheet provides information on how Smarter Balanced Assessments are preparing students for success. Assessment Section, Assessment & Accountability Branch, Office of Strategy, Innovation and Performance

HAWAII STATE DEPARTMENT OF EDUCATION 59 www.alohahsap.org for Students and Families Resource Elementary Writing Questions Equation Response Editor Parent Fact Sheet Parent Guide to Smarter Balanced Assessments Sample Family Report 2015-2016 Smarter Balanced Family Report Interpretive Guide 2015-2016 Smarter Balanced Family Report Cover Letter Smarter Balanced and HSA Science Parent Information Booklet

Smarter Balanced and HSA Science Parent Letters Smarter Balanced UH Placement Policy Poster HAWAII STATE DEPARTMENT OF EDUCATION HawaiiPublicSchools.org 60 Questions Assessment Section, Assessment & Accountability Branch, Office of Strategy, Innovation and Performance HAWAII STATE DEPARTMENT OF EDUCATION 61

Who can assist if I have questions in the future? 1. Review the resources and documentation available on the portal at: http://alohahsap.org 2. Contact the HSAP Help Desk: Hours: 7:30 am to 4:00 p.m. HST, Monday-Friday (except holidays) Phone: 1-866-648-3712 (toll free) Email: [email protected] 3. Contact the Assessment Section (808) 733-4100 Assessment Section, Assessment & Accountability Branch, Office of Strategy, Innovation and Performance HAWAII STATE DEPARTMENT OF EDUCATION 62

Teaming for a Successful Administration of Smarter Balanced Summative ELA/Literacy and Mathematics Assessments When we value each other and work together in harmony and unity, any task, whether big or small, becomes easier and more successful and makes the voyage so much more enjoyable and purposeful. WE DO OUR BEST FOR THE SUCCESS OF OUR STUDENTS AND THEIR FAMILIES! Assessment Section, Assessment & Accountability Branch, Office of Strategy, Innovation and Performance HAWAII STATE DEPARTMENT OF EDUCATION 63 Survey and Certificate We value your feedback in order to continuously improve our trainings and workshops. Please respond to the survey regarding

the 2016 Smarter Balanced Test Coordinator Training. https://www.surveymonkey.com/r/TestCoordinator2017 Thank you for your time and effort to complete this survey! Assessment Section, Assessment & Accountability Branch, Office of Strategy, Innovation and Performance HAWAII STATE DEPARTMENT OF EDUCATION 64

Recently Viewed Presentations