This free survey is powered by QUESTIONPRO.COM
  1. Surveys
  2. 2011
  3. January
  4. M
  5. Metrica Standard Settng: Checkset 2

Metrica Standard Settng: Checkset 2

0%
 

Welcome!


This site will collect your responses to Angoff Check Set #2.

On the pages that follow, you will have to opportunity to enter information that helps us check your understanding of the standard setting process.

The check set will take approximately 10 minutes to complete. You will need to complete the check set in one online session.

The information collected will be completely confidential, and all responses will be deleted when the training is complete.


When you are ready to begin, start
by clicking the Continue button below.

 
 
 
 

** NOTE **

It is important to know that this site does NOT support the use of the 'BACK' button on your web browser.

Each time you click the button at the bottom of the page to continue, your answers are immediately sent to the database.

Click the checkbox below to acknowledge and proceed.

 
 
 
 
* Your first name:
   
* Your last name:
   
* Your email address:
   
 
 
* Standard setting language(s) for which you will be a participant (check all that apply):
 
French
 
Spanish
 
Persian
 
Chinese
 
Korean
 
Iraqi
 
N/A (I am an Observer only, not a participant.)

 
 
Directions: Please indicate your answers to the following set of questions.

* Question 1:
You are making your Angoff Yes/No rating for an item. You think that the borderline candidate moving into Level 1+ can answer the item correctly. Where must you place a YES rating?
 
A. Under the 0+ column
 
B. Under the 1 column
 
C. Under the 1+ column
 
 
* Question 2:
What do "P-values" represent?
 
A. The proportion of all borderline candidates for a specific level who took the item and answered the item correctly
 
B. The proportion of all persons in the tested population expected to answer the item correctly
 
 
* Question 3.
What does a p-value of 0.84 mean?
 
A. The item is relatively easy
 
B. The item is moderately difficult
 
C. The item is very difficult
 
 
* Question 4.
What does the ILR level of an item represent?
 
A. The item’s characteristics in terms of the ILR scale
 
B. Where specifically the item is located on the test scale
 
C. The item’s measured difficulty
 
 
 
* Question 5.
Suppose that the ILR level of an item is shown to be rated at 0+. You believe, however, that the borderline Level 1 candidate would NOT be able to answer the item correctly. What could your rating form look like??
 
A.

 
B.

 
C.

 
 
 
* Question 6.

Please indicate which statement is true.
 
A. Items with low ILR ratings tend to have low p-values.
 
B. An item’s ILR rating and the standard setting rating have to agree.
 
C. The item's ILR rating reflects item characteristics, and the standard setting rating reflects performance expectations.
 
 
In your Angoff worksheet, in round 1, you indicated that the borderline Level 0+ candidate should get the item correct. You now see that item X has an ILR Level of 1 and a p-value of 0.30.

* Question 7.
What does the ILR Level of "1" mean for this item?
 
The item is relatively easy on the VLR scale
 
An expert item rater believes the item best matches the Level 1 ILR description
 
The Borderline Level 1 candidate should get this item correct
 
 
* Question 8.
After considering the new information on item X, are you REQUIRED to change your rating?
 
A. Yes
 
B. No
 
 
 
* Question 9.
Do you agree with this statement?

I understand the background information relating to the standard setting process, and I am ready to begin.
 
A. Yes
 
B. No
 
 
*
Question 10.
Do you agree with this statement?

I feel confident about this task and I am ready to proceed. I have no more questions at this time.
 
A. Yes
 
B. No
 
 
 
If you answered "No" to Question 9 or Question 10, please review the YouTube video for Checkset #2.

If you still have questions, please contact us. We can be reached either by email or toll-free phone:


Email: [email protected]
Phone: 888-502-1105


Please include your name, language group, and best way to contact you.

Click the button below to finish this check set.
 
Questions? Contact [email protected] about this check set.

















































Provided by Center Point Assessment Solutions, Inc.
 
Survey Software Powered by QuestionPro Survey Software