This free survey is powered by QUESTIONPRO.COM

Metrica Standard Setting: Evaluation


0%
 

Welcome!


This site will allow you to take an online survey to help us evaluate your experience with the standard setting process.

The survey will take up to 10 minutes to complete. You will need to complete the survey in one online session.

The information collected will be completely confidential.


When you are ready to begin, start
by clicking the Continue button below.

 
 
 
 

** NOTE **

It is important to know that this site does NOT support the use of the 'BACK' button on your web browser.

Each time you click the button at the bottom of the page to continue, your answers are immediately sent to the database.

Click the checkbox below to acknowledge and proceed.

 
 
 
Directions: Please indicate your answers to the following set of questions using the 4-point scale.

* (1) BORDERLINE PLDs


The topics covered in the opening session provided a clear overview of the purpose for the standard setting workshop.
 
1 = Strongly Disagree
 
2 = Disagree
 
3 = Agree
 
4 = Strongly Agree
 
 
 
* The ILR Performance Level Descriptors were easy to understand.
 
1 = Strongly Disagree
 
2 = Disagree
 
3 = Agree
 
4 = Strongly Agree
 
 
 
* Taking the test helped me understand the required knowledge, skills, and abilities that candidates must demonstrate.
 
1 = Strongly Disagree
 
2 = Disagree
 
3 = Agree
 
4 = Strongly Agree
 
 
 
* The borderline performance level descriptors helped me understand the target candidates.
 
1 = Strongly Disagree
 
2 = Disagree
 
3 = Agree
 
4 = Strongly Agree
 
 
 
* (2) Standard Setting Training - Day 1

The modified Angoff standard setting procedure was well described.
 
1 = Strongly Disagree
 
2 = Disagree
 
3 = Agree
 
4 = Strongly Agree
 
 
 
* The training on the modified Angoff ratings made the task clear to me.
 
1 = Strongly Disagree
 
2 = Disagree
 
3 = Agree
 
4 = Strongly Agree
 
 
 
* The rating demonstration was important to my understanding of what I needed to do for my Round 1 rating.
 
1 = Strongly Disagree
 
2 = Disagree
 
3 = Agree
 
4 = Strongly Agree
 
 
 
* The goals of the procedure were clear.
 
1 = Strongly Disagree
 
2 = Disagree
 
3 = Agree
 
4 = Strongly Agree
 
 
 
* (3) Use of Data Entry Template

Making my ratings was a relatively straightforward task.
 
1 = Strongly Disagree
 
2 = Disagree
 
3 = Agree
 
4 = Strongly Agree
 
 
 
* I kept the target candidates in mind while I made my ratings.
 
1 = Strongly Disagree
 
2 = Disagree
 
3 = Agree
 
4 = Strongly Agree
 
 
 
* The data collection form was easy to use.
 
1 = Strongly Disagree
 
2 = Disagree
 
3 = Agree
 
4 = Strongly Agree
 
 
 
* I made my ratings independently.
 
1 = Strongly Disagree
 
2 = Disagree
 
3 = Agree
 
4 = Strongly Agree
 
 
 
* I had enough time to make my ratings.
 
1 = Strongly Disagree
 
2 = Disagree
 
3 = Agree
 
4 = Strongly Agree
 
 
 
* I felt that I could obtain support whenever I needed it.
 
1 = Strongly Disagree
 
2 = Disagree
 
3 = Agree
 
4 = Strongly Agree
 
 
 
* (4) Standard Setting Training Day 2

The discussion before the Round 2 ratings was helpful to me.
 
1 = Strongly Disagree
 
2 = Disagree
 
3 = Agree
 
4 = Strongly Agree
 
 
 
* If asked, I can explain to any person why I chose to rate items the way I did.
 
1 = Strongly Disagree
 
2 = Disagree
 
3 = Agree
 
4 = Strongly Agree
 
 
 
* Being provided with the additional information in round 2 helped me further understand my ratings.
 
1 = Strongly Disagree
 
2 = Disagree
 
3 = Agree
 
4 = Strongly Agree
 
 
 
* I understood how to make my Round 2 ratings.
 
1 = Strongly Disagree
 
2 = Disagree
 
3 = Agree
 
4 = Strongly Agree
 
 
 
* (5) General Perceptions

I had a good understanding of my role in this standard setting workshop.
 
1 = Strongly Disagree
 
2 = Disagree
 
3 = Agree
 
4 = Strongly Agree
 
 
 
* I feel that this procedure was fair.
 
1 = Strongly Disagree
 
2 = Disagree
 
3 = Agree
 
4 = Strongly Agree
 
 
 
* I feel confident defending the judgments I made in this workshop.
 
1 = Strongly Disagree
 
2 = Disagree
 
3 = Agree
 
4 = Strongly Agree
 
 
 
* Overall, the standard setting procedure allowed me to use my expertise and experience to recommend cut scores.
 
1 = Strongly Disagree
 
2 = Disagree
 
3 = Agree
 
4 = Strongly Agree
 
 
 
* The facilitators made sure that I understood what I needed to do for the workshop.
 
1 = Strongly Disagree
 
2 = Disagree
 
3 = Agree
 
4 = Strongly Agree
 
 
 
* The standard setting was well organized.
 
1 = Strongly Disagree
 
2 = Disagree
 
3 = Agree
 
4 = Strongly Agree
 
 
 
* How many languages did you rate for this standard setting?
 
1. I rated ONE language.
 
2. I rated TWO languages.
 
3. I rated THREE languages.
 
 
 
* What is your gender?
 
Male
 
Female
 
 
* Do you teach or have you taught the language of the test on which you set standards?
 
Yes
 
No
 
 
* Rate your familiarity with the VLR DLPT5 tests before you participated in this activity.
 
1 = Not Familiar
 
2 = Slightly Familiar
 
3 = Somewhat Familiar
 
4 = Very Familiar
 
Questions? Contact [email protected] about this evaluation.

















































Provided by Center Point Assessment Solutions, Inc.
 
Survey Software Powered by QuestionPro Survey Software