What is a test specification? What are the components on a test specification? (Lecture slides mostly in English)

1. PDU 303 PSIKOMETRIK
TEST SPECIFICATION
SEMESTER GASAL 2015/2016
FAKULTAS PSIKOLOGI UNIVERSITAS KATOLIK INDONESIA ATMA JAYA
KULIAH III - 28 AGUSTUS 2015

2. FAKULTAS PSIKOLOGI
UNIVERSITAS KATOLIK INDONESIA ATMA JAYA © 2015 Ardhiati PDU 303 PSIKOMETRIK 2
IMAGE SOURCE: adcb.com/about/investorrelations/financialinformation/ARSite/2013/index.html
WHAT DO WE NEED TO
BUILD IT CORRECTLY?

3. FAKULTAS PSIKOLOGI
UNIVERSITAS KATOLIK INDONESIA ATMA JAYA © 2015 Ardhiati PDU 303 PSIKOMETRIK 3
IMAGE SOURCE:rvculinary.com/cuisine/spicy-beef-rendang-rendang-daging/
WHAT DO WE NEED TO
SERVE IT CORRECTLY?

4. FAKULTAS PSIKOLOGI
UNIVERSITAS KATOLIK INDONESIA ATMA JAYA © 2015 Ardhiati PDU 303 PSIKOMETRIK 4
IMAGE SOURCE: etsy.com/listing/84779204/vintage-blocks-wais-r-block-design
WHAT DO WE NEED TO
CREATE IT CORRECTLY?

5. FAKULTAS PSIKOLOGI
UNIVERSITAS KATOLIK INDONESIA ATMA JAYA © 2015 Ardhiati PDU 303 PSIKOMETRIK 5
INFORMATION
ABOVE ALL OF THE OTHERS, IS

6. FAKULTAS PSIKOLOGI
UNIVERSITAS KATOLIK INDONESIA ATMA JAYA © 2015 Ardhiati PDU 303 PSIKOMETRIK 5
INFORMATION
ABOVE ALL OF THE OTHERS, IS
THAT SHOULD BE FOUND IN…
RECIPES
BLUEPRINTS

7. FAKULTAS PSIKOLOGI
UNIVERSITAS KATOLIK INDONESIA ATMA JAYA © 2015 Ardhiati PDU 303 PSIKOMETRIK 5
INFORMATION
ABOVE ALL OF THE OTHERS, IS
THAT SHOULD BE FOUND IN…
RECIPES
BLUEPRINTS
TEST
SPECIFICATIONS

8. FAKULTAS PSIKOLOGI
UNIVERSITAS KATOLIK INDONESIA ATMA JAYA © 2015 Ardhiati PDU 303 PSIKOMETRIK
GOOD TESTS
6
GOOD
TESTS
(Davidson & Lynch, 2002, p. 7)

9. FAKULTAS PSIKOLOGI
UNIVERSITAS KATOLIK INDONESIA ATMA JAYA © 2015 Ardhiati PDU 303 PSIKOMETRIK
GOOD TESTS
6
GOOD
TESTS
CLEAR
THINKING
CLARITY
(Davidson & Lynch, 2002, p. 7)

10. FAKULTAS PSIKOLOGI
UNIVERSITAS KATOLIK INDONESIA ATMA JAYA © 2015 Ardhiati PDU 303 PSIKOMETRIK
GOOD TESTS
6
GOOD
TESTS
CLEAR
THINKING
ITERATIVE
CONSENSUS-
BASED
SPECIFICATION
DRIVEN
CLARITY
FEEDBACK &
IMPROVEMENT
DIALOGUE,
NOT TOP-DOWN
DICTATE
(Davidson & Lynch, 2002, p. 7)

11. FAKULTAS PSIKOLOGI
UNIVERSITAS KATOLIK INDONESIA ATMA JAYA © 2015 Ardhiati PDU 303 PSIKOMETRIK
GOOD TESTS
7
(Davidson & Lynch, 2002, p. 7)
GOOD
TESTS
SPECIFICATION
DRIVEN
A specification is an
efficient generative recipe
for a test that fosters
dialogue and discovery at a
higher, more abstract level
than achieved by analysis
of a simple item (or task).

12. FAKULTAS PSIKOLOGI
UNIVERSITAS KATOLIK INDONESIA ATMA JAYA © 2015 Ardhiati PDU 303 PSIKOMETRIK
TEST SPECIFICATION
A test’s specifications provide
the official statement about
what the test tests and how it tests it.
The specifications are the blueprint
to be followed by test and item writers,
and they are also essential in the establishment
of the test’s construct validity.
8
(Alderson, Clapham, & Wall, 1995, p. 9)

13. FAKULTAS PSIKOLOGI
UNIVERSITAS KATOLIK INDONESIA ATMA JAYA © 2015 Ardhiati PDU 303 PSIKOMETRIK
TEST SPECIFICATION
However, there is no single best format,
or rubric, for a test specification.
The test specification component
represents a personal choice.
9
(Davidson & Lynch, 2002, p. 20)

14. FAKULTAS PSIKOLOGI
UNIVERSITAS KATOLIK INDONESIA ATMA JAYA © 2015 Ardhiati PDU 303 PSIKOMETRIK
TEST USERSTEST DEVELOPERS TEST PUBLISHERS
Test developers need to
have clear statements
about who the test is aimed
at, what its purpose is,
what content is to be
covered, what methods are
to be used, etc.
Test users need
descriptions of a test’s
content, and different sorts
of users may need
somewhat different
descriptions.
Test specifications are a
valuable source of
information for publishers
wishing to produce
textbooks related to the
tests.
WHO NEEDS TEST SPECIFICATION?
10
(Alderson, Clapham, & Wall, 1995, p. 9-11)

15. FAKULTAS PSIKOLOGI
UNIVERSITAS KATOLIK INDONESIA ATMA JAYA © 2015 Ardhiati PDU 303 PSIKOMETRIK
GENERAL
DESCRIPTION
COMPONENTS
11
GD PA
PROMPT
ATTRIBUTES
RA
RESPONSE
ATTRIBUTES
SAMPLE
ITEM
SI SS
SPECIFICATION
SUPPLEMENT

16. FAKULTAS PSIKOLOGI
UNIVERSITAS KATOLIK INDONESIA ATMA JAYA © 2015 Ardhiati PDU 303 PSIKOMETRIK
A CONCISE SUMMARY
OF WHAT THE
SPECIFICATION IS
ABOUT.
a detailed description of the construct, or
particular aspect, that is being tested
a listing of the characteristics for the
setting in which the test will take place
the purpose of how the test item/task
should be used, written on an explicit
statement
GENERAL DESCRIPTION
12
(Davidson & Lynch, 2002, p. 20-22, 30)
the amount of time allowed for completing
a particular set of items on the test
ICON SOURCE: Check Mark by Creative Stall; from the Noun Project

17. FAKULTAS PSIKOLOGI
UNIVERSITAS KATOLIK INDONESIA ATMA JAYA © 2015 Ardhiati PDU 303 PSIKOMETRIK
DESCRIBES WHAT
WILL BE GIVEN TO THE
TEST TAKER.
PROMPT ATTRIBUTES
13
(Davidson & Lynch, 2002, p. 22-25)
directions, instructions, and the form of
the actual item or task, lead to a relevant
“response”
the description of the item or task format
ICON SOURCE: Check Mark by Creative Stall; from the Noun Project

18. FAKULTAS PSIKOLOGI
UNIVERSITAS KATOLIK INDONESIA ATMA JAYA © 2015 Ardhiati PDU 303 PSIKOMETRIK
DESCRIBES WHAT
SHOULD HAPPEN
WHEN THE TEST TAKER
RESPONDS TO THE
GIVEN.
RESPONSE ATTRIBUTES
14
(Davidson & Lynch, 2002, p. 25-26, 30)
a description of how the test taker
response will be evaluated
detailed description of what the test taker
will do to respond the test items
ICON SOURCE: Check Mark by Creative Stall; from the Noun Project

19. FAKULTAS PSIKOLOGI
UNIVERSITAS KATOLIK INDONESIA ATMA JAYA © 2015 Ardhiati PDU 303 PSIKOMETRIK
ESTABLISHES THE
EXPLICIT FORMAT AND
CONTENT PATTERNS
FOR THE ITEMS OR
TASKS THAT WILL BE
WRITTEN FROM THE
SPECIFICATION.
SAMPLE ITEM
15
(Davidson & Lynch, 2002, p. 26-27)
combination of PA and RA in explicit
format
ICON SOURCE: Check Mark by Creative Stall; from the Noun Project

20. FAKULTAS PSIKOLOGI
UNIVERSITAS KATOLIK INDONESIA ATMA JAYA © 2015 Ardhiati PDU 303 PSIKOMETRIK
WHEN THE OTHER
COMPONENTS NEED
SOME REFERENCES;
IT IS OPTIONAL.
SPECIFICATION SUPPLEMENT
16
(Davidson & Lynch, 2002, p. 27)
list of references
ICON SOURCE: Check Mark by Creative Stall; from the Noun Project

21. FAKULTAS PSIKOLOGI
UNIVERSITAS KATOLIK INDONESIA ATMA JAYA © 2015 Ardhiati PDU 303 PSIKOMETRIK 17
WANT TO KNOW MORE?
ALDERSON, J.C., CLAPHAM, C., & WALL, D. (1995). LANGUAGE TEST
CONSTRUCTION AND EVALUATION. CAMBRIDGE: THE PRESS SYNDICATE OF
THE UNIVERSITY OF CAMBRIDGE.
DAVIDSON, F. & LYNCH, B.K. (2002). TESTCRAFT: A TEACHER’S GUIDE TO
WRITING AND USING LANGUAGE TEST SPECIFICATIONS. NEW HAVEN: YALE
UNIVERSITY PRESS.