Dr. Jethro

Coursework Entry

7 Instrumentation

Notes

What are data

  • Just the information researchers get from their research participants.
  • Ask where, when, how often, and who will collect the data.

    Instrumentation

  • Everything you do to collect that data
  • Preferred to select an already available instrument, rather than create your own.
  • Here are some results from ERIC
  • Better results from ERIC
  • Get instruments here:
    • http://ericae.net
    • http://ets.org/testcoll - dead link
    • https://marketplace.unl.edu/buros/

    • Validity and Reliability

  • Valid: “ Extent to which results from it, permit researchers to draw warranted conclusions about the characteristics of the individuals studied” (p. 138) - Can we draw conclusions from it?
  • Reliable: Does it provide consistent results?

    Objectivity and Usability

  • Objectivity - make it not subjective. Could someone else come to the same conclusions looking at the data?
  • Usability - Is it easy enough for someone to use without a lot of training. APLUS Framework

Ways to Classify Instruments

  • Who provides the data, method of collection, who collects it, kind of response from participants.
  • “ Research data are obtained by directly or indirectly, assessing the subjects of a study” (p. 138).
  • Self-report
  • Informant - provided by other people about the subjects (mom answering for her kids)

    Types of Instruments

    | Researcher-completed | Subject Completed | | —- | —- | | rating scales | questionairres | | Interview schedules | self-checklists | | Observation forms | Attitude Scales | | Tally Sheets | Personality inventories | | Flow Chart | Achievement, aptitude and performance tests | | Performance Checklists | projective sociometric devices | | Anecdotal Records | | | Time and Motion Logs | |

  • Sociogram - related to another idea in The Anatomy of Peace.
  • Selection (choose from a choice) or Supply (supply your own short essay)
  • ERIC Database
  • Unobtrusive - no intrusion into what’s already happening.
  • “in general qualitative, researchers, believe a researchers, worldview, or theoretical framework, greatly influences, how research studies are designed and the results and interpreted” (p. 117) see more in Chapter 18 Philosophical Assumptions

  • Norm-Referenced vs. Criterion Referenced Instruments

  • Norm-Referenced: “Instruments that provide scores that compare individual scores to the scores in appropriate reference group” (p. 139)
  • Criterion-Referenced: “Instruments that are based on a specific target for each learner to achieve” (p. 139).

    Measurement Scales

    See two basic types of variables-quantitative and categorical. Ordered from Least information to Most Information:

  • Nominal - “numbers to indicate membership”
  • Ordinal - “numbers to rank scores high to low”
  • Interval - “numbers to represent equal intervals in different segments on a continuum”
  • Ratio - “numbers to represent equal distance from a zero point”measurement scales.jpeg
  • A question I still have: how will I know which of these is the right scale to use?

    Preparing Data for Analysis

  • scored accurately and consistently
    • advice: practice scoring with another person before doing it with the sample group.
  • tabulating and coding

Jethro Dissertation Instrumentation