PSY 361, Dr.Wininger

Specific Course Objectives

Section I

-Discuss different uses of tests and measures

-Discuss key differences between measuring physical versus psychological
constructs, i.e., consistency, directness, precision

-Identify key historical events and figures in psychological testing

-Define measurement

-Differentiate among different levels of measurement

-Calculate and interpret common statistics associated with psychological
testing (e.g., central tendency, variability, shape of distribution,
correlation)

-Define standard deviation

-Identify uses of advanced statistics used for establishing construct validity,
i.e., correlation, various forms of regression, ANOVA, discriminant
analysis, and factor analysis

-Apply the standard normal curve table to standardized and raw data

-Use SPSS for entering data and running basic statistics

Section II

-Discuss classical true score, X = T + E

-Differentiate between systematic and random error

-Explain the assumptions of the classical true score model

-Define reliability

-Differentiate between reliability index and reliability coefficient

-Differentiate among the different reliability coefficients: stability,
equivalence, stability & equivalence, precision, & internal consistency

-Differentiate between the two different types of internal consistency

-Explain inter-rater reliability

-Discuss factors affecting reliability (how do they affect it?)

-Define standard error of measurement (SEM)

-Calculate SEM

-Calculate a confidence interval for an individual score

-Use the formulas which correct for attenuation for a correlation coefficient.

-Use the formula for estimating reliability changes resulting from lengthening
or shortening a test/measure

-Define Validity or Validation

-Discuss face validity

-Differentiate among the 3 major types of validity

-Discuss the process of establishing content validity

-Differentiate between concurrent and predictive validity

-Discuss the process of establishing criterion validity

-Discuss factors affecting criterion validity

-Interpret a criterion validity coefficient

-Calculate the standard error of estimate

-Calculate a confidence interval for an individual’s
predicted score

-Differentiate among the different types of construct validity

-Demonstrate a basic understanding of factor analysis and how factor loadings
are interpreted.

Section III

-Outline the steps to take when creating a measure

-Explain the difference between conceptualization and operationalization

-Differentiate among item formats for performance measures versus attitude,
affect, and personality measures

-Given item frequency distributions, identify ceiling and floor effects

-Calculate and interpret item difficulty values

-Interpret item discrimination values

-Interpret an inter-item correlation matrix, item-criterion correlation values,
alpha if item deleted values, eigen values,
cumulative percentage values, scree plots, factor
loadings,

-Calculate and interpret percentages, z-scores, t-scores, and percentiles

-Interpret stanine scores

-Discuss “faking” in testing

-Discuss means of dealing with faking and undesirable response styles

-Discuss means of detecting test/item bias

-Identify the various positions on fairness

-Discuss the pros and cons of computer testing

-Differentiate between confidentiality versus anonymity

-Identify the three levels of test complexity

Section IV

-Define measurement

-Differentiate among different levels of measurement

-Calculate and interpret common statistics associated with psychological
testing (e.g., central tendency, variability, shape of

distribution, correlation)

-Define standard deviation

-Apply the standard normal curve to standardized and raw data

-Discuss classical true score, X = T + E

-Explain the assumptions of the classical true score model

-Define reliability

-Differentiate among the different reliability coefficients: stability,
equivalence, stability & equivalence, precision, & internal

consistency

-Differentiate between the two different types of internal consistency

-Explain inter-rater reliability

-Define, calculate, and interpret standard error of measurement (SEM)

-Define Validity or Validation

-Discuss face validity

-Differentiate among the 3 major types of validity

-Differentiate between concurrent and predictive validity

-Interpret a criterion validity coefficient

-Differentiate among the different types of construct validity

-Demonstrate a basic understanding of factor analysis and how factor loadings
are interpreted.

-Outline the steps to take when creating a measure

-Explain the difference between conceptualization and operationalization

-Calculate and interpret item difficulty values

-Calculate and interpret percentages, z-scores, t-scores, and percentiles

-Given an article on the development of an instrument, demonstrate your ability
to evaluate the psychometric properties of the instrument.