construct and measure(问卷测量与建构效度)汇总
合集下载
- 1、下载文档前请自行甄别文档内容的完整性，平台不提供额外的编辑、内容补充、找答案等附加服务。
- 2、"仅部分预览"的文档,不可在线预览部分如存在完整性等问题,可反馈申请退款(可完整预览的文档不适用该条件!)。
- 3、如文档侵犯您的权益，请联系客服反馈,我们会尽快为您处理(人工客服工作时间：9:00-18:30)。
From Hinkin (1998)
2021/5/2
12
Step 1: Item Generation-Deductive Approach
Advantages: through adequate construct definitions, items should capture the domain of interest, thus to assure content validity in the final scale
Disadvantages: requires the researchers to
possess working knowledge of the
phenomena; may not be appropriate for
exploratory studies
From Hinkin (1998)
2021/5/2
It requires:
(a) an understanding of the phenomenon to be investigated
(b) thorough review of the literature to develop the theoretical definition of the construct under examination
2021/5/2
7
Construct Definition
Personal computer satisfaction is an emotional response resulting from an evaluation of the speed, durability, and initial price, but not the appearance of a personal computer. This evaluation is expected to depend on variation in the actual characteristics of the computer (e.g., speed) and on the expectations a participant has about those characteristics. When characteristics meet or exceed expectations, the evaluation is expected to be positive (satisfaction). When characteristics do not come up to expectations, the evaluation is expected to be negative (dissatisfaction).
“Validation is an unending process….Most psychological measures need to be constantly evaluated and reevaluated to see if they are behaving as they should.”
theory
Fatal flaws for empirical papers!!!
2021/5/2
2
“The construction of the measuring devices is perhaps the most important segment of any study. Many well-conceived research studies have never seen the light of day because of flawed measures.”
2021/5/2
Nunnally & Bernstein, 1994, p. 84
3
Empirical Research Model From Schwab (1999)
Independent
Conceptual
X’
(a)
Dependent
Y’
(b1)
(b2)
(c)
Operational X
Y
(d)
12345
2021/5/2
9
Construct Validity ChallengesFrom Schwab (1999)
Construct Variance
Systematic Variance
Observed Score Variance
Deficiency
Construct Valid
Variance
12345
3. How quickly the computer performs calculations
12345
4. How fast the computer runs programs
12345
5. Helpfulness of the salesperson
12345
6. How I was treated when I bought the computer
2021/5/2
4
Construct Validation
Involves procedures researchers use to develop measures and to make inferences about a measure’s construct validity
It is a continual process No one method alone will give
1. Independent and dependent variables are identified by X and Y, respectively. 2. The symbol prime, ’ is used to designate that a variable is specified at the conceptual level. 3. Arrows represent the direction of influence or cause. 4. a—conceptual relationship; d---empirical relationship; b1, b2—construct validity; c---internal validity
Step 4: Confirmatory Factor Analysis
Step 5: Convergent/Discriminant Valiion
2021/5/2
11
Step 1: Item Generation -Deductive Approach
Frequently researchers develop scales inductively by asking a sample of respondents to provide descriptions of their feelings about their organizations or to describe some aspects of behavior
13
Step 1: Item Generation - Inductive Approach
Appropriate when the conceptual basis may not result in easily identifiable dimensions for which items can then be generated
Reliable Contamination
Unreliability
2021/5/2
10
Scale Development Process
From Hinkin (1998)
Step1: Item Generation
Step 2: Questionnaire Administration
Step 3: Initial Item Reduction
2021/5/2
Develop/choose a measure consistent with the definition
Perform logical analyses and empirical tests to determine if observations obtained on the measure conform to the conceptual
Schoenfeldt, 1984
“The point is not that adequate measurement is ‘nice’. It is necessary, crucial, etc. Without it we have nothing.”
Korman, 1974, p. 194
definition
•Content validity •Factor analysis •Reliability •Criterion-related •Convergent •Discriminant •Nomological validity
6
Example: Computer satisfaction
2021/5/2
From Schwab (1999) 8
Hypothetical Computer Satisfaction Questionnaire
Decide how satisfied or dissatisfied you are with each characteristic of your personal computer using the scale below. Circle the number that best describes your feelings for each statement.
Responses classified into a number of categories
by content analysis based on key words or themes
or using a sorting process
2021/5/2
14
Step 1: Item Generation - Inductive Approach
Very Dissatisfied
Dissatisfied
Neither Satisfied nor Dissatisfied
Satisfied
Very Satisfied
1
2
My satisfaction with:
3
4
5
1. Initial price of the computer
12345
2. What I paid for the computer
confidence in the construct validity of your measure
2021/5/2
5
Construct Validation Steps
From Schwab (1999)
Define the construct and develop conceptual meaning for it
Advantages: effective in exploratory research Disadvantages:
Without a definition of construct under examination, it is difficult to develop items that will be conceptually consistent
Survey Instrument
Construct and Measurement Related Problems in Manuscripts
✓Too many constructs ✓Constructs are poorly defined ✓Measures do not match constructs ✓Unreliable/invalid measures ✓Level of measurement does not match the level of the
2021/5/2
12
Step 1: Item Generation-Deductive Approach
Advantages: through adequate construct definitions, items should capture the domain of interest, thus to assure content validity in the final scale
Disadvantages: requires the researchers to
possess working knowledge of the
phenomena; may not be appropriate for
exploratory studies
From Hinkin (1998)
2021/5/2
It requires:
(a) an understanding of the phenomenon to be investigated
(b) thorough review of the literature to develop the theoretical definition of the construct under examination
2021/5/2
7
Construct Definition
Personal computer satisfaction is an emotional response resulting from an evaluation of the speed, durability, and initial price, but not the appearance of a personal computer. This evaluation is expected to depend on variation in the actual characteristics of the computer (e.g., speed) and on the expectations a participant has about those characteristics. When characteristics meet or exceed expectations, the evaluation is expected to be positive (satisfaction). When characteristics do not come up to expectations, the evaluation is expected to be negative (dissatisfaction).
“Validation is an unending process….Most psychological measures need to be constantly evaluated and reevaluated to see if they are behaving as they should.”
theory
Fatal flaws for empirical papers!!!
2021/5/2
2
“The construction of the measuring devices is perhaps the most important segment of any study. Many well-conceived research studies have never seen the light of day because of flawed measures.”
2021/5/2
Nunnally & Bernstein, 1994, p. 84
3
Empirical Research Model From Schwab (1999)
Independent
Conceptual
X’
(a)
Dependent
Y’
(b1)
(b2)
(c)
Operational X
Y
(d)
12345
2021/5/2
9
Construct Validity ChallengesFrom Schwab (1999)
Construct Variance
Systematic Variance
Observed Score Variance
Deficiency
Construct Valid
Variance
12345
3. How quickly the computer performs calculations
12345
4. How fast the computer runs programs
12345
5. Helpfulness of the salesperson
12345
6. How I was treated when I bought the computer
2021/5/2
4
Construct Validation
Involves procedures researchers use to develop measures and to make inferences about a measure’s construct validity
It is a continual process No one method alone will give
1. Independent and dependent variables are identified by X and Y, respectively. 2. The symbol prime, ’ is used to designate that a variable is specified at the conceptual level. 3. Arrows represent the direction of influence or cause. 4. a—conceptual relationship; d---empirical relationship; b1, b2—construct validity; c---internal validity
Step 4: Confirmatory Factor Analysis
Step 5: Convergent/Discriminant Valiion
2021/5/2
11
Step 1: Item Generation -Deductive Approach
Frequently researchers develop scales inductively by asking a sample of respondents to provide descriptions of their feelings about their organizations or to describe some aspects of behavior
13
Step 1: Item Generation - Inductive Approach
Appropriate when the conceptual basis may not result in easily identifiable dimensions for which items can then be generated
Reliable Contamination
Unreliability
2021/5/2
10
Scale Development Process
From Hinkin (1998)
Step1: Item Generation
Step 2: Questionnaire Administration
Step 3: Initial Item Reduction
2021/5/2
Develop/choose a measure consistent with the definition
Perform logical analyses and empirical tests to determine if observations obtained on the measure conform to the conceptual
Schoenfeldt, 1984
“The point is not that adequate measurement is ‘nice’. It is necessary, crucial, etc. Without it we have nothing.”
Korman, 1974, p. 194
definition
•Content validity •Factor analysis •Reliability •Criterion-related •Convergent •Discriminant •Nomological validity
6
Example: Computer satisfaction
2021/5/2
From Schwab (1999) 8
Hypothetical Computer Satisfaction Questionnaire
Decide how satisfied or dissatisfied you are with each characteristic of your personal computer using the scale below. Circle the number that best describes your feelings for each statement.
Responses classified into a number of categories
by content analysis based on key words or themes
or using a sorting process
2021/5/2
14
Step 1: Item Generation - Inductive Approach
Very Dissatisfied
Dissatisfied
Neither Satisfied nor Dissatisfied
Satisfied
Very Satisfied
1
2
My satisfaction with:
3
4
5
1. Initial price of the computer
12345
2. What I paid for the computer
confidence in the construct validity of your measure
2021/5/2
5
Construct Validation Steps
From Schwab (1999)
Define the construct and develop conceptual meaning for it
Advantages: effective in exploratory research Disadvantages:
Without a definition of construct under examination, it is difficult to develop items that will be conceptually consistent
Survey Instrument
Construct and Measurement Related Problems in Manuscripts
✓Too many constructs ✓Constructs are poorly defined ✓Measures do not match constructs ✓Unreliable/invalid measures ✓Level of measurement does not match the level of the