研究设计实验研究的基本问题31

Design 2: The One-Group Pretest-Posttest Design
O1
X
O2
Design 3: The Static-Group Comparison
X
O1
O2
True Experimental Designs
Design 4: The Pretest-Posttest Control Group Design
Pretest
Stimulus
Exp.
Posttest
Randomization Or matching
Control
Comparability
Compare
Compare
Staging Experiments
Pretesting
Subject recruitment
Intro to experiment
6.
– Can results be generalized (external validity)? – Are the relationships true (internal validity)? – Time order if necessary
Key: Dealing with rival hypotheses (another example)
Within subjects design: X1
O1
X2
O2
Each subject acts as his/her own control – that is, O1 is compared with O2 for
each subject.
Quasi-experimental Designs
1. Manipulation 2. Control
To test hypotheses, the experimenter deliberately introduces changes into the environments of subjects and observes or measures the effects of the changes.
1. Even without the program, no more than 30% would have been arrested
2. Family background: Volunteered are different 3. Committed crimes but not been caught 4. Only temporary effects 5. Participation labels them as potential criminals
研究设计实验研究的基本问题31
单击此处添加副标题内容
研究设计:实验研究的基本问题
School of Public Administration & Policy Dr. Kaifeng Yang
问题
研究设计的核心要诣 实验设计的基本过程和环节 实验设计的影响因素
Given the research question, what type of evidence is needed to answer the question (or test the theory) in a convincing way?
True experimental designs are those designs that meet the basic requirements for an experiment.
Pre-experimental Designs
Design 1: The One-Shot Case Study XO
Field experiments: studies that meet all the requirements of a “true” experiment but are conducted in a natural setting.
Experimental designs in survey research Unit of analysis other than individuals
Why? Making decisions to ensure validity
Planning: how to collect, analyze, and interpret data in order to test hypotheses
1. Who 2. Where 3. What 4. How 5. When
Stimulus
Exp.
Posttest
Randomization Or matching
Control
Comparability
Compare
Compare
Pre-experimental vs. True Experimental Designs
Pre-experimental designs are designs that contain one or more features of true experimental design features, such a comparison group or random assignment.
The New Design
1. Two groups: similar characteristics relevant to delinquency; one attend the program, another not.
2. Interview both groups about delinquent activity and family background before the program
Random Assignment vs. Random Sampling
Random sampling is a method of drawing a sample of cases, such as the pool of subjects in an experiment.
Random assignment is a method of assigning subjects from the pool to experimental conditions.
3) Interrupted time-series design
O1 O2 O3 O4
X O5 O6 O7 O8
4) Multiple time-series design
O1 O2 O3 O4 O1 O2 O3 O4
X O5 O5
O6 O7 O8 O6 O7 O8
Experimentation Outside the Laboratory
Quasi-experimental Designs
1) Separate-sample pretest-posttest design
O1
X
R
X
O4
2) Nonequivalent control group designs
O1
X
O2
R
O3
O4
Quasi-experimental Designs (3)
Academic Achiv.
When you observe X and Y co-vary, the reason may be:
1x
y 2x
y
z
z
3x
y
z
4x
y 5x
y
z
z
6x
y
z
Coping with Rival Hypotheses
Operation Fright -- Juvenile Delinquency Visit prison…months ….70% not arrested
Two groups Randomization Treatment manipulation Pre and post-tests on the dependent variable Control of the environment of the experiment
Pretest
records for both groups 6. Two years after the visit, repeat steps 4 and 5 7. Three years after, repeat 4 and 5.
问题
研究设计的核心要诣 实验设计的基本过程和环节 实验设计的影响因素
School type
Academic Achiv.
Child’s ability Parent resource
Home facility School type
School type Academic Achiv.
Academic Achiv.
Parent education value
Child valuation School type
3. Interview all families 4. One year after the visit, interview both groups
about delinquent activity and changes in family 5. During step 4, also check arrest and conviction
Evidence of the versatility of experimentation comes from the incorporation of experimental design methodology into sample surveys and from the use of units of analysis other than individuals.
Experimental Design
Experimental Design (Randomized Controlled)
Group Exper. Control
Random.
wenku.baidu.comRe Rc
Obser.1 Treat Obser.2
Oe1
X
Oe2
Oc1
Oc2
Comparison
Oe2-Oe1 Oc2-Oc1
The quasi-experimental design falls into four subdivided categories, including 1) the separate-sample pretest posttest design, 2) Non-equivalent control group designs, 3) interrupted time-series design, and 4) multiple time-series design.
Manipulation of indep variable
Measurement of dep variable
Debriefing
Acquisition of informed consent
Random assignment
Manipulation check
Key Features of Experimental Approach
Quasi-experimental designs lack some features of a true experimental design, “but permits stronger inferences about cause and effect than pre-experimental designs, by means of special design features and supplementary data.”
O1
X
O2
R
O3
O4
Design 5: The Posttest Only Control Group Design
X
O2
R
O4
True Experimental Designs (2)
Design 6: The Solomon Four-Group Design
O1
X
O2
O3
O4
R
X
O5
O6
Designs 4-6 are called between-subjects designs because different groups of subjects are compared with one another.