In a randomized experiment, chance assigning treatments supports a causal conclusion for the people assigned. To judge a citywide claim, trace who was sampled and who actually responded; nonresponse can make participants unrepresentative even after a random invitation. Check the rate gap in Desmos, then keep cause separate from how far the result reaches. Random assignment supports cause, not representativeness.
Hints
- Hint 1
Nonresponse means some selected households never replied. A random invitation doesn't guarantee the respondents resemble the nonrespondents. Which households were actually tested, and could they differ from other eligible households?
- Hint 2
Random assignment means chance chose which letter each eligible respondent received. That helps separate the effect of the letter from preexisting differences between the two groups. What does it tell you about causation?
- Hint 3
An enrollment rate is the number who enrolled divided by the number who received that letter. Find both rates using the two groups of , then subtract to check the claimed percentage-point gap.
Step-by-step
Separate cause from who the result represents
Step 1Find who reached the experiment
The researchers randomly selected households, but only returned the survey. Of those respondents, were eligible. This nonresponse matters: eligible households that replied might differ from eligible households that didn't, perhaps in their interest in the program. So the eligible respondents aren't necessarily representative of all eligible city households.
- Step 2
Identify what random assignment establishes
The researchers randomly assigned those eligible respondents to the two letters. That means chance, rather than a household's interest in enrolling, chose its letter. With the letter type as the planned difference between groups, the comparison supports a causal conclusion for these eligible respondents.
- Step 3
Find each letter group's enrollment rate
An enrollment rate is enrolled households divided by households receiving that letter. Let be the standard-letter rate and the cost-comparison-letter rate. Type and in Desmos. It shows and , or and .
- Step 4
Check the percentage-point difference
Type below the rates. Desmos shows : multiplying the decimal-rate gap by gives a difference of percentage points. That's a subtraction of the two percentages, not an increase of relative to the standard-letter rate.
- Step 5
Match the conclusion to the households studied
The -percentage-point gap supports a causal conclusion among eligible households that returned the survey. But the researcher claims the effect holds for all eligible households in the city. Because some selected households didn't respond, the study doesn't establish that broader claim. Choice B.