Transcript MESS-LISS SciencePo, seminar 14 dec 2009, Paris

Covering the general population by
Internet interviewing
Marcel Das
1
6-4-2016
MESS Project
• core element: LISS panel
• other key elements:
- core study
- experimental modules
- new forms of data collection
- links with administrative data
2
6-4-2016
- special groups
Core element: LISS panel
 Online panel of 5,000 households

8,000 individuals (>= 16 years)
 Questionnaires each month, 30 min.
 Incentive 15 euro an hour (average)
 For scientific use, at no cost
3
6-4-2016
LISS panel
 Online interviews as method, but:
 Probability sample drawn from address
sampling frame of Statistics
Netherlands
 Includes households without Internet
access (less than 15%): CentERdata
provides equipment
4
6-4-2016
 Contacted by letter, telephone or visit
simPC
Very small and silent
Only the most frequently used functions
Automatic maintenance, safety
Simple operation and readable screens
5
6-4-2016
Installation and support
Recruitment
letter and
brochure
panel
question
short
interview
households
without Internet
simPC
and adsl
confirmation
households with
Internet
Internet
interviews
6
6-4-2016
Secondary
response
target: 60%
Response
letter and
brochure
short
interview
Primary
response
target: 80%
confirmation
simPC
and adsl
Internet
interviews
7
6-4-2016
panel
question
Tertiary
response
target: 53%
Recruitment experiment
Experimental design
CATI
Special
Standard
letter
letter
Prepaid
incentive
Promised
incentive
N
Introduce panel
in letter
Introduce panel
after interview
Introduce panel
in letter
Introduce panel
after interview
0 euro
CAPI
Special
letter
200
0 euro
50 euro
200
6-4-2016
300
50 euro
400
CATI = Computer Assisted Telephone Interviewing
CAPI = Computer Assisted Personal Interviewing
8
Standard
letter
10 euro
20 euro
200
N
10 euro
400
20 euro
300
400
1200
Set up main recruitment
• Combination CATI – CAPI, follow up
CAPI
• Prepaid 10 euro incentive
• Promised extra 10 euro incentive for
starting
• Attention to design letter and brochure
9
6-4-2016
Results
Pilot versus main response rates
0.9
proportion of total
0.8
0.7
0.6
0.5
Pilot
0.4
Main
0.3
0.2
0.1
0
primary
10
6-4-2016
secondary
response
tertiary
Non-response patterns
Similar to those of other leading
scientific panels
Superior to commercial access and
volunteer panels:
- no coverage problems
- no selfselection
11
6-4-2016
Attention for difficult groups
 Correction by oversampling in refreshment of
2009 (with Statistics Netherlands)
12
6-4-2016
 New immigrant panel (with Cross-cultural
Psychology, Tilburg University and Statistics
Netherlands)
Correction of bias by stratified
refreshment sample 2009
Persons
Population
2007
%
April 2008
Bias
April 2009
Bias
Jan 2010
Bias
Age >=70
11.6
-5.4
-5.4
-2.8
Living alone
19.2
-5.4
-5.0
-2.4
Non-western
immigrant
9.6
-5.1
-4.8
-3.7
Group
13
6-4-2016
New forms of data collection
14
6-4-2016
Use of graphical or animated presentation
15
6-4-2016
Biomarkers
pilot study: blood cholesterol, saliva
cortisol, and waist circumference
16
6-4-2016
More biomarker experiments...
- accelerometers
- advanced scales (based on
bioelectrical impedance)
link objective data with self-report
data
17
6-4-2016
high frequency measurement
Use of the LISS panel
18
6-4-2016
Questionnaires
 The “household box”
 Experimental modules open to
academic researchers at no cost
 Core study
19
6-4-2016
Experimental modules
 Who can use the LISS panel:
every researcher who wants to collect
data for scientific, policy or societal
relevant research
Scientific research:
Academic researchers, irrespective of
nationality, can use the LISS panel at no
cost
20
6-4-2016
 Proposals can be submitted throughout
the year
Proposals: Summary (May 2010)
Decision Board of Overseers
21
6-4-2016
Count
Undecided (in review or revision)
14
Accepted
49
Rejected
10
Total
73
Proposals: Examples
Proposal
Perceptions of nutrigenomics
Affiliation(s)
Twente University (NL)
Mental health
Radboud University,
Nijmegen (NL); Emory
University (USA)
Max Planck Institute for
Human Development,
Berlin (Germany)
Leiden University (NL)
Subjective well-being
Computer crime victimization
Volunteer work
22
6-4-2016
University of Duisburg /
Mannheim (Germany)
Open-ended questions
University of Michigan
(US)
Identification of guilt sensitivity University of Laval
(Canada)/Copenhagen
(Denmark)
Available data
 Who can use the LISS data:
every researcher who wants to use data
for scientific, policy or societal relevant
research
 Use of data is free of charge (unless
data are used for research funded by
means of external sources)
23
6-4-2016
 Available data:
 longitudinal core study
 proposed studies
Longitudinal core study
Household and family
Economic situation and housing
Work and schooling
Social integration and leisure
Health
Personality
Religion and ethnicity
Politics and values
24
6-4-2016
LISS data
 Disseminated through website / data
archive: http://www.lissdata.nl
 Database is based on an internationally
used specification for describing social
science data (DDI): one of the first
implementations of DDI version 3
 Search entry with keyword and on
concept, topic, and study (relational)
25
6-4-2016
 Exchangeable with other data archives
October 2010
Publisher: Routledge / Taylor & Francis Group
27
6-4-2016