When you’re doing research in areas with no internet, collecting and analysing the data could be a pain. Lando and David from Health Focus spoke at Qualtrics Converge Europe about how they’re collecting data using the offline app in order to avoid the costly and time-consuming research often needed in low-resource countries.
4. #QualtricsConverge
• Business Focus // Public Health and Social
Development in Sub-Saharan Africa
Who are we?
• Independent Consulting Company //
Developmental politics
• Research // An integral cornerstone of
projects
5. #QualtricsConverge
• Cameroon (German Cooperation): Operational research study to guide design and
contents of a public communication campaign (N=500).
• Democratic Republic of the Congo (Georgetown University): Baseline-endline survey
study to assess the effectiveness and scalability of a USAID funded behavior change
intervention (N=3200)
Example projects from 16/17
6. #QualtricsConverge
• Technical infrastructure, network penetration and access to electricity as
major constraints
• Smart phone use and mobile internet coverage is unbalanced, however
seeing huge growth
• Only proportion of population has access to the internet
Survey Research: Challenges
in Sub-Saharan Africa
7. #QualtricsConverge
• Finding and accessing representative samples of the target group
• Dealing with the fact that only a fraction of the population uses the internet
• Dealing with poor network and electricity coverage particularly in rural areas
• Still using advantages of electronic data collection
Solutions needed for
10. #QualtricsConverge
• Allows you to download and manage your surveys from the Qualtrics Research Suite
• Allows you to work with or without interviewers
• Allows collection of data without active internet connection
• Surveys can be stored on devices for offline use and responses can be submitted
when an internet connection is available
The Qualtrics Offline Surveys App
11. #QualtricsConverge
• Survey logic reduces interviewer induced errors
• No data entry problem (as in paper based surveys)
• (Nearly) live monitoring of data – allows early updates and interventions if errors are
detected
Advantages of the
Qualtrics Offline Surveys App
16. #QualtricsConverge
• Presented approach is applicable to any other subject of interest – given a similar
situation at location
• Sub-Saharan Africa one of the fastest growing markets worldwide – market research
necessary
• Mobile devices and internet access more and more prevalent, but still exclusive and
connection often unstable
• Data that is collected offline in direct interviews with the target group can useful
addition to web survey samples (sample bias / selection bias)
• Data that is collected with interviewers ‚offline‘ allows to survey representative
samples of specific target groups (e.g. users of a specific service or buyers of a
product).
Applicability in other situations
Independent consulting company founded in 2001
Provide consulting services in the field of development politics with a business focus on public health
Policy and law making, Impact evaluation studies, Capacity Building, Public Health marketing campaigns as well as implementation of developmental aid projects on the ground
Strongest regional foothold = Sub-Saharan Africa (DRC / Mozambique / South Africa / Guinea and 13 others): Of around 100 employees that work for us worldwide, 100 in sub-Saharan: Clients: World Health Organization, United Nations, Universities, Governments, as well as private sector clients and NGOs
Out of 160 completed projects, 80 included research components and study assignments
Quantitative Research in terms of project impact evaluations, baseline and indicator establishments or operational research form an integral part of our work
Two selected exemplatory examples ….
-Specifically, Development of a strategy to promote use of modern contraceptives among young women in Cameroon
- Seek provide evidence on the potential of this intervention to shift social norms and increase FP use in urban settings, peri-urban settings and rural areas among clearly defined target groups. Product use of modern cotnraceptives, health services, etc.
In most African countries, particularly the lower-income countries, infrastructure is a major constraint doing business and research: Lack of Electricity / Network Connection / Hardware
48 countries of Sub-Saharan Africa generate roughly the same amount of power as Spain
18-20% of the African population has Internet access -> much less to broadband, unstable [compared to 81% North America or 78% in Western Europe)
38% have access to electricity -> not constant / very strong urban/rural differences between urban and rural population
Internet access is also irregularly distributed among population and countries and not constant: The cost of Internet access (and even more so broadband access) is unaffordable by most of the population. Great parts still live in rural communities or peri-urban settings. -> not representative; both selective regarding urbanity, age, financial and education status
Mobile internet access is now seeing huge growth
- Dealing with unstable or no internet
intelligent answers / solutions to challenges which we are facing in such context?
Central questions is: How can we use digital research and electronic data-collection while not
In order to reach target group interviewers need to be employed. Classically, they used paper-based questionnaires.
Interviewers needed to be trained to follow the written instructions about skipping questions etc. – offline app uses online survey functionality, therefore filters (skip-logic, etc.) can be pre-programmed and errors avoided.
Data is uploaded directly from the devices using the offline app to the Qualtrics servers. Therefore, mistakes during data entry, as are possible in paper based surveys, are excluded.
Regular uploading of data when connection is available allows monitoring of the data in the automatically created report section of Qualtrics and, if necessary, early intervention in case anything goes wrong.
We follow the subsequent steps when setting up and conducting surveys using the offline APP:
Create new user: When interviewers want to download the survey, they will see all the surveys of that user. In order to avoid confusion, we create a new user account for each project, so only the relevant surveys are visible to the interviewer.
Generate API token: Interviewers have to log-in the offline APP using the relevant account data to be able to see and download their surveys. In order to avoid giving the actual account password to interviewers though, an API token is generated. Using the account name and token, interviewers will be able to download the survey, but have no access to the cloud data or administrative privileges.
Set-up survey normally: create questions, select appropriate question types, create survey logic, pretest survey
Download App: APP is downloaded to devices at location with stable internet connection (we provide Android tablets)
Training of interviewers: how to use App (e.g. log-in with Token) and general good interview practice. Necessary for smooth process.
Data collection: Interviewers sample participants based on study design and conduct interviews using the Qualtrics offline app on Android tablets. Responses are stored on the device.
Uploading of data: Data from the individual devices is uploaded to the Qualtrics servers in regular intervals (as specified per individual agreement). It can be accessed using the account and password the survey was created under.
Data monitoring and analysis can be performed as usual with the uploaded data.
Our approach to reach target groups in areas with unstable or patchy internet connection/access while still using the advantages of modern data collection, is applicable to any other subject of interest (e.g. market research,
Last 10 years african countries had the highest economic growth rates worldwide; 2016-2020 average projected growth per annum = 4.8% in subsaharan Africa according to IWF (source: „https://www.gtai.de/GTAI/Content/DE/Trade/Fachdaten/PUB/2016/02/pub201602258001_20658_wachstumsmaerkte-in-afrika---geschaeftschancen-in-ausgewaehlten-branchen--2016.pdf?v=1“)
Areas were grow is particularly strong: Agrobusiness, health industry & environmental technology
Common web survey biases: http://stattrek.com/survey-research/survey-bias.aspx // http://www.tandfonline.com/doi/abs/10.1080/0267257X.2003.9728225