The development of the web survey has led to significant strides in questionnaire survey methodology, including its potential to substantially increase sample sizes at minimal costs. Despite its ...advantages, web surveys typically achieve lower response rates from participants compared to more conventional survey methods.
The aim of this review was to evaluate strategies to increase the response rate to web surveys.
CINAHL (EBSCO), MEDLINE Complete, the Cochrane database of systematic reviews, the Cochrane central register of controlled trials and Psych Info were searched, from inception to the 24th of June, 2021. The Boolean search phrase (Ti: Web survey* OR online survey* OR internet survey*) AND (Ti: response rate* OR nonresponse* or participation rate*) was used. This was supplemented by a secondary search of the reference lists. To be eligible for inclusion in the review, papers had to evaluate one or more strategies to improve response rates to web surveys. Experimental and quasi experimental studies were included in the review.
A total of 159 papers were identified. Following removal of duplicates, and further screening by two independent reviewers, 45 papers met the inclusion and exclusion criteria, and were included in the final review. The use of e-mail pre-notification, email invitation and two reminders were found to increase response rates to web surveys as do the use of a semi-automatic log-in, a simple design and a short survey which takes around 10 min to complete. Incentives, including entry into a prize draw with a cash prize considered to be of value to the participants also increase response rates.
Research studies are needed to explore whether the different strategies used by researchers with the intent to improve response rates are acceptable to potential participants and to evaluate the potential synergistic effect of combinations of several strategies identified in this review.
Tweetable abstract: Email prenotification, email invitation, 2 reminders, simple 10 min design and lottery incentives improve response rates to web surveys
Background
A web-based survey is a novel method for data capture. Some studies have applied web-based surveys in pediatrics, but few of them have reported data on the differences between web-based ...and traditional questionnaire surveys.
Objective
The objective of our study was to evaluate the internal consistency of a web-based survey and compare it with a traditional questionnaire survey in pediatrics.
Methods
A convenience sample of caregivers was invited to participate in the survey on feeding patterns and their children’s eating behaviors if their children were aged 2 to 7 years. A web-based survey and a traditional questionnaire survey were carried out between October 2018 and July 2019. A total of 1085 caregivers were involved in this study, and they were divided into the following three groups based on methods and sources: (1) web-based survey from a web source, (2) web-based survey from a hospital source, and (3) traditional questionnaire survey from a hospital source. The data were then compared and analyzed.
Results
A total of 735 caregivers participated in the web-based survey and 350 caregivers participated in the traditional questionnaire survey, and 816 cases were then included in the analyses after data processing. The effective rate of the web-based survey was 70.1% (515/735), and the completeness rate of the traditional questionnaire survey was 86.0% (301/350). There were no significant differences between web-based surveys from different sources. However, demographic characteristics were significantly different between the web-based and traditional questionnaire surveys, mainly in terms of age and caregivers (χ²4=16.509, P=.002 and χ²4=111.464, P<.001, respectively). Caregivers of children aged 2 to 3 years and grandparents were more likely to respond to the web-based survey. Age-specific stratified analysis showed that the score of “monitoring” and the reporting rate of “poor appetite” in children aged 2 to 3 years were significantly higher in the web-based survey compared to the traditional questionnaire survey after adjusting for demographic characteristics.
Conclusions
A web-based survey could be a feasible tool in pediatric studies. However, differences in demographic characteristics and their possible impacts on the results should be considered in the analyses.
Understanding Society is a household panel survey with continuous fieldwork (monthly samples) using a mixed mode design. Prior to March 2020, around half of all interviews were carried out ...face-to-face, amounting to around 1,150 interviews per month. This article outlines how the survey rapidly transitioned to a protocol without face-to-face interviews and presents some initial indicators of the impact of the change on field outcomes.
Despite the growing popularity of online opt-in samples in criminology, recent work shows that resultant findings often do not generalize. Not all opt-in samples are alike, however, and matching may ...improve data quality. Replicating and extending prior work, we compare the generalizability of relational inferences from unmatched and matched opt-in samples. Estimating identical models for four criminal justice outcomes, we compare multivariate regression results from national matched (YouGov) and unmatched (MTurk) opt-in samples to those from the General Social Survey (GSS). YouGov coefficients are almost always in the same direction as GSS coefficients, especially when statistically significant, and are mostly of a similar magnitude; less than 10% of the YouGov and GSS coefficients differ significantly. By contrast, MTurk coefficients are more likely to be in the wrong direction, more likely to be much larger or smaller, and are about three times as likely to differ significantly from GSS coefficients. Matched opt-in samples provide a relatively inexpensive data source for criminal justice researchers, compared to probability samples, and also appear to carry a smaller generalizability penalty than unmatched samples. Our study suggests relational inferences from matched opt-in samples are more likely to generalize than those from unmatched samples.
Abstract Do web surveys still yield lower response rates compared with other survey modes? To answer this question, we replicated and extended a meta-analysis done in 2008 which found that, based on ...45 experimental comparisons, web surveys had an 11 percentage points lower response rate compared with other survey modes. Fundamental changes in internet accessibility and use since the publication of the original meta-analysis would suggest that people’s propensity to participate in web surveys has changed considerably in the meantime. However, in our replication and extension study, which comprised 114 experimental comparisons between web and other survey modes, we found almost no change: web surveys still yielded lower response rates than other modes (a difference of 12 percentage points in response rates). Furthermore, we found that prenotifications, the sample recruitment strategy, the survey’s solicitation mode, the type of target population, the number of contact attempts, and the country in which the survey was conducted moderated the magnitude of the response rate differences. These findings have substantial implications for web survey methodology and operations.
Impactos da COVID-19 nos direitos humanos Andréa D. Silva; José Ricardo Cunha; Elizabeth B. Hypolito ...
Revista de Estudos Empíricos em Direito,
01/2023, Volume:
9
Journal Article
Peer reviewed
Open access
O conceito de direitos humanos não é consensual, contudo, persiste na cultura moral, política e jurídica do mundo moderno. O Estado sempre ocupou um lugar ambíguo e dialético, sendo hora diretamente ...ou indiretamente responsável pela ofensa, hora responsável pela proteção de direitos. Para além do aspecto da legitimidade, a pandemia da Covid-19 remeteu a um problema bem mais contundente relacionado com a política adotada pelo Governo brasileiro e seus efeitos. Para conhecer a percepção de moradores da cidade do Rio de Janeiro sobre diferentes aspectos relacionados com os impactos da Covid-19 sobre 5 direitos básicos: saúde, educação, liberdade de ir e vir, trabalho e renda, e voto, foi realizada uma pesquisa quantitativa do tipo web survey. Para alcançar os respondentes foi utilizado o método bola de neve, resposta e repasse do questionário, tendo como ponto de partida os contatos pessoais dos autores, docentes e discentes da ENCE, discentes da Faculdade de Direito da UERJ e servidores do IBGE. Como resultado, a grande maioria dos respondentes identificou os cinco direitos citados como Direitos Humanos e revelou acreditar que: 1) há responsabilidade do poder público, seja por ação ou omissão, nas limitações de direitos; 2) a restrição de algum dos direitos mencionados é justificável durante a pandemia; 3) os impactos das limitações de direitos sobre as classes socioeconômicas mais baixas foi maior; 4) estão insatisfeitos com a atuação do Governo Federal no que se refere a criação de medidas para amenizar os impactos da pandemia da Covid-19 e com o nível de rapidez, eficácia e rigidez das medidas adotadas; e, por fim, 5) que estão cumprindo as regras de isolamento social ao mesmo tempo em que outros moradores da cidade do Rio de Janeiro não estão.
The crisis of forced migrants from Ukraine due to the war became one of the biggest in Europe in the 20th–21st centuries. A large increase in the number of refugees due to the war in Ukraine occurred ...after the start of the active phase of hostilities on February 24, 2022. Germany remains one of the countries that received the largest number of forced migrants from Ukraine. It is relevant to study the living conditions, employment, lifestyle, leisure time, well-being and future plans of forced migrants from Ukraine in Germany (using the example of the city of Konstanz). We conducted an exploratory web survey: respondents were interviewed using a formalized questionnaire with a series of open-ended questions implemented on the LimeSurvey online platform. Based on the results of the analysis, the main problems faced by Ukrainian refugees in the city of Konstanz were identified: living conditions and the lack of places in kindergartens. Both problems are characteristic of this city for many years before the war in Ukraine. Among the main features that distinguish forced migrants from Ukraine in connection with the war is a large share of highly qualified persons and persons with completed higher education. Plans for further stay in Germany or return to Ukraine deserve special attention – almost half of the respondents said that they plan to stay in Germany forever, and almost all the rest - to return to Ukraine as soon as it becomes possible. This information also brings new challenges for the country's migration policy and needs further discussion.
In addition, a high sensitivity to questions about the property and financial status in Ukraine before the start of the Russian attack in 2022 was revealed.
While the supply of cannabis is commonly assumed to be dominated by criminal gangs, a sizable share of the domestic cannabis supply is provided by small-scale growers. This article examines the ...nature and scope of small-scale growers’ distribution practices, with a particular focus on cross-country differences and variations between different types of grower-distributors, i.e., “non-suppliers”, “exclusive social suppliers”, “sharers and sellers” and “exclusive sellers”.
Based on a large convenience web survey sample of predominantly small-scale cannabis growers from 18 countries, this article draws on data from two subsamples. The first subsample includes past-year growers in all 18 countries who answered questions regarding their market participation (n = 8,812). The second subsample includes past-year growers in 13 countries, who answered additional questions about their supply practices (n = 2,296).
The majority of the cannabis growers engaged in distribution of surplus products, making them in effect “grower-distributors”. Importantly, many did so as a secondary consequence of growing, and social supply (e.g., sharing and gifting) is much more common than selling. While growers who both shared and sold (“sharers and sellers”), and especially those who only sold (“exclusive sellers”), grew a higher number of plants and were most likely to grow due to a wish to sell for profits, the majority of these are best described as small-scale sellers. That is, the profit motive for growing was often secondary to non-financial motives and most sold to a limited number of persons in their close social network.
We discuss the implications of the findings on the structural process of import-substitution in low-end cannabis markets, including a growing normalization of cannabis supply.
Past research indicates interviewer effects lead to an underestimation of network size and higher nonresponse to the “important matters” name generator. Self-administered surveys offer a potential ...solution, but evidence is mixed and context-specific. We employ a logistic multilevel regression, estimated using a Bayesian Markov Chain Monte Carlo approach, to analyze nonresponse to this name generator from 33 post-electoral surveys across 21 countries in the Comparative National Election Project. We find higher nonresponse in interviewer-administered surveys compared to self-administered surveys, particularly among specific demographic groups. Finally, we discuss the trade-offs in selecting survey modes for collecting ego-network data using this instrument.
•Cross-country analysis of interview modes and nonresponse to the name generator.•Positive association between interviewer-administered surveys and nonresponse.•Consistency with prior studies on survey modes and nonresponse behavior.•Exploration of interplay between interviewer presence and respondent characteristics.•Caution advised in interpreting nonresponse as a sole indicator of social isolation.
This study examines the use of trap questions as indicators of data quality in online surveys. Trap questions are intended to identify respondents who are not paying close attention to survey ...questions, which would mean that they are providing sub-optimal responses to not only the trap question itself but to other questions included in the survey. We conducted three experiments using an online non-probability panel. In the first experiment, we examine whether there is any difference in responses to surveys with one trap question as those that have two trap questions. In the second study, we examine responses to surveys with trap questions of varying difficulty. In the third experiment, we test the level of difficulty, the placement of the trap question, and other forms of attention checks. In all studies, we correlate the responses to the trap question(s) with other data quality checks, most of which were derived from the literature on satisficing. Also, we compare the responses to several substance questions by the response to the trap questions. This would tell us whether participants who failed the trap questions gave consistently different answers from those who passed the trap questions. We find that the rate of passing/failing various trap questions varies widely, from 27% to 87% among the types we tested. We also find evidence that some types of trap questions are more significantly correlated with other data quality measures.