Mobile Compatibility Part 2: The Behavioral Impact of Not Allowing Devices

Excluding mobile devices has an impact on study demographics as mobile respondents are more likely to be younger and non-white. Perhaps more importantly, excluding mobile respondents eliminates those that have different behaviors than their desktop/laptop counterparts.

Eliminating smart phones from surveys can exclude respondents that are much more active online than those who take surveys on tablets or desktops/laptops.

They also differ from a panel profile standpoint. Smartphone survey takers are less likely to be on multiple survey panels, as they are newer to their current panel and take less surveys. Relatedly, smartphone survey takers tend to rate concepts and brands higher than those who take surveys on a laptop/desktop.

Including mobile devices in surveys does come with its challenges.  Common modifications necessary to accommodate mobile device users include reducing survey length, keeping grids to a minimum, and ensuring content can be easily viewed on a smaller screen.  In addition, mobile respondents are less willing to do “extracurricular” research tasks such as participate in a focus group or a product test, and they are more likely to drop out of a survey prior to completion if the survey is too long.

Even with these challenges, we strongly recommend that all surveys are programmed to be device agnostic.  By doing so, you will increase feasibility and create a more representative blend of respondents for your research.