A More Intentional Approach to Sample Design

Want to know a dirty secret in the online sample world? Sample panel bias exists and affects the results of studies on a daily basis.

This is because online sample panel have their own respondent composition, recruitment methods, behaviors, strengths, and limitations. Those characteristics can also change over time, creating differences in awareness, attitudes, behaviors, brand ratings, and concept evaluations.

Combining multiple sample sources is common, but not every approach is designed with data quality or representation in mind. In many cases, providers are added primarily to reach feasibility, fill quotas, or accelerate fieldwork. This can involve either stacking or aggregating panels, in which sources are combined to meet a feasibility goal without fully accounting for differences in panel composition, recruitment practices, respondent behavior, or potential introduced bias.

Because online sample panels differ from one another and change over time, stacking or aggregating them can introduce inconsistencies into the data. Adding more providers does not automatically create a stronger sample plan, particularly when source selection and allocation are not carefully controlled.

That’s why you need Strategic Sample Blending

Sample Bias Problems

Sample Source Bias

Running Out of Sample

Poor Quality

Data Inconsistencies

Ready to Get Started?

Different Ways to Combine Sample

Stacking
This form of combining sources has a panel provider add as many additional panel providers as possible to a core asset to achieve the required feasibility. No care is given to panel makeup, respondents’ attitudes and behaviors, or panel bias.
Aggregating
This form of combining multiple sources is similar to stacking, but you are starting with a core asset. You are just combining panels to reach a feasibility goal; this could mean 2 panels or 20 panels.
Blending
This is the process of combining 3 or more providers, but in a more planned and intentional method, with no provider getting more than 50% of the total allocation.

What is Strategic Sample Blending?

EMI’s Strategic Sample Blending methodology takes a more deliberate approach to combining sample. We intentionally select complementary sample providers and manage their contribution to the study based on the audience, objectives, feasibility requirements, and potential data risks. The result is a customized blend designed to improve representation, support more consistent fieldwork, and reduce the behavioral, attitudinal, and source-related effects that can influence research outcomes.

Every project has different feasibility requirements, target audiences, incidence rates, quotas, and research objectives. EMI develops each sample blend around those requirements rather than trying to make the study fit a particular panel or existing sample asset.

By selecting complementary sources and managing their allocation, EMI can reduce single-source dependency, improve overall feasibility, limit the need for late-stage top-up sample, and help maintain greater consistency throughout fieldwork.

Tracker studies research graphic

Our team considers factors such as:

  • Target audience and demographic composition
  • Respondent attitudes and behaviors
  • Historical partner performance
  • Feasibility and quota requirements
  • Study methodology and complexity
  • Geographic coverage
  • Data quality risks
  • Requirements for trackers or recurring waves

Quality Starts With the Sources We Select

Strategic Sample Blending is supported by EMI’s broader, layered approach to data quality. Every panel provider in our network must complete our rigorous Partner Assessment Process, which evaluates the consistency, reliability, and integrity of its sample. Only a limited percentage of providers meet EMI’s inclusion standards, and continued participation is never guaranteed.

Using our proprietary Quality Optimization Rating, we monitor partner performance across multiple stages of the research process. This includes pre-study traffic health, in-survey respondent behavior, and post-study data-validation measures. Providers that do not maintain our standards are addressed through our partner feedback process or removed from the network. 

This continuous evaluation helps ensure that Strategic Sample Blending is not merely the combination of available sources. It is combining carefully vetted sources whose quality and performance are actively monitored over time.

Vetted sample sources. Magnifying glass showing 5 person icons.

Broader Range of Sample Sources

Depending on the needs of the study, EMI can build blends using multiple types of sources, including:

  • Traditional online panels
  • Specialty panels
  • Expert network
  • Social media sources
  • Custom communities
  • Other controlled, non-traditional sources

EMI maintains a global network of more than 150 panel partners, supplemented by relationships with specialized expert networks. This breadth gives our team the flexibility to develop a sampling strategy around the audience rather than defaulting to a single source.

Informed by Ongoing Research-on-Research

Panel composition and respondent behavior can evolve, which means a successful blend should not remain static
indefinitely. EMI conducts ongoing research-on-research to evaluate changes across the sample landscape and identify differences in respondent attitudes, behaviors, and quality between sources. 

New providers are also included in this research to establish a baseline before they are fully incorporated into client sample plans. These findings help our team understand how sources differ, where potential bias may exist, and which combinations are most appropriate for different audiences and methodologies. 

This evidence-based approach allows EMI to continually refine sample strategies rather than relying solely on historical performance or provider claims.

Data Quality Protection Throughout Fieldwork

Once a customized blend has been developed, EMI applies layered quality controls to help protect the study as respondents move through the research process. These can include:

  • Layered bot and fraud detection
  • Proprietary digital fingerprinting and de-duplication
  • Respondent activity-level tracking
  • Centralized block-list controls
  • Real-time traffic and quality monitoring
  • Proactive project oversight
  • Post-study validation and data scrubbing

By monitoring quality across the entire blend, EMI can identify risks that may extend across multiple panels or studies
rather than viewing each source in isolation. This broader perspective helps prevent duplicate respondents, known
fraudulent participants, excessive survey takers, bots, and other low-quality traffic from compromising the data.

Expert Management From Planning Through Completion

Technology and methodology are only part of an effective sample strategy. EMI’s experienced research management team works as an extension of your organization, providing strategic consultation, hands-on fieldwork oversight, and proactive communication throughout the study.

Our team monitors provider performance, sample allocation, quota delivery, traffic patterns, and quality indicators across the blend. When conditions change, we can adjust the strategy while preserving the integrity of the original sample design.

The result is a customized and controlled approach that combines the reach of multiple providers with the transparency, quality oversight, and expert management needed to deliver more reliable data and support confident decisions.

Ready to Get Started?

Request a free consultation with one of our expert sample consultant.
Awareness levels can vary by as much as 25 percentage points
Based on your sample provider selection
Brand ratings can vary by as much as 20 percentage points
Based on your sample provider selection
Concept ratings can vary by as much as 30 percentage points
Based on sample provider selection

Benefits of Strategic Sample Blending

A carefully designed and actively managed sample blend can provide:

Reduced single-source bias

More representative sample composition

Improved feasibility

Greater quota-delivery flexibility

Better consistency across the study

Less reliance on top-up sample

Faster and more controlled fieldwork

Broader access to specialized audiences

Reduced data-quality risk

Greater confidence in research outcomes

Best Applications for Strategic Sample Blending

Strategic Sample Blending can support a wide range of quantitative research, including:

  • Ad hoc studies
  • Concept testing
  • Brand and awareness research
  • Customer experience studies
  • Political and public opinion research
  • Global and multi-market research
  • Tracker studies
  • Recurring wave studies
  • Other complex sample designs

Get Started Today

Connect with one of our expert sample consultants to learn how your studies can benefit from strategic sample blending.