Skip to main content
Skip to article
  • Qualtrics Platform
    Qualtrics Platform
  • Customer Journey Optimizer
    Customer Journey Optimizer
  • XM Discover
    XM Discover
  • Qualtrics Social Connect
    Qualtrics Social Connect

Analysis Settings

Was this helpful?


This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

The feedback you submit here is used only to help improve this page.

That’s great! Thank you for your feedback!

Thank you for your feedback!

About Analysis Settings

The Analysis Settings in Stats iQ allow you to change details of analyses within Stats iQ. To access Analysis Settings, click the gear icon in the upper-right corner of the workspace. If you would like to know more about variable settings instead, visit the Variable Settings page.
image of the gear icon in the top right hand corner of the Stats iQ workspace used to access analysis settings

Weighting

image of the weighting option in analysis settings

The Weighting option in Analysis Settings allows you to apply weights to your entire workspace. To choose a weight, click the dropdown menu next to the Weighting option and choose the weight you’d like to apply to your analyses.

Qtip: “Qualtrics-defined weighting” is any weighting set up in the Weighting section of the Data & Analysis Tab.
Qtip: For more information on creating weighting variables in Stats iQ, read the Creating & Applying Weights page.

Default Sampling Level

image of the default sampling level option in Analysis Settings

Attention: You will only see this option if your dataset contains more than 10,000 responses. Sampling will be automatically applied if your dataset contains more than 200,000 responses.

Under “Analysis Settings,” you can change the default sampling for your entire Stats iQ analysis. By default, the sampling level is set to 10,000 responses. This is because of the following:

  1. Statistical analyses run on 10,000 responses will be very similar to those run on even much larger sample sizes.
  2. Analyzing 10,000 responses instead of 200,000 and above improves processing speeds.

You may adjust the Default sampling level by clicking the dropdown menu. The minimum is 10,000 responses. The maximum is your entire dataset.

Samples are taken before weights are applied. However, if you choose to apply a filter, sampling takes place (or is reevaluated) after the filter is added.

Card Settings

Sometimes you may want to adjust the sampling on an analysis-by-analysis basis. To change the sampling on a single card, click the dropdown in the upper-left that says sampled down to X.

Sample down to dropdown menu in upper-left of a Relate card

Confidence Level

image of the confidence level option in analysis settings

Setting the confidence level in Stats iQ indicates how confident you would like to be that the results generated through the analysis match the general population. To change your Confidence Level, use the dropdown menu next to the Confidence Level option in Analysis Settings.

If you select the Describe analysis option for a variable that contains data on location, Stats iQ will display a confidence interval (in the form of error bars) on the graphical output. If the confidence level is set to 95%, this width of the error bars indicates that, if we were to sample the population multiple times, we would expect that the results would fall within the bars 95% of the time.

Confidence interval error bars. Look like gray lines at the end of the blue bar of results, showing margin of error to either side of result

Stats iQ will also indicate explicitly the range of the confidence interval when hovering over graphs for categorical data and at the top of the card for numerical data.

Confidence interval associated with graph

The same logic applies to statistical tests created using relate, coefficients produced in regression, and several other statistical calculations in Stats iQ.

By a wide margin, the most commonly used confidence level is 95%. It’s also relatively common to see 90% in business settings, or 99% or higher in scientific settings when there is a lot of available data.

Analysis Mode

image of the analysis mode option in analysis settings

Attention: This option will appear only for Imported Data Projects.

The Analysis Mode option is used to customize your Stats iQ workplace for analyzing survey data. When this setting is enabled, “Sum” calculations will be hidden from your analyses since this metric usually isn’t relevant in a survey context.

Order Relate Results By

image of the order relate results by option in analysis settings

The Order Relate results by option determines how your relate cards are ordered in your workspace. When this option is enabled, your relate analyses will appear in order of statistical significance and effect size, with the strongest relationships appearing first. If this option is disabled, your relate analyses will appear in the same order as the variables appear in the variable pane.

Qtip: Multiple relate cards are created when more than one variable is selected in addition to the key variable, before the Relate analysis button is selected. For more information, visit the page on relating data.

FAQs