Skip to main content
Loading...
Skip to article
  • Qualtrics Platform
    Qualtrics Platform
  • Customer Journey Optimizer
    Customer Journey Optimizer
  • XM Discover
    XM Discover
  • Qualtrics Social Connect
    Qualtrics Social Connect

Calculate Metric Task


Was this helpful?


This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

The feedback you submit here is used only to help improve this page.

That’s great! Thank you for your feedback!

Thank you for your feedback!


About the Calculate Metric Task

The Calculate Metric task lets you trigger a response to metric changes calculated in a dataset over a period of time. In other words, you can set up automated workflows based on trends or events you observe in experience data. The results of your calculate metric task can be used to trigger other tasks within your workflow. For example, you can notify your marketing team’s Slack channel when your brand NPS dips by 10% within a period of a week, or you can create a follow-up ticket for your team if more than 100 opt-outs occur in XM Directory within a week.

Setting Up a Calculate Metric Task

  1. Follow the linked directions to set up a scheduled workflow.
  2. Click the plus sign ( + ) and then Task to create a task.Add task button in the Actions tab
  3. Select Calculate metric.
    Selecting the calculate metric task
  4. Here, you’ll specify the data source that contains your data, the metric you’d like to calculate, and the field to perform the calculation on.choosing the data source, metric, and adding filters
    • Source: The survey or dashboard that hosts the data you will be calculating your metric from. All of your available surveys and dashboards will appear in the dropdown. The following project types are eligible:
      • Survey
      • 360 (survey only, no dashboard)
      • Ad Hoc Employee Research (survey only, no dashboard)
      • Engagement (survey only, no dashboard)
      • Lifecycle (survey only, no dashboard)
      • Pulse (survey only, no dashboard)
      • Dashboards (CX)
        Attention: If you are using a dashboard as your source, make sure that the dashboard has been visited at least once in the last 30 days. If it’s been close to 30 days since the dashboard was last visited, you will receive a warning message via email to the email address associated with your Qualtrics account.
        Add task button in the Actions tab
    • Metric: The type of metric you’ll be calculating based on. Choose from the following metric types:
      • Count of records: Display response counts from the selected fields (i.e., number of respondents choosing a value in a five-point scale).
      • Average: Exhibit the average value for a selected field.
      • NPS: Net Promoter Score. Identify the Detractors, Passives, and Promoters from NPS questions.
    • Field: The specific field or question you will be calculating your metric on. This field does not appear if you select “count of records” as your metric type.
  5. If you selected Top Box / Bottom Box, define what falls into this range using the Metric range minimum and Metric range maximum. When the task runs, you will get the percentage of responses that are within this range of values.
  6. If desired, add Filters. This can be used if you’d like to have the metric calculate on a subset of your data. You can filter based on one of the data source’s survey questions or one of your survey’s embedded data fields. You can also filter based on Text iQ sentiments and topics. For more information on setting conditions in filters, visit Creating Conditions.
    adding a filter

    Attention: Some of the resources for condition building use examples in data filtering instead of Workflows. However, the logic behind these conditions are the same.
    Qtip: When setting up the choice field in your filter you have the option to use piped text from your selected survey. Piped text is only available for multiple choice questions and text entry questions.
    Qtip: If you’re using a dashboard data source, all fields will be listed under Question.
  7. Define the time periods you want to compare.
    choosing the calculation type and saving

    • Single time period: The metric will be calculated using data from the chosen time period.
    • Comparison time period: This period is optional. If you select a comparison time period, the metric will be calculated using a comparison between your chosen time periods. The comparison time period is immediately prior to the single time period specified above.
      Example: For example, if I want to calculate the average score over the past 2 weeks, I would select “Over the past day” for the single time period and “Previous 14 days” for the comparison time period.
      Qtip: Check out the graph inside the task for an example comparing these two time periods and the resulting calculation for each.
    Attention: If you select Count of records as your metric type, you can only choose a single time period. The comparison time period option will be grayed-out.
    the comparison time period option is grayed out because "count of records" is the metric
  8. Click Save.
Attention: After completing the above steps, you must create subsequent tasks in order to use the results of the calculate metric task.
Attention: We recommend that you do not have more than 1 execution per hour for a given calculate metric workflow.

Adding Tasks and Conditions

After setting up your calculate metric task, add conditions and tasks to decide what happens next. Conditions act as thresholds; for example, specifying how much a metric should rise or drop before notifying a team. Tasks determine what specifically happens next; for example, sending an email or a Slack message.

Qtip: It’s not required to create a condition for a calculate metric task. For example, if you wanted to create a weekly report with the results of your calculate metric task, you wouldn’t need to add a condition.
  1. If you want to add thresholds, click the plus sign ( + ) and then Conditions.Adding a new condition beneath the calculate metric task
  2. Click Condition.
    Clicking condition under the Any of the following are true dropdown.
  3. Click Select Condition Type and select Tasks.Close up of the actions interface highlighting the conditions type option
  4. Select Calculate metric.
    Close up of the actions interface showing the calculate option

    Qtip: You’ll see the tasks’s ID in this step. This can be helpful if you’re adding multiple calculate metric tasks to a workflow.
  5. Click Select Option to select the calculation type. See linked section for more details.
  6. Define your threshold.
    Example: In the screenshot above, we want to trigger a workflow whenever our metric changes by 3 or more points. This change is measured over an initial and comparison time period defined during setup.
  7. Click the plus sign ( + ) and select Task to what should happen once metrics are calculated and conditions are met. For example, you can send an email, a Slack message, a Microsoft Teams message, or even an in-product notification.
    Adding additional steps with the Add button

    Qtip: Each tasks are labeled with a unique ID (e.g., “T-ID 1,” “T-ID 2”) for easier identification and organization. If you add a calculate metric task after an email task, but you’re piping the results of the calculate metric task into your email task, the tasks will be automatically reordered so that they are in the correct order.T-ID 1 label on the calculate metric task; unique label for each task
Qtip: You can also use piped text to report the results from the calculate metric task in subsequent tasks. For example, if you wanted to include information about your calculate metric task in a subsequent email task, the results from the calculate metric task will be available in the piped text portion of the rich content editor.the calculate metric results available in the piped text menu of an email task

When Calculate Metric Tasks Are Completed

All types of survey responses can cause changes to the metrics calculated in a calculate metric task. This will cause subsequent tasks to trigger under certain conditions.

image of a condition in a calculate metric task

Options differ based on whether you chose only a single time period, or also added a comparison time period.

image of calculate metric task setup, the step where you define time periods

When only a single time period is defined

  • Average: Calculate a threshold based on an average / mean metric.
  • Count of records: Calculate the number of responses collected for this metric, regardless of the metric’s actual score.
  • Standard deviation: Calculate the standard deviation for the metric.

When a comparison time period is defined

  • Absolute change: The aggregate data from the first time period subtracted from the aggregate from the second time period.
  • Comparison time period: If you configure the calculate metric task with the Change over a period of time option, this is the group of output values from the second time period you set in your task.
  • Relative change (%): The aggregate data from the first time period subtracted from the aggregate from the second time period, divided by your aggregate from the second time period.
  • Single time period: If you configure your calculate metric task with the Change over a period of time option, this will be the output values from the initial time period you set in your task.
Qtip: If you decide to select either the Single or Comparison time period, you can then select the Average, Count of records, or Standard deviation of your metric.
Attention: Once a workflow is completed, the scheduled task cannot be deleted. For example, if a response just submitted meets the condition of an email task, and you go to delete the email task, the email for that response is still scheduled.

Troubleshooting Calculate Metric Tasks

This section has links to additional resources that can help you troubleshoot issues related to email tasks.

Qtip: Some of the resources for condition-building use examples in data filtering instead of Workflows. However, the logic behind these conditions are the same.

Filtering by Dashboard Data

When you set up your task, you can base a metric off of data in a survey or off data in a dashboard.

Creating a calculate metric task, and the field select a data source for your metric is open; in the menu that appears, there's a section called Dashboards

If you choose to base your metric off dashboard data, there are a few things you should know before you add a filter to your task.

Make sure all of the data you want to use in this task is mapped to your dashboard. Also make sure to choose the best type for each field. For example, questions scored on a scale should be number sets, whereas options in a list should be text set.

All dashboard data is listed under Question, not Embedded Data. It doesn’t matter what type of data each field originally was in the survey; they’re all listed under “Question” for dashboards.

Below the metric source, it says Filters - optional. This one is set up to say, question, Region, North America is selected

The values you want to filter with might not immediately appear. First, make sure you’ve collected data for the missing values. If you have, it’s time to recode the field.

For the field you want to break out by, make sure you define each of the values you want to use in the recode editor.

Example:  You want to use Region data in your filter. To do so, open the recode editor, click More Options, then Manage Labels.

Recode editor opened in dashboard data settings

Add all of the possible values to the region field. Make sure to match exact spelling and punctuation.

Manage Labels window has a list of regions

Then click Ok and save your dashboard data. For more detailed steps, see Recoding Fields.

Once your fields are recoded, you should be able to add filters to your task.