Skip to main content
Loading...
Skip to article
  • Qualtrics Platform
    Qualtrics Platform
  • Customer Journey Optimizer
    Customer Journey Optimizer
  • XM Discover
    XM Discover
  • Qualtrics Social Connect
    Qualtrics Social Connect

Analyzing Model Recall (Studio)


Was this helpful?


This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.

The feedback you submit here is used only to help improve this page.

That’s great! Thank you for your feedback!

Thank you for your feedback!


About Analyzing Model Recall

One of the ways to evaluate the effectiveness of a categorization model is to measure its recall. Recall is the percentage of documents that were categorized into a particular model.

To analyze model recall, you should compare the percentage of documents categorized into the model with the number of documents not categorized. To do this, you can create 2 metrics: one for categorized data, the other for uncategorized data.

Qtip: Interested in exploring your data further? See our pages on Filtering by an Entire Category Model and Exploring Uncategorized Data (global other).

 

Creating a Percent Categorized Metric

  1. Create a metric.
  2. Select Filtered metric.
    creating a filtered metric for percent categorized
  3. Under Based On, select % Total.
  4. Under Conditions, select the category model you’re interested in.
  5. Select categorized.
  6. Save your metric.
Qtip: If a model has root-level rules, the “categorized” condition returns all documents that match the root-level rule. However, no other categories within that model are taken into account. To learn more about these results, see How Root-Level Rules Affect the Categorized Filter.

Creating a Percent Uncategorized Metric

  1. Create a metric.
  2. Select Custom metric.
    building the equation for the custom uncategorized metric
  3. In the equation box, type 1.
  4. Click the minus sign ( )
  5. Use the Metric dropdown to select the Percent Categorized metric you created earlier.
  6. Go to the Format tab.
    formatting the custom metric
  7. Add % as the Suffix.
  8. Set the conversion to X100.
  9. Save your metric.

Displaying the Results

Once you’ve built your metrics, you can display them in widgets like any other metric (for example, displaying 1 value in a metric widget, or displaying both values in a pie widget). These metrics can be used interchangeably depending on your analysis.
2 metric widgets. 1 widget shows the "percent categorized" metric while the other shows the "percent uncategorized"