Qualtrics Platform
Customer Journey Optimizer
XM Discover
Qualtrics Social Connect

Comment Summaries Widget (EX)

Qtip: This page describes functionality that we intend to release starting June 20, 2024. Qualtrics may, in its sole discretion and without liability, change the timing of any product feature rollout, change the functionality for any in preview or in development product feature, or choose not to release a product feature or functionality for any reason or for no reason.

Attention: This feature is only available to users on the new simplified pricing and packaging plans for Employee Experience. If you have questions about your Qualtrics pricing and packaging plan, reach out to your account team.

About the Comment Summaries Widget

The comment summaries widget takes your team’s responses to open feedback questions and uses AI to create insightful summaries and highlight key topics. This widget is ideal for very large teams and organizations, where it can be difficult to go through thousands of individual responses. With the help of Text iQ, this widget allows you to quickly identify top themes and topics.

Because this widget efficiently summarizes large amounts of data, we recommend this widget for large teams, where it may not be possible to read each individual comment. Keep in mind that you will also need to have enough responses to exceed anonymity thresholds. To learn more about response limits for this widget, see Understanding the Comment Summaries Widget below.

Qtip: To use this feature, a Brand Administrator must enable Allow third party generative AI features for the organization. See Organization Settings.

Qtip: Once this feature is enabled, this functionality is only compatible with Engagement, Lifecycle, Pulse, and Ad Hoc Employee Research projects. For more details on each, see Types of Employee Experience Projects.

Field Type Compatibility

Each part of this widget is only compatible with the field types listed:

Text question fields: Open Text
Demographic fields: Participant metadata (Text Set, Multi-Answer Text Set)

Setting Up Text iQ

Before you create a comment summaries widget, you need to set up Text iQ in your EX project.

Go to your Engagement, Lifecycle, Pulse, or Ad Hoc Employee Research project.
Open the Data & Analysis tab.
Go to Text iQ.
If you haven’t already, set up Text iQ.
Qtip: You may need to update your dataset with enrichments.
Create topics.

Qtip: If you’re not sure where to start, try some expert-designed topics from the Qualtrics library. We offer premade topics specifically designed for Employee Experience research!
Apply your changes.
Qtip: Wait until your text analysis is done loading to perform the next steps. You can leave the page while this happens.
Follow these steps to map Text iQ data.

Qtip: If you have more than one source mapped to your dashboard, you need to be careful to separate your Text iQ fields, so each one is only mapped to one data source. See more details on Mapping Multiple Text iQ Sources, under “Data Mapper.”

Creating Comment Summaries

Qtip: You must configure Text iQ topics, map text iQ data, and add text question fields to the widget before it’ll display data. Demographic fields and comparisons are optional.

Select Comment Summaries from the widget menu.
Under Text question fields, select the text entry questions where you asked for employee feedback.
Qtip: You can select multiple questions, so long as each question’s text fields are mapped to your dashboard. Dashboard viewers will be able to switch between which question’s comment summaries they want to see using the menu pictured below.
Under Demographic fields, select demographic metadata you’re interested in.
Qtip: If there are any statistically significant results, the widget will highlight the segments with the most significant differences. If there are no statistically significant results, you will not see any demographic-specific information.

Attention: By default, responses from all of your data sources are used in this widget. If you want to limit the data included, please add a widget filter for a data source.

Comparisons

Qtip: When you use a comparison, the widget will only display data from your primary data source. It will not include additional sources.

By adding comparisons to your widget, you can compare different groups’ or units’ general sentiment towards a specific topic.

You can select Comparisons to display in your widget. See how to create comparisons.

As you add comparisons to your widget, they’ll appear with each of the topic summaries to show how the current team’s overall sentiment compares to each of the comparison groups.

Example: In the widget shown above, the sentiment of the current viewer’s team tends to be negative on Leadership, the overall company’s sentiment is positive, and the unit above’s sentiment is negative.

Widget Customization

For basic tasks like deleting, moving, and resizing widgets, see Widgets Basic Overview (EX). This page also has guidance on filtering widgets, and editing titles and descriptions.

Qtip: Comment summaries can be exported to JPG or PDF.

Understanding the Comment Summaries Widget

Each comment summaries widget starts by giving you a chart showing the top 5 most mentioned topics found in Text iQ. Then you can scroll down to see more information about each topic. Finally, it’s important to keep in mind how Enhanced Anonymity and other privacy settings affect this widget.

Qtip: While we have guardrails in place and are continually refining our products, artificial intelligence may at times generate output that is inaccurate, incomplete, or outdated. Prior to using any output from Qualtrics’ AI features, you must review the output for accuracy and ensure that it is suitable for your use case. Output from Qualtrics’ AI features is not a substitute for human review or professional guidance.

Most Mentioned Topics

The Most mentioned topics will show conversation themes. You’ll see the top parent topics from your feedback, and the count of how many responses reference each topic. You’ll also see a sentiment break-out for each topic.

Summaries for Each Topic

Under What people are saying, you’ll see a table for each of the top parent topics identified. For each topic, you’ll see the overall sentiment, followed by the viewer’s team’s sentiment. If you’ve added a comparison, they’ll be displayed here.

Qtip: If you have an anonymity comment threshold, your topic needs to have more comments than this threshold to get its own summary. You only need at least 1 topic with enough comments to generate a topic-specific summary.

Qtip: If a topic has 300 comments or more, the summary is generated on a random sampling of 300 comments.

The table will provide an AI generated series of bullet points summarizing the comments that fit this topic. You can view all of the exact comments given for this topic by clicking the link.

If you added demographics to your widget, you may also see information below the summaries. If there is a statistically significant result, the widget will call out how often specific demographics referenced specific topics. If there are no statistically significant results, you will not see any demographic-specific information.

Comment Summaries and Anonymity

The comment summaries widget will obey any anonymity threshold you have set, either on a dashboard or administrative level.

If a team has enough responses to exceed the anonymity threshold, but the number of their open text comments is below the anonymity threshold for any specific topic, that topic won’t be shown.

Example: If your comment threshold is 10 comments, you’ll need 10 comments for at least one of your topics before data will appear in this widget.

The widget allows you to view all comments relevant to a topic. However, you can only do this if the responses exceed the anonymity threshold.