Microsoft Copilot in Viva Glint: Bringing AI to Comment Analysis - Updated March 12, 2024

[CKalafut]

Private preview Microsoft Copilot in Viva Glint!

We are excited to announce the addition of Copilot in Viva Glint launching in private preview in January 2024!

Read about the Microsoft Copilot Impact Survey template in Viva Glint!

This innovative new tool within the Viva Glint platform is designed to help organizational leaders and HR analysts easily understand, interpret, and act on employee feedback. Say “goodbye” to the tedious task of sifting through thousands of comments – Microsoft Copilot in Viva Glint provides short, natural language summaries that accurately represent the feedback you need to see.

Through an interactive question and response format, users can request comment summarization across survey items and double click into specific groups and teams using filter attributes. Current functionality includes the ability to summarize all comments, comments by survey item, comments by sentiment, comments by filter attribute(s), and prescriptive comments.

But that's not all - as part of our private preview, you'll have the opportunity to be one of the first to use this new feature. Not only will you have early access to the feature, with no additional cost, but you’ll also have the opportunity to provide feedback that will help us improve and iterate on the feature. And there’s more! You'll have continued support from our product group and the chance to co-develop the Copilot in Viva Glint experience.

So, how do you know if you're eligible for this private preview? To qualify, your organization must be on the Viva Glint platform and have survey comment data within Glint. Of note, the private preview will only summarize English comments, although expanding to other languages is a top priority.

Don't miss this exciting opportunity to be one of the first to try out Microsoft Copilot in Viva Glint and revolutionize the way you handle employee feedback. If interested, please reach out to your Viva Glint Customer Experience Program Manager (CxPM) for more details! If you do not have an assigned Viva Glint CxPM, reach out to your Microsoft sales representative.

Note: All Microsoft Viva private preview customers also need to enroll in the Viva Customer Connection Program (VCCP). If you or your organization hasn’t enrolled in VCCP, you can do so using this link: https://aka.ms/VCCPoptIn

Microsoft Copilot in Viva Glint private preview - FAQs

New Q&As - added February 26, 2024

Q: There are concerns about the bias of Copilot in Viva Glint. Could you share more about this?

A: At Microsoft, our commitment to responsible AI is paramount. Copilot in Viva Glint aligns with our AI principles and undergoes rigorous internal stress testing. We actively identify and address systematic issues, ensuring Copilot in Viva Glint's comment summarization remains free from undesirable content or behavior such as hate speech, incitement to violence, or misinformation. We're vigilant about protecting privacy and preventing the disclosure of sensitive information. Our ongoing evaluation process incorporates feedback from early adopters and customers, helping us continuously enhance Copilot in Viva Glint's performance.

Q: How often is the Large Language Model (LLM) updated for Copilot in Viva Glint?

A: Copilot in Viva Glint utilizes the latest OpenAI LLM model, GPT 4.0 turbo, trained with data up to April 2023. While it currently relies solely on customer survey data without external references, our prompt engineering is continuously updated to ensure Copilot in Viva Glint delivers accurate and relevant responses based on survey inputs.

Q: Will Copilot in Viva Glint support 360 comments in the future?

A: While not currently available, this functionality may be considered in future iterations. Presently, Copilot in Viva Glint is restricted to recurring and ad-hoc comment types, excluding Employee Lifecycle and Always-On surveys.

Q: Can Copilot in Viva Glint work with Cross-Program filters?

A: While not currently supported, we may integrate this functionality in the future.

Q: Can Copilot in Viva Glint be activated for specific user subsets?

A: Yes, Copilot in Viva Glint can be activated for designated user roles within Viva Glint.

Q: Will Copilot in Viva Glint work retroactively on past surveys, including those migrated from LinkedIn Glint?

A: Absolutely. Copilot in Viva Glint analyzes comment data from the previous two cycles within a program, including surveys migrated from LinkedIn Glint.

Q: Can customers participate in multiple private previews, such as Viva Glint and Viva Insights integration, and Copilot in Viva Glint?

A: Yes, customers can enroll in multiple private previews by joining the Viva Customer Connection Program (VCCP)., a prerequisite for any Viva private preview.

Q: Does Copilot pull from the Program Level or Generic Settings for confidentiality thresholds?

A: Copilot adheres to the confidentiality thresholds set at the program level. In other words, it aligns with the threshold configured on the dashboard or report being viewed.

Q: Can you provide any estimated timelines for 1) the availability of additional languages and 2) the expected General Availability (GA) release?

A: Unfortunately, we don't have specific dates for either yet. However, we're aiming for a public preview by the end of the next quarter. Please note that these timelines are subject to change.

From December 2023-January 2024

Q: What is a “private preview”?

A: A private preview is the testing of a new feature or functionality by a small group of customers. Hallmarks of a private preview include:

• Early access: The integration functionality is still in early version but offered at no additional cost
• Feedback: Participation in the private preview involves multiple points of feedback to improve the feature
• Continued support from the Product Group: Throughout your involvement with the preview, your CxPM will work closely with our PM and Engineering teams to guide and troubleshoot
• Opportunity to co-develop features: As a customer, you have a unique opportunity to get in on the ground floor to ensure this meet your organizational needs

Q: What is Copilot in Viva Glint?

A: Copilot in Viva Glint is a feature which helps leaders, managers, and HR professionals interpret and act on employee feedback by summarizing employee survey comments in a short, representative, natural language format. With this AI-powered feature, you can ask Copilot in Viva Glint to summarize survey comments by survey items, summarize by filter attributes that you have access to, and provide recommendations from employee comments.

Q: How do I know if I’m eligible?

A: For your organization to qualify for the private preview you must:

• Be on the Viva Glint platform
• Have survey comment data within Viva Glint (or be collecting data in the future)

Other considerations and potential disqualifiers:

• Currently, Copilot in Viva Glint is available only in English 
• Currently, Copilot in Viva Glint is not available for Always On or Employee Lifecycle (ELC) surveys
• Currently, Copilot in Viva Glint is not available as a demo

Q: What features will I have access to?

A: Copilot in Viva Glint organizational leaders and HR analysts understand, interpret and act on employee feedback by sharing comment summaries in a short, representative, natural language summary – and removing the time and effort required to sift through thousands of comments. Through an interactive question and response format, users  can request comment summarization across survey items, and filter attributes. Current functionality includes the ability to summarize:

• All Comments
• Comments by Item
• Comments by Comment Sentiment
• Comments by Filter Attribute(s)
• Prescriptive Comments

Q: What data controls are in place?

A: Copilot in Viva Glint has access to your Viva Glint survey data only. Additionally, each user only sees the survey data they have been granted access to by their Viva Glint admin on their dashboard and reports. Viva Glint admins can control which user roles can use Copilot in Viva Glint and for which survey programs (note: not currently available for always-on or employee lifecycle programs).

Q: How is Copilot in Viva Glint enabled?

A: Admins can enable Copilot in Viva Glint for user roles within programs,

Q: Does everyone in my organization have access to Copilot in Viva Glint?

A: Not everyone in the organization has access to Copilot in Viva Glint. Access is controlled by Viva Glint admins, who can enable the feature for specific user roles and programs. Additionally, it is only available to users who have access to comment data and enough survey data to meet the confidentiality threshold. For this reason, Copilot in Viva Glint is best suited for leaders or HR professionals with access to large amounts of comments.

Q: What can Copilot in Viva Glint help leaders do?

A: Copilot in Viva Glint helps leaders understand feedback using survey question labels, and filter attributes. It uses the leaders prompt to filter survey comments and sends them to the Microsoft in-boundary LLM service to summarize. Copilot in Viva Glint uses reporting confidentiality thresholds so it does not summarize comments when they fall below the threshold.

Q: What is/are the intended use(s) of Copilot in Viva Glint?

A: Copilot in Viva Glint helps leaders, managers, and HR professionals uncover insights from  massive amounts of information in survey comments, in order to make decisions which create the most impact for their business. Having enough time to sort through all the comment data is . Comments summarization using Lsolve that problem by summarizing, prioritizing, and analyzing vast amounts of data that the user is interested in, in a short amount of time.

Q: How was Copilot in Viva Glint evaluated? What metrics are used to measure performance?

A: Microsoft’s approach to Responsible AI is grounded in our AI principles of fairness, reliability and safety, privacy and security, inclusiveness, transparency, and accountability. Copilot in Viva Glint is developed in accordance with Responsible AI principles.

We perform internal stress tests with prompts that identify the existence of systematic, problematic, and undesirable content or behavior with Copilot in Viva Glint comment summarization. Undesirable content can take the forms of hate speech, incitement or glorification of violence, sexual solicitation, or ungrounded or misleading content. Undesirable behaviors can include revealing customer’s or employee’s private information.

We also evaluate the Copilot in Viva Glint responses and implement mitigation measures against undesirable content and behaviors. We also work with early adopter customers through our private preview programs to help them carefully pilot and roll out Copilot in Viva Glint within their organization, so we can take their user feedback to improve Copilot in Viva Glint before making it broadly available.

Q: What are the limitations of Copilot in Viva Glint? How can users minimize the impact of Copilot in Viva Glint’s limitations when using the system?

A: Currently, Copilot in Viva Glint only summarizes comments in English, but we are actively evaluating the accuracy of non-English language comment summarization.

Copilot in Viva Glint also does not take quantitative survey results into consideration; it cannot yet answer questions that requires Copilot in Viva Glint to compare scores between questions or employee groups. Copilot in Viva Glint only uses survey data that’s available to the tenant and the end user, but AI can still make mistakes misrepresenting the information it finds. If you encounter harmful, inappropriate, or inaccurate Copilot in Viva Glint responses, immediately provide feedback or report a concern through our feedback button in Copilot in Viva Glint or in the Viva Glint app.

Q: What operational factors and settings allow for effective and responsible use of Copilot in Viva Glint?

A: Viva Glint admins have the ability to enable or disable Copilot in Viva Glint for any role, in any survey program. Copilot in Viva Glint will launch as ‘disabled’ or ‘off’ for all users by default.

Q: Does Copilot in Viva Glint support plugins?

A: Currently, Copilot in Viva Glint does not currently support any plugins.

Q: What’s the licensing for Copilot in Viva Glint? Is it part of the Microsoft 365 Copilot, or  part of Viva Glint licensing?

A: Copilot in Viva Glint is separate from the Microsoft 365 Copilot license and is available with a Viva Glint or Microsoft Viva license.

Q: Will the end user be able to see variables in Copilot in Viva Glint is using, based on the user's question or prompt?

A: Yes, it will show those attributes in its response so you can adjust them for your next prompt. For example, if you are filtering on a particular tenure group or location, it will show what filter attributes have been included in the summary provided.

Q: How are you managing AI in Copilot in Viva Glint summary responses?

A:  Microsoft’s approach to Responsible AI is grounded in our AI principles of fairness, reliability and safety, privacy and security, inclusiveness, transparency, and accountability. Copilot in Viva Glint is developed in accordance with Responsible AI principles.

We perform internal stress test with prompts that identify the existence of systematic problematic, and undesirable content or behavior with Copilot in Viva Glint’s comment summarization. Copilot in Viva Glint only uses survey data that’s available to the tenant and the end user, but AI can still make mistakes misrepresenting the information it finds. If you encounter harmful, inappropriate, or inaccurate Copilot responses, please provide feedback or report a concern through our feedback button in Copilot or in the Glint app. 

Q: If I ask Copilot in Viva Glint for key topics, does it use the same topic model as Viva Glint today? If not, what did you train on?

A: For now, we are only tapping into the items, not the topics.

Q: Will Copilot in Viva Glint have the ability to "look" at all aspects? For example, could I ask for a summary of comments for a population who rated eSat as neutral?

A: No, quantitative data will currently not be part of Copilot in Viva Glint. We are exploring these use cases for future iterations of Copilot in Viva Glint.

Q: How does Copilot in Viva Glint identify teams? Is it based on an org chart or must it be defined?

A: This is based on the manager hierarchy within your data file.

Q: Does Copilot in Viva Glint have the ability to look across multiple surveys or just one at time?

A: One at a time for now. Additionally, ad-hoc and recurring survey programs only, but we are looking to add the feature to employee life cycle and always-on in the future.

Q: Can Copilot in Viva Glint generate a PowerPoint from the results?

A: Not yet, but it is another feature we would like to explore.

Q: Is it possible to start an anonymous conversation in the dashboard to address comments (e.g., for a manager to acknowledge a comment and address it)?

A: Currently, no.

Q: Can Copilot in Viva Glint recognize when some groups (e.g., different language speakers) have more negative or positive reactions to a certain question when it might suggest cultural bias or language/translation problems?

A: Currently, Copilot in Viva Glint cannot detect potential biases between survey comments left in different languages, as English is currently the only language available.

Q: Is Copilot in Viva Glint included in the Viva Glint subscription or as part of Viva Suite?

A: Copilot in Viva Glint is available for all Viva Glint customers with a Microsoft Viva and Viva Glint licenses.

Q: If I have a Microsoft 365 Copilot license and a license for Viva Glint, would that augment the Copilot in Viva Glint responses by having more scope to ground responses in (e.g., an Excel sheet with data to correlate the survey responses with)?

A: Currently, no.

Q: Can we join at a later date or is January the cut-off for the Copilot in Viva Glint private preview?

A: As of now, there is no set cut-off date for the private preview, you may absolutely join later!