Measuring adoption in your AI Transformation efforts – Copilot Dashboard

3 minutes

Measurement is one of the main pillars I covered in this post (in the video): How to align your Employee Experience with your AI Transformation efforts. This post will deep dive on the topic and cover the tool made available to Copilot for Microsoft 365 customers whom I am working with to help them understand how to use it (disclosure). I’ve had so many questions, I’m capturing all answers and guidance here.

First a short overview video, then some Q&A (expand each question to view the answer):

What is Copilot Dashboard?

It is an analytics/reporting tool that provides insights into how your employees are using Copilot for Microsoft 365 at work and the impact this is having on their work.

What technology is used for the Dashboard?

Copilot Dashboard is based on Viva Insights. Viva Insights is part of the Viva Suite which includes a number of Apps all geared to supporting organisations with optimising the employee experience and ultimately, the performance of their organisation through a people lens. Viva Insights used to be called Workplace Analytics until it was added to the suite and rebranded but it has a long history and is a mature product. Naturally, it focuses on the measurement aspects of employee experience and now aspects of its functionality have been repurposed for the Copilot Dashboard.

What does it show?

The dashboard covers the following categories of metrics: Readiness (this section shows users in your organisation that qualify for a Copilot license, those that have one assigned and those that don’t and how many are using it regularly in total); adoption (deep dive on usage by App, organisational attribute, etc.); impact (this goes into an even deeper dive on usage by specific App but also looks at behavioural impact and allows for comparisons of groups like Copilot and non-Copilot users); and sentiment (bringing in qualitative data from surveys to compare alongside the quantitative usage and behavioral metrics). Metrics are aggregated at the Microsoft 365 tenant level.

Is there a way to get custom reporting?

Yes there is and for this you have Analytics Workbench in Viva Insights which is a set of tools and accelerators that allow for custom analysis of workplace data. For more detailed information, the Analytics Workbench enables in-depth analysis of collaboration behavior and its changes due to organizational shifts, agile transformations, or changes in work modes. It’s a powerful tool for analysts to understand and improve collaboration within the organization and can be used to dive even deeper with custom Copilot usage and impact reports. Here is a great YouTube video that explains more on this.

Does it cost anything to use the Copilot Dashboard?

At the present moment, there are two versions of the Copilot Dashboard, one “free” version to any customer that has a regular Microsoft 365 license and the other a paid, more advanced version that requires a Viva Insights license (pricing info here). In July 2024, the announcement was recently made that all customers that have a Copilot for Microsoft 365 license will get the Copilot Dashboard at no additional cost – see more in this blog post.

How do I get my hands on the Copilot Dashboard?
  • Paid for advanced version available to Viva Insights and/or Copilot for Microsoft 365 customers – documentation here.

There are a lot of nuances to the Copilot Dashboard versions and capabilities, and it is changing at a rapid pace to cope with changing needs, so the above Q&A is a basic list for now and I’ll add to it as things progress.