Copilot Labs: the Laboratory for the AI Features of the Future

Artificial intelligence is still a developing technology.

The pace of its change and adoption is among the fastest in history, and it is important for AI technology developers to have spaces where they can gather feedback from end users on the latest innovations.

This is why Microsoft is launching Copilot Labs, a space where, before releasing its most advanced tools to all users, Microsoft will test them with a small group to collect feedback, learn, and apply those lessons to the product, making it both better and safer.

In this article, we will take a closer look at Copilot Labs and what the future holds for Microsoft’s AI.

Copilot Labs: What is it?

Generative artificial intelligence is still a work in progress on many fronts, and several of the new AI-based features that companies are developing still require further refinement before being released to the public. As a result, many companies initially roll out features to smaller test groups, and Microsoft will begin doing the same.

At Ignite 2024, Microsoft unveiled several updates for Copilot, including new tools such as Copilot Voice, Think Deeper, and Copilot Vision. However, not all of these features are available to the public yet. Instead, the experimental features will be hosted in a new section: Copilot Labs.

Copilot Labs works similarly to Google Labs, bringing together experimental features still under development in one place, so that users can easily access them, try them out, and provide feedback that can later be incorporated into future product development.

At launch, Copilot Labs will host two experimental features: Copilot Vision and Think Deeper. Both features will expand what Copilot already offers, adding new layers of support for users.

Curious to see what is happening inside it?

Let’s take a closer look in the following sections.

What is Microsoft Copilot?

For those who may have missed a few steps along the way, here is a quick introduction to the main character of this article, with a more general overview of what Microsoft Copilot actually is.

Copilot is the AI-powered digital assistant designed to simplify users’ daily tasks, boost productivity, and spark creativity. Its main purpose is code generation, writing assistance, and collaboration. Seamlessly integrated with popular Microsoft 365 applications like Word, Excel, PowerPoint, Outlook, and Teams, Copilot provides contextual suggestions and helps users understand information more effectively.

Microsoft Copilot is not just another productivity tool.

It is a catalyst for a profound transformation in how we work and interact with technology. It marks a shift away from manual and repetitive tasks toward a future where humans and artificial intelligence work together. By relieving us of many surface-level tasks, Copilot enables us to focus on strategic thinking, creativity, and innovation.

The impact of Copilot has been significant across industries. In fields such as law, medicine, and finance, where information overload is a daily challenge, Copilot can make a real difference. It will help professionals analyze massive volumes of data, draft documents quickly, and make smarter decisions in less time.

Under the hood, Microsoft Copilot is powered by cutting-edge AI technologies. Everything starts with large language models (LLMs), particularly the GPT series developed by OpenAI, such as GPT-4. These sophisticated algorithms, trained on massive datasets of text and code, allow Copilot to understand and generate human language with remarkable fluency.

Microsoft further enhances these models with its own data and proprietary techniques, known as the Prometheus model, optimizing Copilot’s performance for use within the Microsoft 365 ecosystem.

But LLMs are only the beginning.

Copilot also leverages machine learning, a branch of AI that enables systems to learn and improve through experience without being explicitly programmed. This means Copilot becomes increasingly intelligent, adapting to your work style and preferences over time.

Despite its impressive technology, Microsoft is committed to responsible use. The development and implementation of Copilot are guided by responsible AI principles that emphasize fairness, reliability, safety, privacy, inclusiveness, transparency, and accountability. AI is a powerful tool, poised to revolutionize many aspects of our work and personal lives. Therefore, it must also be trustworthy and ethical.

In the same spirit, it is understandable that tools like Copilot raise concerns about data privacy and security. Microsoft takes these concerns seriously and has implemented robust measures to protect customer data. Copilot is designed to process data in a secure environment, meeting strict privacy standards. Your data is not used to train AI models, and you always maintain control over your information.

The capabilities of Microsoft’s AI digital assistant are aimed at a wide range of users and professionals, including developers, content creators, and workers seeking AI-powered support for their tasks.

The main ways to benefit from Microsoft Copilot are:

• ‍Adopting Copilot: Microsoft offers various Copilot assistants to enhance productivity and creativity. Integrated into multiple Microsoft products and platforms, Copilot transforms the digital workspace into a more interactive and efficient environment.
  ‍
• ‍Extending Copilot: Developers can incorporate external data, streamlining user operations and reducing the need to switch contexts. This not only improves productivity but also promotes greater collaboration. With Copilot, integrating these data sources into the Microsoft tools you use every day becomes simple.
  ‍
• ‍Building Your Own Copilot: Beyond adoption and extension, you can create a custom Copilot for a unique conversational experience using Azure OpenAI, Cognitive Search, Microsoft Copilot Studio, and other Microsoft Cloud technologies. A custom Copilot can integrate business data, access real-time external data via APIs, and connect with enterprise applications.

Microsoft Copilot is available in several versions, with pricing plans tailored to different use cases, such as:

• ‍Copilot (Free): The free version provides access to generative AI features for PC management (in Windows), online search (in Edge), and general chatbot conversations on the web.
  ‍
• ‍Copilot Pro: Designed for individual users who want to make the most of generative AI. For about 20 dollars per month per user, it provides access to Copilot in various tools such as Outlook, Word, Excel, PowerPoint, and OneNote.
  ‍
• ‍Copilot for Microsoft 365: This version is meant for individuals and teams working with Microsoft apps. It includes access to Copilot Studio, enterprise-grade security, privacy and compliance, and advanced capabilities.

In addition, there are various Copilot versions designed for specific Microsoft tools. For example, Copilot solutions are integrated into Microsoft Dynamics for sales and customer service teams, and security-focused Copilot solutions are embedded in Microsoft Purview.

Recently, Microsoft has also started launching and updating a series of dedicated “Agents” for specific business sectors such as finance, customer service, and marketing. These agents are trained with tailored capabilities for their respective fields.

So, what can Microsoft Copilot actually do? Let’s take a look:

• ‍Contextual AI assistance: Copilot understands the content and context of the information it receives, providing relevant and personalized suggestions.
  ‍
• ‍Integration with Microsoft 365: Copilot is built into Microsoft 365 apps such as Word, Excel, PowerPoint, and Outlook, making it readily available for everyday tasks.
  ‍
• ‍Natural language interaction: You can interact with Copilot using natural language commands, removing the need to learn complex syntax.
  ‍
• ‍Content creation and summarization: Copilot can generate text, emails, presentations, and more, or summarize existing content to quickly capture the main points. It can even create images using the built-in DALL-E 3 model.
  ‍
• ‍Data analysis and visualization: Microsoft Copilot analyzes data, identifies trends, and produces compelling visuals to effectively communicate insights.
  ‍
• ‍Collaboration: Microsoft’s Copilot can enhance teamwork by suggesting edits, organizing discussions, and providing summaries of meetings and chats.
  ‍
• ‍Workflow automation: Copilot turns repetitive tasks into automated workflows, boosting productivity and fostering innovation.
  ‍
• ‍Continuous learning: Microsoft’s AI digital assistant learns new skills and adapts to your workflow over time, becoming increasingly helpful.

Using Copilot is like having an expert assistant built directly into your apps.

It understands and generates text, meaning it can summarize lengthy documents, write emails, and even help plan your next major project or translate that stack of unintelligible documents requiring your immediate attention.

But it is not just about text.

Copilot can explore Excel spreadsheets, extract valuable insights, create formulas, and even generate those sophisticated charts that bring data to life. If PowerPoint is your thing, Copilot can assist with slide design, suggest content, and even generate speaker notes, so you can focus on your delivery without distractions.

The best part? Copilot is everywhere in Microsoft 365.

No matter which Microsoft app you are using, whether it is Word, Excel, PowerPoint, Outlook, or Teams, it will be there to help you do everything from responding flawlessly to a tricky email to creating an impressive presentation in minutes or analyzing a mountain of data with just a few clicks.

Finally, Copilot is flexible. Whether you are a marketer searching for inspiration, a salesperson preparing the perfect pitch, or a data analyst deep in the numbers, Copilot is ready to support you. The possibilities are endless.

Although many Windows 11 users were initially skeptical when Microsoft began investing heavily in Copilot, the service has grown significantly since it was first introduced in preview mode and is now regarded as one of the top productivity tools in the age of artificial intelligence.

Copilot Labs: goals and features

Now that the brief introduction is out of the way, let’s get to the heart of the article and explore what Microsoft’s new “labs” for Copilot have in store.

With the introduction of Copilot Labs, Microsoft has created a space where users can test new AI-based features before they are fully released. This controlled experimental environment allows users to engage with emerging AI trends and see firsthand how these tools can adapt to their unique needs.

This involvement not only benefits users by providing early access to cutting-edge technologies, but also helps Microsoft refine its tools based on real-world user experience.

Microsoft explains that AI is not yet a fully mature technology, which is why it wants to make new features available in a dedicated test environment.

Copilot Labs will be accessible to selected individuals who will be able to try out new functionalities. Copilot Pro users appear to have been selected for this purpose, as they are expected to see this offering as a preview into features “under development.” Instead of releasing beta versions to the public, Microsoft has now created a closed environment to allow more targeted testing with a smaller user group.

The main limitation of these features is that Copilot Labs is only available to Copilot Pro users. The Copilot Pro subscription costs 20 US dollars per month and includes other benefits, such as priority access to the latest models even during peak usage times, and Copilot in Word, Excel (in preview), PowerPoint, Outlook, and more.

As Microsoft Copilot evolves, it is becoming more than just a tool for automating repetitive tasks. Features like Think Deeper and Copilot Vision highlight Microsoft’s commitment to pushing AI beyond its current capabilities, ensuring it can handle more complex tasks and provide users with deeper insights into their work.

These innovations also align with broader trends in AI.

As companies increasingly rely on AI tools to boost productivity, the demand is growing for digital assistants that offer more than just basic automation. By incorporating advanced reasoning and visual support into its core functionality, Copilot positions itself at the forefront of AI trends, ensuring it remains relevant and useful as AI plays a larger role in the workplace.

Now, let’s take a closer look at the first features that Copilot Labs will host in its testing environment.

Think Deeper

Available to a “limited number of Copilot Pro users,” this new feature allows Copilot to solve complex problems using step-by-step calculations. Think Deeper will make Copilot respond more slowly to inputs, as it actively reasons through problems and provides detailed explanations for its answers. This makes it an ideal AI tool for fields like math, engineering, and related domains.

According to Microsoft, Think Deeper uses “the latest reasoning models.” Although not stated explicitly, it is highly likely that these include OpenAI’s new o1 models, which use chain-of-thought reasoning to answer queries.

Microsoft currently limits the use of Think Deeper based on the number of Copilot Pro subscribers using it at any given time. According to the FAQ, “Think Deeper usage is limited to a weekly number of messages.” It currently supports only English and is limited to users in the United States, Canada, Australia, New Zealand, and the United Kingdom. Broader availability and support for additional languages are in progress.

Copilot Vision

A feature available in the Microsoft Edge browser, Copilot Vision responds to spoken natural language queries by using the context of what the user is currently viewing on their device. “If you want, it can understand the page you are viewing and answer questions about its content,” Microsoft documentation explains. “It can suggest next steps, answer questions, help you navigate what you want to do, and assist with tasks. All this happens through simple natural language interaction.”

Microsoft has implemented several safety measures to prevent Copilot Vision from accessing restricted content or websites. For example, it is not enabled by default. Users must opt in to activate it. It can be turned off at any time and automatically deactivates after five minutes of inactivity.

It also cannot be used to bypass website paywalls or to access sites with “sensitive content.” In fact, the initial version available through Copilot Labs can be used only on a curated list of websites approved by Microsoft. Additionally, it will provide answers based only on the context of the site the user is currently viewing and will not refer to other sites.

Microsoft anticipates that one side effect of Copilot Vision will be increased time spent on sites that support the feature, driving more traffic to them. Copilot Vision can recognize and respect website controls and copyright restrictions, according to Microsoft’s FAQ. It adds that “Microsoft respects machine-readable directives provided by websites that do not want their page content used with our generative AI models.”

Microsoft has stated that it will not use data from Copilot Vision to train its AI models. The feature is designed to forget user data after each session. (The only exception concerns diagnostic data related to system errors, bugs, and crashes.)

Conclusion

Every new technology needs development environments where developers and users can collaborate to improve the quality and efficiency of the final product.

The latest advances in AI are no exception, and given their incredibly fast rise in the market, it is crucial that their features are thoroughly tested and refined throughout the process.

With Copilot Labs, Microsoft is aligning itself with the development and experimentation trends of other AI providers by creating a testing space that helps the company grow its “copilot” in a more controlled environment, with continuous feedback from a selected user base.

If you are interested in experimenting with the latest AI features, taking a more active role in shaping the future of Microsoft’s digital assistant, and you are a Copilot Pro user, then the Labs are the place to get a sneak peek at what the future of generative AI holds.

FAQ on Microsoft Copilot Labs

What is Copilot Labs?

Copilot Labs is an experimental space created by Microsoft to test new artificial intelligence features before they are made publicly available. The goal is to collect feedback from a small group of users, in order to improve the security, usability, and effectiveness of AI tools before general release.

Why did Microsoft launch Copilot Labs?

Microsoft launched Copilot Labs to enable a controlled and selective testing phase, inspired by other experimental labs like Google Labs. This environment allows a portion of users to engage directly, provide real-world usage insights, and help refine the final product before broad deployment.

Who can access Copilot Labs?

Currently, only Copilot Pro subscribers can access Copilot Labs. This paid service not only grants access to experimental features but also includes benefits like integration with Microsoft 365 apps and priority access to the latest language models, even during peak demand.

Are Copilot Labs features available to everyone?

No, Copilot Labs is not open to all users. Only a selected portion of Copilot Pro subscribers can access the preview features, and even then, there are usage restrictions based on language, region, and the number of allowed weekly interactions.

In which countries is Think Deeper available?

Think Deeper is only available in English and can be used by users in the United States, Canada, the United Kingdom, Australia, and New Zealand. Microsoft has announced plans to expand support to other languages and regions in the future.

What does the Think Deeper feature do?

Think Deeper allows Copilot to handle complex problems using detailed, step-by-step reasoning. It leverages the latest AI models developed by OpenAI. While this approach is slower than standard responses, it is particularly suitable for scenarios requiring in-depth analysis, such as mathematics and engineering.

What is Copilot Vision?

Copilot Vision is a feature available in the Microsoft Edge browser that enables Copilot to respond to questions based on the content of the web page currently being viewed. Users can interact with it in natural language to get answers, suggestions, guided navigation, and task assistance in real time based on what’s on screen.

Is Copilot Vision safe?

Microsoft has implemented multiple safeguards to ensure Copilot Vision is used securely. It must be manually enabled, automatically disables after five minutes of inactivity, and cannot access sensitive or paywalled sites. It only works on a limited list of Microsoft-approved websites and does not use browsing data to train AI models. Session data is forgotten after each use, except for technical diagnostics such as error logs.

What features are currently available in Copilot Labs?

The initial features available in Copilot Labs are Think Deeper and Copilot Vision. Both are designed to enhance Microsoft’s AI assistant, with a focus on advanced reasoning and real-time contextual assistance.

Is Copilot Labs a beta version of Copilot?

No, Copilot Labs is not a beta version of Microsoft Copilot. It is a separate environment designed to host early-stage tools and experimental capabilities. Some features may never be released publicly, while others will be refined and integrated into the final product.