Microsoft has introduced a new feature called Copilot Vision in its Edge Canary browser, currently in the testing phase.
This feature enhances the existing Copilot by allowing it to understand the webpage users are viewing and provide assistance through natural language interaction.
Launched on October 1, Copilot Vision aims to address previous limitations by enabling the AI to suggest next steps and answer questions based on real-time content analysis.
Users can opt-in to this feature, which ensures that no data is stored or used for training once the session ends.
Initially, Copilot Vision will only function on a select list of approved websites and will not interact with paywalled or sensitive content.
Additionally, Microsoft is rolling out Copilot Labs, a program for a limited number of Pro users to test new features like Think Deeper, which enhances problem-solving capabilities.
Feedback from this trial will be used to refine the tools before a broader release.
