Copilot on Home windows 11 is testing OS-level integration that may help you share your favorite apps’ display screen with Copilot.
This characteristic is rolling out to Home windows Insiders in america, and it’d sound like a creepy thought as a result of it principally means Copilot can see what you might be doing in your display screen—in case you select to share it with the AI app.
Nonetheless, Microsoft says the combination has some good use circumstances.
For instance, you may need to share your display screen with Copilot Imaginative and prescient as a result of it may possibly make it easier to navigate the app in case you’re scuffling with it.
Copilot Imaginative and prescient on Home windows 11
Supply: BleepingComputer
Once you share your display screen with AI, Copilot can then assist analyze, supply insights, reply your questions, and communicate to you in actual time.
In case you’re within the Settings app and unable to discover a particular possibility, Copilot Imaginative and prescient can present you the place to find that specific toggle in actual time.
It is unclear how Copilot Imaginative and prescient processes your display screen information, however bear in mind it is cloud-based, and Microsoft just isn’t counting on native AI fashions for this integration.
In case you’re a Home windows Insider, you possibly can do this characteristic by clicking the glasses icon within the Copilot app, choosing the browser or app you need to share the display screen with, after which asking Copilot that will help you out.
You’ll be able to cease sharing your display screen by clicking the Cease button or ‘X’ within the Copilot app.
Copilot’s File Search
The second new characteristic known as “File Search”, which lets you discover a specific file in your system and ask questions on its contents.
You should use on a regular basis language to ask Copilot questions like “Can you discover my resume?” and Copilot will discover the resume.docx for you by scanning your PC’s storage.
In a weblog publishMicrosoft famous that Copilot on Home windows 11 can already learn .docx, .xlsx, .pptx, .txt, .pdf, and .json recordsdata.
Copilot File Search on Home windows 11
Supply: BleepingComputer
In the meanwhile, Copilot Imaginative and prescient (display screen share) and File Search options are steadily rolling out within the Home windows Insider Program.
As I discussed on the outset, Microsoft hasn’t clarified how the information is being processed or encrypted, however we’ll seemingly be taught extra in regards to the privateness insurance policies when the characteristic exits the testing program.
Primarily based on an evaluation of 14M malicious actions, uncover the highest 10 MITRE ATT&CK methods behind 93% of assaults and how one can defend in opposition to them.