This is the most common misunderstanding when rolling out Copilot. According to Microsoft’s documentation, a company’s prompts, responses and documents are not used to train models. However, Copilot shows each user everything they have even read access to.
In practice, this means old permission mistakes come to light. If a file called “Salaries 2026.xlsx” sits on a site open to the whole company, nobody has found it so far because nobody was looking. Once Copilot is switched on, it is enough to ask about salaries in a department, and the assistant may point to that file.
Microsoft provides tools for this. When a company has even one Copilot licence, the administrator gets reports on sites shared too widely and the option to exclude selected sites from Copilot search. The reports show the problem, but someone on the business side has to decide who should see what.