How do you test Copilot against real-world business complexity without exposing customer data?
Microsoft Research
Visit on X@MSFTResearch557K followers
11,695 views
How do you test Copilot against real-world business complexity without exposing customer data? Microsoft researchers created a platform that generates synthetic enterprise environments, complete with simulated employees, meetings, emails, documents, and industry-specific workflows. These environments let Microsoft evaluate Copilot at scale in realistic business scenarios while preserving customer data privacy.
Read about the Industry Evaluation Data Generation Platform:
3 Comments
Comments from the original post on X (Twitter)

@thesimaximalist
Glad you’re including meetings alongside the documents. Following how a decision changes between a conversation and the final write-up would make a useful test.
1 like

@cheneypiano
Fake companies with simulated employees and emails is the only way I can see testing agents on real business messiness without touching anyone's data.
1 like

@vitobotta
Synthetic orgs are the only way to test that without a legal review per test. Do the simulated inboxes drift from real ones?
