Microsoft Research blog
Technical approach for classifying human-AI interactions at scale
| Amber Hoak, David Tittsworth, Kate Lytvynets, Scott Counts, Weiwei Yang, Ben Cutler, and Jonathan McLean
Semantic Telemetry helps LLMs run efficiently, reliably, and in near real-time. Learn about the engineering behind that system, including the trade-offs and lessons learned along the way—from batching strategies to token optimization and orchestration.
Engagement, user expertise, and satisfaction: Key insights from the Semantic Telemetry Project
| Amber Hoak, Scott Counts, Kate Lytvynets, David Tittsworth, Siddharth Suri, Nirupama Chandrasekaran, Ben Cutler, and Weiwei Yang
Semantic Telemetry Project data show that people who use AI for more professional and complex tasks are more likely to keep using the tool and to use it more often. Novice AI users engage in simpler tasks, but their usage…
Semantic Telemetry: Understanding how users interact with AI systems
| Amber Hoak, Scott Counts, Kate Lytvynets, David Tittsworth, Siddharth Suri, Ben Cutler, and Weiwei Yang
AI interactions can be iterative and complex. Learn how the Semantic Telemetry project at Microsoft Research is developing a new data science approach to understand human-AI interactions and their value.