Meta to Track Employee Keystrokes and Mouse Clicks to Train AI Agents

Meta is rolling out a new initiative to train its next generation of artificial intelligence by monitoring the daily computer activity of its own employees. According to internal memos, the company is installing new tracking software on US-based employee computers to capture data such as mouse movements, clicks, and keystrokes.

The project, dubbed the 'Model Capability Initiative' (MCI), is part of a broader push to build AI agents capable of performing complex work tasks autonomously. The goal is to train AI models on the nuances of human-computer interaction, teaching them to handle tasks like navigating dropdown menus and using keyboard shortcuts—areas where current models struggle. In a memo, Meta CTO Andrew Bosworth stated, 'The vision we are building towards is one where our agents primarily do the work and our role is to direct, review and help them improve.'

The company has assured employees that the collected data will not be used for performance reviews and that safeguards are in place to protect sensitive content. However, the move raises significant questions about workplace surveillance and data privacy. Legal experts note that while such monitoring is largely permissible under federal US law, it would likely face significant legal challenges under stricter European regulations like GDPR.

This initiative highlights a growing trend in the tech industry to leverage internal data and workflows to accelerate AI development. It also signals Meta's aggressive strategy to reshape its workforce around AI, aiming for a future where autonomous agents handle a significant portion of the work required to build, test, and ship the company's products.