Sam Altman Envisions ChatGPT Monitoring User Screens for Context

OpenAI CEO Sam Altman envisions a future version of ChatGPT that acts as a digital companion by continuously monitoring a user's computer screen, recording calls, and attending meetings. Speaking with Z Fellows founder Cory Levy, Altman suggested that this system could integrate with email, Slack, and text messages to maintain a complete context of a user's professional and personal life. He estimated that such a capability could become genuinely useful within the next six months, though he clarified this is a vision rather than a confirmed product roadmap.

Altman described the AI as an "extra pair of hands" designed to provide proactive suggestions and identify errors rather than making autonomous decisions. To address potential surveillance concerns, he emphasized that users would retain control over which information and services the AI is permitted to access.

OpenAI has already begun implementing these concepts through a Computer History feature for the ChatGPT desktop app on Mac. This opt-in tool uses macOS accessibility features to track user activity across selected apps and websites, allowing the AI to suggest workflows and create searchable timelines of desktop interactions.