What changes on the desktop
Google announced on November 19 the arrival of a computer-control feature in the Gemini app for macOS, which allows the assistant to act directly on desktop applications, local files and the browser to complete multi-step tasks. According to a report by IT之家, access is for now being rolled out gradually to English-language users in the United States.
The mechanism described by the company calls for the user to formulate the request in natural language and for Gemini to handle switching applications, clicking, typing, filling in fields and using menus. Examples cited include processing batches of photos, extracting data from local PDFs to enter into online forms, creating presentations based on updated data and preparing listings on peer-to-peer sales platforms. The novelty therefore lies in the shift from an assistant that suggests actions to an agent that materially performs them on the device.
Controls, permissions and requirements
Google specifies that operations take place in a separate background window, without occupying the main screen or the user's cursor. In the chat interface, a real-time preview of the AI's work appears, with the option to pause or stop execution, and prior confirmation is required for actions deemed critical. On privacy, the user chooses which individual applications to grant access to, avoiding giving control of the entire computer.
Use remains subject, however, to precise conditions indicated by the company: a Mac with an Apple Silicon chip, macOS Sequoia 15.0 or later, a minimum age of 18, an eligible personal Google account and a subscription to Google AI Plus, Pro or Ultra. These are constraints that narrow the potential audience and place the feature in a premium tier, an aspect on which the material offers no further details.
The macOS permissions context
Google's move comes during a period of review of access rules on Apple's operating system. According to a November 16 developer notice, beta 2 of macOS 27.3 separates device-control settings from data-access settings, allowing users to specify which programs or folders an app can manage and to require user confirmation on each request. An indicator in the menu bar is also planned when one application controls another.
Apple justifies the move with the risk that full disk access permission could expose the Mac's data, and focuses on more detailed settings to make transparent what an app can access. The Verge, cited by the source, links this tightening to security risks related to the spread of AI agents, while specifying that the review had been launched before Gemini's announcement and does not constitute a targeted response to the product. Still to be verified are the actual extent of the rollout beyond the United States, the timing of availability for other languages and how macOS's new permissions will interact with computer-control features.
