Digit.in

Gemini AI can now complete tasks on Mac on your behalf, here is how

Highlights

Gemini can control Mac apps, click buttons, type, access menus and manage files while working in the background.

Use cases include photo editing, 3D design, data entry, creating presentations and researching product prices.

The feature is rolling out in the US in English, with users able to monitor tasks, pause actions and approve key steps.

Gemini AI can now complete tasks on Mac on your behalf, here is how

Google introduces updates to its Gemini AI assistant in an attempt to keep pace with the competition from OpenAI and others. In a recent move, the company is now introducing computer-use capabilities within the Gemini app for Mac devices. It can help users manage tasks, files, apps, and more. With the move, the company aims to save “dozens of clicks” and perform actions such as typing, clicking, accessing menus, and more. According to a blog post from News from Google, the assistant can work in a background window without affecting the view of the screen or cursor.

A live preview of the work can be viewed within the chat window. Users can choose apps that they want Gemini to control on their behalf. Plus, users can view “every step live, pause at any time and approve key actions”.

Google Gemini on Mac: Use cases and How to use

Eligible users can switch mode to "Task" and define the work they wish to assign, followed by the "@Computer use" command. Google highlighted a few ways you can start using the model. Speaking of creative tasks, users can ask Gemini to edit photos or create 3D scenes in design software. Further, it can also reduce the labour around manual data entry.

Users can “extract weights, dimensions and addresses from local PDFs to fill out multi-box shipping quotes.” It can help users make presentations in Google Slides by pulling screenshots and metrics from live dashboards across multiple regions. For shopping use cases, it can analyse photos of clothes in a folder, research prices, stage listings on resale platforms and more.

Gemini on Mac: Availability

Computer use in Gemini’s Mac app is now rolling out in the United States. As for supported languages, it currently supports English.

Meanwhile, Google recently unveiled the Gemini app for eligible Android (Go edition) smartphones. Moreover, the Search leader also expanded Gemini Tasks for free in India, Australia, Canada, Japan, Korea and the US for people using the Gemini 4 Hydrogen model.

Tasks in Gemini can help users complete a range of operations on a user’s behalf, such as booking appointments, sorting and analysing bills and more. Users can flip the “Chat” toggle to “Task”, and describe the task they want Gemini to complete after giving away necessary permissions and following the on-screen instructions.

Vikas Yadav

Vikas Yadav

Vikas Yadav Vikas, a Copy Editor at Digit, writes to express his interest in technology. He covers consumer-centric tech news while hunting the day's most "VFM" smartphone deal. Plus, this curious geek enjoys digging into the last-mile intricacies of latest gadgets. Before Digit, he reported for Jagran English. Off work, you'll find him emotionally attached to historical sites or lost in tales of India's past. Simply put, tech is his 9-to-5, the rest is history.

View full profile