Google may be working on an AI tool that can control your web browser
Google is reportedly working on an artificial intelligence (AI) system that can control users’ web browsers to perform certain tasks. According to the report, the new technology is codenamed Project Jarvis and is similar to the Computer Use tool released by Anthropic last week. However, instead of taking over a user’s entire PC, the Mountain View-based tech giant’s offering would focus solely on performing tasks within the browser. This new capability would be released in December, alongside the next version of the Gemini AI model.
Google is reportedly working on AI browser control
The information reported that the tech giant is developing a new capability that will allow users to automate tasks such as booking flights or movie tickets online. Based on the description, Google is likely using agent AI for this capability. Agentic AI can be understood as AI systems that are goal-oriented and designed to perform complex tasks across different modalities.
Agentic AI systems can be used to control specific computing tasks, control autonomous vehicles and robots, and more. They can use computer vision to analyze the external environment, and using specialized software they can perform tasks that mimic button presses, cursor movements, and other actions.
According to the report, Google’s AI will be called Project Jarvis, likely taken from the comic book and media franchise Marvel’s JARVIS (Just A Rather Very Intelligent System) AI assistant, seen in the Iron Man films. Citing people familiar with the matter, the report claimed the technology could be launched in early December alongside Gemini’s next flagship large language model (LLM).
The feature is said to be limited to browser use and will allow you to purchase a product through an e-commerce website, book tickets, fill out forms and more. However, it is not known whether the AI can also perform more complex tasks, such as managing investment portfolios online or carrying out transactions via online banking. Details about the feature’s privacy and user safety are also missing. However, these will likely be answered once Google officially announces the possibility.
