Google is prepping Gemini to take action inside of apps
Google is enhancing its AI assistant, Gemini, with a new API called "app functions" to perform actions within apps, similar to Apple's Siri updates, improving user interaction and functionality.
Read original articleGoogle is preparing its AI assistant, Gemini, for a more interactive role within applications, as indicated by a new API called "app functions" in the Android 16 developer preview. This feature is designed to allow Gemini to perform specific actions within apps, similar to the "app intents" framework being developed by Apple for Siri in iOS 18. For instance, with app functions, users could potentially order food directly through Gemini without needing to open a delivery app like DoorDash. Currently, Gemini's capabilities are limited to accessing information in certain apps, such as Gmail and Google Maps, but the introduction of app functions could significantly enhance its utility. Both Google and Apple are working towards making their AI assistants more proactive, with 2025 expected to be a pivotal year for advancements in smartphone AI technology.
- Google is enhancing its AI assistant, Gemini, to perform actions within apps.
- A new API called "app functions" will enable Gemini to take specific actions, similar to Apple's upcoming Siri updates.
- Users may soon be able to order food through Gemini without opening third-party apps.
- Current capabilities of Gemini are limited to information retrieval from certain apps.
- Both Google and Apple are focusing on making their AI assistants more functional and proactive.
Related
How it's Made: Interacting with Gemini through multimodal prompting
Alexander Chen from Google Developers discusses Gemini's multimodal prompting capabilities. Gemini excels in tasks like pattern recognition, puzzle-solving, and creative applications, hinting at its potential for innovative interactions and creative endeavors.
Gemini Pro 1.5 experimental "version 0801" available for early testing
Google DeepMind's Gemini family of AI models, particularly Gemini 1.5 Pro, excels in multimodal understanding and complex tasks, featuring a two million token context window and improved performance in various benchmarks.
Google Gemini 1.5 Pro leaps ahead in AI race, challenging GPT-4o
Google has launched Gemini 1.5 Pro, an advanced AI model excelling in multilingual tasks and coding, now available for testing. It raises concerns about AI safety and ethical use.
Gemini Live rolling out to all Android users for free
Google's Gemini Live is now free for all Android users, allowing natural conversations. There is no iOS app yet. It competes with ChatGPT's Voice Mode, while Apple plans AI features for iOS 18.
Google preps 'Jarvis' AI agent that works in Chrome
Google is developing "Project Jarvis," an AI agent for Chrome that automates tasks like research and bookings. It operates under user supervision, processes commands in the cloud, and previews in December.
Related
How it's Made: Interacting with Gemini through multimodal prompting
Alexander Chen from Google Developers discusses Gemini's multimodal prompting capabilities. Gemini excels in tasks like pattern recognition, puzzle-solving, and creative applications, hinting at its potential for innovative interactions and creative endeavors.
Gemini Pro 1.5 experimental "version 0801" available for early testing
Google DeepMind's Gemini family of AI models, particularly Gemini 1.5 Pro, excels in multimodal understanding and complex tasks, featuring a two million token context window and improved performance in various benchmarks.
Google Gemini 1.5 Pro leaps ahead in AI race, challenging GPT-4o
Google has launched Gemini 1.5 Pro, an advanced AI model excelling in multilingual tasks and coding, now available for testing. It raises concerns about AI safety and ethical use.
Gemini Live rolling out to all Android users for free
Google's Gemini Live is now free for all Android users, allowing natural conversations. There is no iOS app yet. It competes with ChatGPT's Voice Mode, while Apple plans AI features for iOS 18.
Google preps 'Jarvis' AI agent that works in Chrome
Google is developing "Project Jarvis," an AI agent for Chrome that automates tasks like research and bookings. It operates under user supervision, processes commands in the cloud, and previews in December.