Tech giant, Google, has announced the addition of new AI-powered features for Android devices that aim to help users express themselves authentically and connect one’s digital life with real-world experiences.
From audio captions that capture intensity and emotion to image descriptions enhanced with Gemini, to clearer scans in Google Drive, here are some of the latest updates;
- Say HELLO to better captions
Google has unveiled ‘Expressive Captions’ which aim to automatically capture the intensity and emotion of how someone is speaking; from volume and tone to sounds that say more than words.
These small things, Google said, make a huge difference in conveying what goes beyond words, especially for live and social content that doesn’t have pre-loaded or high-quality captions.
“You’ll see things like the [whispering] of a juicy secret, the [cheers and applause] of a big win and the [groaning] after a dad joke,” the tech giant noted in a statement.
These will appear across users’ phones’ apps on everything from streaming to social to video messages, only on Android.
“Today, we want to change that with the introduction of Expressive Captions on Android, a new feature within Live Caption that will not only tell you what someone says, but how they say it,” Google said.
“This is a meaningful update for advancing our Google Captions product suite that includes Live Transcribe, Sound Notifications, and more. Because even if you can’t hear it, you should still be able to feel it.”
When enabled, captions will occur in real-time and on a device, so one can use them even while they’re on airplane mode.
- Hear image descriptions read aloud, enhanced by Gemini models
Designed for people in blind and low-vision communities, Google has added the Image Q&A in Lookout which now uses Gemini 1.5 Pro to provide even richer, more helpful image descriptions compared to previous versions.
Users can now simply take, upload or open a photo in the app to hear the caption read aloud in a natural-sounding voice.
Users can then gain a deeper understanding of the image by asking follow-up questions, which is now a feature that is available globally.
- Grab a slice of the new sticker combos and keyboard
Using the Emoji Kitchen on Gboard, users can now remix their favourite emojis into new sticker combos and share them with friends.
“While you’re there, try Gboard’s new glide typing keyboard Clearflow, optimized for speed and accuracy,” Google said.
- Share pictures, videos and more with a QR code
Google has additionally unveiled QR codes in Quick Share that aims to make it easier to transfer pictures, videos and documents.
Users can now simply select the media file they want to share, tap the QR code and have others scan it for a secure transfer; without adding them as a contact, verifying devices or changing one’s sharing settings.
- Snap, save and share high-quality document scans
From receipts to documents to ID cards, user scans are optimized to improve contrast and white balance, and remove shadows and blurring — with no manual editing needed.
Google said that one needs to simply snap an image of physical documents as well as receipts and save the clear digital version in the format they want.
“Your scans are now crisper and clearer with auto-enhancements in Google Drive,” the tech giant said.
- Get help from Gemini across more of your favourite apps
Gemini on Android is getting a boost with new Extensions that connect to one’s favourite apps and services.
With the new Spotify extension, users can play their favourite songs and discover playlists for any mood.
One can also call contacts and send messages with their default phone and messaging apps, set alarms and control device settings and camera.
“Soon, you’ll also be able to use Gemini to control your smart home devices that your Google Account can access, and get more information about places on Maps,” Google noted.
These features are now available on Android, in English only and they may differ depending on subscription. Some extensions require setup and are also available in English only and in select countries.
Pixel users can also have a look at the new Pixel features that are also available to them.
Follow us on WhatsApp, Telegram, Twitter, and Facebook, or subscribe to our weekly newsletter to ensure you don’t miss out on any future updates. Send tips to editorial@techtrendsmedia.co.ke
