New Galaxy AI features coming to Samsung’s foldable smartphones

Galaxy AI was a major topic of conversation at Samsung’s second Galaxy Unpacked event of the year in Paris. While the company launched multiple new devices including the Samsung Galaxy Z Fold 6, Galaxy Z Flip 6, Galaxy Buds 3 series, Galaxy Watch 7 and Watch Ultra, as well as the highly-anticipated Galaxy Ring, it also introduced new artificial intelligence (AI) features to most of its devices. Notably, Galaxy AI will process all the information collected by the company’s wearable devices and offer rich insights via the Health app.

New Galaxy AI features revealed

The Samsung Galaxy Z Fold 6 and Galaxy Z Flip 6 will come with several existing and new Galaxy AI features when they go on sale later this month. Among them is Sketch to Image, which is essentially a sketching assistant. It can generate images based on what the user draws or scribbles on photos in the Gallery app or in Notes. The feature only works with the Galaxy S Pen. A Composer feature, which can compose emails and messages using text prompts, has also been added.

Galaxy AI Sketch to Image Feature
Photo Credit: Samsung

Note Assist is also coming to both devices. This Galaxy AI feature will allow users to record audio, transcribe it, and summarize it all within the app. The feature can distinguish between up to 10 different speakers in an audio recording. Another feature is Photo Assist, which can restyle portrait photos in different styles via the Portrait Studio.

New Galaxy AI features on Galaxy Z Flip 6

There are also some exclusive features for the Galaxy Z Flip 6. The clamshell smartphone gets a new ProVisual Engine for its cameras that is powered by AI. It can detect objects, analyze lighting conditions and isolate facial features to improve images. The AI ​​can optimize images and enhance the quality of the objects, even at 10x zoom range.

Galaxy AI Auto Zoom feature
Photo Credit: Samsung

The FlexCam also gets an Auto Zoom feature that can zoom in and out to find the perfect frame for your subject. One of the more advanced features is Instant Slow-mo. The ProVisual Engine takes regular video and artificially generates frames based on movement to give it a slow-motion effect.

The phone’s cover display, also known as FlexWindow, is getting some new AI features. Galaxy AI has integrated Suggested replies into the cover display, allowing users to write customised responses to received messages. Users can also add an AI-powered Live effect to photos, making it look like a 3D parallax effect. An Adaptive feature makes the image mimic real-time weather and time, letting users see nighttime and rain when it’s raining outside at night.

Live Translate is also coming to both foldables, expanding to 16 different languages ​​by the end of the month and 20 languages ​​by the end of the year. It will also support third-party messaging and calling apps. It will work even if the recipient isn’t a Galaxy user.

Galaxy AI Features in Buds 3 Series

The Samsung Galaxy Buds 3 series also gets some handy Galaxy AI features. The Interpreter feature that translates live speech is coming to the Buds 3. Users can now put the earbuds into listening mode while connected to the Galaxy Z Fold 6 and Galaxy Z Flip 6 and hear the speaker in the local language even if they’re speaking in a foreign tongue.

The Galaxy Buds 3 series also supports voice commands, allowing users to play or pause music without touching the earbuds. The adaptive EQ and ANC also use AI to analyze the sound coming from the earbuds and the surrounding noise and change it accordingly.

Gemini AI features on Galaxy devices

In addition to Galaxy AI features, Google has also packed several Gemini AI features into the new Galaxy Z foldables. The Gemini app is optimized for use on the big screen, making it a good fit for the Galaxy Z Fold 6. Because Gemini can understand the context of videos on YouTube, it will soon be able to respond to queries about specific videos as well. Notably, this isn’t a feature exclusive to Galaxy devices.

Gemini AI side panel
Photo Credit: Samsung

Another interesting feature is a side panel mode for Gemini AI, which gives users ample space to multi-task and use other applications.

Finally, Circle to Search, developed by Google, is also getting an upgrade. Users can now long-press to get a translation for anything visible on the screen. Users can also highlight a word or phrase to learn more about it.