10 Best Google Pixel 9 New AI Features

The ninth-gen Google Pixels are out, and along with the phones Pixel 9, Pixel 9 Pro, Pixel 9 Pro XL, and Pixel 9 Pro Fold are the wearables Pixel Bud Pro 2 and Pixel Watch 3—all powered by Gemini AI.

Here, we’ll explore 10 new AI features we haven’t seen before in a Pixel phone. We’ll also learn how a Pixel 9 case with MagSafe can help further maximize the functionality and user experience of the 2024 AI phones.

Top 10 Google Pixel 9 New AI Features

The Google Pixel 9 phones are heavily powered by AI, which enhances their capabilities. From camera features and everyday assistance to accessibility and efficiency tools, they have it all.

Below are some highlights that will improve your mobile phone experience.

1. Pixel Screenshots App

This new app by Google helps you organize, recall, and use your screenshots. It uses the Gemini Nano language model, which enables your phone to understand the content of your screenshots and extract information, such as text, dates, and images. You can then use this information to search for screenshots, create reminders, or even translate texts.

To use the Pixel Screenshot app on your Pixel 9, here are the steps:

1. Open the screen you want to capture.

2. Press the Power and Volume down buttons at the same time. Your device will take a picture of the screen and save it.

3. At the bottom left, you'll find a preview of your screenshot. You can tap on it to view it in full size.

4. To edit or share your screenshot, tap on the Markup or Share button.

Here are some uses you can do with the app:

• Organize your screenshots by creating custom collections.

• Search for specific screenshots by keywords.

• Add notes to your screenshots.

• Set reminders based on the information in your screenshots.

2. “Add Me” Photography Feature

A new AI feature that you’ll actually find useful is the “Add me” camera feature which uses augmented reality so you never miss out on a group photo.

Here’s how to use the Add Me photography feature on the Pixel 9, Pixel 9 Pro, Pixel 9 Pro XL, and Pixel 9 Pro Fold:

1. Open the Camera app and select the "More" tab.

2. Tap on the "Add Me" icon.

3. The camera will begin scanning the scene for people and create a depth map of where everyone is.

4. After the first photo is taken, you swap with the person who was just in the group photo.

5. That person is then instructed to align the frame with the shot that you took and take another photo.

6. The software then saves all of these photos, including the one with you stitched into the photo they took.

3. Advanced Google AI Assistant

Gemini is still under development, but it is already a very impressive AI assistant. Here are some of its key features:

• Generative AI: Gemini can generate text, code, images, music, and other types of content. This makes it a valuable tool for creative professionals and students.

• Conversational AI: Gemini can understand and respond to natural language questions. This makes it easy to use and interact with.

• Task completion: Gemini can complete various tasks for you, such as writing emails, creating presentations, and analyzing data.

• Knowledge base: Gemini has access to a vast knowledge base of information, which it can use to answer your questions and complete tasks.

• Customization: Gemini can be customized to your individual needs and preferences.

4. Plus Magic Editor, Auto Frame, and Guided Frame

The Google Pixel 9 camera app includes the Plus Magic Editor and Guided Frame features.   

Plus Magic Editor is an editing tool that allows you to change your photos, including moving, removing, and resizing people or objects. You can also change the background of your photos and even extend the edges of the image.

Guided Frame helps you take photos in the frame and detect low light. Its vision is to guide people with blindness or low vision to take great pictures with ease. Guided Frame also ensures you have just the right angle, prompting you to tilt your face up, down, or to the sides when needed.

5. Pixel Weather App

The Pixel Weather App is a standalone app that offers a beautiful and customizable weather experience for Pixel devices. It's designed to provide accurate and up-to-date weather information, emphasizing simplicity and ease of use.

Its other features include:

• Personalized weather summaries

• Customizable layout

• Integration with other Pixel features, such as the Clock app

• Other useful features like precipitation maps, hourly forecasts, and 10-day forecasts

6. Google Keep

Google Keep takes note-taking to the next level. Jot down ideas, create lists, and set reminders. Quickly capture thoughts with voice notes or handwritten notes. Organize notes with labels, colors, or pinning. Collaborate with others by sharing notes and lists. Set reminders based on time, location, or linked notes. Keep even extracts text from images, making it easy to save important information.

7. Call Notes

Capture important information from your phone calls using Pixel’s Call Notes. It uses on-device Gemini Nano to create a private summary of your conversation, including key details like appointment times, addresses, phone numbers, and important keywords. This summary is then available in the Recents tab of your phone app, making it easy to access and review later.   

To use Call Notes:

• Simply make or receive a phone call on your Pixel 9.

• After the call ends, tap the "Call notes" icon in the Recents tab.

• The summary and a transcript of the conversation will be generated and displayed.

• You can also listen to the call's audio by tapping the play button.

8. Google Tensor G4 Chip – Built for Advanced AI

The Google Tensor G4 Chip is a significant upgrade from its predecessors, substantially boosting performance and efficiency. The G4 chip is equipped with a custom Tensor Processing Unit (TPU) optimized for machine learning tasks. This enables it to handle complex AI models and algorithms with exceptional speed and accuracy.

One of the Tensor G4's key advantages is its ability to perform tasks that require significant computational power, such as natural language processing, image recognition, and video analysis. In addition to its raw processing power, the Tensor G4 also benefits from improved memory bandwidth and latency, which allows it to access data more quickly and efficiently.

9. Live Transcribe

Live Transcribe is a powerful accessibility feature on the Pixel 9 that uses AI to convert spoken audio into real-time text. It's particularly helpful for people who are deaf or hard of hearing, as well as those who struggle with understanding spoken language.

Its key features include real-time transcription, language support, customization, and integration with other apps.

To use Live Transcribe:

1. Go to Settings > Accessibility > Live Transcribe and turn it on.

2. Tap the Live Transcribe icon in your Quick Settings or use the accessibility shortcut you've set up.

3. Customize the appearance and behavior of Live Transcribe to your liking.

Live Transcribe is a valuable tool that can significantly improve communication and accessibility for many people.

10. Live Caption

Pixel 9’s Live Caption provides real-time captions for audio content, including videos, calls, and even ambient sounds. To enable Live Caption:

1. Go to Settings > Accessibility > Live Caption and turn it on.

2. Start captioning. The captions will automatically appear for any audio content you're playing or consuming.

How to Maximize the Functionality of Your Pixel 9

To get the most out of your Pixel 9 phone, consider the following tips:

1. Customize your home screen. Add widgets, shortcuts, and folders to make your home screen more personalized and efficient.

2. Explore the settings menu. You can adjust many settings to customize your Pixel 9 experience.

3. Download apps. Millions of apps are available for the Pixel 9. Download any apps you need to get the most out of your mobile device.

4. Use the Google Assistant. The Google Assistant is a powerful tool that can help you with various tasks, such as setting reminders, sending messages, and playing music.

5. Add MagSafe. While the Pixel 9 doesn't have native MagSafe support, you can add a MagSafe case to your phone. This will allow you to use MagSafe accessories, such as chargers and wallets.

6. Take advantage of the camera. The Pixel 9 has a powerful camera that can take stunning photos and videos, plus more AI-powered editing tools.

7. Use the Pixel Stand. The Pixel Stand is a wireless charging stand that can also be used as a smart home hub.

Wrap Up

With Gemini AI, your Google Pixel 9 phone can do many things. It is designed specifically to make your life easier and more efficient. These are just some of the many new AI features available on the Pixel 9. By exploring and experimenting with these features, you can unlock your phone's full potential and make it work seamlessly for your needs.