Picture Sunday afternoon: the kids' swimming reminders are buried somewhere in Gmail, the electric bill is hiding in a different email thread, and you've got a flyer photo on your phone you keep meaning to type into your calendar. Gemini — Google's AI assistant that lives inside your Google account — can pull all of that together if you set it up right. Here's how.
What you'll need before you start
- A free Google account (the same one you use for Gmail). Sign-in is automatic if you're on Chrome.
- The Gemini app on your phone (free on iOS and Android), or open gemini.google.com in any browser on your computer.
- For Gemini to actually read your emails, you need to connect Gmail in Gemini's settings — Google will ask you to confirm which data the assistant can see. This is a one-time toggle.
- A phone with iOS 16+ or Android 10+ for the app, and a working microphone if you want to use voice.
- Some features are sharper on Google AI Pro (the paid tier, around $30 a month at the time of writing), but the basics below work on the free plan.
Step 1 — Open Gemini and sign in
Tap the Gemini app icon on your phone, or visit gemini.google.com on your computer. If you're not already signed in, tap Sign in and pick the Google account that holds your Gmail and Calendar. You'll see a blank chat box with a small microphone icon on the right and a paperclip on the left.
You'll know it worked when you see your Google account profile picture in the top corner and a "Hello" greeting from Gemini in the chat area.
💬 Example line: just type "Hi" to start — Gemini will respond and you'll know you're in.
Step 2 — Connect your Gmail, Drive, and Calendar
In the Gemini app, tap your profile picture (top right) → Settings → Connected apps (sometimes labeled Extensions). On the website, click the Settings cog, then Extensions. Toggle on Gmail, Google Drive, and Google Calendar. Google will pop up a permissions screen — tap Allow on each one.
You'll know it worked when each app shows a blue "Connected" tick and the toggle stays blue when you leave and return to the page.
💬 Example line: a permissions request will read roughly "Allow Gemini to read, compose, and send email on your behalf?" — tap Allow if you're happy for it to read your inbox.
Step 3 — Ask your first cross-app question
Now ask something Gemini actually has to dig for. In the chat box, type a single question that spans two apps. For example: "Look in my Gmail for the kids' swimming lesson schedule, then check my Calendar and tell me if there's a clash next Tuesday." Press Enter. Gemini will think for a few seconds, then show a short answer with little source chips (small clickable labels) underneath — tap one to jump straight to the email.
You'll know it worked when you see source chips linking back to a specific Gmail message and a Calendar entry under the answer.
💬 Example line: "Find my latest electricity bill in Gmail. Who is the provider, how much is due, and when?"
Step 4 — Try a voice conversation with Gemini Live
In the Gemini app, tap the waveform icon (the squiggly line, top right of the chat box) — this opens Gemini Live, the back-and-forth voice mode. Speak normally, as if talking to a person. You can interrupt Gemini mid-answer, and it will adjust. On the website, click the microphone in the chat box for a simpler one-shot voice reply.
You'll know it worked when the waveform icon turns into a colored pulsing circle and Gemini replies out loud in a natural voice.
💬 Example line: speak out loud: "I have chicken, a capsicum, and some yoghurt. What's for dinner, and what's on the shopping list?"
Step 5 — Upload a photo or screenshot for a calendar event
Tap the paperclip (or + icon) in the chat box and choose Photos or Files. Pick the screenshot of the school newsletter or the photo you took of the flyer. Then type: "Read this and add the events to my Calendar." Gemini will pull out the dates, times, and event names, and show a draft entry before it saves anything.
You'll know it worked when you see a preview card with the event title, date, and a green Add to Calendar button.
💬 Example line: "Extract the dates from this flyer and add them as all-day events on the right days."
Step 6 — Use Gemini inside Gmail itself
Open Gmail on the web (or the app) and look for the "Ask Gemini" button — it's a small four-point star icon, top right of an open email, or open the side panel from the toolbar. Click it and ask things like "Summarize this long email chain" or "Draft a polite reply saying I'll pay on Friday." It's the same AI, just sitting inside Gmail so you don't have to switch tabs.
You'll know it worked when you see a short summary in the side panel, or a draft reply appears in the reply box ready to edit.
💬 Example line: "Write a reply to this. Keep it short, polite, and say I'll pay the bill on Friday."
Common mistakes
- Forgetting to connect the apps. If Gemini keeps saying "I can't access your emails," go back to Settings → Connected apps and check Gmail is toggled on. Without that step, it only knows what you type into the chat.
- Asking questions that are too broad. "Tell me about my life" gets a vague answer. Narrow it down: one app, one time window, one job — like "Find my tax documents from July in Drive."
- Treating every answer as gospel. Gemini can still get dates or amounts wrong. Always tap the source chip and read the original email before you act on a number.
- Leaving voice mode on by accident. If your phone battery drains fast, check that Gemini Live isn't still running in the background — swipe it away from your recent apps when you're done.
